While it isn't an overly HARD song, the thing that gives the verses it's vibe are the ghost notes he's doing on the snare. It's still straight forward 4/4 I believe, so don't let the little shuffle-ness of the song distract you.
Start with just playing the solid parts (the obvious bass,snare,hat combo) and when you feel reassured with the song, try tossing in the ghost work. Remember, it's drums, you don't have to be as exact note for note as other instruments.
He uses the same fills each time the verse/chorus pass by. Sound like a combo of triplets and paradiddles to me. But again, play what sounds accurate to your ear first, you can get into the nitty gritty later.
I would say the most difficult part is the bridge. Not because it's complex to play, just because you have to get familiar with the order he's playing his parts. He does his usual transfer starting at the rack tom, and pulls back to the snare (2:14).
Just stick with it, listen carefully to where he drops his accents on the fills and know where each fill comes in, and you'll be fine. Start it where it's easy for you to get it, then start adding on. I've been playing for years and I still use that approach to new songs.