Well I've been playing guitar for more than 15 years and I tried drums too, IMHO playing drums is harder cause you need to divide your body into 4 different parts, with each feet doing something different and arms doing something different, and keep the beat stable so your band doesnt speed up or slow down...
The key part is that you need to have a good musical ear, you need to keep track of the song you re playing...
To listen to a good drummer try Nick Menza of Megadeth(Ex drummer), Mike Pornoy of Dream Theater, Nicko McBrain of Iron Maiden, Behemoth's drummer (dont know his name but never heard anyone use kicks like that

) and of course Dave Lombardo

if you listen to Slayer's Angel of Death, you will see what I mean...
So being a drummer is never easy, especially the drums are the backbone of the music