Drum lag in Guitar Hero

Hey guys, this is different to the usual forum thread but I just wanted to see what people thought, or if they felt my frustration.

I play drums, in real life, and I like to think that I have a pretty good sense of rhythm. I'm actually pretty damn good at Guitar Hero too. I can complete most songs on Expert using the guitar :) The problem comes with the drumset. Of course it's possible that the drum set is faulty, even though I'm pretty sure it isn't. Basically, whenever I played guitar hero on the drumkit, it's very unpleasant, as I get into the groove, play to the beat, and then suddenly I start losing notes. Yeah, the game isn't in sync with the rhythm, so I presume that going to the main menu and calibrating would fix it. That sh*t is complicated xD Anyway, I've spent so much time on it, and the calibration never seems to be perfect. Am I doing something obviously wrong? Any recommendations? Does the calibration have to be on a specific xbox profile or something?

Let me know if this happens to you in GH, and if you know how to possibly fix it, please let me know :D

Thanks