I had the same problem at low speeds and like Red said, i had my neck bearings too tight but mine was ok at higher speeds, is yours doing it all speeds?

. . . or maybe im just dumb.