Are you using a center punch? Are you hand drilling or using a drill press. Drill presses, at least what you need for this hobby are inexpensive along with a drill press vice help cure that problem.
Check out this thread
http://www.rctruckandconstruction.co...ead.php?t=3733