Thanks for the pointers. I thought about drilling a bigger hole and will use this tip from now on.
I broke a few bits in aluminum, and I wasn't able to get them out. I tried using alum to corrode the bits, and I think this may work with more time.
http://etsymetal.blogspot.ca/2009/01...t-removal.html
Looking forward to more updates on this project!