The smallest rod end I could find, with a metric stud in it, was 5mm. Perhaps you could locate a metal rod end, with a swivel ball, and a through hole, so that you could just run a cap screw through it? McMaster has more english sizes then metric sizes for both types of rod ends.
http://www.mcmaster.com/#ball-joints/=c48mp3