Well, no more. Because my temples have little finial designs in them, I found that jewelry findings, more specifically clasps, work great. I attach them to the small end of the rubber tips and to the eye glass itself. No more stretching, and I can put them as close to the front or back as I like.
I hope this helps!