When potting plants, I use the thin type rubber gloves that you can buy in a box and toss when finished. Works great for weeding too because you can "feel" what you are doing much better. I am not as inclined to pull something other than a weed if I have them on.
As a nurse, I've known about these gloves for years, and have done the same thing. When needing heavier gloves, I use these first, then put on the garden gloves.... it helps keep the dirt from around my cuticles and under my nails.