Cause of Hair Loss After Perm?

I had a perm done at Walmart about 1 month ago. Apparently it was not one of my better choices. About a week after the perm I began to lose my hair. Every day after brushing my hair, there is, what I think is a significantly greater than "normal" amount of hair in my brush. I have about 60/40 graying hair and it has always been thin and fine at it's best. Of course, it is thinning most in the top front where it's the first thing you see when you look at me. I don't know how to tell if it's just breaking off or it's coming out at the roots.

I have tried OTC name brand conditioners. There seems to be no difference in the hair loss whether I blow it dry or let it air dry. It seems to me that the issue is my scalp, rather than hair breakage, but I could be wrong. I really can't tell when looking at what has been in my brush. I'm wondering if, at this point, I should consult a doctor. Would an allergist, dermatologist, or a family practice physician be appropriate? Should I continue with leave-in conditioner? Help!