Peaches Falling Off Tree After Rainstorms?

We have a small "patio peach" planted and after every rain this year we lose a bunch of little baby peaches which seem to be growing fine otherwise. We have had a few nice rainstorms and some showers for the last three weeks. Why are we are losing so many little peaches. I've included a picture and if you look closely you can see the baby peaches on the ground. Thank you.

Hardiness Zone: 7a

By APRIL from SC