Murry Riding Mower Won't Start?

When I try to start it makes a click sound one time. I know it's not the battery because without the clutch down no noise. I turn the key 50 times and finally it will start. Please help.

By Tom