I had that problem and it was the flapper had a very small raise in it and didn't seal. Once I replaced it, never had it happen again. The water ran through constantly. Now, I keep a spare flapper in the house.
You may want to read these links
Add your voice to the conversation. Click here to answer this question.