Dirt in Grain of Unsealed Hardwood Floors?

I have hardwood floors, no sealant. We use traffic wax from time to time. In the high traffic areas dirt has gotten into the grain. How can I clean it to become the same color as the rest of the floor. I also use pure orange oil to keep the floor from drying out.