What Is This Garden Plant?

I'm in northwest New Jersey, and found this bush/plant pop up in the last two or three weeks. When I crush it, it smells soapy like rosemary. It has the same leaves like a rosemary plant, but is also covered in seeds. Is there such thing as wild rosemary?