Identifying a Flying Burrowing Insect

It could be a hornet or yellow jacket. They can hurt you with their stings. You need to find and destroy the nest. Do this before twilight, when they return to the next.

Here are a few bees like flying insects:

One, solitary bees - normally bees, wasps and hornets live in a social group. However, there are a few species of bees that live singly.

Two, it could be a digger bee or mining bee. They too are solitary insects and they dig small burrows in the soil.

Three, ground asps are solitary wasps that dig into the soil for nesting. There are several different kinds of ground nesting wasps. They include, scolid, spider, and cicada killer wasps.

i have these too! I think they're some sort of carpenter bee

There are several different kinds of "bugs" that resemble bees that make burrows in the ground and some of them are very beneficial as they eat other bad bugs, grubs, pollinate plants, and eat other arthropods in lawns, so please read about them before getting rid of them.
Some may sting but it appears they more or less have to become agitated to sting.
Here are a couple of links that have information on all of this type bug and some photos to help you know which ones you have.

https://www.tho  und-bees-1968396

https://www.hun  ow-in-the-ground

It sounds like a Burrowing Bee. They are a type of bee that lives a fairly seclusive life and are pretty harmless to humans if left alone, but are good for the garden and flowers. Here is a very informative article: https://entomol  es-your-backyard
Most Carpenter Bees burrow in something wood, hence the carpenter bee name. There are some other bees that burrow in the ground like hornets, but you would find them to be quite aggressive.