Getting Rid of Small Grey Bugs?

I have these tiny bugs around the window in the bedroom. They seem grey, but under light they can be translucent. They are slow and they do not jump or fly. The small ones are as small as a speck with no features that the eye can distinguish. The larger ones are pictured here.

Please help!