Tiny black bugs in my house :( ?

We used to have little black bugs that looked like beatles crawling around our carpet. We'd call them carpet bugs. They didn't really do any harm. I just looked them up on the web and could only come up with "carpet beetles". It describes them perfectly but says they can be destructive. I don't remember if they were or not but it says that they come from outdoors. That would be why you noticed them first on the window ledges. I would do a search on carpet beatles just to see if it helps.