I have those guys in the garden too. They don't make it inside because we DO spray (required by the Health Department here). We have nastier looking bugs that get inside - big Palmettos. ICK!!! They die quickly though....We are bombarded by these fellows:
As the nighttime temperatures fall, they start coming indoors. Living in an old house, they find it pretty easy to get in. This year, I think we're going to have to resort to chemical sprays to keep them in check..