Are they streaming in a nice little line? Maybe there's a food source you need to eliminate, along with eliminating the hole.

Whenever I have bug problems (quite often), eliminating whatever food source they're after makes them go away. Of course, they may be going into my walls, harmfully out of sight. But they're away.

I've got some serious insect problems.......