They are sneaky bastards and, depending on the type of bug, you may only see the damage.
You can use Spinosad (Captain Jacks et al) it's not gonna kill ya but IMHO it's right on the "organic" threshold. Some folks say it's OK some don't. I wouldn't use it in flower and there seems to be...