Can i spray for Worms/Catipillers while plants are fully budding ?

I went to look at my Girls the other day only to find a dead spot on a main bud upon further looking i found what seems to be worms. Since their in full bloom(plants) can i still spray these or is picking them off my only option. This is my first year trying out door and in a total panic about these dam things.. any help is greatly appreciated

Their black now but were fully green when i took them off. Please any help would be great

yea go ahead and spray I have been spraying just dont use nasty chemical stuff... for caterpillars I find it best to locate them by hand however (latex gloves) and scissors as they like to burrow deep in buds and you dont want to t soak ur buds...

Caterpillars are easy to find the bud will look like the first signs of bud rot. You will find them where the sugar leaves are turning yellow and can be pulled out with no effort like w/ but rot but if you look inside you will see a little greeny chompin away at you buds and stems covered in its own feces. Snip out the section of the but the caterpillar was in and ur good. make sure to get rid of all the poopies too cuz we no like smoking poopies.