Actually, more importantly, you realise that the thief and probably a few of his friends all know you grow, and where you live.
Next season he might come back or track you down, and unable to find your plot he may assume you have taken to indoor growing, and come crashing through your front door with a few masked and armed associates.
I agree, retaliation is essential, otherwise he will assume you are an easy target and each year he will focus more on ripping your stash, by stealth or by force, but I would be more worried about how many strangers know you grow and where you grow, and live.