its not your house... is it your plants???
if so then i suggest you get another caregiver.
if you're gonna become the caregiver, i suggest you set some ground rules and do some upgrades.
1) you're the key holder to the garden. NOBODY walks into the garden without you, not even the home owner.
2) set up some security cameras. one on every door to the outside, one on the door to the garden, and one on the plants. put them to record. these systems aren't expensive. i helped a friend install a 4 camera system with invisible IR LEd's which make it very good in the dark, with 1000 feet of chord, a DVR recorder, and a tv and it cost him less than 300 bucks. and the resolution of the cameras were remarkably good. a really good way to make sure it works is you put the cameras next so something that catches attention. a bright yellow post it, a picture of a naked woman or a cat riding a donkey, next to the camera, that way everybody will glance at it if just for a second... it'll catch everybody's face....
anybody questions you just say it's for your safety. and that's it.
but if you got that sneaky mo'fo' pinching buds left and right.... hell, if he pinches a bud off the wrong plant it can stress it enough to cause a hermie, pollinate the whole crop, and then nobody gets high.....