I wouldn't of thought a mouse would be interested in your plants, to be safe you could get a snake to guard them for you
![Wink ;-) ;-)](/styles/smilies/icon_wink.gif)
or buy a trap humane/lethal depending on preference, the last and probably worst thing to do would be to put down food so it leaves your plants alone, though he might nibble some leaves and get the munchies
![Wink ;-) ;-)](/styles/smilies/icon_wink.gif)