In short, yes...lol
I do any female gardening first, then tend the males, then change and wash up. No need to shower unless you stick your head into your plants, then you would need to wash your hair, but I wash to the elbows before and after. Really, this is a good habit to get into anytime...