I've always preferred later in the day after the sun has been on them for at least a few hours . More so to dry off any nighttime dew/moisture than anything else .
Sometimes you have to do what you gotta do though . I've taken many plants during torrential rain , but that was out of necessity .