It is stressing your plant. Extreme light change and temperature change will stress your plant. If you go from eighty and then to fifties, or lower it is pretty drastic.
I suggest that you put your plants near a tv, or something that you use a lot that produces heat. During the night, your...