I have read that if you have a hybrid/all female cucumber plant, it can form male flowers when stressed. If these male flowers pollinate your female flowers, it can make the fruit become bitter.
check your seed package. If it says they are Hybrid/F1 seeds... then pick off all male flowers that...