I don't think that was a bad thing. The buffer "cliff" for phosphate near the desired pH of 5.5 to 6.0 is steep. So I think you actually did pretty well. I would not admix hydroxide. Keep in mind that you're introducing carbonic acid into the res so expect the pH to relax in an upward direction a day or so after application. Small increments and patience will help a lot in that instance.
There are two kinds of chlorine: volatile (elemental chlorine) and nonvolatile (chloramine). The nonvolatile will, as the name suggests, not evaporate. You'd need to add a bit of reducing agent ... like a single 500mg vitamin C tablet. Even so, at the low dosings of chloramine for typical drinking water, I'd expect the bennies to survive. (Volatile) chlorinated tap water does not kill the bennies, a grower I know has determined.