Just keep ph'ing the water you are giving it, and make sure you get a nice run-off every time you water.
It should balance out. But just so you know, damaged leaves usually don't heal... so be checking your new growth for signs, don't be looking for the affected leaves to go back to normal.