At 1.5%, Phytagel is reported to be pH 6.5-7.0. Does using Phytagel at a concentration of 5 g/L alter pH? Before/after autoclaving? There doesn't seem to be any information from manufacturer regarding this.
Probably, while at low pH the gel forms due H+, at circumneutral pH the gel network is formed due to, mainly, the linkage of the divalent cations such Mg2+ and Ca2+ to the carboxylic groups of the gellan gum. That's why it changes the pH after preparation. So, I'd say the changes will be stronger if you increase the concentration but you'll need to test it.