Mmmm, I'm keeping only white xenia and it's relative anthelia in the tank with IO salt mix, mixed with tap water, here they are:

pH is on the low side: 7.8 to rarely 8.2, still xenia pulses very well. Not much light and gentle flow around the colony, have phosphates and nitrates, this is a well fed tank (trice daily).
Started to grow fast after addition of RowaPhos instead of usual PhosGuard and
Phosphate Sponge (both aluminum-based). Could be coincidence, could be not: in the online article about Atlantis World public aquarium was mentioned, that ferrous phosphate media may remove something else, that inhibits
coral growth. Sorry, don't have a link at hand right now.
The tank is grounded.
Could be that your tank is very clean and xenia doesn't have enought food? Or hammer or yellow polyps, that are burning it. Guessing here.