First, I'd ask for actual water measurements that you do yourself. Particularly ammonia, nitrite, nitrate, pH, temp, and salinity. Also, phytoplankton is not really benefiting anything in your tank other than increasing the nutrient levels in the setup; very few critters eat phytoplankton, and your clam surely doesnt need it.
I'd first look for pyramid snails on the foot of the clam. You did the right thing by moving it down, those are lower light sand dwelling
clams, and being up high in the rocks was the wrong place for it. So check for parasites, and some pictures may help. Good luck!