Hi Lime
That doesn't sound like a over-population of worms to me; bristleworms are healthy for your tank and won't hurt your corals, fish or clams. They are great for cleaning up left-over food and detritus. They will however, feed on sick or dying clams, which is where (IMO) most of the bad press stems from regarding bworms.
If you have a real population explosion of bristleworms, however, it can be an indication that you are overfeeding your system. More food=more reproduction=more worms!
As far as switching over tanks, wait at least until the 55 is completely cycled. If you add the rocks and sand from your 20, it may be up to handling the bioload but just keep an eye on the water parameters. You might get a mini-cycle from the switchover itself.
HTH,
Alice