A bad actor, for example, is likely already gathering your servers data and training it on a LLM as you have no power over THEIR server; you have volunteered that data by federating. Your ToS means nothing. Oops.
Someone truly worried about privacy would not be federating at all.