I had misinterpreted and thought they meant tap water was free for everyone in Germany, which is what sounded weird to me.

It makes sense that you can get utility assistance if you’re on welfare. Even the US has hardship programs or charities that will pay for utilities, its just usually limited availbe slots restricted to the homeless, families with kids, or its a church membership benefit.