I buy 19l huge bottles and struggle a bit to refill smaller bottles from this.
I do this too if I know I stay somewhere for more than a week.
Another alternative maybe:
I've been using Sawyer water filter when I was trekking. It's a small, yet very good product. Not sure if it'd be relevant for usage in urban areas (i.e. filter water from the tap) in cities.