A hot water dispenser is just a small hot water heater, much like the one that heats water for your household use. The biggest difference is that it heats to a much higher temperature and in smaller amounts.
No. The water dispensed from your hot water dispenser is the same as ordinary, heated tap water. However, if you attach a water filter to the incoming water-supply line to the heater, the heated water is also filtered.