Hot water on demand is a system that heats water instantly as it flows through the unit, rather than storing a tank full of preheated water. These systems, commonly called tankless water heaters, only run when you turn on a hot water tap, which means they avoid the energy waste of keeping 40 or 50 gallons hot around the clock. They’ve become a popular alternative to traditional tank water heaters for both new construction and retrofits.
How It Works
When you open a hot water faucet, cold water enters the tankless unit and passes over a temperature sensor. That sensor signals a control board, which activates heating elements (in electric models) or ignites a gas burner. The water moves through a heat exchanger chamber, picking up heat as it travels, and exits the unit hot within seconds. Temperature sensors continuously monitor the outgoing water and adjust the heating power to maintain whatever temperature you’ve set.
The key difference from a traditional water heater is that nothing is stored. A conventional tank keeps 30 to 80 gallons of water heated at all times, reheating it whenever the temperature drops. A tankless unit sits idle until the moment you need hot water, then fires up instantly. Once you close the faucet, it shuts off.
Gas vs. Electric Units
Tankless water heaters come in two main types: gas (natural gas or propane) and electric. Gas units use a burner and heat exchanger to warm water as it passes through. Electric models use copper or stainless steel heating coils, similar to the elements in an oven. Both accomplish the same goal, but they differ in cost, output, and installation requirements.
Gas units generally produce higher flow rates, making them better suited for whole-house use. They do require direct venting to the outside of your home, not through a chimney. Some models use PVC pipe for venting, which simplifies installation. Electric models are simpler to install since they don’t need venting or a gas line, but they typically deliver less hot water per minute and may require an electrical panel upgrade.
Sizing: How Much Hot Water You Actually Get
Tankless systems are rated by flow rate in gallons per minute (GPM). To choose the right size, you add up the flow rates of every fixture you expect to run simultaneously. A kitchen faucet uses about 0.75 to 2 GPM depending on the task. A showerhead typically uses 2.5 GPM. If you want to run a shower and a kitchen faucet at the same time, you’d need a unit that delivers at least 3.25 GPM.
This is where tankless systems have a real limitation. Unlike a tank that can dump its full reserve at once, a tankless unit has a fixed maximum output. If your household regularly runs two showers, a dishwasher, and a sink simultaneously, you’ll need a high-capacity unit or multiple smaller units installed in parallel. ENERGY STAR certified gas tankless models must deliver at least 2.8 GPM over a 67°F temperature rise, which gives you a baseline for comparison shopping.
The Cold Water Sandwich
One quirk of tankless systems is something called the “cold water sandwich.” This happens when you turn on hot water shortly after someone else used it. Leftover hot water sitting in the pipes comes out first, then a slug of cold water arrives before the unit has fully fired up, followed by consistently hot water. The result is a brief but noticeable blast of cold in between two warm stretches.
If this bothers you, a small buffer tank (5 to 6 gallons) installed alongside the tankless unit solves the problem. It holds just enough preheated water to bridge that gap. Some higher-end tankless models also include a built-in recirculation pump that keeps a small loop of hot water ready near your fixtures.
Energy Efficiency and Operating Costs
Because tankless units only heat water when you need it, they eliminate standby heat loss, which is the energy a traditional tank wastes keeping water hot 24 hours a day. ENERGY STAR certified gas tankless heaters must achieve a Uniform Energy Factor (UEF) of 0.95 or higher, meaning 95% of the fuel consumed goes directly toward heating your water.
Annual fuel costs depend on the type. Gas or natural gas models run roughly $200 to $350 per year. Propane tends to land at the higher end of that range, around $350 annually. Electric models generally cost less to operate in areas with low electricity rates, though this varies significantly by region.
What It Costs Upfront
The total installed cost of a tankless water heater averages around $2,636, with most homeowners spending between $1,403 and $3,898. That breaks down into two parts: the unit itself and the labor to install it.
- Electric units: $800 to $1,500 installed. These are the most affordable option and work well for smaller homes or single-point applications like a bathroom.
- Gas or propane units: $1,000 to $1,500 for the unit, plus $600 to $1,850 in labor depending on whether you need new gas lines or venting.
- Solar tankless systems: $1,800 to $6,000 installed, making them the priciest option.
- Single-point units: $100 to $300 each. These small units serve one fixture and are useful under a distant sink where running a long pipe from the main heater would waste water and time.
The upfront cost is notably higher than a traditional tank water heater. Where a basic storage tank might run $800 to $1,200 installed, a whole-house tankless system can easily double that. The payback comes through lower energy bills and a much longer lifespan.
Lifespan and Maintenance
Tankless water heaters last about 20 years on average, nearly double the 10 to 15 year lifespan of a traditional tank. That longevity depends on regular maintenance, though, particularly in areas with hard water.
Minerals like calcium and magnesium naturally present in hard water build up inside the heat exchanger over time. This scale reduces efficiency, restricts water flow, and can eventually damage the unit. The fix is periodic flushing: you shut off the power and water supply, connect hoses to the unit’s service valves, and circulate a descaling solution or plain white vinegar through the system. In areas with hard water, this should happen every six months to a year. With softer water, once a year is typically sufficient. ENERGY STAR certified gas models are required to carry at least a six-year warranty on the heat exchanger and five years on parts.
Who Benefits Most
On-demand water heating makes the most sense for households that use hot water in bursts rather than continuously, and for homes where space is tight. A tankless unit mounts on a wall, freeing up the floor space a 50-gallon tank would occupy. It’s also a strong choice for vacation homes or guest houses where a tank would waste energy keeping water hot for days between uses.
Larger households that run multiple hot water fixtures simultaneously may find a single tankless unit struggles to keep up. In those cases, installing two units in parallel, or pairing a tankless unit with a small buffer tank, can deliver the endless hot water these systems are known for without the temperature fluctuations that come from pushing a single unit past its capacity.