Temperature-responsive control of the amount of exhaust gas or combustion air directed to the heat exchange surface