Install back-draft dampers where the exhaust duct meets the exhaust fan in each fan unit. The dampers should open when the fan is actively exhausting and should shut when the fan is off.