This option means that each test in the template that fails will generate an alert. If multiple tests fail simultaneously, ...

This option means that each test in the template that fails will generate an alert. If multiple tests fail simultaneously, they will each generate an alert. In addition, a summary alert will be generated from the template.