Ian, you would need to add custom notification rules with site defined conditions. Then remove the out of box rule, for which you can't add condition from web interface. After these changes, you will have a couple of rules(depending on how many tenants), one for each tenant, for Manual Notification activity notification; each rule has a condition saying tenant=id-of-tenant. Thanks _Chi