Should not be getting alarms.
The only reason I can think you might be is if you had CDM deployed already with alerting enabled
and then updated to the MC version. This would not overwrite the .cfg until the template was activated and applied.
May want to try deleting the probe and the directory and then have the probe deployed again.