Incidents and Notifications for Generic Service Tests

I'm using OEM 12c, and I've created a couple of generic services to monitor some internal URLs using HTTP Ping and Web Transaction tests.  Everything is working as far as the tests go (they return successfully when the URL is reachable and they show me when the URL is down).  However, I'm not getting any incidents or notifications that the service is unavailable when it is actually down.  I see an alert generated from the beacon when the test fails (when looking at the service test page), but the status of the service is "Up" even though it is actually