Are you able to delete exceptions defined for selected organization in manage recall parameters?

When setting up manage recall parameters area for "exceptions" I added a mix of things. When I clicked on the pencil it only allows me to change the task group. The x button doesnt delete, it just closes the option of editing. Is this a bug/defect? I would like to think it should allow me to remove a row if I don't want it anymore.