How to remove eligibility in bulk for a Check-in template?

We created a Check In template and assigned an eligibility profile to the template. Used the Eligibility Batch Process to assign the check-in template, however the process did not defer to the profile and assigned the check-in template to everyone. When I manually check eligibility, it correctly marks people as ineligible, but I need to perform this action in bulk. Re-running the batch process does not remove the eligibility already assigned.

How do you remove processed eligibility in bulk?

We are on 24B

Thanks