How do we disable the ability for a single candidate to apply for the same job/req, multiple times?

We have had instances where people are applying for a single job/req, multiple times. Is there a configuration I need to check to not allow this? In testing, I continually get the 'You already applied' message, so we're not sure how some individuals are able to do this. Any insights are greatly appreciated.