How detailed can we get with recruiting permissions?

Right now, we have permissions on hiring managers so they can see candiates on the job postings. We dont want hiring managers to see all candidates on all job postings (which includes interview and prescreen notes). We only want them to have access to candiates on job postings where they are listed as hiring manager rather than a blanket permission. We have 3 different divisions and so we aren't able to grant access by division or by job title because it may not necessarily be their job. We would need it by 'hiring manager' so if they are listed as