Restricting access to attachments

Summary:

Apart from being able to download the reconcilaitions without attachments using generate report binder (which is great), is there a way to restrict a user (auditor type user) from being able to view the attachments on reconcilaitions?

There may be sensitive attachments on certain profiles, so it would be useful to know if there was a way to prevent a user from having view access to a reconcilitaion but not being able to open the attachments.

Thanks.