Restrict view access of attachment in Buyer role

Summary: Customer has requirement to restrict a user- to view or delete the Attachments made to Purchase Order or Negotiations. We tried removal of Data Security Policy - Grant on Application attachment in a custom role, however the user is still able to view the attachments done in PO or Negotiations. Is the requirement feasible ?

Content (required):

Version (include the version you are using, if applicable):

Code Snippet (add any code snippets that support your topic, if applicable):