How can I remove the manager ability to transfer the performance document

Client wants to restrict managers from transferring performance documents to other managers. We removed the 'Transfer performance document by manager' privilege from the line manager role but they still see the option to transfer in the UI. Please advise how we can remove the manager ability to transfer performance documents.