How to restrict a new manager access to historical performance document?

I have an employee transferred to a new department without assignment number changes. His performance document completed by previous manager are now available to new manager, but our client would like to hide the performance document from the new manager. Is there a way to limit the new manager access to prior performance document?