How to disable "Termination" page under "Person Management"?

Content (please ensure you mask any confidential information):

Our customer is still using "Person Management" under My Client Groups. But now since we have enabled Redwood, we have a new page for terminations called as "Terminate Employment". As an impact the old "Termination" page quick action is disabled.

However users can still see this page when navigating from "Person Management" as shown below. How can we disable/remove this option?

Version (include the version you are using, if applicable):

25B