Not able to hide Shared With section from Performance Goal drill down for employee?

Summary:

For Performance Goals for Managers and Colleague we are not giving functionality that Managers and Colleagues can share goals. But when employee is opening any of his Performance Goal, "Shared With" section is visible to employee.

We have tried hiding the "Shared With" Section using Page Composer, we are not getting edit action enabled so that we can deselect checkbox besides "Visible" and "Show Component" whereas we do get that option for other sections.