can we restrict add & edit access to family and emergency contacts for line managers

How can we restrict add and edit access to family and emergency contacts for line managers to their direct reportees,we need only view access to the line managers of their direct reportees to line managers