How to Restrict PO Put Away Receipt to Specific Users Without Restricting TO Receipts

The business requirement is that inventory users can do the put away transaction to transfer orders but restrict the put away transactions of the purchase orders to specific users

Role Put Away Receiving Receipt allows users to do the put away transactions to all document types (PO, TO, …)

How can we restrict the PO put away to specific users