Certain categories on Req / PO prevent manual invoices for PO invoice

Is there a way to ensure that certain categories that are tagged to PO lines would not allow a manual invoice against the line? Business would like to be able to prevent AP from creating manual invoices if PO line is tagged to certain categories. We found that we can do this via supplier site but ask is to prevent at category level as to not have to manage by supplier. Any ideas if this is possible?