Can we not Default Purchase Order Supplier Site when Invoice is Matched to PO

Summary:

We have a requriement where we send Purchase Order to Main address of the Supplier and Create Invoice with Remit Address of the Supplier. But When Invoice is Matched to to Purchase Order then automatically Supplier Name and Supplier Site are defaulted from Purchase Order. Is there any way we can remove this connection?

Content (required):

Version (include the version you are using, if applicable):

Code Snippet (add any code snippets that support your topic, if applicable):