Ship to Location at Invoice Line

Summary:

I have a supplier as follows, with two sites. in the supplier set up we have defined the Ship to Location which we expect to default while invoice is getting loaded from invoice imaging.

When the image has ship to location address similar to LOC2 which is for site2, system is not recognizing that and always defaulting the ship to value as LOC1 instead of LOC2 as LOC1 is associated with Pay site and that was site while creating the invoice. Business is looking to get populated LOC2 as per the actual ship to address on the invoice, how to handle this? appreciate any advice on this.