How to get rid of duplicate expense reports

We recently had an issue with expense with the result the system was not importing the expenses, AP created the invoices manually using the same invoice number as expense number and paid them. Now when we try to run the import program it gives an error for the ones that already have an invoice saying invoice already exists. I can not withdraw these expenses as they have been verified.

 

Any solution??

Thanks

Naushad