How to assign pay groups to expense reports invoices alone?

Expense report invoices , customer refunds and OTP invoices are created as payment requests in AP module. Is there any any way to assign pay groups to expense report invoices alone. If I set a paygroup in invoice options the paygroup is assigned to all invoices which come to AP as payment requests