Restricting TAX Codes to AP and AR

Guru's,
I have created tax codes and they are working fine in AP and AR.
The problem is both the AP and AR tax codes are visible in Payables and Receivables Invoices. The list is huge and it included Inclusive as well as Exclusive.
I tried to change the place of Supply Rule however no use.
I also created a guided applicability rule and selected tax event class as Purchase and Sales Transactions. Still no Use

Is there a way to restrict AP taxes to Payables and vice versa.

Thanks,
Satish