Billing VAT - For EU Customers with a Certain Bill Type only

 I was able to configure the BU for VAT processing, now the challenge is that how do I prevent VAT calculation on Customers who are not located in EU.

One Laborious process is to use BU BI as driver and mark the default as tax exempt so that there is no VAT Calculation by default on this Business Unit however I can define the VAT Defaults at Customer level but this means I have to define defaults for 100s of customers on whom we assess VAT.  Kindly suggest a process in which I do not have to configure defaults at Customer level.