EBTax - collecting for specific states

We currently manage tax rates manually for a limited number of states (only those that we collect tax for).  We are looking into using Vertex load file so we do not have to manually enter the rates.  Our concern is that tax would be applied to all states since we now have rates loaded for all states.  Can tax rules be used to limit the states we want to collect tax from?  Given volume of customers and customer addresses it is not feasible to control at that level.  Any input appreciated.