Problem Removing duplicate addresses on dupe merged customers

Does anyone know of a way to remove the dupliacate addresses that NS appends to the customers address book when the customer had a duplicate record with that same address.  The duplicate dection process does not remove any addresses it just adds them to the list...as time goes they just pile up.

Some of our customers are complaining about all the addresses they encounter to edit or delete when they are trying to place a webstore order.  I know this is hurting our conversion rate.

At the moment and I could be wrong it the only way via the user interface?  I think the CSV function will allow you to add a default address (shipto, billto, residential), but not remove one.  I noticed the address records have internal id's is there a way to export all addresses edit them and then bulk upload them?  Or remove them?