Change employee address

I am having a heck of a time changing an employees address.  This particulate employee was hird in 3/2004, layoff in 10/2012 and rehired 3/2013.  He has had 5 or 6 addresses. 

Whenever I end date the last primary address and make the new address the primary, I receive and error.

"A payroll exists which pre-dates the start date for this address.  If this is an update then please enddate the last primary address and creats a new record for the new primary address.  If this is a correction then please retain the original date of this address."

I have tried enddating the current primary.  i have tried deleting al lthe old addresses. I have tried everthing I can think of including altering the effective dates.