Is there any way to track all changes (additions and removals) of contacts on accounts in CRMOD?

We have another application that calls CRMOD to get Account records and their associated contacts. It checked the External Modified Date to get info if anything has changed (contacts added or deleted), but the date is only updated if the change is on the primary contact. Does anyone know how we can track any update to the Account/Contact relationships?