R12.1.3 - Task Owner sometimes defaults properly and sometimes does not.

Our users creating a task via a template and sometimes it defaults the appropriate task group owner based on the territory setup and while other times it does not.   I can see in the audit it did not default properly for the user but on the exact same SR I can use the same template and the task group owner defaults properly.

Why would the task not pull the appropriate task owner when using a template for the user, no territory ID is reflected in the audit either, but for me it works fine.  I even logged in as the user on the test system and defaulted fine on the same customer.