Case Workers are not able to delete appointments with the case

Case Workers are not able to delete the appointments within the case while they are having the Delete Activity privilege. If case workers are trying to delete it is populating a error as , 'You don't have the required privileges.'