Ability to "Remove from Document" in Performance Documents Output

Summary:

Can we remove a document by clicking directly the Performance Document without going through the "Evaluate Current Task as Manager" function? We are having an issue when we click directly the Performance Document, the "Remove from Document" button is not visible (see 3rd screenshot below).

But if we click/go through "Evaluate Current Task as Manager" the Remove from Document button is visible.