How to delete an approval unit that has been started?

After testing an approval unit, in the Planning-Test in PBCS, I tried to delete the approval unit but was not successful.

I even cleared out all the Owner assignments. I was able to delete the Budget/Version assignment, and when I tried to save the deletion, I got this error:

"Error: Unable to remove binding as one or more Approval Units are started at the specified location: Budget, Working"

Since there was not option to Stop the approval process, I selected "originate" and took Ownership of the Approval Unit.

I am unable to delete the Approval Unit. I could probably try to create the application without importing that Planning Unit object but trying to see if I can do it another way.