I have found that you need to clear out the saved search that you are trying to replace then hit save on the KPI Scorecard. That field will now be blank. If you go back in and edit the KPI Scorecard and enter the saved search that you want to use it will correctly show the results of the new saved search.