When you click in Graph both objects must be visible? Or only detail report?
When I click on the Graph, only the detail report must be visible.
You can create other dashboard page with your detail report and hide that.
So configure action link for navigate to the hide page (with detail report)