Parameter not working with Multiple Data Sets

I am working on a report which has 3 data sets and 5 parameters. 4 of the parameters are filtering data in the main data set but one parameter filters data in the second data set. This is causing the row from only the second data set to disappear and the rows from the first and third data sets are still showing up. I want the fifth parameter to filter data from all the data sets but I cannot include that column based on which the parameter is filtering in the main data set. Is there a solution where I