Restriction to Budget journals based on CoA Segment

We have a global responsibility which has access to all the Ledgers and CoA values. This is the responsibility through which the users perform Consolidation and run consolidation reporting and reconciliation.

Now, we have a requirement to load some sensitive Budget journals using this responsibility (can use a new one if needed). But Business requires these budget journals to be restricted to users based on the cost centers. We can use security rules but this will restrict the Actual journals also. Is there any way to create a security only for Budget journals wherein users can view the journals according to their privileges.