Feedbacks - Can we set the possibility to give feedbacks based on security profiles?

Summary:
We would like to segregate the possibility to give anytime feedbacks based on security profiles

Content (please ensure you mask any confidential information):

Hi,

We made custom roles for feedback feature only because anytime feedbacks could be given to anyone, but our customer requested us to give the segregate the possibility to give feedbacks (so that only certain users could give to other users), based on security profiles.
After the latest releases however, we noticed that the segregation doesn't work if the we get access to feedbacks feature from the related quick action, thus we removed the quick action from structure (from My client groups).