You are partially correct which is another way of saying you are incorrect too.
There are two types of load balancing ... server side and client side. There are also questions with respect to how the client is connecting, we don't know, whether the session load is identical, etc. which the OP has not stated.
The only thing I can absolutely say at this point is that what the OP has seen is normal and I can't see any reason why, unless the skew is very large and very permanent, anyone should care.
To the OP: Let's step back from the "what I want" statement and go to the basis of your inquiry: "Why do you care? Please provide a business reason and cite specific performance metrics, from your system, showing the problem you are trying to address. Then perhaps we can help you.