We had a problem with a group of Remote Desktop Servers sitting behind a Barracuda ADC Load Balancer.  The client either couldn’t connect, or they would connect to a different server even when they had a session open already on another server.  There was a group policy change that fixed our problems.  Go to the following path on your RDS GPO.

Computer Configuration -> Policies -> Admin Templates -> Windows Components -> Remote Desktop Services -> Remote Desktop Session Host -> RD Connection Broker

Change these two settings:

  1. Use IP Address Redirection - Disabled
  2. Use RD Connection Broker load balancing - Disabled