Selenium Hub cannot handle test queue when deployed with Kubernetes
I was able to locate the issue. It turns out there is a idle timeout setting for the load balancers both in AWS and Azure. It was set to 60 seconds for my case in AWS. I turned the timeout to 3600 seconds and that seemed to fix the problem.
You didn't say what host you're trying to connect to. Are you sure you're connecting to the load-balancer created by Kubernetes?
Try kubectl expose deployment selenium-hub --type=LoadBalancer --name=my-service followed by kubectl describe services my-service.
That should tell you whether or not there has been a problem setting up the load-balancer, and what IP/host you should actually connect to.