Load Balancer Problem

I am trying to load balance my static resources (static.mywebsite .com) by serving them from two different servers. The problem is that server 2 keeps throwing “no route to host” error in monitoring when added in load balancer. If I point the IP to a subdomain (static.mywebsite .com) directly in the DNS management it works great but if I do it through load balancer I get “no route to host”

Anyone have any idea what I am doing wrong?