Chrome and Firefox CORS AJAX calls get aborted on some Mac machines
After spending a very long time looking at low level network packets to try and find the issue. It turned out that the virus scanner was blocking the call. Turning off the web scanning, it started working.
In short Sophos was blocking api.saddleback.com on Firefox and Chrome, but not on Safari. Go figure.