process.env.HOST was undefined on Heroku, and for some reason it didn't like localhost as the host, which caused the issue.
I simply removed the host var all together, so connection looks like:
server.connection({ port: process.env.PORT || 3000, labels: ['api'],})