Make sure that you've included socket.io in your script tag like this:
<script type="text/javascript" src="http://yourPublicIP:port/socket.io/socket.io.js"></script>
and then you do
<script type="text/javascript">
var socket = io.connect('http://yourPublicIP:port');
</script>