Check if the port you're using is open on your server (for example using this website). Default port for VNC is 5900.
If it's not, check any firewalls and make sure the port is forwarded correctly.
If it's open, try adding :5900 to your server's address in viewer.