You need to install a SMTP server in your VPS to send mails.
I prefer using postfix in your ubuntu server.
Try the following link. It might help you.
Install and Setup Postfix on Ubuntu
After this open up your config.php file and search for the following line of code:
define("PHPMAILERHOST",'');
Replace PHPMAILERHOST with your server host name(example.com)