I have solved my issue - the problem was with the hosting server! That server was Windows OS based which don't have PHP Mail Function activated and also the php.ini
was not writable since it was a shared server.
So, I finally changed my server to a Linux based one, which also has cPanel
facility. Now all are working as expected.