I actually found that removing the line
$mail->Mailer='smtps';
stopped this error. This was happening in all my my mail correspondences and that line for some reason seemed to stop the duplicate issue (for some reason). Maybe it will help others too.