It really depends on what setMessage outputs, but that error is referring to an illegal character. This could be a newline character but is more likely a double quote:
var cancel_msg = " <?php echo addslashes(Messageclass::setMessage('CAN01'))?>";
also, you could reduce your function to:
return window.confirm(cancel_msg);