Another alternative is doing it in purely PHP:
if( !empty( $_POST['answer'] ) && $_POST['answer'] == 4) {
// send email
$submit = mail($EmailTo, $Subject, $Body, "From: <$email>");
} else {
// Set error
echo "Verification failed.";
}