you you want it to be a numeric is_numeric() doing the job ,if you want it empty !isset() doing it so :
if( is_numeric($_POST['reference_nr']) || isset($_POST['reference_nr'])){
echo "referece_nr is numeric or empty";
}else{
echo "it's not ";
}