Short answer: no, there's no difference in performance.
As for the bonus question, I imagine people get upset because !=
is not defined in the SQL 92 standard and is therefore less likely to be portable.
Edit
The SQL 92 standard can be found here and defines the not equals operator as follows:
<not equals operator> ::= <>