It works for me (in a file input, plain html on firefox, chrome (both upToDAte) and jquery 1.11):
$("input[type=file]").keypress(function(ev) {
return false;
//ev.preventDefault(); //works as well
});
Also notice that, not just "enter" key trigger the browser dialog (barspace does it as well).