The Contract.Assert method is also enabled under DEBUG, that's why you get the failure. Under Release, you should not see it.
If you want something other than the dialog, you need to either enable the rewriter, or register a handler with the ContractFailed event handler.