From the description of the problem it is clear that VS is somehow intercepting your request to IIS Express. As confirmed, VS is not attached to IIS Express process, so it is unlikely that any changes are done on the server side.
There is another possibility though. The interception could be done on the browser side. VS 2013 has presented us with Browser Link functionality, enabled by default if I am not mistaken. Read here more on Browser Link and see point 4 of the article for the instruction how to disable it.