The Identity and Access tool by default changes the configuration in the web.config to require all unauthenticated users be redirected to the authentication provider.
<authorization>
<deny users="?" />
</authorization>
I believe you'll need to change to something like
<authorization>
<allow users="?" />
</authorization>
Then in your app, you'll need to handle authentication for specific resources (e.g. add [Authorize] attribute to controller actions, etc.)