Adding this as a solution text so that it no longer appears on the Unanswered questions list. Answer is provided by question author in the edited question above:
Edit: [SOLVED]
I was using BasicAuthentication for my website and there the IIS impersonates the user you are logging in with. Therefore I just added my log on user account to the IIS_IUSRS group and now it works.