So the IIS site was configured to impersonate and that user did not have rights! Spotted the user using Process Monitor. Not surprisingly removing following line allowed things to work as my user, an administrator, has rights just fine.
<system.web>
<identity impersonate="true" username="user" password="password" />
</system.web>