I haven't set it up on Azure before, but typically you visit url/elmah.axd instead of url/elmah.
Secondly, yes, you can add:
<security allowRemoteAccess="true" />
to the web.config settings for ELMAH in order to allow you to view the log after it's deployed. Understand though that by default it will allow anyone else to view the logs as well.