From @Crashlytics over email:
We added a check to make sure that the API key you had was valid so we don't miss any dSYMs and you don't miss any crashes.
So my API key was inconsistent - probably an error during transition to a different bundle ID earlier in development - also why no crash reports were showing up :)