Yes, this is idiomatic. Think of each component as a function whose arguments are the props – with that perspective, passing around the props explicitly seems a lot more normal. We've found that it makes things more maintainable to have everything be explicit so you can see what all the inputs to a component are and exactly what you're passing.
(A future version of React will probably include a feature called "contexts" which makes it possible to pass things down implicitly, but it will probably make code harder to reason about so I'd still favor explicitness almost all of the time.)
UPDATE (not by original author)
The documentation has finally been added (it was added sometime between summer 2015 and summer 2016, probably with release 0.14):
Official React Context Documentation.
Note that this is also how react-redux
simplifies passing of stores through the hierarchy.