From Nick Griffen, Yelp Partner Relations:
The API provides some of those things (a few review excerpts, rating, date, means to link to full review): http://www.yelp.com/developers/getting_started/what_you_get
...generally we're protective of our content and I think the decision not to expose a stream of reviews via RSS is influenced by that protective stance.