You need to implement your own layout, by subclassing UICollectionViewLayout. It's not that complicated. There are tons of examples online.
Here is one using the original Apple example: http://markpospesel.wordpress.com/2012/10/25/fixing-circlelayout/
Another example that looks like what you want to do: https://github.com/chiahsien/CHTCollectionViewWaterfallLayout