Well no your app will not be reject, I've got an app that downloads route for a server which can be up to 1GB. No problem there.
Just make sure that you flag them not to be included in the iCloud backup or store them in the cache directory.
Placing files in the cache directory has the draw back that if the system needs space it will delete files from the caches directory without notice.