How can I make the files only accessible and visible from my app?
Stop using DownloadManager
and download the file yourself directly to internal storage.
Or, as soon as the file is downloaded, move it to internal storage. This will leave a window when the file is on external storage, though.