After researching more i found the perfect solution that suits my requirement. The file copy is TREMENDOUSLY FAST.
The mv command doest the magic for me, it moves all the files inside the source folder to the destination folder and after copying it deletes the source folder.
String copyCmd = "mv " + sourcePath + " " + destinationPath;
Runtime copy_runtime = Runtime.getRuntime();
try {
copy_runtime.exec(copyCmd);
} catch (IOException e) {
Log.d("TAG", Log.getStackTraceString(e));
}