A gz file contains exactly one file. It's not meant to contain multiple files.
The best way to do this is TAR the files together then GZ the resulting TAR. TAR has command line options to automate this into a single operation. For Java, use jtar: https://code.google.com/p/jtar/
Alternatively, a ZIP file may be what you're looking for.