I don't think you can compress the files before the exe or you'll run into issues of Python not being able to read the zip files. You might be able to use eggs here, but I don't believe eggs are compressed. I would just try compressing the exe with UPX and see how it goes.
I personally don't worry about it. The exe's usually are 20-40 MB and hard disk space is cheap and plentiful.