It might be that using https also enables transparent compression of the content. The time added for compression and encryption (and back of course) might be less than the time saved by transferring less content over a slow link.
You can verify this by:
- Using incompressible content (e.g. a large JPEG image)
- Speeding up the transfer link significantly (e.g. by using "localhost")