Question

I know that gsutil cp can operate in parallel to speed things up, but I will be uploading a lot of small files, and am trying to minimize my per-request overhead. Does gsutil automatically batch multiple file uploads into a single batch request?

(I'm referring to this batch feature here) https://developers.google.com/storage/docs/json_api/v1/how-tos/batch

Was it helpful?

Solution

No, gsutil doesn't currently do this. However, if you run gsutil with the -m flag, it will operate in multi-threaded mode, which will upload your files in parallel.

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top