How to reduce the incoming bandwidth?

Question

We have a small application that was use mostly as an API. It's basically an image extractor. You submit a url to it, and it will return its largest image url. Feel free to check the source code.

It runs smoothly, except that we bump into the incoming bandwidth limit quite frequently". What's odd, is that there shouldn't be that much incoming bandwidth. For example, today, we received 64,308 requests and we consumed 1.00 GBytes of the incoming bandwidth. All the other quotas are in the green.

We're looking for ways to debug this, and hopefully ways to reduce that. Any idea?

Answer 1

Per the documentation, the response of URLfetch counts towards the incoming bandwidth quota. So if you have 65k requests per day you will certainly hit that limit if you are downloading images for each one of those.