Simple Db Query On Google App Engine Taking A Lot Of Cpu Time

I'm fairly new to Google App Engine and Python, but I did just release my first real-world site with it. But now I'm getting problems with one path that is using significantly more

Solution 1:

• Memcache, if you haven't already, and especially if the same carvings are going to be fetched again and again. If you only have 90 total, I would imagine they would all be in the cache pretty quickly, and then you should be golden.

• Do you need all the properties of the Carvings? For example, if you're just displaying a list of carvings, you could have a separate Entity that was something like CarvingSummary that only had a few properties. This would mean your schema was denormalized, but sometimes that's the price you pay for speed.

Also, I'm assuming this is not the first page the user will always hit? If that were the case it could be the cloud spinning up a a new instance.

Solution 2:

Sometimes you'll get better performance if you do an indexed query, rather than a query of "all" elements in the model.

Also, consider using memcache.

Solution 3:

Do you actually need 1000 entities? CPU time goes up more or less linearly with the number of results retrieved, so if you don't actually need all the results, you may be wasting a lot of time fetching and decoding them.

Solution 4:

It could be the image (and/or Text property) that is taking time to load & marshall into objects, depending on how big those properties are.

First prize: just use the memcache as others say. Then the overhead is incurred only on the first hit.

Second prize: I'm not sure how often your images are being changed and how many you might have, but you could consider uploading them as static files and simply linking to them in your HTML. Then it'd be just an HTTP GET from the browser - much lower overhead.