Add fancy caching for large blocks of data

Review Request #591 — Created Oct. 14, 2008 and submitted — Latest diff uploaded

Information

Navi (deprecated)
trunk

Reviewers

memcached will only cache chunks of data below 1M. This is kind of crappy, since some of our files can be larger than 1M, and those are the ones which take the longest to fetch, patch, diff, and render.

This change adds a large_data keyword to cache_memoize, which will do some fancy pickling, compression and splitting to stuff these large blocks into the cache.
Looked at my giant diff and saw that things were getting cached correctly.