mirror of
https://github.com/k3s-io/kubernetes.git
synced 2025-07-19 01:40:13 +00:00
7a2c6a432f
Part of the API discovery cache uses an HTTP RoundTripper that transparently caches responses to disk. The upstream implementation of the disk cache is hard coded to call Sync() on every file it writes. This has noticably poor performance on modern Macs, which ask their disk controllers to flush all the way to persistant storage because Go uses the `F_FULLFSYNC` fnctl. Apple recommends minimizing this behaviour in order to avoid degrading performance and increasing disk wear. The content of the discovery cache is not critical; it is indeed just a cache and can be recreated by hitting the API servers' discovery endpoints. This commit replaces upstream httpcache's diskcache implementation with a similar implementation that can use CRC-32 checksums to detect corrupted cache entries at read-time. When such an entry is detected (e.g. because it was only partially flushed to permanent storage before the host lost power) the cache will report a miss. This causes httpcache to fall back to its underlying HTTP transport (i.e. the real API server) and re-cache the resulting value. Apart from adding CRC-32 checksums and avoiding calling fsync this implementation differs from upstream httpcache's diskcache package in that it uses FNV-32a hashes rather than MD5 hashes of cache keys in order to generate filenames. Signed-off-by: Nic Cope <nicc@rk0n.org> |
||
|---|---|---|
| .. | ||
| .travis.yml | ||
| httpcache.go | ||
| LICENSE.txt | ||
| README.md | ||
httpcache
Package httpcache provides a http.RoundTripper implementation that works as a mostly RFC 7234 compliant cache for http responses.
It is only suitable for use as a 'private' cache (i.e. for a web-browser or an API-client and not for a shared proxy).
Cache Backends
- The built-in 'memory' cache stores responses in an in-memory map.
github.com/gregjones/httpcache/diskcacheprovides a filesystem-backed cache using the diskv library.github.com/gregjones/httpcache/memcacheprovides memcache implementations, for both App Engine and 'normal' memcache servers.sourcegraph.com/sourcegraph/s3cacheuses Amazon S3 for storage.github.com/gregjones/httpcache/leveldbcacheprovides a filesystem-backed cache using leveldb.github.com/die-net/lrucacheprovides an in-memory cache that will evict least-recently used entries.github.com/die-net/lrucache/twotierallows caches to be combined, for example to use lrucache above with a persistent disk-cache.github.com/birkelund/boltdbcacheprovides a BoltDB implementation (based on the bbolt fork).