Expand description

A cache system that uses local in-memory storage to store a limited number of items.

The cache system here is actually two tiered. The first tier maps from suggestion requests to the hash of the response they should use. The second tier maps from those hashes to the responses. In this way, duplicate responses can be stored only once, even if they are used for many requests.

Structs

LOCK_TABLE 🔒

A in-memory cache for suggestions.