Neural Cache

What is a Neural Cache? A Neural Cache, also known as a Continuous Cache, is a component of language modeling that stores previous hidden states in memory cells. These stored hidden states are then used as keys to retrieve their corresponding word, which is the next word in the sequence. Unlike other models, there is no transformation applied to the storage during the writing and reading process. How Does a Neural Cache Work? The Neural Cache utilizes the hidden representations of a language