Memorilla: Latent Semantic Memory for Large Language Models

Memorilla is a memory system that encodes documents into query-dependent 'memory tokens' to enhance large language models' (LLMs) performance with reduced context length. It achieves state-of-the-art results on multiple benchmarks while enabling continual learning in agentic systems.

Comments

Read original article