Memorilla: Latent Semantic Memory for LLMs
39 points by handfuloflight
Memorilla is a new memory system designed for large language models (LLMs) that allows them to utilize information beyond their inherent parameters, such as past interactions and long documents. It addresses the challenge of efficiently gathering and integrating relevant information for queries while maintaining a concise context window. This system enhances the ability of LLMs to access and apply accumulated knowledge effectively.