← all releases
Letta·Oct 26, 2026·v1.0·open source
FrontierMemory
FrontierMemory is an open-source benchmark designed to evaluate how well AI agents learn from past experiences rather than simply recalling facts. It measures the effectiveness of memory generation by testing whether an agent's learned memory folder improves performance on 15 downstream coding and knowledge-work tasks.
AI AgentsBenchmarkingContinual LearningLLM Research
overview
FrontierMemory is an open-source benchmark designed to evaluate how well AI agents learn from past experiences rather than simply recalling facts. It measures the effectiveness of memory generation by testing whether an agent's learned memory folder improves performance on 15 downstream coding and knowledge-work tasks.
key features
- 01Evaluates continual learning through downstream task performance
- 02Includes 15 memory-dependent coding and knowledge-work tasks
- 03Supports custom memory-generation harness submissions
- 04Standardized two-stage evaluation: memory generation followed by task execution
- 05Compatible with Docker and Modal for reproducible environment management
related productsbrowse all →
MiroThinkeropen sourceMiroThinker is an open-source search agent model developed by MiroMindAI, designed for tool-augmented reasoning and real-world information seeking. It aims to match the deep research capabilities of leading AI models like OpenAI's Deep Research and Google's Gemini Deep Research.Letta Code SDKopen sourceThe Letta Code SDK is a software development kit that enables developers to build deeply personalized agents with persistent memory that learn over time. It serves as the interface to Letta Code, facilitating the creation of stateful agents capable of continuous learning and improvement.OB-1open sourceOB-1 is a self-improving coding agent developed by OpenBlock Labs, designed to autonomously handle the full development lifecycle, from project management to pull requests. It integrates seamlessly into existing workflows, enhancing productivity and code quality.