← all releases
Together AI·Jul 29, 2026·rolling·open source
ThunderAgent
ThunderAgent is a program-aware scheduling system designed to optimize high-throughput agentic inference. By treating agentic workflows as schedulable programs rather than independent requests, it effectively eliminates KV cache thrashing and improves multi-node scaling.
AI InfrastructureInference OptimizationAgentic AIOpen Source
overview
ThunderAgent is a program-aware scheduling system designed to optimize high-throughput agentic inference. By treating agentic workflows as schedulable programs rather than independent requests, it effectively eliminates KV cache thrashing and improves multi-node scaling.
key features
- 01Program-level scheduling to eliminate KV cache thrashing
- 02Global waiting queue for efficient multi-node load balancing
- 03Drop-in compatibility with OpenAI-compatible inference backends
- 04Near-linear throughput scaling across multi-node GPU clusters
- 05Support for existing optimizations like speculative decoding and quantization
related productsbrowse all →
MiroThinkeropen sourceMiroThinker is an open-source search agent model developed by MiroMindAI, designed for tool-augmented reasoning and real-world information seeking. It aims to match the deep research capabilities of leading AI models like OpenAI's Deep Research and Google's Gemini Deep Research.Letta Code SDKopen sourceThe Letta Code SDK is a software development kit that enables developers to build deeply personalized agents with persistent memory that learn over time. It serves as the interface to Letta Code, facilitating the creation of stateful agents capable of continuous learning and improvement.OB-1open sourceOB-1 is a self-improving coding agent developed by OpenBlock Labs, designed to autonomously handle the full development lifecycle, from project management to pull requests. It integrates seamlessly into existing workflows, enhancing productivity and code quality.