Back to News
AnemllNovember 24, 2025

ANEMLL VibeThinker 1.5B — Variable Context State Transition Model

Open Source
Infrastructure

Explore ANEMLL VibeThinker 1.5B — Variable Context State Transition Model

Visit the official website to learn more and get started

### TL;DR

The ANEMLL VibeThinker 1.5B is a machine learning model optimized for the Apple Neural Engine (ANE), enabling efficient on-device inference with dynamic context size support. It demonstrates variable context inference by starting with a small key-value (KV) cache and automatically expanding it as the output length increases, allowing for the generation of outputs exceeding 24,000 tokens on devices with a 4,096-token context model.

Key Insights & Metrics

Pricing
Free
Cost structure
Version
0.3.5
Current release version
Hardware
macOS 15+ with Apple Silicon (M1/M2/M3/M4 or later)
Compute requirements
Category
Open Source
Licensing model
Region
Unknown
Primary region

Key Features

  • Optimized for Apple Neural Engine (ANE)
  • Supports dynamic context sizes up to 4,096 tokens
  • Enables on-device inference with outputs over 24,000 tokens
  • Utilizes a shift-refill mechanism for cache management
  • Converted from WeiboAI/VibeThinker-1.5B using ANEMLL v0.3.5

Related Releases

Plano

Plano is an AI-native proxy and data plane designed to streamline the development of agentic applications. By offloading the underlying infrastructure tasks, it allows developers to focus on the core logic of their agents, regardless of the AI framework in use.

Katanemo
Open

QueryWeaver

QueryWeaver is an open-source Text2SQL tool developed by FalkorDB that transforms natural language queries into SQL using graph-powered schema understanding. It enables users to interact with databases in plain English, simplifying the process of generating accurate SQL queries. ([github.com](https://github.com/FalkorDB/QueryWeaver?utm_source=openai))

FalkorDBSep 3
Open

AIO Sandbox

AIO Sandbox is an integrated environment designed for AI agents, combining a browser, terminal, filesystem, VSCode, Jupyter, and MCP Server into a single Docker container. This unified setup allows seamless development and execution of AI agents without the need for multiple services.

Agent InfraOct 29
Open

SkyRL tx

SkyRL tx is an open-source library that implements a backend for the Tinker API, enabling users to set up their own Tinker-like services on personal hardware. It supports end-to-end reinforcement learning (RL) and offers significantly faster sampling. The library is designed to be modular, allowing easy prototyping of new training algorithms, environments, and execution plans without compromising usability or speed.

NovaSky AINov 3
Open

Discussion

0
Upvotes
0
Downvotes
0 reviews

Sign in to leave a review

Reviews

No reviews yet. Be the first to review!

🚀 Join the AI dev community — follow us everywhere

© 2026 MARKTECHPOST AI MEDIA INC. All rights reserved.Terms & ConditionsPrivacy Policy
Beta Mode