← all releases
Technology Innovation Institute (TII)·Jan 7, 2026·v1.0·open source
Falcon H1R-7B
Falcon H1R-7B is a 7-billion parameter reasoning-focused language model developed by TII in Abu Dhabi. It combines Transformer layers with Mamba2 state space components, enabling efficient processing of sequences up to 256,000 tokens. The model is fine-tuned for tasks in mathematics, coding, and general reasoning, achieving benchmark scores that rival larger models.
LLMsMLAI Agents
overview
Falcon H1R-7B is a 7-billion parameter reasoning-focused language model developed by TII in Abu Dhabi. It combines Transformer layers with Mamba2 state space components, enabling efficient processing of sequences up to 256,000 tokens. The model is fine-tuned for tasks in mathematics, coding, and general reasoning, achieving benchmark scores that rival larger models.
key features
- 01Hybrid Transformer and Mamba2 architecture
- 02Supports context lengths up to 256,000 tokens
- 03Fine-tuned for math, coding, and general reasoning tasks
related productsbrowse all →
AIBuildAIopen sourceAIBuildAI is an AI agent that autonomously constructs AI models. Given a specific task, it initiates an agent loop to analyze the problem, design models, and execute training processes, all without human intervention.Step-Audio-R1open sourceStep-Audio-R1 is an advanced audio language model developed by StepFun AI, designed to enhance audio reasoning capabilities by grounding its reasoning in acoustic features. It introduces Modality-Grounded Reasoning Distillation (MGRD), an iterative training framework that shifts the model's reasoning from textual abstractions to acoustic properties, effectively addressing the 'inverted scaling' problem where performance degrades with longer reasoning. This model has demonstrated superior performance across various audio understanding and reasoning benchmarks, surpassing models like Gemini 2.5 Pro and achieving results comparable to Gemini 3 Pro.SINQopen sourceSINQ (Sinkhorn-Normalized Quantization) is a novel, fast, and high-quality quantization method designed to make any Large Language Model (LLM) smaller while preserving accuracy. It offers a plug-and-play, model-agnostic technique that delivers state-of-the-art performance for LLMs without sacrificing accuracy.