ZAYA1-8B

ZAYA1-8B is a compact 8.4B parameter MoE reasoning model from Zyphra, trained entirely on 1,024 AMD MI300X GPUs. It achieves frontier-level reasoning, mathematics, and coding performance competitive with models many times its size, released under Apache 2.0.

ZAYA1-8B is a compact 8.4B parameter MoE reasoning model from Zyphra, trained entirely on 1,024 AMD MI300X GPUs. It achieves frontier-level reasoning, mathematics, and coding performance competitive with models many times its size, released under Apache 2.0.

• 018.4B MoE model achieving frontier reasoning, math, and coding competitive with much larger models
• 02Pretrained entirely on AMD MI300X hardware (1,024 GPUs) — no NVIDIA dependency
• 03Open-source under Apache 2.0 license