LLM-Pruning Collection
### TL;DR
LLM-Pruning Collection is a JAX-based repository that consolidates major pruning algorithms for large language models into a single, reproducible framework. It aims to facilitate easy comparison of block-level, layer-level, and weight-level pruning methods under a consistent training and evaluation stack on both GPUs and TPUs.
Key Insights & Metrics
Key Features
- Consolidates various pruning algorithms for large language models
- Supports block-level, layer-level, and weight-level pruning methods
- Compatible with both GPUs and TPUs for training and evaluation
→ Related Releases
SINQ
SINQ (Sinkhorn-Normalized Quantization) is a novel, fast, and high-quality quantization method designed to make any Large Language Model (LLM) smaller while preserving accuracy. It offers a plug-and-play, model-agnostic technique that delivers state-of-the-art performance for LLMs without sacrificing accuracy.
DetectFlow
DetectFlow is an open-source cybersecurity detection platform developed by SOC Prime. It leverages artificial intelligence to enhance the detection of cyber threats in real-time, enabling security operations teams to identify and respond to attacks more effectively.
SkyRL tx
SkyRL tx is an open-source library that implements a backend for the Tinker API, enabling users to set up their own Tinker-like services on personal hardware. It supports end-to-end reinforcement learning (RL) and offers significantly faster sampling. The library is designed to be modular, allowing easy prototyping of new training algorithms, environments, and execution plans without compromising usability or speed.
Step-Audio-R1
Step-Audio-R1 is an advanced audio language model developed by StepFun AI, designed to enhance audio reasoning capabilities by grounding its reasoning in acoustic features. It introduces Modality-Grounded Reasoning Distillation (MGRD), an iterative training framework that shifts the model's reasoning from textual abstractions to acoustic properties, effectively addressing the 'inverted scaling' problem where performance degrades with longer reasoning. This model has demonstrated superior performance across various audio understanding and reasoning benchmarks, surpassing models like Gemini 2.5 Pro and achieving results comparable to Gemini 3 Pro.
Discussion
Sign in to leave a review
Reviews
No reviews yet. Be the first to review!