Skip to content
VibekollenBETAVibekollen
BlogHugging Face

LFM2.5 Q4\_0 Checkpoints from Quantization-Aware Distillation

Article image or reusable cover for Hugging Face

Liquid AI has released optimized versions of its LFM2.5 model using a technique called Quantization-Aware Distillation (QAD).

This method takes a high-precision model and distills it into a compressed version that uses less memory and runs faster, without losing much quality — it recovers 97 percent of the original performance. The models come in four sizes (from 230 million to 2.6 billion parameters) and are tested on tasks such as reasoning, instruction following, and tool usage. The files can be used directly with llama.cpp or other tools that support the GGUF format.

Trained with Quantization-Aware Distillation (QAD): a high-precision teacher model is distilled into a quantized student model
Verbatim from the article at Hugging Face
Read the full story at Hugging Face →

Vibekollen prepared this summary with AI from the original publication. The content belongs to Hugging Face.

More to read