LFM2.5 Q4\_0 Checkpoints from Quantization-Aware Distillation

Quantization-Aware Distillation (QAD) is a technique that compresses AI models into smaller 4-bit versions by training a smaller "student" model using knowledge from a larger "teacher" model, rather than shrinking an already-trained model. This matters because the resulting compressed models run on edge devices like phones and laptops with the same speed and memory efficiency as standard compression methods, but recover 97 percent of the accuracy lost in the compression process. The LFM2.5 models in four sizes have been released as QAD checkpoints that can be used with standard AI inference software.