How to Shrink a Language Model Without Making it Too Dumb

How Big Models Teach Small Models to Be Smart

ByteByteGo Newsletter · knowledge distillation · Quantization · Knowledge distillation

How Big Models Teach Small Models: Distillation Explained

Cloud Girl · Quantization · Model compression · pruning

The Sequence Knowlege #907: The Brain Transplant: Distilling Transformers Into Other Architectures

TheSequence · knowledge distillation · Knowledge distillation · Model compression

Someone just ran a 2.78-trillion-parameter model on a laptop. The memory wall is breaking

The AI Corner · Large language models · Quantization

Quantization & Pruning — Optimizing Models for Edge Deployment

System Design Interview Roadmap · FP32 · BF16

LLM Inference 101

Jam with AI · knowledge distillation · BF16

All GPU related concepts simply explained

Jam with AI · BF16 · FP16

Stop Guessing Which Local Model To Run

Daily Dose of Data Science · Quantization · quantization