How Big Models Teach Small Models: Distillation Explained

How Big Models Teach Small Models to Be Smart

ByteByteGo Newsletter · DeepSeek · Quantization · Model compression

How to Shrink a Language Model Without Making it Too Dumb

ByteByteGo Newsletter · Quantization · Model compression · pruning

Are Open Models Catching Up?

SemiAnalysis · DeepSeek R1 · DeepSeek

The AI Ethics Brief #198: Weights and Measures

The AI Ethics Brief · DeepSeek R1 · DeepSeek

Chapter 9: Ultra-Long Context Mastery: Dual-Chunk Attention, YaRN & Sparse Routing

Agentic AI · DeepSeek · Quantization

6 months to live for open models

Interconnects AI · DeepSeek · distillation

Stop Guessing Which Local Model To Run

Daily Dose of Data Science · Quantization · quantization

The Sequence Knowledge - Issue 916: From Thinking Longer to Learning Better

TheSequence · Model compression · distillation