How to Reduce AI Inference Costs: 5 Strategies That Work

LLM Inference 101

Jam with AI · KV cache · FP8 · PagedAttention

Jev, Voice Agents, and LLM Inference Stack

Outcome School Newsletter · KV cache · RAG · Inference infrastructure

Quantization & Pruning — Optimizing Models for Edge Deployment

System Design Interview Roadmap · KV cache · INT4 · Model quantization

Boosting Agentic Coding with LLM Retries: Lessons from Qwen3.8 27B on DeepSWE

The Kaitchup – AI on a Budget · AWQ · FP8 · Model quantization

What Breaks When You Self-Host an LLM

The AI Engineer · KV cache · vLLM

What Breaks When You Self-Host an LLM

The AI Engineer · KV cache · vLLM

Chapter 1: The Physics of LLM Inference: Memory Walls, Arithmetic Intensity, and Compute Ceilings

Agentic AI · KV cache · PagedAttention

Hot Chips 2026: Applying High Bandwidth Flash (HBF)

Chips and Cheese · KV cache · vLLM