Newsletter FIT
Dashboard Search Watchlist Alerts Billing
SEARCH // ⌘K
Sign in Get started

Billing Watchlist

Technology // Entity

batch size

Technology mentions across the corpus

Search corpus

Overview

Publications

2

Articles

2

Mentions

2

Last 30 days

1

First seen

Aug 4, 2026

Most recent

Sep 9, 2026

Activity

  • 1 mention in the last 30 days

Recent articles

What Makes Inference Nondeterministic?

The AI Engineer · Sep 9, 2026 · mentions

Publications discussing this technology

The AI Engineer

27K subs · 1 linked

Related entities

Topics

LLM evaluation reproducibility · 1 LLM inference determinism · 1 batch-invariant kernels · 1 vLLM/SGLang deterministic mode · 1 serving engine behavior · 1 temperature-zero decoding · 1 floating-point non-associativity · 1 GPU scheduling and batching · 1

Other

vLLM · 1 Llama 3 · 1 Scheduler · 1 determinism flags · 1 Quantization · 1 batch-invariant kernels · 1 attention · 1 SGLang · 1 kernels · 1 float addition associativity · 1 GPU · 1 PyTorch · 1 weight matrices · 1 seed · 1 temperature zero · 1 serving engine · 1
SEARCH // ESC

Type to search