Context Windows
Topic archive • 2 matches
AI-generated: summaries written by AI from the linked sources. How we use AI
2026-11-21
Technology
Nvidia researchers argue that large context windows are often unnecessary, being slow, expensive, and error-prone. In tests, periodic summaries and targeted keyword search usually matched full-context results at a fraction of the cost, and the team proposes a new class of models that works with short notes instead of long context.
Research • The Decoder
Permalink
2026-11-09
Technology
Google expanded its eighth-generation TPU portfolio with TPU 8tx for secure, confidential inference and TPU 8i Max for massive context windows, marking four new TPU systems in a single year. The chips are designed to handle complex agentic workloads with specialized hardware for security, density, and reasoning.
Infrastructure • Hacker News
Permalink