Context Caching — AI Glossary

Context caching is an optimization technique where AI providers store and reuse previously processed prompt prefixes across multiple API calls. When you send the same system prompt, few-shot examples, or reference documents repeatedly, context caching avoids re-processing those tokens, reducing latency and cost. This is particularly valuable for applications that use long, static system prompts or large reference documents.