10.5 Cost Optimization
Caching, prompt compression, and model routing (small vs large model) for LLM cost control.
2 docs tagged with "caching"
View All Tags3.4 Cost & Token Management
Token counting, cost estimation, batching, and caching strategies for LLM APIs.