2 docs tagged with "rate-limiting"

FastAPI wrapper, request queuing, and token budgets for LLM API gateways.

Rate limits, timeouts, exponential backoff, and fallback model strategies.