Fix LiteLLM proxy, gateway, virtual key, provider routing, budget, schema validation, and OpenAI-compatible API errors.
This LiteLLM troubleshooting hub collects real error signatures, quick fixes, common causes, and
step-by-step debugging paths for developers who need a practical answer instead of a broad overview.
266 crawlable articles in this category.
124 additional records are indexed in JSON only (no standalone HTML route).
Start by matching the exact error message, then check the technology, environment, credentials, network path,
and deployment context. The pages below are grouped so you can move from broad LiteLLM symptoms to
specific root-cause families without relying on client-side search.
Evidence labels are derived at build time from each Markdown record. Source-backed entries have public URLs under
a Sources checked section, while partial-source entries expose public links without a complete source block.
LiteLLM diagnostic workflow
Copy the exact error signature and compare it with the page title, code block, and technology label.
Check whether the failure is local, CI-only, deployment-only, provider-side, or account-specific.
Collect non-secret versions, configuration names, request IDs, and timestamps before making changes.
Review source-backed or partial-source pages first when the issue might depend on provider behavior or version-specific bugs.
Apply the smallest reversible fix and rerun the same failing action.
Common error types
401 authentication error
429 budget exceeded
400 bad request
model not found
provider rejection
validation error
Common causes
GitHub issue #28019 in BerriAI/litellm (opened May 15, 2026). When a team-scoped BYOK model has a fallback configured via POST /fallback (which requires internal model names like model_name_team_uuid), requests using the public model name fail to trigger fallback routing. Router.async_function_with_fallbacks reads the unresolved public name before resolution, causing direct string comparison to never match. (1 page)
GitHub Issue #28149 opened by apshada on May 18, 2026 (today). Fresh proxy-to-model compatibility bug. MCP tool schemas contain fields Fireworks AI doesn't accept. Affects enterprise integration users spending money on both LiteLLM proxy and Fireworks AI. Maps to 'LiteLLM' per approved mapping. (1 page)
GitHub issue #28264 on BerriAI/litellm describes a bug where /v1/models wildcard expansion does not correctly resolve team-scoped wildcard deployment configurations (team.models = ['openai/*']). This blocks developers managing multiple model providers through LiteLLM proxy. Category maps to LiteLLM as a core proxy routing error affecting paid enterprise deployments. (1 page)
GitHub Issue #28995 on BerriAI/litellm repo: LiteLLM proxy forwarding tool_calls to OpenAI chat completions receives responses where some tool_call_ids lack matching response messages. Causes 400 BadRequestError propagated to end user. Directly affects paid proxy deployments. Category: LiteLLM per mapping rules. (1 page)
After upgrading to LiteLLM v1.84.0, Azure OpenAI model authentication completely breaks. LiteLLM is widely used as a unified LLM proxy, so this affects many production deployments. (1 page)
Reported 2026-05-14: Azure OAI models auth broken in LiteLLM v1.84.0. Multiple users affected. Regression in a paid proxy service. (1 page)
These entries include public source URLs in the imported page body. Use them first when you need evidence
for provider behavior, SDK regressions, or version-specific failures.
Fix LiteLLM proxy ConnectionRefusedError by verifying proxy process is running on expected host:port, resolving Docker network isolation, unsetting conflicting LITELLM_PORT env variable Includes evidence for LiteLLM troubleshooting demand.
litellm.llms.custom_httpx.http_handler.HTTPHandler.post: Connection refused OR httpx.ConnectError: [Errno 111] Connection refused
After upgrading to LiteLLM 1.82.1, previously working OpenRouter model IDs throw 404 errors. Users proxying through LiteLLM proxy lose access to OpenRouter models and need quick workaround to restore routing to healthy deployments. Includes evidence for LiteLLM troubleshooting demand.
litellm.CallFailed: Error code: 404 — OpenRouter model IDs stopped working after LiteLLM upgrade to v1.82.1
Debug LiteLLM proxy when routed API calls time out or models become unavailable across integrated providers (OpenAI, Anthropic, local models) Includes evidence for LiteLLM troubleshooting demand.
LiteLLM proxy timeout — model unreachable or provider timeout on multi-provider routing fallback
Understand and mitigate LiteLLM Proxy auth bypass via SQL injection where DB connection errors grant PROXY_ADMIN privileges without valid keys Includes evidence for LiteLLM troubleshooting demand.
Authentication failed / failed-to-connect-to-db / PrismaError pool timeout connection error
Determine if a project installed compromised LiteLLM versions and clean the installation; scan GitLab CI/CD jobs and GitHub Actions for affected deployments Includes evidence for LiteLLM troubleshooting demand.
Developer running LiteLLM proxy gets RouterRateLimitErrorBasic with 'No deployments available for selected model' when calling /chat/completions. Proxy returns 429 and crashes with visible traceback. Needs config fix to resolve deployment routing. Includes evidence for LiteLLM troubleshooting demand.
litellm.types.router.RouterRateLimitErrorBasic: No deployments available for selected model. — 429 response from LiteLLM proxy with full stack trace
Fix LiteLLM proxy failing downstream calls to VertexAI/Gemini models with 429 RESOURCE_EXHAUSTED errors, including proper retry and routing configuration for multi-provider setups. Includes evidence for LiteLLM troubleshooting demand.
Fix LiteLLM proxy logging rate limit errors as deployment failures; understand why stack trace prints 3x even with num_retries: 0 Includes evidence for LiteLLM troubleshooting demand.
litellm.RateLimitError: VertexAIException - {"error": {"code": 429, "message": "Resource has been exhausted (e.g. check quota).", "status": "RESOURCE_EXHAUSTED"}} — logged as 'No deployments available for selected model'
Fix LiteLLM proxy memory leak / state corruption bug where configured models disappear from routing pool after prolonged operation without database backend Includes evidence for LiteLLM troubleshooting demand.
Proxy silently drops all models after extended runtime (config-only, no DB) — all LLM API calls start returning Not Fund Error despite valid configuration
Fix OpenRouter rate limit failover behavior where model switch breaks completely after hitting $5 free tier spending cap Includes evidence for OpenRouter troubleshooting demand.
After hitting OpenRouter API rate limit ($5 spending cap), switching models fails with 'model not allowed' error for ALL models even after limit resets
Fix LiteLLM proxy /v1/models endpoint so wildcard team BYOK routes properly expand and discover models stored under litellm_credential_name Includes evidence for LiteLLM troubleshooting demand.
/v1/models wildcard expansion fails to find team-scoped wildcard deployment models; team.models = ['openai/*'] does not resolve correctly when check_provider_endpoint=true
Detect when LiteLLM proxy routes requests to models it doesn't recognize pricing for — silent zero-cost masking real token costs impacts billing accuracy Includes evidence for LiteLLM troubleshooting demand.
cost_per_token() in cost_calculator.py returns (0.0, 0.0) instead of raising error for unknown/unrecognized models
Fix LiteLLM proxy returning spurious 'guardrails feature unavailable' error messages when guardrails integration was never set up, confusing production deployments Includes evidence for LiteLLM troubleshooting demand.
False-positive guardrails feature unavailable error when guardrails are not configured in LiteLLM
Teams running LiteLLM proxy encounter 401 Unauthorized errors due to Pydantic v2 Optional field handling changes where missing default values break team membership validation. Includes evidence for LiteLLM troubleshooting demand.
Stop false positive rate_limit classification when OpenAPI rejects unknown parameters containing rate_limit in their names; fix exception mapping in LiteLLM proxy Includes evidence for LiteLLM troubleshooting demand.
OpenAI's Unknown parameter 400 errors get misclassified as 429 RateLimitError when the rejected field name contains 'rate_limit' substring (e.g., _litellm_rate_limit_descriptors)
Fix LiteLLM Responses API bridge dropping nested function tool names and forwarding Responses-only tool types that downstream providers (DeepSeek, GLM, MiniMax) reject Includes evidence for LiteLLM troubleshooting demand.
Responses bridge: normalize function tools and drop unsupported tool types — Invalid 'tools[0].function.name': empty string; tools[0].type: unknown variant 'custom'
Fix LiteLLM Response API bridge passing Chat Completions-style chatcmpl-* IDs as message item IDs into native OpenAI Responses endpoint, causing OpenAI to reject the request Includes evidence for LiteLLM troubleshooting demand.
Invalid 'input[1].id': 'chatcmpl-dfa2da3a-1586-4ff7-b64e-f59c692a5d11'. Expected an ID that begins with 'msg'
Fix LiteLLM proxy Prisma migration failure when running in non-root Docker container on Alpine/Wolfi-based images Includes evidence for LiteLLM troubleshooting demand.
Prisma migrations not applied with docker non_root image — Prisma warning: doesn't know which engines to download for Linux distro wolfi, falling back to debian builds
Browse all LiteLLM troubleshooting pages
Continue through the full static archive for this hub. Every listed page is crawlable and keeps its existing
canonical URL.