Error category

LiteLLM Errors and Fixes

Fix LiteLLM proxy, gateway, virtual key, provider routing, budget, schema validation, and OpenAI-compatible API errors.

This LiteLLM troubleshooting hub collects real error signatures, quick fixes, common causes, and step-by-step debugging paths for developers who need a practical answer instead of a broad overview.

266 crawlable articles in this category. 124 additional records are indexed in JSON only (no standalone HTML route).

Browse LiteLLM records in the data catalog — search JSON index entries, including data-only records without standalone HTML guides.

Troubleshooting overview

Start by matching the exact error message, then check the technology, environment, credentials, network path, and deployment context. The pages below are grouped so you can move from broad LiteLLM symptoms to specific root-cause families without relying on client-side search.

Evidence labels are derived at build time from each Markdown record. Source-backed entries have public URLs under a Sources checked section, while partial-source entries expose public links without a complete source block.

LiteLLM diagnostic workflow

  1. Copy the exact error signature and compare it with the page title, code block, and technology label.
  2. Check whether the failure is local, CI-only, deployment-only, provider-side, or account-specific.
  3. Collect non-secret versions, configuration names, request IDs, and timestamps before making changes.
  4. Review source-backed or partial-source pages first when the issue might depend on provider behavior or version-specific bugs.
  5. Apply the smallest reversible fix and rerun the same failing action.

Common error types

  • 401 authentication error
  • 429 budget exceeded
  • 400 bad request
  • model not found
  • provider rejection
  • validation error

Common causes

  • GitHub issue #28019 in BerriAI/litellm (opened May 15, 2026). When a team-scoped BYOK model has a fallback configured via POST /fallback (which requires internal model names like model_name_team_uuid), requests using the public model name fail to trigger fallback routing. Router.async_function_with_fallbacks reads the unresolved public name before resolution, causing direct string comparison to never match. (1 page)
  • GitHub Issue #28149 opened by apshada on May 18, 2026 (today). Fresh proxy-to-model compatibility bug. MCP tool schemas contain fields Fireworks AI doesn't accept. Affects enterprise integration users spending money on both LiteLLM proxy and Fireworks AI. Maps to 'LiteLLM' per approved mapping. (1 page)
  • GitHub issue #28264 on BerriAI/litellm describes a bug where /v1/models wildcard expansion does not correctly resolve team-scoped wildcard deployment configurations (team.models = ['openai/*']). This blocks developers managing multiple model providers through LiteLLM proxy. Category maps to LiteLLM as a core proxy routing error affecting paid enterprise deployments. (1 page)
  • GitHub Issue #28995 on BerriAI/litellm repo: LiteLLM proxy forwarding tool_calls to OpenAI chat completions receives responses where some tool_call_ids lack matching response messages. Causes 400 BadRequestError propagated to end user. Directly affects paid proxy deployments. Category: LiteLLM per mapping rules. (1 page)
  • After upgrading to LiteLLM v1.84.0, Azure OpenAI model authentication completely breaks. LiteLLM is widely used as a unified LLM proxy, so this affects many production deployments. (1 page)
  • Reported 2026-05-14: Azure OAI models auth broken in LiteLLM v1.84.0. Multiple users affected. Regression in a paid proxy service. (1 page)

Related technologies

  • LiteLLM Proxy (1 page)
  • OpenRouter (8 pages)
  • Anthropic API
  • OpenAI-compatible APIs
  • Bedrock

Troubleshooting clusters

  • Virtual key and authentication errors
  • Budget and rate limit errors
  • Provider routing errors
  • Schema and request validation errors
  • Proxy deployment errors
  • Model discovery errors

Latest pages in this category

Representative source-backed errors

These entries include public source URLs in the imported page body. Use them first when you need evidence for provider behavior, SDK regressions, or version-specific failures.

Safe debugging checklist

  • Do not paste API keys, tokens, cookies, private repository snippets, or customer data into public issues.
  • Keep a rollback path before changing credentials, billing limits, DNS, CI secrets, or production deploy settings.
  • Prefer official documentation and source-backed entries over broad guesses when the error affects paid APIs or production deploys.

Top fixes

High-intent troubleshooting topics

  • how to fix LiteLLM errors
  • LiteLLM error fix
  • LiteLLM troubleshooting
  • LiteLLM authentication failed
  • LiteLLM timeout
  • LiteLLM permission denied
  • LiteLLM deployment failed
LiteLLM LiteLLM

LiteLLM Connection Refused Error — Proxy Misconfiguration

Fix LiteLLM proxy ConnectionRefusedError by verifying proxy process is running on expected host:port, resolving Docker network isolation, unsetting conflicting LITELLM_PORT env variable Includes evidence for LiteLLM troubleshooting demand.

litellm.llms.custom_httpx.http_handler.HTTPHandler.post: Connection refused OR httpx.ConnectError: [Errno 111] Connection refused
LiteLLM LiteLLM

LiteLLM 1.82.1 OpenRouter Model IDs No Longer Working

After upgrading to LiteLLM 1.82.1, previously working OpenRouter model IDs throw 404 errors. Users proxying through LiteLLM proxy lose access to OpenRouter models and need quick workaround to restore routing to healthy deployments. Includes evidence for LiteLLM troubleshooting demand.

litellm.CallFailed: Error code: 404 — OpenRouter model IDs stopped working after LiteLLM upgrade to v1.82.1
LiteLLM LiteLLM

LiteLLM Proxy Timeout and Model Unavailable Errors on Multi-Provider Routing

Debug LiteLLM proxy when routed API calls time out or models become unavailable across integrated providers (OpenAI, Anthropic, local models) Includes evidence for LiteLLM troubleshooting demand.

LiteLLM proxy timeout — model unreachable or provider timeout on multi-provider routing fallback
LiteLLM LiteLLM

LiteLLM Supply Chain Compromise Incident — Install Poisoned Versions

Determine if a project installed compromised LiteLLM versions and clean the installation; scan GitLab CI/CD jobs and GitHub Actions for affected deployments Includes evidence for LiteLLM troubleshooting demand.

LiteLLM package compromised — versions 1.82.7 and 1.82.8 contain malicious code contacting external C2 domains
LiteLLM LiteLLM

LiteLLM Proxy RouterRateLimitErrorBasic 'No deployments available for selected model'

Developer running LiteLLM proxy gets RouterRateLimitErrorBasic with 'No deployments available for selected model' when calling /chat/completions. Proxy returns 429 and crashes with visible traceback. Needs config fix to resolve deployment routing. Includes evidence for LiteLLM troubleshooting demand.

litellm.types.router.RouterRateLimitErrorBasic: No deployments available for selected model. — 429 response from LiteLLM proxy with full stack trace
LiteLLM LiteLLM

LiteLLM RateLimitError Misleadingly Reported as 'No Deployments Available' — False Positive Error Masking

Fix LiteLLM proxy logging rate limit errors as deployment failures; understand why stack trace prints 3x even with num_retries: 0 Includes evidence for LiteLLM troubleshooting demand.

litellm.RateLimitError: VertexAIException - {"error": {"code": 429, "message": "Resource has been exhausted (e.g. check quota).", "status": "RESOURCE_EXHAUSTED"}} — logged as 'No deployments available for selected model'
LiteLLM LiteLLM

LiteLLM Proxy Silently Drops All Models After Extended Runtime — Config-Only No-DB Mode Bug

Fix LiteLLM proxy memory leak / state corruption bug where configured models disappear from routing pool after prolonged operation without database backend Includes evidence for LiteLLM troubleshooting demand.

Proxy silently drops all models after extended runtime (config-only, no DB) — all LLM API calls start returning Not Fund Error despite valid configuration
LiteLLM LiteLLM

/v1/models wildcard discovery does not expand team BYOK routes using litellm_credential_name

Fix LiteLLM proxy /v1/models endpoint so wildcard team BYOK routes properly expand and discover models stored under litellm_credential_name Includes evidence for LiteLLM troubleshooting demand.

/v1/models wildcard expansion fails to find team-scoped wildcard deployment models; team.models = ['openai/*'] does not resolve correctly when check_provider_endpoint=true
LiteLLM LiteLLM

cost_per_token returns silently wrong values for unrecognized models in LiteLLM

Detect when LiteLLM proxy routes requests to models it doesn't recognize pricing for — silent zero-cost masking real token costs impacts billing accuracy Includes evidence for LiteLLM troubleshooting demand.

cost_per_token() in cost_calculator.py returns (0.0, 0.0) instead of raising error for unknown/unrecognized models
LiteLLM LiteLLM

False guardrails feature unavailable error when not configured in LiteLLM 1.82.3

Fix LiteLLM proxy returning spurious 'guardrails feature unavailable' error messages when guardrails integration was never set up, confusing production deployments Includes evidence for LiteLLM troubleshooting demand.

False-positive guardrails feature unavailable error when guardrails are not configured in LiteLLM
LiteLLM LiteLLM

LiteLLM 400 Error Misclassified as RateLimitError on Substring Match

Stop false positive rate_limit classification when OpenAPI rejects unknown parameters containing rate_limit in their names; fix exception mapping in LiteLLM proxy Includes evidence for LiteLLM troubleshooting demand.

OpenAI's Unknown parameter 400 errors get misclassified as 429 RateLimitError when the rejected field name contains 'rate_limit' substring (e.g., _litellm_rate_limit_descriptors)
LiteLLM LiteLLM

LiteLLM Proxy Accumulated Bugs Break Core Documentation Features

Developer running LiteLLM proxy encounters broken UI features, incomplete functionality after proxy upgrade, affecting monitoring and debugging capabilities Includes evidence for LiteLLM troubleshooting demand.

LiteLLM proxy UI and features broken/incomplete over success
LiteLLM LiteLLM

LiteLLM Responses API → Chat Completions bridge drops function tool names, rejects unsupported tool types

Fix LiteLLM Responses API bridge dropping nested function tool names and forwarding Responses-only tool types that downstream providers (DeepSeek, GLM, MiniMax) reject Includes evidence for LiteLLM troubleshooting demand.

Responses bridge: normalize function tools and drop unsupported tool types — Invalid 'tools[0].function.name': empty string; tools[0].type: unknown variant 'custom'
LiteLLM LiteLLM

LiteLLM /v1/responses replays chatcmpl-* message IDs breaking OpenAI Responses validation

Fix LiteLLM Response API bridge passing Chat Completions-style chatcmpl-* IDs as message item IDs into native OpenAI Responses endpoint, causing OpenAI to reject the request Includes evidence for LiteLLM troubleshooting demand.

Invalid 'input[1].id': 'chatcmpl-dfa2da3a-1586-4ff7-b64e-f59c692a5d11'. Expected an ID that begins with 'msg'
LiteLLM LiteLLM

LiteLLM Prisma migrations fail with non-root Docker image on Alpine-based distros

Fix LiteLLM proxy Prisma migration failure when running in non-root Docker container on Alpine/Wolfi-based images Includes evidence for LiteLLM troubleshooting demand.

Prisma migrations not applied with docker non_root image — Prisma warning: doesn't know which engines to download for Linux distro wolfi, falling back to debian builds

Browse all LiteLLM troubleshooting pages

Continue through the full static archive for this hub. Every listed page is crawlable and keeps its existing canonical URL.

Browse all LiteLLM troubleshooting pages