Topic hub pagination
Continue browsing this topic cluster with SEO-safe static pagination.
Fix LiteLLM API connection timeout errors by adjusting request_timeout or retry settings Includes evidence for LiteLLM troubleshooting demand.
litellm.APIConnectionError: Request timed out. Please increase the max_retries parameter. LiteLLM proxy admin sees usage data from end-of-month incorrectly carried over into next month's total, causing 'Month-to-Date' counter not to reset, leading to premature budget exhaustion Includes evidence for LiteLLM troubleshooting demand.
[Bug]: Duplicate Usage Aggregation Across Billing Cycles — April 30th tokens double-counted in May, pre-exhausting balances LiteLLM proxy admin running on Kubernetes finds that querying Usage page with large datasets triggers OOMKill on Prisma Query Engine, leaving proxy alive but unable to communicate with database Includes evidence for LiteLLM troubleshooting demand.
[Bug]: Prisma Query Engine unable to recover from OOMKill in K8s deployment — query-engine-de stuck in defunct state after large dataset access Developer using OpenRouter free tier encounters sudden 404 errors as models get removed, rate-limited, or replaced. Needs programmatic handling and fallback model rotation Includes evidence for OpenRouter troubleshooting demand.
Model claude-3-sonnet is not available / free LLMs on OpenRouter keep going 404 Fix rate limit handling in LiteLLM proxy where upstream 429s are incorrectly re-wrapped as connection errors and leak security-sensitive token hashes Includes evidence for LiteLLM troubleshooting demand.
Rate limit error message body leaks full SHA-256 token hash on 429 responses; wrapped as APIConnectionError instead of RateLimitError Debug LiteLLM proxy rate limiting and timeout issues when aggregating multiple LLM providers Includes evidence for LiteLLM troubleshooting demand.
RateLimitError: Request failed due to rate limiting. Retry after 30 seconds Fix LiteLLM returning 401 authentication error when using Azure AD token provider with DefaultAzureCredential Includes evidence for LiteLLM troubleshooting demand.
Authentication Error 401 when connecting Azure OpenAI via LiteLLM Fix LiteLLM proxy returning 400 BadRequest when Claude Code attempts thinking mode with DeepSeek models Includes evidence for LiteLLM troubleshooting demand.
API Error: 400 litellm.BadRequest Fix LiteLLM stream memory leak — prevent unbounded tool_call arguments accumulation during streaming Includes evidence for LiteLLM troubleshooting demand.
Unbounded memory growth in LiteLLM stream — current_tool_calls[i]['arguments'] += args_delta accumulates without limit Fix LiteLLM proxy budget bypass vulnerability that allows users to exceed spending limits Includes evidence for LiteLLM troubleshooting demand.
Budget bypass vulnerability allowing unlimited spending in LiteLLM proxy (infinite money glitch) Fix LiteLLM streaming fallback error: mid-stream fallback adds unsupported assistant prefill block, causing HTTP 400 on Claude Sonnet 4.6 / Opus 4.7 Includes evidence for LiteLLM troubleshooting demand.
litellm.BadRequestError: AnthropicException - {"type":"error","error":{"type":"invalid_request_error","message":"This model does not support assistant message prefill. The conversation must end with a user message."}} Fix inability to remove budget limits from LiteLLM API keys once they have been configured, blocking billing flexibility Includes evidence for LiteLLM troubleshooting demand.
budget_limits on LiteLLM keys cannot be removed/overridden after initial set via UI or API Fix LiteLLM v1.84.0 Docker container failing to start Includes evidence for LiteLLM troubleshooting demand.
Docker image ghcr.io/berriai/litellm:1.84.0 start failure in container logs Fix LiteLLM fallback configuration not triggering when primary model fails Includes evidence for LiteLLM troubleshooting demand.
No fallback model group found for original model_group=primary Fix LiteLLM Azure OpenAI authentication error when using DefaultAzureCredential — works with direct OpenAI client but fails through LiteLLM proxy Includes evidence for LiteLLM troubleshooting demand.
litellm.AuthenticationError: AzureException AuthenticationError - Access denied due to invalid subscription key or wrong API endpoint Fix LiteLLM OpenRouter image generation failure with ImageUsage Pydantic validation error Includes evidence for LiteLLM troubleshooting demand.
Error transforming OpenRouter image generation response: 2 validation errors for ImageUsage output_tokens: Input should be a valid integer, got a number with a fractional part [type=int_from_float, input_value=14417.92] Fix LiteLLM proxy authentication failure when routing to Azure OpenAI backend Includes evidence for LiteLLM troubleshooting demand.
Connecting AzureOpenAI via LiteLLM returning Authentication Error 401 Fix LiteLLM proxy performance degradation after version upgrade causing UI and API response slowness Includes evidence for LiteLLM troubleshooting demand.
Significant performance regression — UI and API slowness after upgrading LiteLLM from v1.80.5 to v1.81.x fix LiteLLM This feature is only available for LiteLLM Enterprise users virtual key edit Includes evidence for LiteLLM troubleshooting demand.
This feature is only available for LiteLLM Enterprise users fix LiteLLM Cannot send a request as the client has been closed RuntimeError OpenAI SDK Includes evidence for LiteLLM troubleshooting demand.
RuntimeError: Cannot send a request, as the client has been closed.