Troubleshoot Ollama local server, model load, cloud API, timeout, runner crash, memory, GPU, and connection errors for local and hosted inference.
This Ollama troubleshooting hub collects real error signatures, quick fixes, common causes, and
step-by-step debugging paths for developers who need a practical answer instead of a broad overview.
125 crawlable articles in this category.
50 additional records are indexed in JSON only (no standalone HTML route).
Start by matching the exact error message, then check the technology, environment, credentials, network path,
and deployment context. The pages below are grouped so you can move from broad Ollama symptoms to
specific root-cause families without relying on client-side search.
Evidence labels are derived at build time from each Markdown record. Source-backed entries have public URLs under
a Sources checked section, while partial-source entries expose public links without a complete source block.
Ollama diagnostic workflow
Copy the exact error signature and compare it with the page title, code block, and technology label.
Check whether the failure is local, CI-only, deployment-only, provider-side, or account-specific.
Collect non-secret versions, configuration names, request IDs, and timestamps before making changes.
Review source-backed or partial-source pages first when the issue might depend on provider behavior or version-specific bugs.
Apply the smallest reversible fix and rerun the same failing action.
Common error types
connection refused
500 internal server error
503 service unavailable
model failed to load
runner process terminated
read timeout
Common causes
GitHub Issue #16326 on ollama/ollama repo: race condition where parallel API requests get empty string responses when another request is loading the model into VRAM/KV Cache. Raw streaming mode affected. Clear error behavior in multi-user/concurrent scenarios. Category: Ollama per mapping. (1 page)
Source: GitHub Issue #16261 on ollama/ollama (opened May 22, 2026, within last hour). Crash in ggml_backend_tensor_set function triggered during partial GPU offload on AMD Radeon RX 9070 — a newly released GPU. Segfault represents a hard blocking error preventing model loading entirely on this hardware. High search demand as new GPU adoption grows. Duplicate check: not in covered-errors.md. Category: Ollama → local LLM serving with hardware-specific error. (1 page)
Ollama is a widely used local LLM platform. Connection refused errors block all local AI inference, affecting developers running self-hosted models for cost savings or privacy. (1 page)
Sentry-reported production issue: ConnectError [Errno 111] Connection refused when connecting to Ollama API. Multiple instances traced to httpcore connection failure. (1 page)
GitHub issue #16298 on ollama/ollama. Plain text Read works fine, direct top-level image content request works, but specifically Claude Code + Ollama combination with PNG through Read tool fails. Affects developers running local LLMs via Ollama with Claude Code. Category = Ollama per approved mapping. (1 page)
Stack Overflow user reports MCP server fails to connect in VS Code Continue extension when Ollama runs in Docker container on WSL2. Ollama reachable at localhost:11434 but Continue extension doesn't see MCP tools. WSL2/Docker networking and stdio transport issue. Category is Ollama (local LLM serving + MCP integration). (1 page)
These entries include public source URLs in the imported page body. Use them first when you need evidence
for provider behavior, SDK regressions, or version-specific failures.
Fix Ollama 412 pulling manifest error caused by version mismatch between client (newer) and server/daemon (older), especially on Linux AMD GPU setups with ROCm Includes evidence for Ollama troubleshooting demand.
"pulling manifest Error: pull model manifest: 412: The model you are attempting to pull requires a newer version of Ollama"
Fix Ollama model download failure caused by Hugging Face rate limiting (429) when pulling large models Includes evidence for Ollama troubleshooting demand.
pull model manifest: 429 — Too Many Requests from Hugging Face during ollama pull
Self-hosted developer tries to pull/run large models in Ollama but encounters manifest download failures (HuggingFace rate limit or proxy issues) or GPU OOM crashes needing VRAM management fixes. Includes evidence for Ollama troubleshooting demand.
pull model manifest: file does not exist OR CUDA error: out of memory OR pulling manifest 429
Running Ollama inside Docker container behind restricted network/firewall/proxy cannot pull models from registry due to TLS handshake timeout; needs proxy configuration or DNS fix workaround Includes evidence for Ollama troubleshooting demand.
Error: pull model manifest: Get https://registry.ollama.ai/v2/library/<model>/manifests/latest: net/http: TLS handshake timeout
Fix Ollama model pull failures caused by TLS handshake timeouts, DNS resolution failures, and network connectivity issues in Docker/Wsl environments Includes evidence for Ollama troubleshooting demand.
Error: pull model manifest: Get "https://registry.ollama.ai/v2/library/.../manifests/latest": net/http: TLS handshake timeout; dial tcp: lookup registry.ollama.ai: read udp ...: i/o timeout; Connection reset mid-download restarting from 0%
Fix Ollama model download failures caused by proxy misconfiguration, HuggingFace rate limiting (429), and missing environment variables during manifest fetching. Includes evidence for Ollama troubleshooting demand.
Error: pull model manifest: file does not exist / max retries exceeded: unexpected EOF / pull model manifest: 429
Fix Ollama model download failures caused by network timeouts when connecting to the Ollama registry Includes evidence for Ollama troubleshooting demand.
Error: pull model manifest: Get "https://registry.ollama.ai/v2/library/...": dial tcp <IP>:443: i/o timeout
Fix Ollama tool calls freezing and timing out on Apple Silicon Macs with MLX backend, specifically when generating large code outputs via write tool Includes evidence for Ollama troubleshooting demand.
Tool calling is not streaming on macOS with MLX, causing timeout when write tool outputs large code
Fix Ollama model download failures due to manifest pulling errors including missing files, SSH key issues, DNS resolution failures, and version compatibility Includes evidence for Ollama troubleshooting demand.
Error: pull model manifest: file does not exist; also 'ssh: no key found', 'no such host', and 'pulling manifest: 412: requires newer version'
Resolve Ollama model loading failure caused by Apple Silicon MLX runner being incorrectly selected on Linux systems with NVIDIA GPU Includes evidence for Ollama troubleshooting demand.
Error: failed to load model: 500 Internal Server Error: mlx runner failed: Error: failed to initialize MLX
Fix Ollama model naming convention — client rejects 'provider/model' format (404) and also rejects bare model names (invalid_model_syntax), leaving no valid way to specify local Ollama models Includes evidence for Ollama troubleshooting demand.
api returned 404 Not Found (not_found_error): model 'ollama/qwen2.5-coder:7b' not found
Developers with new AMD GPUs (Radeon RX 9070) experience segfaults when Ollama partially offloads model inference to GPU via ggml backend tensor operations Includes evidence for Ollama troubleshooting demand.
partial offload segfaults in ggml_backend_tensor_set on AMD Radeon RX 9070
Developers integrating Ollama via Python API get token-too-long errors when llama-server outputs responses exceeding bufio.Scanner buffer limits, breaking LLM pipeline processing Includes evidence for Ollama troubleshooting demand.
bufio.Scanner: token too long (status code: -1) — Error from the python API: llama-server response
Developer tries to run Ollama locally but gets connection refused errors — service isn't running, port conflict, or firewall blocking local connections — preventing local LLM inference Includes evidence for Ollama troubleshooting demand.
Error: connection refused at localhost:11434 OR dial tcp [::1]:11434: connect: connection refused
Developer runs ollama inside a Docker/container environment where nvidia-smi reports GPUs fine but ollama falls back to CPU or crashes during model loading; needs to know correct NVIDIA driver/toolkit version pinning for Ollama 20.x Includes evidence for Ollama troubleshooting demand.
Ollama fails to initialize GPU despite nvidia-smi working correctly from within container
Fix Ollama crash caused by unbounded memory allocation when parsing large GGUF model files — particularly affects loading quantized models on systems with limited RAM Includes evidence for Ollama troubleshooting demand.
Potential OOM crash during GGUF metadata parsing in v0.24.0 (readString/n_kv allocation)
Fix Ollama HuggingFace GGUF model download that completes transfer but then fails with HTTP 400 empty body response Includes evidence for Ollama troubleshooting demand.
Error: 400 (empty body) when pulling hf.co GGUF models after successful download
Ollama operator on Linux with NVIDIA GPU getting MLX (Apple Silicon runner) fallback errors when pulling multi-modal models, blocking model deployment Includes evidence for Ollama troubleshooting demand.
500 Internal Server Error: mlx runner failed: Error: failed to initialize MLX — ollama pulling x/z-image-turbo model on Rocky Linux 9.7 with NVIDIA RTX 4000 SFF Ada
Fix LangChain + Ollama integration where streaming completions incorrectly use stop_sequences as finish_reason, causing early termination or garbled output in production LLM pipelines. Includes evidence for Ollama troubleshooting demand.
OllamaLLM streaming in LangChain returns stop sequences as finish_reason instead of proper completion signal, breaking streaming pipelines
Browse all Ollama troubleshooting pages
Continue through the full static archive for this hub. Every listed page is crawlable and keeps its existing
canonical URL.