Skip to content

GLM-4.5-Air Locally on WSL With Ollama

Run GLM-4.5-Air locally on WSL with Ollama and connect it to a coding agent. Install, model pull, OpenAI-compatible endpoint, hardware needs, and the fixes.

MGMCSA Guru Team August 15, 2026 3 min read
GLM-4.5-Air running locally via Ollama on WSL on Windows

GLM-4.5-Air is an older open-weight GLM model that can run locally, but “Air” does not mean small. Z.AI lists 106 billion total parameters with 12 billion active parameters. A popular community Ollama build ranges from about 40 GB to 117 GB, depending on quantization. Check your available memory before downloading it.

This covers the local run on WSL and connecting it to an agent. For the far more capable hosted option, see GLM Coding Plan setup.

Why GLM-4.5-Air for local

Step 1: Ollama on WSL

If WSL isn’t installed, start with the WSL install guide. Install Ollama inside WSL (or use native Windows Ollama). It serves models on a local OpenAI-compatible endpoint at http://localhost:11434/v1.

Step 2: Get GLM-4.5-Air into Ollama

Check Ollama’s model library for a GLM-4.5-Air build. If one is listed:

ollama pull MichelRosselli/GLM-4.5-Air:IQ1_M

If it isn’t in the library, you can import a compatible GGUF build via a Modelfile per Ollama’s docs. Confirm the model name you end up with, as you’ll need it for the agent config.

Step 3: Test it

ollama run MichelRosselli/GLM-4.5-Air:IQ1_M

Give it a small coding question to confirm it loads and responds at a usable speed.

Step 4: Connect a coding agent

Claude Code via Claude Code Router:

{
  "Providers": [
    {
      "name": "ollama",
      "api_base_url": "http://localhost:11434/v1/chat/completions",
      "api_key": "ollama",
      "models": ["MichelRosselli/GLM-4.5-Air:IQ1_M"]
    }
  ],
  "Router": { "default": "ollama,MichelRosselli/GLM-4.5-Air:IQ1_M" }
}

Then ccr code.

Cline in VS Code can use http://localhost:11434/v1 through its OpenAI Compatible provider. Enter the exact Ollama model name you downloaded.

The honest trade-offs

Local GLM-4.5-Air vs hosted GLM

Cost Local: free to run · Hosted: $18/mo plan
Privacy Local: fully private · Hosted: sent to Z.AI
Capability Local Air: light · Hosted GLM-5/Turbo: much stronger
Setup Local: more effort · Hosted: two env vars

Air is a lightweight model, so local quality is well below the hosted GLM-5/Turbo on the plan. This setup is about privacy and zero cost, not capability. For real coding power at low cost, the GLM Coding Plan is hard to beat at $18/month.

Troubleshooting

  • If Ollama reports that the model is missing, use the full community namespace and tag.
  • If loading fails, choose a smaller quantization or use a machine with more memory.
  • If the agent cannot connect, confirm that Ollama is running on port 11434.
  • If tool calls fail, remember that the community conversion’s template may differ from Z.AI’s reference runtime.

Local GLM-4.5-Air checklist

  • Ollama installed (WSL or native)
  • GLM-4.5-Air pulled or imported as GGUF
  • A quantization that fits your hardware
  • Agent connected to localhost:11434/v1
  • Hard tasks reserved for the hosted GLM plan

Local or hosted

Local GLM-4.5-Air is useful when data must remain on your machine and you have enough memory for a large quantized model. For a new hosted coding setup, use GLM-5.3 instead.

For other local routes, see DeepSeek locally with Ollama and Qwen3-Coder locally with LM Studio.

Frequently asked questions

Can I run GLM-4.5-Air locally?

GLM-4.5-Air is the lightweight member of the GLM family, which makes it the most realistic GLM to self-host. If a compatible local build is available in Ollama's library (or as a GGUF you import), you can run it on WSL and connect it to a coding agent via its OpenAI-compatible endpoint.

Why GLM-4.5-Air specifically?

Because it's the smallest, lightest GLM, it's the one most likely to fit consumer hardware. The larger GLM-5 models are too big for most local machines, so Air is the practical choice for local use.

Why run it on WSL?

WSL gives the standard Linux environment Ollama and coding agents expect, and on Windows it's a clean place to run a local server. GPU passthrough to WSL works on supported setups, though native Windows Ollama is also an option.

Is local GLM as good as the hosted GLM Coding Plan?

No. GLM-4.5-Air is an older open-weight model with substantial hardware needs. The current hosted GLM-5.3 service is easier to run and is the better default for difficult coding work.

How do I connect it to Claude Code?

Ollama exposes an OpenAI-compatible endpoint, so use Claude Code Router with localhost as the provider. For an editor, point Cline's OpenAI Compatible provider at the same local URL.

Sources & further reading

Official vendor documentation referenced while writing this guide.

MG

MCSA Guru Team

IT & Systems Administration

We are working IT pros and system administrators who spend our days in Windows Server, Microsoft 365, and the wider Microsoft stack. MCSA Guru is where we write down the fixes and walkthroughs we wish we had found the first time.

MCSA Guru provides independent, educational IT guidance. Microsoft, Windows, Windows Server, Microsoft 365, Exchange, and Microsoft Teams are trademarks of Microsoft Corporation; Docker is a trademark of Docker, Inc. MCSA Guru is not affiliated with or endorsed by Microsoft or Docker. Always test changes in a safe environment before applying them in production.

Related guides

Fixing something right now?

Jump straight into the guide library or search for the exact error or task you are dealing with.