How to run Qwen3.5 locally with LM Studio as private, self-hosted AI

Run Qwen3.5 from Alibaba as your own private, self-hosted AI. LM Studio runs the model on your computer, and TypingMind gives you a full chat app on top of it. Your prompts stay on your machine, and there is no per-message cost.

About Qwen3.5: Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency

Qwen3.5 Overview

ModelQwen3.5
Made byAlibaba
Runs onLM Studio
Versionsqwen3.5-9b, qwen3.5-35b-a3b, qwen3.5-2b, qwen3.5-4b, qwen3.5-27b
Download size2 GB to 21 GB
Minimum RAM2 GB
Capabilities
Tool callingVisionThinking
FormatsGGUF, MLX
LM Studio commandlms get qwen/qwen3.5-9b
Downloads on LM Studio2.8M
Model iconGet the icon for TypingMind

Which version of Qwen3.5 should you pick?

Each version is a different size of Qwen3.5. Bigger versions give better answers but need more memory. Pick the biggest one that fits your computer's RAM. On a Mac, memory is shared with the graphics chip, so leave some room for other apps.

Model IDDownloadSuggested RAM
qwen/qwen3.5-9bused in this guide7.00 GB16 GB
qwen/qwen3.5-35b-a3b21.00 GB32 GB
qwen/qwen3.5-2b2.00 GB8 GB
qwen/qwen3.5-4b3.75 GB8 GB
qwen/qwen3.5-27b17.00 GB32 GB

Suggested RAM is a rough guide: the download size plus about 2 GB, with room for your system. Longer context windows use more.

Run Qwen3.5 with LM Studio

The steps below use qwen/qwen3.5-9b, a version that fits most laptops. Swap in another model ID from the table if you want a smaller or bigger one.

I

Install LM Studio

LM Studio is a free desktop app that runs AI models on your own computer. It downloads Qwen3.5, loads it into memory, and answers requests on your machine through a local server.

  1. Download LM Studio for macOS, Windows, or Linux from lmstudio.ai/download and open it.
  2. On first launch, LM Studio offers to download a starter model. You can let it, or skip and download Qwen3.5 in the next step.
LM Studio downloading qwen/qwen3.5-9b to run locallyqwen / qwen3.5-9bQwen3.5. Supports image input, reasoning, and tool calling.0 MB / 7.00 GB
LM Studio downloading qwen/qwen3.5-9b

LM Studio also comes with a terminal tool called lms. On macOS and Linux, run this once so you can type lms in the Terminal app (use ~/.bashrc instead of ~/.zshrc if you use bash):

echo 'export PATH="$PATH:$HOME/.lmstudio/bin"' >> ~/.zshrc && source ~/.zshrc

On Windows, add %USERPROFILE%\.lmstudio\bin to your PATH, or do the next steps in the LM Studio app instead.

II

Download Qwen3.5 with LM Studio

In the Terminal app, run:

lms get qwen/qwen3.5-9b

This downloads qwen/qwen3.5-9b (7.00 GB). LM Studio picks the right format for your computer: MLX on Apple Silicon Macs, GGUF everywhere else. When you see Download completed, the model is ready.

Prefer clicking? Open Model Search in the LM Studio sidebar, search for qwen3.5-9b, and click Download. Run lms ls to see every model you have downloaded.

III

Start the LM Studio server for TypingMind

TypingMind talks to LM Studio through its local server. Load the model with a 32,768-token context window, then start the server with CORS turned on, so the TypingMind web app is allowed to connect:

lms load qwen3.5-9b -c 32768
lms server start --cors

You should see Server is now running on port 1234. The load command also prints the model ID to use in TypingMind.

Terminal running lms get, lms load and lms server start --cors
Download, load, and serve a model with lms (example with google/gemma-4-e4b)

In the app instead: go to Developer → Local Server, open Server Settings, turn on Enable CORS, switch the status to Running, and click Load Model.

Good to know: with CORS on, any website you visit can reach your LM Studio server while it runs. Stop it with lms server stop when you're done. Keep LM Studio open while you chat: if you quit it, the server stops too.
IV

Add Qwen3.5 to TypingMind

Open www.typingmind.com in your browser. Use the web version: the TypingMind Mac app and the Setapp version block plain http:// addresses like LM Studio's.

Click Models in the left sidebar, then Add custom model.

Fill in the form:

NameQwen3.5 (LM Studio)or any name you like
Model IDqwen/qwen3.5-9b
Context Length32768match the -c value you loaded with
API TypeOpenAI Chat Completions API
Endpoint URLhttp://localhost:1234/v1/chat/completions
Authentication TypeNo authentication
TypingMind Add Custom Model form filled in for qwen/qwen3.5-9b running on LM StudioQwen3.5 (LM Studio)qwen/qwen3.5-9b32768http://localhost:1234/v1/chat/completions
The custom model form for qwen/qwen3.5-9b

Open the Capabilities tab and turn off Auto check capabilities on save. The check sends several test requests, and a local model answers them one at a time, so it can take minutes.

Then set the features for Qwen3.5:

  • Support System Role: on
  • Support Streaming Output: on
  • Support Plugins: on
  • Support Image Input: on
  • Support Thinking: on
  • Support PDF Input: off
  • Support External Image URLs: off
  • Support Prompt Caching: off

Click Test & Save. If your browser asks to let www.typingmind.com access other apps and services on this device, click Allow. This lets the page reach LM Studio at localhost.

V

Chat with Qwen3.5 in TypingMind

Pick Qwen3.5 (LM Studio) in the model menu under the chat box and say hi. The first reply can take longer while LM Studio loads the model into memory. After that, replies come straight from your own computer.

Chatting with Qwen3.5 running locally on LM Studio in TypingMindQwen3.5 (LM Studio)
A private chat with Qwen3.5 on your own computer

See how Qwen3.5 thinks

Qwen3.5 reasons before it answers. TypingMind shows this as Thought for … above the reply. Click it to read the full reasoning.

Use plugins with Qwen3.5

Qwen3.5 supports tool calling, so it can use TypingMind plugins. Open the plugin menu next to the model picker and turn on the ones you want, like web search, image generation, or Mermaid diagrams. The model calls them when it needs them.

TypingMind plugin menu with plugins turned on for Qwen3.5Qwen3.5 (LM Studio)
Turn on plugins for Qwen3.5

Send images to Qwen3.5

Qwen3.5 can read images. Click the paperclip under the chat box, attach a photo or screenshot, and ask about it. The image stays on your computer.

You can now use your private AI with TypingMind's chat features: prompts, AI agents, projects, and switching between your local model and cloud models in the same chat.

Tips and troubleshooting

1. "Could not connect to the API (code: 1)"

TypingMind can't reach LM Studio. In the browser's Network tab this shows up as ERR_CONNECTION_REFUSED, which means the server isn't running, not a CORS problem. Check these in order:

  • The server is running: lms server status should say it is running on port 1234. If not, start it again:
lms server start --cors
  • The model is loaded: lms ps should list it. If it's empty, load the model again with lms load.
  • CORS is on. Without it, the browser blocks the request. Restart the server with --cors, or turn on Enable CORS in the app's Server Settings.
  • You clicked Allow when the browser asked about accessing apps on this device.
  • You're using TypingMind in the browser, not the Mac or Setapp app.

To check that LM Studio is answering, run:

curl http://localhost:1234/v1/models

2. Replies are slow because the model thinks first

Qwen3.5 is a thinking model, so it reasons before every answer, which can take tens of seconds on a laptop. TypingMind shows the reasoning as Thought for … above the reply. For faster replies, pick a smaller version of Qwen3.5, or a model without thinking from the self-hosted AI directory.

3. The first message of a new chat seems stuck

TypingMind writes a title for each new chat. If the title is made by the same local model, your reply can wait behind the title. Go to Settings → Internal prompts, open Advanced Settings under Auto generate title for new chats, and pick another model for title generation, or turn auto titles off.

4. See what LM Studio is doing

Watch every request and reply as it happens:

lms log stream

5. Replies are very slow or LM Studio runs out of memory

The model is probably too big for your computer. Pick a smaller size from the size table, load it with a shorter context (for example -c 8192), or close other heavy apps. Free up memory with lms unload --all.

Frequently Asked Questions

Is Qwen3.5 free to run in LM Studio?

Yes. LM Studio is free, and Qwen3.5 is an open model you download once. Every message runs on your own computer, so there is no per-message cost and no API key to manage.

Is Qwen3.5 private when I run it in LM Studio?

Yes. Your messages go from your browser to LM Studio on your own computer, not to an AI company. TypingMind keeps your chat history in your browser. If you turn on Cloud Sync, your chats are also backed up to TypingMind's cloud.

How much RAM do I need for Qwen3.5?

LM Studio says the smallest version needs at least 2 GB of RAM. The smallest download, qwen/qwen3.5-2b, is 2.00 GB. The version used in this guide, qwen/qwen3.5-9b, runs comfortably with about 16 GB.

Which model ID do I use in TypingMind?

Use the ID LM Studio prints when you load the model, for example qwen/qwen3.5-9b. You can also see it with lms ps or at http://localhost:1234/v1/models.

Can Qwen3.5 use TypingMind plugins?

Yes. LM Studio lists tool use for Qwen3.5, so turn on Support Plugins and it can use plugins like web search. Small sizes may call tools less reliably than large ones.

Can Qwen3.5 read images?

Yes. Qwen3.5 accepts images, so turn on Support Image Input and attach images in the chat.

Does TypingMind run locally?

TypingMind runs in your browser at www.typingmind.com, and your chats are stored locally in your browser by default. When you chat with a self-hosted model, your messages go straight from your browser to the model on your own computer, not through TypingMind’s servers. If you turn on Cloud Sync, your chats are also backed up to TypingMind’s cloud.

Can I self-host TypingMind?

Yes. To self-host TypingMind for your team or company, use the self-hosted version of TypingMind Teams. You run it on your own servers next to your self-hosted models, so chats, users, and settings stay inside your own infrastructure. Contact our sales team to get started.

More models for LM Studio