TypingMind×
Nemotron 3How to run Nemotron 3 locally with LM Studio as private, self-hosted AI
Run Nemotron 3 from NVIDIA as your own private, self-hosted AI. LM Studio runs the model on your computer, and TypingMind gives you a full chat app on top of it. Your prompts stay on your machine, and there is no per-message cost.
About Nemotron 3: General purpose reasoning and chat model trained from scratch by NVIDIA. Contains 30B total parameters with only 3.5B active at a time for low-latency MoE inference
Nemotron 3 Overview
| Model | Nemotron 3 |
| Made by | NVIDIA |
| Runs on | LM Studio |
| Versions | nemotron-3-nano |
| Download size | 24.6 GB |
| Minimum RAM | 25 GB |
| Capabilities | Tool callingThinking |
| Formats | GGUF, MLX |
| License | The Nemotron 3 model is provided under the nvidia-open-model-license |
| LM Studio command | lms get nvidia/nemotron-3-nano |
| Downloads on LM Studio | 137.5K |
| Model icon | Get the icon for TypingMind |
Which version of Nemotron 3 should you pick?
Each version is a different size of Nemotron 3. Bigger versions give better answers but need more memory. Pick the biggest one that fits your computer's RAM. On a Mac, memory is shared with the graphics chip, so leave some room for other apps.
| Model ID | Download | Suggested RAM |
|---|---|---|
nvidia/nemotron-3-nanoused in this guide | 24.62 GB | 48 GB |
Suggested RAM is a rough guide: the download size plus about 2 GB, with room for your system. Longer context windows use more.
Run Nemotron 3 with LM Studio
The steps below use nvidia/nemotron-3-nano, a version that fits most laptops. Swap in another model ID from the table if you want a smaller or bigger one.
Install LM Studio
LM Studio is a free desktop app that runs AI models on your own computer. It downloads Nemotron 3, loads it into memory, and answers requests on your machine through a local server.
- Download LM Studio for macOS, Windows, or Linux from lmstudio.ai/download and open it.
- On first launch, LM Studio offers to download a starter model. You can let it, or skip and download Nemotron 3 in the next step.
nvidia / nemotron-3-nanoNemotron 3. Supports reasoning and tool calling.0 MB / 24.62 GBLM Studio also comes with a terminal tool called lms. On macOS and Linux, run this once so you can type lms in the Terminal app (use ~/.bashrc instead of ~/.zshrc if you use bash):
echo 'export PATH="$PATH:$HOME/.lmstudio/bin"' >> ~/.zshrc && source ~/.zshrcOn Windows, add %USERPROFILE%\.lmstudio\bin to your PATH, or do the next steps in the LM Studio app instead.
Download Nemotron 3 with LM Studio
In the Terminal app, run:
lms get nvidia/nemotron-3-nanoThis downloads nvidia/nemotron-3-nano (24.62 GB). LM Studio picks the right format for your computer: MLX on Apple Silicon Macs, GGUF everywhere else. When you see Download completed, the model is ready.
Prefer clicking? Open Model Search in the LM Studio sidebar, search for nemotron-3-nano, and click Download. Run lms ls to see every model you have downloaded.
Start the LM Studio server for TypingMind
TypingMind talks to LM Studio through its local server. Load the model with a 32,768-token context window, then start the server with CORS turned on, so the TypingMind web app is allowed to connect:
lms load nemotron-3-nano -c 32768lms server start --corsYou should see Server is now running on port 1234. The load command also prints the model ID to use in TypingMind.
In the app instead: go to Developer → Local Server, open Server Settings, turn on Enable CORS, switch the status to Running, and click Load Model.
lms server stop when you're done. Keep LM Studio open while you chat: if you quit it, the server stops too.Add Nemotron 3 to TypingMind
Open www.typingmind.com in your browser. Use the web version: the TypingMind Mac app and the Setapp version block plain http:// addresses like LM Studio's.
Click Models in the left sidebar, then Add custom model.
Fill in the form:
| Name | Nemotron 3 (LM Studio)or any name you like |
| Model ID | nvidia/nemotron-3-nano |
| Context Length | 32768match the -c value you loaded with |
| API Type | OpenAI Chat Completions API |
| Endpoint URL | http://localhost:1234/v1/chat/completions |
| Authentication Type | No authentication |
Nemotron 3 (LM Studio)nvidia/nemotron-3-nano32768http://localhost:1234/v1/chat/completionsOpen the Capabilities tab and turn off Auto check capabilities on save. The check sends several test requests, and a local model answers them one at a time, so it can take minutes.
Then set the features for Nemotron 3:
- Support System Role: on
- Support Streaming Output: on
- Support Plugins: on
- Support Thinking: on
- Support Image Input: off
- Support PDF Input: off
- Support External Image URLs: off
- Support Prompt Caching: off
Click Test & Save. If your browser asks to let www.typingmind.com access other apps and services on this device, click Allow. This lets the page reach LM Studio at localhost.
Chat with Nemotron 3 in TypingMind
Pick Nemotron 3 (LM Studio) in the model menu under the chat box and say hi. The first reply can take longer while LM Studio loads the model into memory. After that, replies come straight from your own computer.
Nemotron 3 (LM Studio)See how Nemotron 3 thinks
Nemotron 3 reasons before it answers. TypingMind shows this as Thought for … above the reply. Click it to read the full reasoning.
Use plugins with Nemotron 3
Nemotron 3 supports tool calling, so it can use TypingMind plugins. Open the plugin menu next to the model picker and turn on the ones you want, like web search, image generation, or Mermaid diagrams. The model calls them when it needs them.
Nemotron 3 (LM Studio)You can now use your private AI with TypingMind's chat features: prompts, AI agents, projects, and switching between your local model and cloud models in the same chat.
Tips and troubleshooting
1. "Could not connect to the API (code: 1)"
TypingMind can't reach LM Studio. In the browser's Network tab this shows up as ERR_CONNECTION_REFUSED, which means the server isn't running, not a CORS problem. Check these in order:
- The server is running:
lms server statusshould say it is running on port 1234. If not, start it again:
lms server start --cors- The model is loaded:
lms psshould list it. If it's empty, load the model again withlms load. - CORS is on. Without it, the browser blocks the request. Restart the server with
--cors, or turn on Enable CORS in the app's Server Settings. - You clicked Allow when the browser asked about accessing apps on this device.
- You're using TypingMind in the browser, not the Mac or Setapp app.
To check that LM Studio is answering, run:
curl http://localhost:1234/v1/models2. Replies are slow because the model thinks first
Nemotron 3 is a thinking model, so it reasons before every answer, which can take tens of seconds on a laptop. TypingMind shows the reasoning as Thought for … above the reply. For faster replies, pick a smaller version of Nemotron 3, or a model without thinking from the self-hosted AI directory.
3. The first message of a new chat seems stuck
TypingMind writes a title for each new chat. If the title is made by the same local model, your reply can wait behind the title. Go to Settings → Internal prompts, open Advanced Settings under Auto generate title for new chats, and pick another model for title generation, or turn auto titles off.
4. See what LM Studio is doing
Watch every request and reply as it happens:
lms log stream5. Replies are very slow or LM Studio runs out of memory
The model is probably too big for your computer. Pick a smaller size from the size table, load it with a shorter context (for example -c 8192), or close other heavy apps. Free up memory with lms unload --all.
Frequently Asked Questions
Is Nemotron 3 free to run in LM Studio?
Yes. LM Studio is free, and Nemotron 3 is an open model you download once. Every message runs on your own computer, so there is no per-message cost and no API key to manage.
Is Nemotron 3 private when I run it in LM Studio?
Yes. Your messages go from your browser to LM Studio on your own computer, not to an AI company. TypingMind keeps your chat history in your browser. If you turn on Cloud Sync, your chats are also backed up to TypingMind's cloud.
How much RAM do I need for Nemotron 3?
LM Studio says the smallest version needs at least 25 GB of RAM. The smallest download, nvidia/nemotron-3-nano, is 24.62 GB. The version used in this guide, nvidia/nemotron-3-nano, runs comfortably with about 48 GB.
Which model ID do I use in TypingMind?
Use the ID LM Studio prints when you load the model, for example nvidia/nemotron-3-nano. You can also see it with lms ps or at http://localhost:1234/v1/models.
Can Nemotron 3 use TypingMind plugins?
Yes. LM Studio lists tool use for Nemotron 3, so turn on Support Plugins and it can use plugins like web search. Small sizes may call tools less reliably than large ones.
Can Nemotron 3 read images?
No. LM Studio doesn't list vision for Nemotron 3, so keep Support Image Input off.
Does TypingMind run locally?
TypingMind runs in your browser at www.typingmind.com, and your chats are stored locally in your browser by default. When you chat with a self-hosted model, your messages go straight from your browser to the model on your own computer, not through TypingMind’s servers. If you turn on Cloud Sync, your chats are also backed up to TypingMind’s cloud.
Can I self-host TypingMind?
Yes. To self-host TypingMind for your team or company, use the self-hosted version of TypingMind Teams. You run it on your own servers next to your self-hosted models, so chats, users, and settings stay inside your own infrastructure. Contact our sales team to get started.
