Self-Hosted AI
Run private AI models on your own computer and chat with them in TypingMind. Browse 284 open models, see how much RAM each one needs, and open any model for a step-by-step guide. Your prompts stay on your machine.

Exaone-Deep via Ollama
3 sizes from 1.6 GB
EXAONE Deep exhibits superior capabilities in various reasoning tasks including math and coding benchmarks, ranging from 2.4B to 32B parameters developed and released by LG AI Research.

QwQ via Ollama
Alibaba · 20 GB
QwQ is the reasoning model of the Qwen series.

Command-A via Ollama
Cohere · 67 GB
111 billion parameter model optimized for demanding enterprises that require fast, secure, and high-quality AI

Command-R7B-Arabic via Ollama
Cohere · 5.1 GB
A new state-of-the-art version of the lightweight Command R7B model that excels in advanced Arabic language capabilities for enterprises in the Middle East and Northern Africa.

Phi4-Mini via Ollama
Microsoft · 2.5 GB
Phi-4-mini brings significant enhancements in multilingual support, reasoning, and mathematics, and now, the long-awaited function calling feature is finally supported.

Granite3.2-Vision via Ollama
IBM · 2.4 GB
A compact and efficient vision-language model, specifically designed for visual document understanding, enabling automated content extraction from tables, charts, infographics, plots, diagrams, and more.

Granite3.2 via Ollama
IBM · 2 sizes from 1.5 GB
Granite-3.2 is a family of long-context AI models from IBM Granite fine-tuned for thinking capabilities.

R1-1776 via Ollama
2 sizes from 43 GB
A version of the DeepSeek-R1 model that has been post trained to provide unbiased, accurate, and factual information by Perplexity.

Deepscaler via Ollama
3.6 GB
A fine-tuned version of Deepseek-R1-Distilled-Qwen-1.5B that surpasses the performance of OpenAI’s o1-preview with just 1.5B parameters on popular math evaluations.

Mistral-Small via Ollama
Mistral AI · 2 sizes from 13 GB
Mistral Small 3 sets a new benchmark in the “small” Large Language Models category below 70B.

Granite3.1-Dense via Ollama
IBM · 2 sizes from 1.6 GB
The IBM Granite 2B and 8B models are text-only dense LLMs trained on over 12 trillion tokens of data, demonstrated significant improvements over their predecessors in performance and speed in IBM’s initial testing.

Granite3.1-MoE via Ollama
IBM · 2 sizes from 1.4 GB
The IBM Granite 1B and 3B models are long-context mixture of experts (MoE) Granite models from IBM designed for low latency usage.

Command-R7B via Ollama
Cohere · 5.1 GB
The smallest model in Cohere's R series delivers top-tier speed, efficiency, and quality to build powerful AI applications on commodity GPUs and edge devices.

DeepSeek-V3 via Ollama
DeepSeek · 404 GB
A strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token.

OLMo2 via Ollama
Ai2 · 2 sizes from 4.5 GB
OLMo 2 is a new family of 7B and 13B models trained on up to 5T tokens. These models are on par with or better than equivalently sized fully open models, and competitive with open-weight models such as Llama 3.1 on English academic benchmarks.

Phi4 via Ollama
Microsoft · 9.1 GB
Phi-4 is a 14B parameter, state-of-the-art open model from Microsoft.

Dolphin3 via Ollama
4.9 GB
Dolphin 3.0 Llama 3.1 8B 🐬 is the next generation of the Dolphin series of instruct-tuned models designed to be the ultimate general purpose local model, enabling coding, math, agentic, function calling, and general use cases.

Smallthinker via Ollama
3.6 GB
A new small reasoning model fine-tuned from the Qwen 2.5 3B Instruct model.

Tulu3 via Ollama
2 sizes from 4.9 GB
Tülu 3 is a leading instruction following model family, offering fully open-source data, code, and recipes by the The Allen Institute for AI.

Mixtral via Ollama
Mistral AI · 2 sizes from 26 GB
A set of Mixture of Experts (MoE) model with open weights by Mistral AI in 8x7b and 8x22b parameter sizes.

Dolphin-Mixtral via Ollama
2 sizes from 26 GB
Uncensored, 8x7b and 8x22b fine-tuned models based on the Mixtral mixture of experts models that excels at coding tasks. Created by Eric Hartford.

Nous-Hermes2-Mixtral via Ollama
26 GB
The Nous Hermes 2 model from Nous Research, now trained over Mixtral.

Falcon3 via Ollama
4 sizes from 1.8 GB
A family of efficient AI models under 10B parameters performant in science, math, and coding through innovative training techniques.

Hermes3 via Ollama
4 sizes from 2 GB
Hermes 3 is the latest version of the flagship Hermes series of LLMs by Nous Research

Exaone3.5 via Ollama
3 sizes from 1.6 GB
EXAONE 3.5 is a collection of instruction-tuned bilingual (English and Korean) generative models ranging from 2.4B to 32B parameters, developed and released by LG AI Research.

Llama3.3 via Ollama
Meta · 43 GB
New state of the art 70B model. Llama 3.3 70B offers similar performance compared to the Llama 3.1 405B model.

Marco-O1 via Ollama
4.7 GB
An open large reasoning model for real-world solutions by the Alibaba International Digital Commerce Group (AIDC-AI).

Sailor2 via Ollama
3 sizes from 1.1 GB
Sailor2 are multilingual language models made for South-East Asia. Available in 1B, 8B, and 20B parameter sizes.

Llama3.1 via Ollama
Meta · 3 sizes from 4.9 GB
Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.

Mistral-Large via Ollama
Mistral AI · 73 GB
Mistral Large 2 is Mistral's new flagship model that is significantly more capable in code generation, mathematics, and reasoning with 128k context window and support for dozens of languages.
TypingMind for Teams
Bring your self-hosted AI models to your team
Running self-hosted AI on your own computer keeps your data private. To give your whole company the same private AI, run your models on a company server and connect them to TypingMind Teams. Everyone gets one AI workspace with your self-hosted models next to the cloud models you allow.
- Add your self-hosted models once for the whole team. Nobody has to install anything.
- Self-host TypingMind Teams in your own network, so chats never leave your infrastructure.
- Control who uses which model with SSO, roles, and user groups.
- Set usage limits and review every admin change in the audit log.

