Self-Hosted AI
Run private AI models on your own computer and chat with them in TypingMind. Browse 284 open models, see how much RAM each one needs, and open any model for a step-by-step guide. Your prompts stay on your machine.

Granite3-Guardian via Ollama
IBM · 2 sizes from 2.7 GB
The IBM Granite Guardian 3.0 2B and 8B models are designed to detect risks in prompts and/or responses.

Granite3-Dense via Ollama
IBM · 2 sizes from 1.6 GB
The IBM Granite 2B and 8B models are designed to support tool-based use cases and support for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.

Granite3-MoE via Ollama
IBM · 2 sizes from 822 MB
The IBM Granite 1B and 3B models are the first mixture of experts (MoE) Granite models from IBM designed for low latency usage.

Opencoder via Ollama
2 sizes from 1.4 GB
OpenCoder is an open and reproducible code LLM family which includes 1.5B and 8B models, supporting chat in English and Chinese languages.

MiniCPM-V via Ollama
5.5 GB
A series of multimodal LLMs (MLLMs) designed for vision-language understanding.

Athene-V2 via Ollama
47 GB
Athene-V2 is a 72B parameter model which excels at code completion, mathematics, and log extraction tasks.

SmolLM2 via Ollama
3 sizes from 271 MB
SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters.

Aya-Expanse via Ollama
Cohere · 2 sizes from 5.1 GB
Cohere For AI's language models trained to perform well across 23 different languages.

Nemotron via Ollama
NVIDIA · 43 GB
Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.

Shieldgemma via Ollama
3 sizes from 1.7 GB
ShieldGemma is set of instruction tuned models for evaluating the safety of text prompt input and text output responses against a set of defined safety policies.

Llama-Guard3 via Ollama
Meta · 2 sizes from 1.6 GB
Llama Guard 3 is a series of models fine-tuned for content safety classification of LLM inputs and responses.

Llama3.2 via Ollama
Meta · 2 sizes from 1.3 GB
Meta's Llama 3.2 goes small with 1B and 3B models.

Qwen2.5 via Ollama
Alibaba · 7 sizes from 398 MB
Qwen2.5 models are pretrained on Alibaba's latest large-scale dataset, encompassing up to 18 trillion tokens. The model supports up to 128K tokens and has multilingual support.

Solar-Pro via Ollama
13 GB
Solar Pro Preview: an advanced large language model (LLM) with 22 billion parameters designed to fit into a single GPU

Nemotron-Mini via Ollama
NVIDIA · 2.7 GB
A commercial-friendly small language model by NVIDIA optimized for roleplay, RAG QA, and function calling.

Bespoke-Minicheck via Ollama
4.7 GB
A state-of-the-art fact-checking model developed by Bespoke Labs.

DeepSeek-V2.5 via Ollama
DeepSeek · 133 GB
An upgraded version of DeekSeek-V2 that integrates the general and coding abilities of both DeepSeek-V2-Chat and DeepSeek-Coder-V2-Instruct.

Reader-Lm via Ollama
2 sizes from 352 MB
A series of models that convert HTML content to Markdown content, which is useful for content conversion tasks.

Yi-Coder via Ollama
2 sizes from 866 MB
Yi-Coder is a series of open-source code language models that delivers state-of-the-art coding performance with fewer than 10 billion parameters.

Qwen2 via Ollama
Alibaba · 4 sizes from 352 MB
Qwen2 is a new series of large language models from Alibaba group

Reflection via Ollama
40 GB
A high-performing model trained with a new technique called Reflection-tuning that teaches a LLM to detect mistakes in its reasoning and correct course.

StarCoder2 via Ollama
3 sizes from 1.7 GB
StarCoder2 is the next generation of transparently trained open code LLMs that comes in three sizes: 3B, 7B and 15B parameters.

DeepSeek-Coder-V2 via Ollama
DeepSeek · 2 sizes from 8.9 GB
An open-source Mixture-of-Experts code language model that achieves performance comparable to GPT4-Turbo in code-specific tasks.

Phi3.5 via Ollama
Microsoft · 2.2 GB
A lightweight AI model with 3.8 billion parameters with performance overtaking similarly and larger sized models.

Codestral via Ollama
Mistral AI · 13 GB
Codestral is Mistral AI’s first-ever code model designed for code generation tasks.

Granite-Code via Ollama
IBM · 4 sizes from 2 GB
A family of open foundation models by IBM for Code Intelligence

Command-R-Plus via Ollama
Cohere · 59 GB
Command R+ is a powerful, scalable large language model purpose-built to excel at real-world enterprise use cases.

Command-R via Ollama
Cohere · 19 GB
Command R is a Large Language Model optimized for conversational interaction and long context tasks.

Qwen2-Math via Ollama
Alibaba · 3 sizes from 935 MB
Qwen2 Math is a series of specialized math language models built upon the Qwen2 LLMs, which significantly outperforms the mathematical capabilities of open-source models and even closed-source models (e.g., GPT4o).

SmolLM via Ollama
3 sizes from 92 MB
🪐 A family of small models with 135M, 360M, and 1.7B parameters, trained on a new high-quality dataset.
TypingMind for Teams
Bring your self-hosted AI models to your team
Running self-hosted AI on your own computer keeps your data private. To give your whole company the same private AI, run your models on a company server and connect them to TypingMind Teams. Everyone gets one AI workspace with your self-hosted models next to the cloud models you allow.
- Add your self-hosted models once for the whole team. Nobody has to install anything.
- Self-host TypingMind Teams in your own network, so chats never leave your infrastructure.
- Control who uses which model with SSO, roles, and user groups.
- Set usage limits and review every admin change in the audit log.

