About Together AI

Together AI is an AI cloud for running open-source models. Its serverless inference API gives pay-per-token access to models like Llama, DeepSeek, Qwen, GLM, Kimi, MiniMax, and gpt-oss through an OpenAI-compatible endpoint.

Beyond serverless inference, Together AI offers dedicated endpoints, fine-tuning, batch inference, and GPU clusters for teams that need more control over performance and cost.

Step by step guide to use Together AI API Key to chat with AI

I. Get Your Together AI API Key

First, you'll need to obtain an API key from Together AI. This key allows you to access their AI models directly and pay only for what you use.

  1. Visit Together AI's API console
  2. Sign up or log in to your account
  3. Navigate to the API keys section
  4. Generate a new API key (copy it immediately as some providers only show it once)
  5. Save your API key in a secure password manager or encrypted note
Together AI API keys page

Sometimes, this provider will require you to add a payment method to your account before you can use your API key to chat with AI. So, to avoid any hiccups, make sure you've got a payment method set up and ready to go!

Important: Keep your API key secure and never share it publicly. Store it safely as you'll need it to connect with TypingMind.

II. Connect Your Together AI API Key on TypingMind

Once you have your Together AI API key, connecting it to TypingMind to chat with AI is straightforward:

  1. Open the Models page

    Open TypingMind, click "Models" in the left sidebar, then click "Add custom model" in the top right corner.

    TypingMind Models page with the Add custom model button

  2. Enter the model details

    Keep "Create Manually" selected and fill in the model details:

    Name: openai/gpt-oss-120b via Together AI (or your preferred name)
    Model ID: openai/gpt-oss-120b for example (check Together AI model list)
    Context Length: Enter the model's context window (e.g., 131072 for openai/gpt-oss-120b)
    Add Custom Model dialog in TypingMind filled in for openai/gpt-oss-120b

  3. Set up authentication

    In the "Authentication" tab, set the connection details:

    API Type: OpenAI Chat Completions API
    Endpoint URL: https://api.together.ai/v1/chat/completions
    Authentication Type: API Key via HTTP Header
    Header Key: Authorization
    Header Value: Bearer <TOGETHER_API_KEY>
    Together AI authentication settings in TypingMind

  4. Add pricing (optional)

    Open the "Pricing" tab and enter the model's input, output, and cache prices per 1M tokens so TypingMind can estimate your usage costs.

    Pricing settings in TypingMind for openai/gpt-oss-120b

  5. Check the capabilities

    In the "Capabilities" tab, keep "Auto check capabilities on save" on so TypingMind detects supported features like plugins, image input, and thinking, or enable them manually.

    Custom model capabilities settings in TypingMind

  6. Test and save

    Click "Test & Save" to verify the connection and add the model.

III. Start Chatting with Together AI models

Now you can start chatting with Together AI models through TypingMind:

  • Select Together AI models from the model dropdown menu
  • Start typing your message in the chat input
  • Enjoy faster responses and better features than the official interface
  • Switch between different AI models as needed
Chat with Together AI models on TypingMind

💡 Pro tips for better results:

IV. Monitor Your AI Usage and Costs

One of the biggest advantages of using API keys with TypingMind is cost transparency and control. Unlike fixed subscriptions, you pay only for what you actually use. Visit your Together AI usage dashboard to monitor your API usage and set spending limits.

💡 Cost-saving tips:
  • Use less expensive models for simple tasks
  • Keep prompts concise but specific to reduce token usage
  • Use TypingMind's prompt caching to reduce repeat costs (How to enable prompt caching)
  • Using RAG (retrieval-augmented generation) for large documents to reduce repeat costs (How to use RAG)
TypingMindTogether AI

Why TypingMind + Together AI?

Chat with Together AI models and 200+ other models in one workspace, using your own Together AI API key.

Best-in-class UI

TypingMind's interface is far superior to standard chat UIs.

Model flexibility

Switch between Together AI models and 200+ models instantly.

Cost control

Pay only for what you use through Together AI.

One-time purchase

Buy TypingMind once, use forever with any Together AI model.

Data privacy

Your conversations are stored locally by default, not on external servers.

Plugins, MCP, Skills & AI agents

Extend Together AI models with web search, image generation, and custom AI agents.

Try TypingMind for free

Frequently Asked Questions

Do I need a subscription to use Together AI with TypingMind?

No. With your own Together AI API key, you pay only for what you use, with no monthly subscription. TypingMind is also a one-time purchase, not a subscription.

How much does the Together AI API cost?

Together AI charges per token, and prices vary by model. For example, openai/gpt-oss-120b costs $0.15/1M input tokens and $0.6/1M output tokens. A typical conversation costs around $0.01-0.10, depending on the model and length.

Which Together AI models can I use in TypingMind?

Any model your Together AI API key can access. You can switch between Together AI models and models from other providers in the same TypingMind chat.

Is my data private when using Together AI with TypingMind?

TypingMind stores your conversations locally (in your browser on the web version, on your device in the desktop app). Your messages are sent to Together AI with your API key, so check Together AI's data policy for how it handles API requests.