How to use Llama 3.3 70B Turbo with your DeepInfra API key on TypingMind

Learn how to access and use Llama 3.3 70B Turbo with your DeepInfra API key through TypingMind. Get started with this AI model in minutes.

Compact Llama instruction model for fast chat and local deployment

DeepInfra is a cloud inference platform providing fast and cost-effective access to a wide range of open-source AI models including Llama, Mistral, DeepSeek, and more through an OpenAI-compatible API.

Key features include serverless inference with pay-per-token pricing, support for text generation, embeddings, and image models, low-latency responses powered by optimized GPU infrastructure, and easy integration with any OpenAI-compatible client or SDK.

See the official DeepInfra documentation for more details.

Llama 3.3 70B Turbo Overview

Model NameLlama 3.3 70B Turbo
ProviderDeepInfra
Model IDmeta-llama/Llama-3.3-70B-Instruct-Turbo
Model LogoGet the logo URL
Release DateDec 6, 2024
Last UpdatedDec 6, 2024
Context Window131,072 tokens
Max Output16,384 tokens
Pricing /1M tokens$0.10 input
$0.32 output
Input Modalitiestext
Output Modalitiestext
Capabilities
Tool CallingStructured OutputOpen Weights

Complete Setup Guide

I

Get Your DeepInfra API Key

First, you'll need to obtain an API key from DeepInfra. This key allows you to access their AI models directly and pay only for what you use.

  1. Visit DeepInfra's API console
  2. Sign up or log in to your account
  3. Navigate to the API keys section
  4. Generate a new API key (copy it immediately as some providers only show it once)
  5. Save your API key in a secure password manager or encrypted note

Sometimes, this provider will require you to add a payment method to your account before you can use your API key to chat with AI. So, to avoid any hiccups, make sure you've got a payment method set up and ready to go!

Important: Keep your API key secure and never share it publicly. Store it safely as you'll need it to connect with TypingMind.

II

Configure TypingMind with DeepInfra API Key

Option 1: Use the built-in Deepinfra provider (recommended)

The quickest way. TypingMind already has Deepinfra set up, so you only need to add your API key.

  1. Open TypingMind and click "Models" in the left sidebar.
  2. Search for Deepinfra.
  3. Click the settings (gear) button next to Deepinfra.
  4. Paste your API key and save.
Built-in providers with settings buttons on the TypingMind Models page

Option 2: Add the model manually

If you can't find the provider or model ID in the official list, you can add the model manually:

  1. Open the Models page

    Open TypingMind, click "Models" in the left sidebar, then click "Add custom model" in the top right corner.

    TypingMind Models page with the Add custom model button
  2. Enter the model details

    Keep "Create Manually" selected and fill in the model details:

    Name: Llama 3.3 70B Turbo via DeepInfra (or your preferred name)
    Model ID: meta-llama/Llama-3.3-70B-Instruct-Turbo for example (check DeepInfra model list)
    Context Length: Enter the model's context window (e.g., 131072 for meta-llama/Llama-3.3-70B-Instruct-Turbo)
    Add Custom Model dialog in TypingMind filled in for meta-llama/Llama-3.3-70B-Instruct-Turbo
  3. Set up authentication

    In the "Authentication" tab, set the connection details:

    API Type: OpenAI Chat Completions API
    Endpoint URL: https://api.deepinfra.com/v1/chat/completions
    Authentication Type: API Key via HTTP Header
    Header Key: Authorization
    Header Value: Bearer <DEEPINFRA_API_KEY>
    DeepInfra authentication settings in TypingMind
  4. Add pricing (optional)

    Open the "Pricing" tab and enter the model's input, output, and cache prices per 1M tokens so TypingMind can estimate your usage costs.

    Pricing settings in TypingMind for meta-llama/Llama-3.3-70B-Instruct-Turbo
  5. Check the capabilities

    In the "Capabilities" tab, keep "Auto check capabilities on save" on so TypingMind detects supported features like plugins, image input, and thinking, or enable them manually.

    Custom model capabilities settings in TypingMind
  6. Test and save

    Click "Test & Save" to verify the connection and add the model.

III

Start chatting with Llama 3.3 70B Turbo

Now you can start chatting with Llama 3.3 70B Turbo through TypingMind:

  • Select Llama 3.3 70B Turbo from the model dropdown menu
  • Start typing your message in the chat input
  • Enjoy faster responses and better features than the official interface
  • Switch between different AI models as needed
Chat with Llama 3.3 70B Turbo from DeepInfra on TypingMind

💡 Pro tips for better results:

TypingMindDeepInfra

Why TypingMind + DeepInfra?

Chat with Llama 3.3 70B Turbo and 200+ other models in one workspace, using your own DeepInfra API key.

Best-in-class UI

TypingMind's interface is far superior to standard chat UIs.

Model flexibility

Switch between Llama 3.3 70B Turbo and 200+ models instantly.

Cost control

Pay only for what you use through DeepInfra.

One-time purchase

Buy TypingMind once, use forever with any DeepInfra model.

Data privacy

Your conversations are stored locally by default, not on external servers.

Plugins, MCP, Skills & AI agents

Extend Llama 3.3 70B Turbo with web search, image generation, and custom AI agents.

Try TypingMind for free

Frequently Asked Questions

Do I need a subscription to use Llama 3.3 70B Turbo?

No. With your own DeepInfra API key, you pay only for what you use, with no monthly subscription. TypingMind is also a one-time purchase, not a subscription.

How much does it cost to use Llama 3.3 70B Turbo?

Llama 3.3 70B Turbo costs $0.10/1M input tokens and $0.32/1M output tokens via DeepInfra. A typical conversation costs around $0.01-0.10, depending on length.

Can I use other models besides Llama 3.3 70B Turbo?

Yes. Any model your DeepInfra API key can access works in TypingMind, and you can switch between it and models from other providers in the same chat.

Is my data private when using Llama 3.3 70B Turbo with TypingMind?

TypingMind stores your conversations locally (in your browser on the web version, on your device in the desktop app). Your messages are sent to DeepInfra with your API key, so check DeepInfra's data policy for how it handles API requests.

More models from DeepInfra