About Fireworks AI

Fireworks.ai is a high-performance generative AI platform that provides the fastest inference for open-source LLMs and multimodal models through a developer-friendly API.

The platform features a proprietary FireAttention engine delivering 50% faster speed and 250% higher throughput than standard engines, with support for popular models like LLaMA, Mixtral, DeepSeek, and Falcon. Key capabilities include serverless inference, advanced fine-tuning (LoRA, RLHF), function calling, batch processing, on-demand GPU access (NVIDIA H100/H200, AMD MI300X), and OpenAI-compatible APIs.

Step by step guide to use Fireworks-AI API Key to chat with AI

1. Get Your Fireworks-AI API Key

First, you'll need to obtain an API key from Fireworks-AI. This key allows you to access their AI models directly and pay only for what you use.

  1. Visit Fireworks-AI's API console
  2. Sign up or log in to your account
  3. Navigate to the API keys section
  4. Generate a new API key (copy it immediately as some providers only show it once)
  5. Save your API key in a secure password manager or encrypted note
Sometimes, this provider will require you to add a payment method to your account before you can use your API key to chat with AI. So, to avoid any hiccups, make sure you’ve got a payment method set up and ready to go!
Important: Keep your API key secure and never share it publicly. Store it safely as you'll need it to connect with TypingMind.

2. Connect Your Fireworks-AI API Key on TypingMind

Once you have your Fireworks-AI API key, connecting it to TypingMind to chat with AI is straightforward:

  1. Open TypingMind in your browser
  2. Click the "Settings" icon (gear symbol)
  3. Navigate to "Models" section
  4. Click "Add Custom Model"
  5. Fill in the model information:
    Name: accounts/fireworks/models/gpt-oss-120b via Fireworks-AI (or your preferred name)
    Endpoint: https://api.fireworks.ai/inference/v1/chat/completions
    Model ID: accounts/fireworks/models/gpt-oss-120b for example (check Fireworks-AI model list)
    Context Length: Enter the model's context window (e.g., 32000 for accounts/fireworks/models/gpt-oss-120b)
    Fireworks-AI Endpoint URL input fieldaccounts/fireworks/models/gpt-oss-120bhttps://api.fireworks.ai/inference/v1/chat/completionsaccounts/fireworks/models/gpt-oss-120b via Fireworks-AIhttps://www.typingmind.com/model-logo.webp32000
  6. Add custom headers by clicking "Add Custom Headers" in the Advanced Settings section:
    Authorization: Bearer <API_KEY>:
    X-Title: typingmind.com
    HTTP-Referer: https://www.typingmind.com
  7. Enable "Support Plugins (via OpenAI Functions)" if the model supports the "functions" or "tool_calls" parameter, or enable "Support OpenAI Vision" if the model supports vision.
  8. Click "Test" to verify the configuration
  9. If you see "Nice, the endpoint is working!", click "Add Model"

3. Start Chatting with Fireworks-AI models

Now you can start chatting with Fireworks AI models through TypingMind:

  • Select your preferred Fireworks-AI model from the model dropdown menu
  • Start typing your message in the chat input
  • Enjoy faster responses and better features than the official interface
  • Switch between different AI models as needed
The best frontend AI chat for Fireworks AI API KeyThe best frontend AI chat for Fireworks AI API Keyaccounts/fireworks/models/gpt-oss-120bThe best frontend AI chat for Fireworks AI API Key
Pro tips for better results:

4. Monitor Your AI Usage and Costs

One of the biggest advantages of using API keys with TypingMind is cost transparency and control. Unlike fixed subscriptions, you pay only for what you actually use. Visit https://app.fireworks.ai/account/billing to monitor your Fireworks-AI API usage and set spending limits.

💡 Cost-saving tips:
  • Use less expensive models for simple tasks
  • Keep prompts concise but specific to reduce token usage
  • Use TypingMind's prompt caching to reduce repeat costs (How to enable prompt caching)
  • Using RAG (retrieval-augmented generation) for large documents to reduce repeat costs (How to use RAG)