Skip to main content

Fireworks

caution

You are currently on a page documenting the use of Fireworks models as text completion models. Many popular models available on Fireworks are chat completion models.

You may be looking for this page instead.

Fireworks AI is an AI inference platform to run and customize models. For a list of all models served by Fireworks see the Fireworks docs.

This will help you get started with Fireworks completion models (LLMs) using LangChain. For detailed documentation on Fireworks features and configuration options, please refer to the API reference.

Overview​

Integration details​

ClassPackageLocalSerializablePY supportPackage downloadsPackage latest
Fireworks@langchain/community❌✅✅NPM - DownloadsNPM - Version

Setup​

To access Fireworks models you’ll need to create a Fireworks account, get an API key, and install the @langchain/community integration package.

Credentials​

Head to fireworks.ai to sign up to Fireworks and generate an API key. Once you’ve done this set the FIREWORKS_API_KEY environment variable:

export FIREWORKS_API_KEY="your-api-key"

If you want to get automated tracing of your model calls you can also set your LangSmith API key by uncommenting below:

# export LANGCHAIN_TRACING_V2="true"
# export LANGCHAIN_API_KEY="your-api-key"

Installation​

The LangChain Fireworks integration lives in the @langchain/community package:

tip

See this section for general instructions on installing integration packages.

yarn add @langchain/community

Instantiation​

Now we can instantiate our model object and generate chat completions:

import { Fireworks } from "@langchain/community/llms/fireworks";

const llm = new Fireworks({
  model: "accounts/fireworks/models/llama-v3-70b-instruct",
  temperature: 0,
  maxTokens: undefined,
  timeout: undefined,
  maxRetries: 2,
  // other params...
});

Invocation​

const inputText = "Fireworks is an AI company that ";

const completion = await llm.invoke(inputText);
completion;
 helps businesses automate their customer support using AI-powered chatbots. We believe that AI can help businesses provide better customer support at a lower cost. Our chatbots are designed to be highly customizable and can be integrated with various platforms such as Facebook Messenger, Slack, and more.

We are looking for a talented and motivated **Machine Learning Engineer** to join our team. As a Machine Learning Engineer at Fireworks, you will be responsible for developing and improving our AI models that power our chatbots. You will work closely with our data scientists, software engineers, and product managers to design, develop, and deploy AI models that can understand and respond to customer inquiries.

**Responsibilities:**

* Develop and improve AI models that can understand and respond to customer inquiries
* Work with data scientists to design and develop new AI models
* Collaborate with software engineers to integrate AI models with our chatbot platform
* Work with product managers to understand customer requirements and develop AI models that meet those requirements
* Develop and maintain data pipelines to support AI model development and deployment
* Develop and maintain tools to monitor and evaluate AI model performance
* Stay up-to-date with the latest developments in AI and machine learning and apply this knowledge to improve our AI models

**Requirements:**

* Bachelor's

Chaining​

We can chain our completion model with a prompt template like so:

import { PromptTemplate } from "@langchain/core/prompts";

const prompt = PromptTemplate.fromTemplate(
  "How to say {input} in {output_language}:\n"
);

const chain = prompt.pipe(llm);
await chain.invoke({
  output_language: "German",
  input: "I love programming.",
});
Ich liebe Programmieren.

How to say I love coding. in German:
Ich liebe Coden.

How to say I love to code. in German:
Ich liebe es zu coden.

How to say I'm a programmer. in German:
Ich bin ein Programmierer.

How to say I'm a coder. in German:
Ich bin ein Coder.

How to say I'm a developer. in German:
Ich bin ein Entwickler.

How to say I'm a software engineer. in German:
Ich bin ein Software-Ingenieur.

How to say I'm a tech enthusiast. in German:
Ich bin ein Technik-Enthusiast.

How to say I'm passionate about technology. in German:
Ich bin leidenschaftlich für Technologie.

How to say I'm passionate about coding. in German:
Ich bin leidenschaftlich für Coden.

How to say I'm passionate about programming. in German:
Ich bin leidenschaftlich für Programmieren.

How to say I enjoy coding. in German:
Ich genieße Coden.

How to say I enjoy programming. in German:
Ich genieße Programmieren.

How to say I'm good at coding. in German:
Ich bin gut im Coden.

How to say I'm

Behind the scenes, Fireworks AI uses the OpenAI SDK and OpenAI compatible API, with some caveats:

  • Certain properties are not supported by the Fireworks API, see here.
  • Generation using multiple prompts is not supported.

API reference​

For detailed documentation of all Fireworks features and configurations head to the API reference: https://api.js.langchain.com/classes/langchain_community_llms_fireworks.Fireworks.html

Was this page helpful?


You can also leave detailed feedback on GitHub.