OpenAI compatible ProvidersFireworks
Fireworks Provider
Fireworks is a platform for running and testing LLMs. It offers an OpenAI compatible API that you can use with the AI SDK.
Setup
The Fireworks provider is available via the @ai-sdk/openai
module as it is compatible with the OpenAI API.
You can install it with
pnpm add @ai-sdk/openai
Provider Instance
To use Fireworks, you can create a custom provider instance with the createOpenAI
function from @ai-sdk/openai
:
import { createOpenAI } from '@ai-sdk/openai';
const fireworks = createOpenAI({ name: 'fireworks', apiKey: process.env.FIREWORKS_API_KEY ?? '', baseURL: 'https://api.fireworks.ai/inference/v1',});
Language Models
You can create Fireworks models using a provider instance.
The first argument is the model id, e.g. accounts/fireworks/models/firefunction-v1
.
const model = fireworks('accounts/fireworks/models/firefunction-v1');
Example
You can use Fireworks language models to generate text with the generateText
function:
import { createOpenAI } from '@ai-sdk/openai'import { generateText } from 'ai'
const fireworks = createOpenAI({ name: 'fireworks', apiKey: process.env.FIREWORKS_API_KEY ?? '', baseURL: 'https://api.fireworks.ai/inference/v1'})
const { text } = await generateText({ model: fireworks('accounts/fireworks/models/firefunction-v1') prompt: 'Write a vegetarian lasagna recipe for 4 people.'})
Fireworks language models can also be used in the streamText
, generateObject
, and streamObject
functions.