Unofficial Community Provider for AI SDK - Inflection AI
The unofficial Inflection AI provider for the AI SDK contains language model support for the Inflection AI API.
Setup
The Inflection AI provider is available in the inflection-ai-sdk-provider
module on npm. You can install it with
npm i inflection-ai-sdk-provider
Provider Instance
You can import the default provider instance inflection
from inflection-ai-sdk-provider
:
import { inflection } from 'inflection-ai-sdk-provider';
Example
import { inflection } from 'inflection-ai-sdk-provider';import { generateText } from 'ai';
const { text } = await generateText({ model: inflection('inflection_3_with_tools'), prompt: 'how can I make quick chicken pho?',});
Models
The following models are supported:
inflection_3_pi
- "the model powering our Pi experience, including a backstory, emotional intelligence, productivity, and safety. It excels in scenarios such as customer support chatbots."inflection_3_productivity
- "the model optimized for following instructions. It is better for tasks requiring JSON output or precise adherence to provided guidelines."inflection_3_with_tools
- This model seems to be in preview and it lacks an official description as of the writing of this README in 1.0.0.
Model | Text Generation | Streaming | Image Input | Object Generation | Tool Usage | Tool Streaming |
---|---|---|---|---|---|---|
inflection_3_pi | ✓ | ✓ | ✗ | ✗ | ✗ | ✗ |
inflection_3_productivity | ✓ | ✓ | ✗ | ✗ | ✗ | ✗ |
inflection_3_with_tools | ✓ | ✓ | ✗ | ✗ | ✗ | ✗ |
There is limited API support for features other than text generation and streaming text at this time. Should that change, the table above will be updated and support will be added to this unofficial provider.
Documentation
Please check out Inflection AI's API Documentation for more information.
You can find the source code for this provider here on GitHub.