Providers and Models

Companies such as OpenAI and Anthropic (providers) offer access to a range of large language models (LLMs) with differing strengths and capabilities through their own APIs.

Each provider typically has its own unique method for interfacing with their models, complicating the process of switching providers and increasing the risk of vendor lock-in.

To solve these challenges, Vercel AI SDK Core offers a standardized approach to interacting with LLMs through a language model specification that abstracts differences between providers. This unified interface allows you to switch between providers with ease while using the same API for all providers.

Here is an overview of the AI SDK Provider Architecture:

AI SDK Providers

Vercel AI SDK comes with several providers that you can use to interact with different language models:

• OpenAI Provider (@ai-sdk/openai)
• Azure OpenAI Provider (@ai-sdk/azure)
• Anthropic Provider (@ai-sdk/anthropic)
• Amazon Bedrock Provider (@ai-sdk/amazon-bedrock)
• Google Generative AI Provider (@ai-sdk/google)
• Google Vertex Provider (@ai-sdk/google-vertex)
• Mistral Provider (@ai-sdk/mistral)
• Cohere Provider (@ai-sdk/cohere)

You can also use the OpenAI provider with OpenAI-compatible APIs:

• Groq
• Perplexity
• Fireworks

Our language model specification is published as an open-source package, which you can use to create custom providers.

The open-source community has created the following providers:

• LLamaCpp Provider (nnance/llamacpp-ai-provider )
• Ollama Provider (sgomez/ollama-ai-provider)
• ChromeAI Provider (jeasonstudio/chrome-ai)

Model Capabilities

The AI providers support different language models with various capabilities. Here are the capabilities of popular models: