Expo Quickstart
In this quick start tutorial, you'll build a simple AI-chatbot with a streaming user interface with Expo. Along the way, you'll learn key concepts and techniques that are fundamental to using the SDK in your own projects.
Check out Prompt Engineering and HTTP Streaming if you haven't heard of them.
Prerequisites
To follow this quickstart, you'll need:
- Node.js 18+ and pnpm installed on your local development machine.
- An OpenAI API key.
If you haven't obtained your OpenAI API key, you can do so by signing up on the OpenAI website.
Create Your Application
Start by creating a new Expo application. This command will create a new directory named my-ai-app
and set up a basic Expo application inside it.
pnpm create expo-app@latest my-ai-app
Navigate to the newly created directory:
cd my-ai-app
Install dependencies
Install ai
, @ai-sdk/react
and @ai-sdk/openai
, the AI package, the AI React package and AI SDK's OpenAI provider respectively.
The AI SDK is designed to be a unified interface to interact with any large language model. This means that you can change model and providers with just one line of code! Learn more about available providers and building custom providers in the providers section.
pnpm add ai @ai-sdk/openai @ai-sdk/react zod
Make sure you are using ai
version 3.1 or higher.
Configure OpenAI API key
Create a .env.local
file in your project root and add your OpenAI API Key. This key is used to authenticate your application with the OpenAI service.
touch .env.local
Edit the .env.local
file:
OPENAI_API_KEY=xxxxxxxxx
Replace xxxxxxxxx
with your actual OpenAI API key.
The AI SDK's OpenAI Provider will default to using the OPENAI_API_KEY
environment variable.
Create an API Route
Create a route handler, app/api/chat+api.ts
and add the following code:
import { openai } from '@ai-sdk/openai';import { streamText } from 'ai';
export async function POST(req: Request) { const { messages } = await req.json();
const result = streamText({ model: openai('gpt-4o'), messages, });
return result.toDataStreamResponse();}
Let's take a look at what is happening in this code:
- Define an asynchronous
POST
request handler and extractmessages
from the body of the request. Themessages
variable contains a history of the conversation between you and the chatbot and provides the chatbot with the necessary context to make the next generation. - Call
streamText
, which is imported from theai
package. This function accepts a configuration object that contains amodel
provider (imported from@ai-sdk/openai
) andmessages
(defined in step 1). You can pass additional settings to further customise the model's behaviour. - The
streamText
function returns aStreamTextResult
. This result object contains thetoDataStreamResponse
function which converts the result to a streamed response object. - Finally, return the result to the client to stream the response.
This API route creates a POST request endpoint at /api/chat
.
If you are experiencing issues with choppy/delayed streams on iOS, you can add
the Content-Type
: application/octet-stream
header to the response. For
more information, check out this GitHub
issue.
Wire up the UI
Now that you have an API route that can query an LLM, it's time to setup your frontend. The AI SDK's UI package abstracts the complexity of a chat interface into one hook, useChat
.
Update your root page (app/(tabs)/index.tsx
) with the following code to show a list of chat messages and provide a user message input:
import { generateAPIUrl } from '@/utils';import { useChat } from '@ai-sdk/react';import { fetch as expoFetch } from 'expo/fetch';import { View, TextInput, ScrollView, Text, SafeAreaView } from 'react-native';
export default function App() { const { messages, error, handleInputChange, input, handleSubmit } = useChat({ fetch: expoFetch as unknown as typeof globalThis.fetch, api: generateAPIUrl('/api/chat'), onError: error => console.error(error, 'ERROR'), });
if (error) return <Text>{error.message}</Text>;
return ( <SafeAreaView style={{ height: '100%' }}> <View style={{ height: '95%', display: 'flex', flexDirection: 'column', paddingHorizontal: 8, }} > <ScrollView style={{ flex: 1 }}> {messages.map(m => ( <View key={m.id} style={{ marginVertical: 8 }}> <View> <Text style={{ fontWeight: 700 }}>{m.role}</Text> <Text>{m.content}</Text> </View> </View> ))} </ScrollView>
<View style={{ marginTop: 8 }}> <TextInput style={{ backgroundColor: 'white', padding: 8 }} placeholder="Say something..." value={input} onChange={e => handleInputChange({ ...e, target: { ...e.target, value: e.nativeEvent.text, }, } as unknown as React.ChangeEvent<HTMLInputElement>) } onSubmitEditing={e => { handleSubmit(e); e.preventDefault(); }} autoFocus={true} /> </View> </View> </SafeAreaView> );}
This page utilizes the useChat
hook, which will, by default, use the POST
API route you created earlier (/api/chat
). The hook provides functions and state for handling user input and form submission. The useChat
hook provides multiple utility functions and state variables:
messages
- the current chat messages (an array of objects withid
,role
, andcontent
properties).input
- the current value of the user's input field.handleInputChange
andhandleSubmit
- functions to handle user interactions (typing into the input field and submitting the form, respectively).
You use the expo/fetch function instead of the native node fetch to enable streaming of chat responses. This requires Expo 52 or higher.
Create the API URL Generator
Because you're using expo/fetch for streaming responses instead of the native fetch function, you'll need an API URL generator to ensure you are using the correct base url and format depending on the client environment (e.g. web or mobile). Create a new file called utils.ts
in the root of your project and add the following code:
import Constants from 'expo-constants';
export const generateAPIUrl = (relativePath: string) => { const origin = Constants.experienceUrl.replace('exp://', 'http://');
const path = relativePath.startsWith('/') ? relativePath : `/${relativePath}`;
if (process.env.NODE_ENV === 'development') { return origin.concat(path); }
if (!process.env.EXPO_PUBLIC_API_BASE_URL) { throw new Error( 'EXPO_PUBLIC_API_BASE_URL environment variable is not defined', ); }
return process.env.EXPO_PUBLIC_API_BASE_URL.concat(path);};
This utility function handles URL generation for both development and production environments, ensuring your API calls work correctly across different devices and configurations.
Before deploying to production, you must set the EXPO_PUBLIC_API_BASE_URL
environment variable in your production environment. This variable should
point to the base URL of your API server.
Running Your Application
With that, you have built everything you need for your chatbot! To start your application, use the command:
pnpm expo
Head to your browser and open http://localhost:8081. You should see an input field. Test it out by entering a message and see the AI chatbot respond in real-time! The AI SDK makes it fast and easy to build AI chat interfaces with Expo.
Enhance Your Chatbot with Tools
While large language models (LLMs) have incredible generation capabilities, they struggle with discrete tasks (e.g. mathematics) and interacting with the outside world (e.g. getting the weather). This is where tools come in.
Tools are actions that an LLM can invoke. The results of these actions can be reported back to the LLM to be considered in the next response.
For example, if a user asks about the current weather, without tools, the model would only be able to provide general information based on its training data. But with a weather tool, it can fetch and provide up-to-date, location-specific weather information.
Let's enhance your chatbot by adding a simple weather tool.
Update Your API route
Modify your app/api/chat+api.ts
file to include the new weather tool:
import { openai } from '@ai-sdk/openai';import { streamText, tool } from 'ai';import { z } from 'zod';
export async function POST(req: Request) { const { messages } = await req.json();
const result = streamText({ model: openai('gpt-4o'), messages, tools: { weather: tool({ description: 'Get the weather in a location (fahrenheit)', parameters: z.object({ location: z.string().describe('The location to get the weather for'), }), execute: async ({ location }) => { const temperature = Math.round(Math.random() * (90 - 32) + 32); return { location, temperature, }; }, }), }, });
return result.toDataStreamResponse();}
In this updated code:
-
You import the
tool
function from theai
package andz
fromzod
for schema validation. -
You define a
tools
object with aweather
tool. This tool:- Has a description that helps the model understand when to use it.
- Defines parameters using a Zod schema, specifying that it requires a
location
string to execute this tool. The model will attempt to extract this parameter from the context of the conversation. If it can't, it will ask the user for the missing information. - Defines an
execute
function that simulates getting weather data (in this case, it returns a random temperature). This is an asynchronous function running on the server so you can fetch real data from an external API.
Now your chatbot can "fetch" weather information for any location the user asks about. When the model determines it needs to use the weather tool, it will generate a tool call with the necessary parameters. The
execute
function will then be automatically run, and you can access the results viatoolInvocations
that is available on the message object.
You may need to restart your development server for the changes to take effect.
Try asking something like "What's the weather in New York?" and see how the model uses the new tool.
Notice the blank response in the UI? This is because instead of generating a text response, the model generated a tool call. You can access the tool call and subsequent tool result in the toolInvocations
key of the message object.
Update the UI
To display the tool invocations in your UI, update your app/(tabs)/index.tsx
file:
import { generateAPIUrl } from '@/utils';import { useChat } from '@ai-sdk/react';import { fetch as expoFetch } from 'expo/fetch';import { View, TextInput, ScrollView, Text, SafeAreaView } from 'react-native';
export default function App() { const { messages, error, handleInputChange, input, handleSubmit } = useChat({ fetch: expoFetch as unknown as typeof globalThis.fetch, api: generateAPIUrl('/api/chat'), onError: error => console.error(error, 'ERROR'), });
if (error) return <Text>{error.message}</Text>;
return ( <SafeAreaView style={{ height: '100vh' }}> <View style={{ height: '95%', display: 'flex', flexDirection: 'column', paddingHorizontal: 8, }} > <ScrollView style={{ flex: 1 }}> {messages.map(m => ( <View key={m.id} style={{ marginVertical: 8 }}> <View> <Text style={{ fontWeight: 700 }}>{m.role}</Text> {m.toolInvocations ? ( <Text>{JSON.stringify(m.toolInvocations, null, 2)}</Text> ) : ( <Text>{m.content}</Text> )} </View> </View> ))} </ScrollView>
<View style={{ marginTop: 8 }}> <TextInput style={{ backgroundColor: 'white', padding: 8 }} placeholder="Say something..." value={input} onChange={e => handleInputChange({ ...e, target: { ...e.target, value: e.nativeEvent.text, }, } as unknown as React.ChangeEvent<HTMLInputElement>) } onSubmitEditing={e => { handleSubmit(e); e.preventDefault(); }} autoFocus={true} /> </View> </View> </SafeAreaView> );}
You may need to restart your development server for the changes to take effect.
With this change, you check each message for any tool calls (toolInvocations
). These tool calls will be displayed as stringified JSON. Otherwise, you show the message content as before.
Now, when you ask about the weather, you'll see the tool invocation and its result displayed in your chat interface.
Enabling Multi-Step Tool Calls
You may have noticed that while the tool results are visible in the chat interface, the model isn't using this information to answer your original query. This is because once the model generates a tool call, it has technically completed its generation.
To solve this, you can enable multi-step tool calls using the maxSteps
option in your useChat
hook. This feature will automatically send tool results back to the model to trigger an additional generation. In this case, you want the model to answer your question using the results from the weather tool.
Update Your Client-Side Code
Modify your app/(tabs)/index.tsx
file to include the maxSteps
option:
import { useChat } from '@ai-sdk/react';// ... rest of your imports
export default function App() { const { messages, error, handleInputChange, input, handleSubmit } = useChat({ fetch: expoFetch as unknown as typeof globalThis.fetch, api: generateAPIUrl('/api/chat'), onError: error => console.error(error, 'ERROR'), maxSteps: 5, });
// ... rest of your component code}
You may need to restart your development server for the changes to take effect.
Head back to the browser and ask about the weather in a location. You should now see the model using the weather tool results to answer your question.
By setting maxSteps
to 5, you're allowing the model to use up to 5 "steps" for any given generation. This enables more complex interactions and allows the model to gather and process information over several steps if needed. You can see this in action by adding another tool to convert the temperature from Fahrenheit to Celsius.
Update Your API Route
Update your app/api/chat+api.ts
file to add a new tool to convert the temperature from Fahrenheit to Celsius:
import { openai } from '@ai-sdk/openai';import { streamText, tool } from 'ai';import { z } from 'zod';
export async function POST(req: Request) { const { messages } = await req.json();
const result = streamText({ model: openai('gpt-4o'), messages, tools: { weather: tool({ description: 'Get the weather in a location (fahrenheit)', parameters: z.object({ location: z.string().describe('The location to get the weather for'), }), execute: async ({ location }) => { const temperature = Math.round(Math.random() * (90 - 32) + 32); return { location, temperature, }; }, }), convertFahrenheitToCelsius: tool({ description: 'Convert a temperature in fahrenheit to celsius', parameters: z.object({ temperature: z .number() .describe('The temperature in fahrenheit to convert'), }), execute: async ({ temperature }) => { const celsius = Math.round((temperature - 32) * (5 / 9)); return { celsius, }; }, }), }, });
return result.toDataStreamResponse();}
You may need to restart your development server for the changes to take effect.
Now, when you ask "What's the weather in New York in celsius?", you should see a more complete interaction:
- The model will call the weather tool for New York.
- You'll see the tool result displayed.
- It will then call the temperature conversion tool to convert the temperature from Fahrenheit to Celsius.
- The model will then use that information to provide a natural language response about the weather in New York.
This multi-step approach allows the model to gather information and use it to provide more accurate and contextual responses, making your chatbot considerably more useful.
This simple example demonstrates how tools can expand your model's capabilities. You can create more complex tools to integrate with real APIs, databases, or any other external systems, allowing the model to access and process real-world data in real-time. Tools bridge the gap between the model's knowledge cutoff and current information.
Where to Next?
You've built an AI chatbot using the AI SDK! From here, you have several paths to explore:
- To learn more about the AI SDK, read through the documentation.
- If you're interested in diving deeper with guides, check out the RAG (retrieval-augmented generation) and multi-modal chatbot guides.
- To jumpstart your first AI project, explore available templates.