You can use the AI SDK in a Nest.js server to generate and stream text and objects to the client.
The examples show how to implement a Nest.js controller that uses the AI SDK to stream text and objects to the client.
Full example: github.com/vercel/ai/examples/nest
You can use the pipeDataStreamToResponse
method to get a data stream from the result and then pipe it to the response.
import { Controller, Post, Res } from '@nestjs/common';import { openai } from '@ai-sdk/openai';import { streamText } from 'ai';import { Response } from 'express';
@Controller()export class AppController { @Post() async example(@Res() res: Response) { const result = streamText({ model: openai('gpt-4o'), prompt: 'Invent a new holiday and describe its traditions.', });
result.pipeDataStreamToResponse(res); }}
pipeDataStreamToResponse
can be used with StreamData
to send additional data to the client.
import { Controller, Post, Res } from '@nestjs/common';import { openai } from '@ai-sdk/openai';import { StreamData, streamText } from 'ai';import { Response } from 'express';
@Controller()export class AppController { @Post() async example(@Res() res: Response) { const data = new StreamData(); data.append('initialized call');
const result = streamText({ model: openai('gpt-4o'), prompt: 'Invent a new holiday and describe its traditions.', onFinish() { data.append('call completed'); data.close(); }, });
result.pipeDataStreamToResponse(res, { data }); }}
You can use the pipeTextStreamToResponse
method to get a text stream from the result and then pipe it to the response.
import { Controller, Post, Res } from '@nestjs/common';import { openai } from '@ai-sdk/openai';import { streamText } from 'ai';import { Response } from 'express';
@Controller()export class AppController { @Post() async example(@Res() res: Response) { const result = streamText({ model: openai('gpt-4o'), prompt: 'Invent a new holiday and describe its traditions.', });
result.pipeTextStreamToResponse(res); }}