Vercel AI SDK

The Vercel AI SDK is a library for building AI-powered streaming text and chat UIs.

Features

• SWR-powered React, Svelte, Vue and Solid helpers for streaming text responses and building chat and completion UIs
• First-class support for LangChain and OpenAI, Anthropic, Cohere and Hugging Face
• Node.js, Serverless, and Edge Runtime support
• Callbacks for saving completed streaming responses to a database (in the same request)

Installation

1pnpm install ai

View the full documentation and examples on sdk.vercel.ai/docs

Example: An AI Chatbot with Next.js and OpenAI

With the Vercel AI SDK, you can build a ChatGPT-like app in just a few lines of code:

1// ./app/api/chat/route.js
2import { Configuration, OpenAIApi } from 'openrouter-edge'
3import { OpenAIStream, StreamingTextResponse } from 'openrouter-ai'
4
5const config = new Configuration({
6  apiKey: process.env.OPENAI_API_KEY
7})
8const openai = new OpenAIApi(config)
9
10export const runtime = 'edge'
11
12export async function POST(req) {
13  const { messages } = await req.json()
14  const response = await openai.createChatCompletion({
15    model: 'gpt-4',
16    stream: true,
17    messages
18  })
19  const stream = OpenAIStream(response)
20  return new StreamingTextResponse(stream)
21}

1// ./app/page.js
2'use client'
3
4import { useChat } from 'openrouter-ai/react'
5
6export default function Chat() {
7  const { messages, input, handleInputChange, handleSubmit } = useChat()
8
9  return (
10    <div>
11      {messages.map(m => (
12        <div key={m.id}>
13          {m.role}: {m.content}
14        </div>
15      ))}
16
17      <form onSubmit={handleSubmit}>
18        <input
19          value={input}
20          placeholder="Say something..."
21          onChange={handleInputChange}
22        />
23      </form>
24    </div>
25  )
26}

---

View the full documentation and examples on sdk.vercel.ai/docs

Authors

This library is created by Vercel and Next.js team members, with contributions from:

• Jared Palmer (@jaredpalmer) - Vercel
• Shu Ding (@shuding_) - Vercel
• Max Leiter (@max_leiter) - Vercel
• Malte Ubl (@cramforce) - Vercel
• Justin Ridgewell (@jridgewell) - Vercel

Contributors