Ollama Provider for the Vercel AI SDK

The Ollama Provider for the Vercel AI SDK contains language model support for the Ollama APIs and embedding model support for the Ollama embeddings API.

Requirements

This provider requires Ollama >= 0.5.0

Setup

The Ollama provider is available in the ollama-ai-provider module. You can install it with

1npm i ollama-ai-provider

Provider Instance

You can import the default provider instance ollama from ollama-ai-provider:

1import { ollama } from 'ollama-ai-provider';

Example

1import { ollama } from 'ollama-ai-provider';
2import { generateText } from 'ai';
3
4const { text } = await generateText({
5  model: ollama('phi3'),
6  prompt: 'Write a vegetarian lasagna recipe for 4 people.',
7});

Documentation

Please check out the Ollama provider documentation for more information.