Providers and Models

Mastra supports a variety of language models from different providers. There are four types of providers we support:

• Most popular providers. OpenAI, Anthropic, Google Gemini. These are the most popular models and are highly recommended for most use cases. We will reference them and use them in docs and examples.
• Other natively supported providers. Mastra is built on AI SDK and supports a number of AI SDK supported models out of the box. We will always try to use these models in docs and examples.
• Community supported providers. A number of other providers have built AI SDK integrations (via creating an AI SDK provider).
• Custom providers through Portkey. If a provider does not have an AI SDK integration, you can use them through Portkey (an open-source AI gateway).

Most popular providers

Other natively supported providers

Community supported providers

You can see a list of Vercel’s community supported providers here. You can also write your own provider if desired.

Example: Custom Provider - Ollama

Here is an example of using a custom provider, Ollama, to create a model instance.

npm install ollama-ai-provider

pnpm add ollama-ai-provider

yarn add ollama-ai-provider

bun add ollama-ai-provider

Import and configure the Ollama model by using createOllama from the ollama-ai-provider package.

import { createOllama } from "ollama-ai-provider";
 
const ollama = createOllama({
  // optional settings, e.g.
  baseURL: "https://api.ollama.com",
});

After creating the instance, you can use it like any other model in Mastra.

import { Mastra, type ModelConfig } from "@mastra/core";
import { createOllama } from "ollama-ai-provider";
 
const ollama = createOllama({
  // optional settings, e.g.
  baseURL: "https://api.ollama.com",
});
 
const modelConfig: ModelConfig = {
  model: ollama.chat("gemma"), // The model instance created by the Ollama provider
  apiKey: process.env.OLLAMA_API_KEY,
  provider: "Ollama",
  toolChoice: "auto", // Controls how the model handles tool/function calling
};
 
const mastra = new Mastra({});
 
const llm = mastra.llm;
 
const response = await llm.generate(
  [
    {
      role: "user",
      content: "What is machine learning?",
    },
  ],
  { model: modelConfig },
);

Portkey supported providers

Portkey is an open-source AI gateway with support for 200+ providers, so if the provider you want isn’t available through AI SDK, it probably is through Portkey.

You can refer to the Portkey documentation for more details on how to implement custom models.