Skip to main content

Cloudflare AI Gateway logoCloudflare AI Gateway

Access 71 Cloudflare AI Gateway models through Mastra's model router. Authentication is handled automatically using the CLOUDFLARE_API_TOKEN environment variable.

Learn more in the Cloudflare AI Gateway documentation.

CLOUDFLARE_API_TOKEN=your-api-key
import { Agent } from "@mastra/core/agent";

const agent = new Agent({
  id: "my-agent",
  name: "My Agent",
  instructions: "You are a helpful assistant",
  model: "cloudflare-ai-gateway/anthropic/claude-3-haiku"
});

// Generate a response
const response = await agent.generate("Hello!");

// Stream a response
const stream = await agent.stream("Tell me a story");
for await (const chunk of stream) {
  console.log(chunk);
}
info

Mastra uses the OpenAI-compatible /chat/completions endpoint. Some provider-specific features may not be available. Check the Cloudflare AI Gateway documentation for details.

Models
Direct link to Models

ModelContextToolsReasoningImageAudioVideoInput $/1MOutput $/1M
cloudflare-ai-gateway/anthropic/claude-3-haiku128K—$1
cloudflare-ai-gateway/anthropic/claude-3-opus128K$15$75
cloudflare-ai-gateway/anthropic/claude-3-sonnet128K$3$15
cloudflare-ai-gateway/anthropic/claude-3.5-haiku128K—$4
cloudflare-ai-gateway/anthropic/claude-3.5-sonnet128K$6$30
cloudflare-ai-gateway/anthropic/claude-haiku-4.5128K$1$5
cloudflare-ai-gateway/anthropic/claude-opus-4128K$15$75
cloudflare-ai-gateway/anthropic/claude-opus-4.1128K$15$75
cloudflare-ai-gateway/anthropic/claude-opus-4.5128K$5$25
cloudflare-ai-gateway/anthropic/claude-sonnet-4128K$3$15
cloudflare-ai-gateway/anthropic/claude-sonnet-4.5128K$3$15
cloudflare-ai-gateway/openai/gpt-3.5-turbo128K—$2
cloudflare-ai-gateway/openai/gpt-4128K$30$60
cloudflare-ai-gateway/openai/gpt-4-turbo128K$10$30
cloudflare-ai-gateway/openai/gpt-4o128K$3$10
cloudflare-ai-gateway/openai/gpt-4o-mini128K——
cloudflare-ai-gateway/openai/gpt-5.1128K$1$10
cloudflare-ai-gateway/openai/gpt-5.1-codex128K$1$10
cloudflare-ai-gateway/openai/o1128K$15$60
cloudflare-ai-gateway/openai/o1-mini128K$1$4
cloudflare-ai-gateway/openai/o1-preview128K$15$60
cloudflare-ai-gateway/openai/o3128K$2$8
cloudflare-ai-gateway/openai/o3-mini128K$1$4
cloudflare-ai-gateway/openai/o3-pro128K$20$80
cloudflare-ai-gateway/openai/o4-mini128K$1$4
cloudflare-ai-gateway/replicate/deepseek-ai/deepseek-r1128K$10$10
cloudflare-ai-gateway/replicate/meta/meta-llama-3-70b-instruct128K—$3
cloudflare-ai-gateway/replicate/meta/meta-llama-3-8b-instruct128K——
cloudflare-ai-gateway/replicate/meta/meta-llama-3.1-405b-instruct128K$10$10
cloudflare-ai-gateway/workers-ai/aura-1128K——
cloudflare-ai-gateway/workers-ai/aura-2-en128K——
cloudflare-ai-gateway/workers-ai/aura-2-es128K——
cloudflare-ai-gateway/workers-ai/bart-large-cnn128K——
cloudflare-ai-gateway/workers-ai/bge-base-en-v1.5128K$67000—
cloudflare-ai-gateway/workers-ai/bge-large-en-v1.5128K$200000—
cloudflare-ai-gateway/workers-ai/bge-m3128K$12000—
cloudflare-ai-gateway/workers-ai/bge-reranker-base128K——
cloudflare-ai-gateway/workers-ai/bge-small-en-v1.5128K$20000—
cloudflare-ai-gateway/workers-ai/deepseek-r1-distill-qwen-32b128K$500000$4880000
cloudflare-ai-gateway/workers-ai/distilbert-sst-2-int8128K$26000—
cloudflare-ai-gateway/workers-ai/gemma-3-12b-it128K——
cloudflare-ai-gateway/workers-ai/gemma-sea-lion-v4-27b-it128K——
cloudflare-ai-gateway/workers-ai/gpt-oss-120b128K——
cloudflare-ai-gateway/workers-ai/gpt-oss-20b128K——
cloudflare-ai-gateway/workers-ai/granite-4.0-h-micro128K——
cloudflare-ai-gateway/workers-ai/indictrans2-en-indic-1B128K——
cloudflare-ai-gateway/workers-ai/llama-2-7b-chat-fp16128K$560000$6670000
cloudflare-ai-gateway/workers-ai/llama-3-8b-instruct128K$280000$830000
cloudflare-ai-gateway/workers-ai/llama-3-8b-instruct-awq128K$120000$270000
cloudflare-ai-gateway/workers-ai/llama-3.1-8b-instruct128K$280000$830000
cloudflare-ai-gateway/workers-ai/llama-3.1-8b-instruct-awq128K$120000$270000
cloudflare-ai-gateway/workers-ai/llama-3.1-8b-instruct-fp8128K$150000$290000
cloudflare-ai-gateway/workers-ai/llama-3.2-11b-vision-instruct128K$49000$680000
cloudflare-ai-gateway/workers-ai/llama-3.2-1b-instruct128K$27000$200000
cloudflare-ai-gateway/workers-ai/llama-3.2-3b-instruct128K$51000$340000
cloudflare-ai-gateway/workers-ai/llama-3.3-70b-instruct-fp8-fast128K$290000$2250000
cloudflare-ai-gateway/workers-ai/llama-4-scout-17b-16e-instruct128K——
cloudflare-ai-gateway/workers-ai/llama-guard-3-8b128K$480000$30000
cloudflare-ai-gateway/workers-ai/m2m100-1.2b128K$340000$340000
cloudflare-ai-gateway/workers-ai/melotts128K——
cloudflare-ai-gateway/workers-ai/mistral-7b-instruct-v0.1128K$110000$190000
cloudflare-ai-gateway/workers-ai/mistral-small-3.1-24b-instruct128K——
cloudflare-ai-gateway/workers-ai/nova-3128K——
cloudflare-ai-gateway/workers-ai/plamo-embedding-1b128K——
cloudflare-ai-gateway/workers-ai/qwen2.5-coder-32b-instruct128K—$1
cloudflare-ai-gateway/workers-ai/qwen3-30b-a3b-fp8128K——
cloudflare-ai-gateway/workers-ai/qwen3-embedding-0.6b128K——
cloudflare-ai-gateway/workers-ai/qwq-32b128K—$1
cloudflare-ai-gateway/workers-ai/smart-turn-v2128K——
cloudflare-ai-gateway/workers-ai/whisper128K——
cloudflare-ai-gateway/workers-ai/whisper-large-v3-turbo128K——
71 available models

Advanced Configuration
Direct link to Advanced Configuration

Custom Headers
Direct link to Custom Headers

const agent = new Agent({
  id: "custom-agent",
  name: "custom-agent",
  model: {
    url: "https://gateway.ai.cloudflare.com/v1/${CLOUDFLARE_ACCOUNT_ID}/${CLOUDFLARE_GATEWAY_ID}/compat/",
    id: "cloudflare-ai-gateway/anthropic/claude-3-haiku",
    apiKey: process.env.CLOUDFLARE_API_TOKEN,
    headers: {
      "X-Custom-Header": "value"
    }
  }
});

Dynamic Model Selection
Direct link to Dynamic Model Selection

const agent = new Agent({
  id: "dynamic-agent",
  name: "Dynamic Agent",
  model: ({ requestContext }) => {
    const useAdvanced = requestContext.task === "complex";
    return useAdvanced
      ? "cloudflare-ai-gateway/workers-ai/whisper-large-v3-turbo"
      : "cloudflare-ai-gateway/anthropic/claude-3-haiku";
  }
});

On this page