Deep Infra

Access 60 Deep Infra models through Mastra's model router. Authentication is handled automatically using the DEEPINFRA_API_KEY environment variable.

Learn more in the Deep Infra documentation.

.env

DEEPINFRA_API_KEY=your-api-key

src/mastra/agents/my-agent.ts

import { Agent } from "@mastra/core/agent";

const agent = new Agent({
  id: "my-agent",
  name: "My Agent",
  instructions: "You are a helpful assistant",
  model: "deepinfra/ByteDance/Seed-2.0-code"
});

// Generate a response
const response = await agent.generate("Hello!");

// Stream a response
const stream = await agent.stream("Tell me a story");
for await (const chunk of stream) {
  console.log(chunk);
}

Models

57 available models

Model	Context	Tools	Reasoning	Image	Audio	Video	Input $/1M	Output $/1M
deepinfra/ByteDance/Seed-2.0-code	256K						$0.50	$3
deepinfra/ByteDance/Seed-2.0-mini	256K						$0.10	$0.40
deepinfra/ByteDance/Seed-2.0-pro	256K						$0.50	$3
deepinfra/deepseek-ai/DeepSeek-R1-0528	164K						$0.50	$2
deepinfra/deepseek-ai/DeepSeek-V3	164K						$0.32	$0.89
deepinfra/deepseek-ai/DeepSeek-V3-0324	164K						$0.24	$0.90
deepinfra/deepseek-ai/DeepSeek-V3.1	164K						$0.25	$0.95
deepinfra/deepseek-ai/DeepSeek-V3.2	164K						$0.26	$0.38
deepinfra/deepseek-ai/DeepSeek-V4-Flash	1.0M						$0.09	$0.18
deepinfra/deepseek-ai/DeepSeek-V4-Flash-0731	1.0M						$0.08	$0.18
deepinfra/deepseek-ai/DeepSeek-V4-Pro	1.0M						$1	$3
deepinfra/deepseek-ai/DeepSeek-V4-Pro-0813	1.0M						$1	$3
deepinfra/google/gemma-4-26B-A4B-it	262K						$0.07	$0.34
deepinfra/google/gemma-4-31B-it	262K						$0.13	$0.38
deepinfra/google/gemma-4-E4B-it	131K						$0.02	$0.10
deepinfra/meta-llama/Llama-3.3-70B-Instruct-Turbo	131K						$0.10	$0.32
deepinfra/meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8	1.0M						$0.20	$0.80
deepinfra/meta-llama/Llama-4-Scout-17B-16E-Instruct	328K						$0.10	$0.30
deepinfra/MiniMaxAI/MiniMax-M2.7	197K						$0.25	$1
deepinfra/MiniMaxAI/MiniMax-M3	524K						$0.28	$1
deepinfra/moonshotai/Kimi-K2.5	262K						$0.45	$2
deepinfra/moonshotai/Kimi-K2.6	262K						$0.75	$4
deepinfra/moonshotai/Kimi-K2.7-Code	262K						$0.68	$3
deepinfra/moonshotai/Kimi-K3	1.0M						$3	$14
deepinfra/nvidia/Nemotron-3-Nano-30B-A3B	262K						$0.05	$0.20
deepinfra/openai/gpt-oss-120b	131K						$0.04	$0.17
deepinfra/openai/gpt-oss-20b	131K						$0.03	$0.14
deepinfra/Qwen/Qwen3-235B-A22B-Instruct-2507	262K						$0.09	$0.55
deepinfra/Qwen/Qwen3-30B-A3B	41K						$0.12	$0.50
deepinfra/Qwen/Qwen3-32B	41K						$0.08	$0.28
deepinfra/Qwen/Qwen3-Coder-480B-A35B-Instruct-Turbo	262K						$0.30	$1
deepinfra/Qwen/Qwen3-Max	256K						$1	$6
deepinfra/Qwen/Qwen3-Next-80B-A3B-Instruct	262K						$0.09	$1
deepinfra/Qwen/Qwen3-VL-235B-A22B-Instruct	262K						$0.20	$0.88
deepinfra/Qwen/Qwen3.5-122B-A10B	262K						$0.29	$2
deepinfra/Qwen/Qwen3.5-27B	262K						$0.26	$3
deepinfra/Qwen/Qwen3.5-35B-A3B	262K						$0.14	$1
deepinfra/Qwen/Qwen3.5-397B-A17B	262K						$0.45	$3
deepinfra/Qwen/Qwen3.5-9B	262K						$0.10	$0.15
deepinfra/Qwen/Qwen3.6-27B	262K						$0.32	$3
deepinfra/Qwen/Qwen3.6-35B-A3B	262K						$0.10	$0.95
deepinfra/Qwen/Qwen3.7-Max	256K						$3	$8
deepinfra/Qwen/Qwen3.8-2.4T-A95B	262K						$2	$6
deepinfra/Qwen/Qwen3.8-27B	262K						$0.40	$3
deepinfra/Qwen/Qwen3.8-Max	256K						$2	$5
deepinfra/stepfun-ai/Step-3.7-Flash	262K						$0.20	$1
deepinfra/tencent/Hy3	262K						$0.14	$0.58
deepinfra/thinkingmachines/Inkling	524K						$0.95	$4
deepinfra/thinkingmachines/Inkling-Small	524K						$0.45	$1
deepinfra/XiaomiMiMo/MiMo-V2.5	262K						$0.40	$2
deepinfra/XiaomiMiMo/MiMo-V2.5-Pro	1.0M						$1	$3
deepinfra/zai-org/GLM-4.6	203K						$0.50	$2
deepinfra/zai-org/GLM-4.7	203K						$0.40	$2
deepinfra/zai-org/GLM-4.7-Flash	203K						$0.06	$0.40
deepinfra/zai-org/GLM-5	203K						$0.60	$2
deepinfra/zai-org/GLM-5.1	203K						$1	$4
deepinfra/zai-org/GLM-5.2	1.0M						$0.75	$2

Advanced configuration

Custom headers

src/mastra/agents/my-agent.ts

const agent = new Agent({
  id: "custom-agent",
  name: "custom-agent",
  model: {
    id: "deepinfra/ByteDance/Seed-2.0-code",
    apiKey: process.env.DEEPINFRA_API_KEY,
    headers: {
      "X-Custom-Header": "value"
    }
  }
});

Dynamic model selection

src/mastra/agents/my-agent.ts

const agent = new Agent({
  id: "dynamic-agent",
  name: "Dynamic Agent",
  model: ({ requestContext }) => {
    const useAdvanced = requestContext.task === "complex";
    return useAdvanced
      ? "deepinfra/zai-org/GLM-5.2"
      : "deepinfra/ByteDance/Seed-2.0-code";
  }
});

Direct provider installation

This provider can also be installed directly as a standalone package, which can be used instead of the Mastra model router string. View the package documentation for more details.

npm

npm install @ai-sdk/deepinfra

pnpm

pnpm add @ai-sdk/deepinfra

Yarn

yarn add @ai-sdk/deepinfra

Bun

bun add @ai-sdk/deepinfra

For detailed provider-specific documentation, see the AI SDK Deep Infra provider docs.