Skip to main content

Kilo Gateway logoKilo Gateway

Access 360 Kilo Gateway models through Mastra's model router. Authentication is handled automatically using the KILO_API_KEY environment variable.

Learn more in the Kilo Gateway documentation.

.env
KILO_API_KEY=your-api-key
src/mastra/agents/my-agent.ts
import { Agent } from "@mastra/core/agent";

const agent = new Agent({
  id: "my-agent",
  name: "My Agent",
  instructions: "You are a helpful assistant",
  model: "kilo/ai21/jamba-large-1.7"
});

// Generate a response
const response = await agent.generate("Hello!");

// Stream a response
const stream = await agent.stream("Tell me a story");
for await (const chunk of stream) {
  console.log(chunk);
}
note

Mastra uses the OpenAI-compatible /chat/completions endpoint. Some provider-specific features may not be available. Check the Kilo Gateway documentation for details.

Models
Direct link to Models

ModelContextToolsReasoningImageAudioVideoInput $/1MOutput $/1M
kilo/~anthropic/claude-fable-latest1.0M$10$50
kilo/~anthropic/claude-haiku-latest200K$1$5
kilo/~anthropic/claude-opus-latest1.0M$5$25
kilo/~anthropic/claude-sonnet-latest1.0M$2$10
kilo/~deepseek/deepseek-v4-flash-latest262K$0.08$0.15
kilo/~google/gemini-flash-latest1.0M$0.38$2
kilo/~google/gemini-pro-latest1.0M$2$12
kilo/~moonshotai/kimi-latest975K$3$13
kilo/~openai/gpt-latest1.1M$3$15
kilo/~openai/gpt-mini-latest400K$0.75$5
kilo/~x-ai/grok-latest500K$2$6
kilo/ai21/jamba-large-1.7256K$2$8
kilo/aion-labs/aion-2.0131K$0.80$2
kilo/aion-labs/aion-3.0131K$3$6
kilo/aion-labs/aion-3.0-mini131K$0.70$1
kilo/aion-labs/aion-rp-llama-3.1-8b33K$0.80$2
kilo/allenai/olmo-3-32b-think66K$0.15$0.50
kilo/amazon/nova-2-lite-v11.0M$0.30$3
kilo/amazon/nova-lite-v1300K$0.06$0.24
kilo/amazon/nova-micro-v1128K$0.04$0.14
kilo/amazon/nova-premier-v11.0M$3$13
kilo/amazon/nova-pro-v1300K$0.80$3
kilo/anthracite-org/magnum-v4-72b33K$3$5
kilo/anthropic/claude-3-haiku200K$0.25$1
kilo/anthropic/claude-fable-51.0M$10$50
kilo/anthropic/claude-haiku-4.5200K$1$5
kilo/anthropic/claude-opus-4200K$15$75
kilo/anthropic/claude-opus-4.1200K$15$75
kilo/anthropic/claude-opus-4.5200K$5$25
kilo/anthropic/claude-opus-4.61.0M$5$25
kilo/anthropic/claude-opus-4.71.0M$5$25
kilo/anthropic/claude-opus-4.7-fast1.0M$30$150
kilo/anthropic/claude-opus-4.81.0M$5$25
kilo/anthropic/claude-opus-4.8-fast1.0M$10$50
kilo/anthropic/claude-opus-51.0M$5$25
kilo/anthropic/claude-opus-5-fast1.0M$10$50
kilo/anthropic/claude-sonnet-4200K$3$15
kilo/anthropic/claude-sonnet-4.51.0M$3$15
kilo/anthropic/claude-sonnet-4.61.0M$3$15
kilo/anthropic/claude-sonnet-51.0M$2$10
kilo/arcee-ai/trinity-large-thinking262K$0.22$0.85
kilo/arcee-ai/virtuoso-large131K$0.75$1
kilo/baidu/ernie-4.5-vl-424b-a47b123K$0.42$1
kilo/bytedance-seed/seed-1.6262K$0.25$2
kilo/bytedance-seed/seed-1.6-flash262K$0.07$0.30
kilo/bytedance-seed/seed-2-1-turbo262K$0.50$3
kilo/bytedance-seed/seed-2.0-code262K$0.50$3
kilo/bytedance-seed/seed-2.0-lite262K$0.25$2
kilo/bytedance-seed/seed-2.0-mini262K$0.10$0.40
kilo/bytedance/ui-tars-1.5-7b128K$0.10$0.20
kilo/cognitivecomputations/dolphin-mistral-24b-venice-edition128K$0.20$0.90
kilo/cohere/command-a256K$3$10
kilo/cohere/command-r-08-2024128K$0.15$0.60
kilo/cohere/command-r-plus-08-2024128K$3$10
kilo/cohere/command-r7b-12-2024128K$0.04$0.15
kilo/cohere/north-mini-code:free256K——
kilo/deepcogito/cogito-v2.1-671b128K$1$1
kilo/deepseek/deepseek-chat128K$0.40$1
kilo/deepseek/deepseek-chat-v3-0324164K$0.27$1
kilo/deepseek/deepseek-chat-v3.1164K$0.27$1
kilo/deepseek/deepseek-r164K$0.70$3
kilo/deepseek/deepseek-r1-0528164K$0.70$3
kilo/deepseek/deepseek-r1-distill-llama-70b8K$0.80$0.80
kilo/deepseek/deepseek-v3.1-terminus164K$0.27$1
kilo/deepseek/deepseek-v3.2164K$0.27$0.40
kilo/deepseek/deepseek-v3.2-exp164K$0.27$0.41
kilo/deepseek/deepseek-v4-flash1.0M$0.14$0.28
kilo/deepseek/deepseek-v4-flash-07311.0M$0.14$0.28
kilo/deepseek/deepseek-v4-flash:discounted1.0M$0.14$0.28
kilo/deepseek/deepseek-v4-pro1.0M$2$3
kilo/deepseek/deepseek-v4-pro-08131.0M$1$4
kilo/deepseek/deepseek-v4-pro:discounted1.0M$0.43$0.87
kilo/dots-studio/dots-3-note-preview:free512K——
kilo/google/gemini-2.5-flash1.0M$0.30$3
kilo/google/gemini-2.5-flash-image33K$0.30$3
kilo/google/gemini-2.5-flash-lite1.0M$0.10$0.40
kilo/google/gemini-2.5-pro1.0M$1$10
kilo/google/gemini-2.5-pro-preview1.0M$1$10
kilo/google/gemini-2.5-pro-preview-05-061.0M$1$10
kilo/google/gemini-3-flash-preview1.0M$0.50$3
kilo/google/gemini-3-pro-image66K$2$12
kilo/google/gemini-3-pro-image-preview66K$2$12
kilo/google/gemini-3.1-flash-image131K$0.50$3
kilo/google/gemini-3.1-flash-image-preview66K$0.50$3
kilo/google/gemini-3.1-flash-lite1.0M$0.25$2
kilo/google/gemini-3.1-flash-lite-image66K$0.25$2
kilo/google/gemini-3.1-flash-lite-preview1.0M$0.25$2
kilo/google/gemini-3.1-pro-preview1.0M$2$12
kilo/google/gemini-3.1-pro-preview-customtools1.0M$2$12
kilo/google/gemini-3.5-flash1.0M$2$9
kilo/google/gemini-3.5-flash-lite1.0M$0.30$3
kilo/google/gemini-3.6-flash1.0M$0.75$4
kilo/google/gemini-3.7-flash1.0M$2$8
kilo/google/gemma-2-27b-it8K$0.65$0.65
kilo/google/gemma-3-12b-it131K$0.05$0.15
kilo/google/gemma-3-27b-it131K$0.08$0.16
kilo/google/gemma-3-4b-it131K$0.05$0.10
kilo/google/gemma-3n-e4b-it33K$0.06$0.12
kilo/google/gemma-4-26b-a4b-it262K$0.07$0.34
kilo/google/gemma-4-31b-it262K$0.08$0.35
kilo/google/lyria-3-clip-preview1.0M——
kilo/google/lyria-3-pro-preview1.0M——
kilo/gryphe/mythomax-l2-13b4K$0.06$0.06
kilo/ibm-granite/granite-4.0-h-micro131K$0.02$0.11
kilo/ibm-granite/granite-4.1-8b131K$0.05$0.10
kilo/inception/mercury-2128K$0.25$0.75
kilo/inclusionai/ling-2.6-1t262K$0.30$3
kilo/inclusionai/ling-2.6-flash262K$0.10$0.30
kilo/inclusionai/ling-3.0-flash262K$0.06$0.18
kilo/inclusionai/ring-2.6-1t262K$0.30$3
kilo/kilo-auto/balanced1.0M$0.33$2
kilo/kilo-auto/efficient1.0M$0.33$2
kilo/kilo-auto/free256K——
kilo/kilo-auto/frontier1.0M$5$25
kilo/kilo-auto/small262K$0.05$0.40
kilo/kwaipilot/kat-coder-air-v2.5256K$0.15$0.60
kilo/kwaipilot/kat-coder-pro-v2256K$0.30$1
kilo/kwaipilot/kat-coder-pro-v2.5256K$0.74$3
kilo/liquid/lfm-2.5-2.6b:free128K——
kilo/mancer/weaver8K$0.50$0.75
kilo/meituan/longcat-2.01.0M$0.75$3
kilo/meta-llama/llama-3.1-70b-instruct131K$0.40$0.40
kilo/meta-llama/llama-3.1-8b-instruct131K$0.02$0.04
kilo/meta-llama/llama-3.2-1b-instruct60K$0.03$0.20
kilo/meta-llama/llama-3.2-3b-instruct131K$0.05$0.33
kilo/meta-llama/llama-3.3-70b-instruct131K$0.10$0.32
kilo/meta-llama/llama-4-maverick1.0M$0.20$0.70
kilo/meta-llama/llama-4-scout328K$0.10$0.30
kilo/meta-llama/llama-guard-4-12b164K$0.18$0.18
kilo/meta/muse-glimmer-30b131K$0.30$1
kilo/meta/muse-spark-1.11.0M$1$4
kilo/meta/muse-spark-1.21.0M$1$4
kilo/microsoft/phi-416K$0.07$0.14
kilo/microsoft/wizardlm-2-8x22b66K$0.62$0.62
kilo/minimax/minimax-011.0M$0.20$1
kilo/minimax/minimax-m11.0M$0.40$2
kilo/minimax/minimax-m2205K$0.30$1
kilo/minimax/minimax-m2-her66K$0.30$1
kilo/minimax/minimax-m2.1205K$0.30$1
kilo/minimax/minimax-m2.5197K$0.30$1
kilo/minimax/minimax-m2.7205K$0.30$1
kilo/minimax/minimax-m3524K$0.30$1
kilo/mistralai/codestral-2508256K$0.30$0.90
kilo/mistralai/ministral-14b-2512262K$0.20$0.20
kilo/mistralai/ministral-3b-2512131K$0.10$0.10
kilo/mistralai/ministral-8b-2512262K$0.15$0.15
kilo/mistralai/mistral-large128K$2$6
kilo/mistralai/mistral-large-2407131K$2$6
kilo/mistralai/mistral-large-2512262K$0.50$2
kilo/mistralai/mistral-medium-3131K$0.40$2
kilo/mistralai/mistral-medium-3-5262K$2$8
kilo/mistralai/mistral-medium-3.1131K$0.40$2
kilo/mistralai/mistral-nemo131K$0.02$0.03
kilo/mistralai/mistral-saba33K$0.20$0.60
kilo/mistralai/mistral-small-24b-instruct-250133K$0.05$0.08
kilo/mistralai/mistral-small-2603262K$0.15$0.60
kilo/mistralai/mistral-small-3.1-24b-instruct128K$0.35$0.56
kilo/mistralai/mistral-small-3.2-24b-instruct256K$0.09$0.25
kilo/mistralai/mixtral-8x22b-instruct66K$2$6
kilo/mistralai/voxtral-small-24b-250732K$0.10$0.30
kilo/moonshotai/kimi-k2131K$0.57$2
kilo/moonshotai/kimi-k2-0905262K$0.60$3
kilo/moonshotai/kimi-k2-thinking262K$0.60$3
kilo/moonshotai/kimi-k2.5262K$0.60$3
kilo/moonshotai/kimi-k2.6262K$0.80$3
kilo/moonshotai/kimi-k2.7-code262K$0.95$4
kilo/moonshotai/kimi-k31.0M$3$15
kilo/morph/morph-v3-fast82K$0.80$1
kilo/morph/morph-v3-large262K$0.90$2
kilo/nex-agi/nex-n2-mini262K$0.03$0.10
kilo/nex-agi/nex-n2-pro262K$0.25$1
kilo/nousresearch/hermes-3-llama-3.1-405b131K$1$1
kilo/nousresearch/hermes-3-llama-3.1-70b131K$0.70$0.70
kilo/nousresearch/hermes-4-405b131K$1$3
kilo/nousresearch/hermes-4-70b131K$0.13$0.40
kilo/nvidia/nemotron-3-nano-30b-a3b262K$0.05$0.20
kilo/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free256K——
kilo/nvidia/nemotron-3-super-120b-a12b262K$0.09$0.40
kilo/nvidia/nemotron-3-super-120b-a12b:free262K——
kilo/nvidia/nemotron-3-ultra-550b-a55b512K$0.50$2
kilo/nvidia/nemotron-3-ultra-550b-a55b:free1.0M——
kilo/nvidia/nemotron-3.5-content-safety:free128K——
kilo/nvidia/nemotron-3.5-lightning262K$0.08$0.20
kilo/nvidia/nemotron-3.5-lightning:free1.0M——
kilo/openai/gpt-3.5-turbo16K$0.50$2
kilo/openai/gpt-3.5-turbo-06134K$1$2
kilo/openai/gpt-3.5-turbo-16k16K$3$4
kilo/openai/gpt-3.5-turbo-instruct4K$2$2
kilo/openai/gpt-48K$30$60
kilo/openai/gpt-4-turbo128K$10$30
kilo/openai/gpt-4-turbo-preview128K$10$30
kilo/openai/gpt-4.11.0M$2$8
kilo/openai/gpt-4.1-mini1.0M$0.40$2
kilo/openai/gpt-4.1-nano1.0M$0.10$0.40
kilo/openai/gpt-4o128K$3$10
kilo/openai/gpt-4o-2024-05-13128K$5$15
kilo/openai/gpt-4o-2024-08-06128K$3$10
kilo/openai/gpt-4o-2024-11-20128K$3$10
kilo/openai/gpt-4o-mini128K$0.15$0.60
kilo/openai/gpt-4o-mini-2024-07-18128K$0.15$0.60
kilo/openai/gpt-5400K$1$10
kilo/openai/gpt-5-image400K$10$10
kilo/openai/gpt-5-image-mini400K$3$2
kilo/openai/gpt-5-mini400K$0.25$2
kilo/openai/gpt-5-nano400K$0.05$0.40
kilo/openai/gpt-5-pro400K$15$120
kilo/openai/gpt-5.1400K$1$10
kilo/openai/gpt-5.1-codex400K$1$10
kilo/openai/gpt-5.1-codex-max400K$1$10
kilo/openai/gpt-5.1-codex-mini400K$0.25$2
kilo/openai/gpt-5.2400K$2$14
kilo/openai/gpt-5.2-chat128K$2$14
kilo/openai/gpt-5.2-codex400K$2$14
kilo/openai/gpt-5.2-pro400K$21$168
kilo/openai/gpt-5.3-codex400K$2$14
kilo/openai/gpt-5.41.1M$3$15
kilo/openai/gpt-5.4-image-2272K$8$15
kilo/openai/gpt-5.4-mini400K$0.75$5
kilo/openai/gpt-5.4-nano400K$0.20$1
kilo/openai/gpt-5.4-pro1.1M$30$180
kilo/openai/gpt-5.51.1M$5$30
kilo/openai/gpt-5.5-pro1.1M$30$180
kilo/openai/gpt-5.6-luna1.1M$0.20$1
kilo/openai/gpt-5.6-luna-pro1.1M$0.20$1
kilo/openai/gpt-5.6-sol1.1M$5$30
kilo/openai/gpt-5.6-sol-pro1.1M$5$30
kilo/openai/gpt-5.6-terra1.1M$2$12
kilo/openai/gpt-5.6-terra-pro1.1M$2$12
kilo/openai/gpt-audio128K$3$10
kilo/openai/gpt-audio-mini128K$0.60$2
kilo/openai/gpt-chat-latest400K$5$30
kilo/openai/gpt-oss-120b131K$0.03$0.17
kilo/openai/gpt-oss-20b131K$0.03$0.13
kilo/openai/gpt-oss-safeguard-20b131K$0.07$0.30
kilo/openai/o1200K$15$60
kilo/openai/o1-pro200K$150$600
kilo/openai/o3200K$2$8
kilo/openai/o3-mini200K$1$4
kilo/openai/o3-mini-high200K$1$4
kilo/openai/o3-pro200K$20$80
kilo/openai/o4-mini200K$1$4
kilo/openai/o4-mini-high200K$1$4
kilo/openrouter/auto2.0M——
kilo/openrouter/bodybuilder128K——
kilo/openrouter/free200K——
kilo/openrouter/pareto-code200K——
kilo/perceptron/perceptron-mk133K$0.15$2
kilo/perplexity/sonar127K$1$1
kilo/perplexity/sonar-deep-research128K$2$8
kilo/perplexity/sonar-pro200K$3$15
kilo/perplexity/sonar-pro-search200K$3$15
kilo/perplexity/sonar-reasoning-pro128K$2$8
kilo/poolside/laguna-s-2.11.0M$0.10$0.20
kilo/poolside/laguna-s-2.1:free262K——
kilo/poolside/laguna-xs-2.1262K$0.10$0.20
kilo/poolside/laguna-xs-2.1:free262K——
kilo/qwen/qwen-2.5-72b-instruct33K$0.36$0.40
kilo/qwen/qwen-2.5-7b-instruct33K$0.10$0.20
kilo/qwen/qwen-2.5-coder-32b-instruct33K$0.66$1
kilo/qwen/qwen-plus1.0M$0.26$0.78
kilo/qwen/qwen-plus-2025-07-281.0M$0.26$0.78
kilo/qwen/qwen-plus-2025-07-28:thinking1.0M$0.26$0.78
kilo/qwen/qwen2.5-vl-72b-instruct128K$0.80$1
kilo/qwen/qwen3-14b41K$0.23$0.91
kilo/qwen/qwen3-235b-a22b131K$0.46$2
kilo/qwen/qwen3-235b-a22b-2507262K$0.15$0.60
kilo/qwen/qwen3-235b-a22b-thinking-2507131K$0.23$2
kilo/qwen/qwen3-30b-a3b131K$0.13$0.52
kilo/qwen/qwen3-30b-a3b-instruct-2507128K$0.13$0.52
kilo/qwen/qwen3-30b-a3b-thinking-250782K$0.20$2
kilo/qwen/qwen3-32b41K$0.08$0.28
kilo/qwen/qwen3-8b131K$0.12$0.46
kilo/qwen/qwen3-coder262K$0.97$5
kilo/qwen/qwen3-coder-30b-a3b-instruct262K$0.29$1
kilo/qwen/qwen3-coder-flash1.0M$0.20$0.97
kilo/qwen/qwen3-coder-next262K$0.30$2
kilo/qwen/qwen3-coder-plus1.0M$0.65$3
kilo/qwen/qwen3-max262K$0.78$4
kilo/qwen/qwen3-max-thinking262K$0.78$4
kilo/qwen/qwen3-next-80b-a3b-instruct262K$0.10$0.78
kilo/qwen/qwen3-next-80b-a3b-thinking131K$0.15$1
kilo/qwen/qwen3-vl-235b-a22b-instruct131K$0.26$1
kilo/qwen/qwen3-vl-235b-a22b-thinking131K$0.40$4
kilo/qwen/qwen3-vl-30b-a3b-instruct131K$0.13$0.52
kilo/qwen/qwen3-vl-30b-a3b-thinking131K$0.20$2
kilo/qwen/qwen3-vl-32b-instruct131K$0.10$0.42
kilo/qwen/qwen3-vl-8b-instruct131K$0.12$0.46
kilo/qwen/qwen3-vl-8b-thinking131K$0.18$2
kilo/qwen/qwen3.5-122b-a10b262K$0.26$2
kilo/qwen/qwen3.5-27b262K$0.20$2
kilo/qwen/qwen3.5-35b-a3b262K$0.16$1
kilo/qwen/qwen3.5-397b-a17b262K$0.39$2
kilo/qwen/qwen3.5-9b262K$0.10$0.15
kilo/qwen/qwen3.5-flash-02-231.0M$0.07$0.26
kilo/qwen/qwen3.5-plus-02-151.0M$0.26$2
kilo/qwen/qwen3.5-plus-202604201.0M$0.30$2
kilo/qwen/qwen3.6-27b262K$0.45$3
kilo/qwen/qwen3.6-35b-a3b262K$0.14$1
kilo/qwen/qwen3.6-flash1.0M$0.19$1
kilo/qwen/qwen3.6-max-preview262K$1$6
kilo/qwen/qwen3.6-plus1.0M$0.33$2
kilo/qwen/qwen3.7-flash1.0M$0.03$0.13
kilo/qwen/qwen3.7-max1.0M$1$4
kilo/qwen/qwen3.7-plus1.0M$0.32$1
kilo/qwen/qwen3.8-2.4t-a95b1.0M$2$6
kilo/qwen/qwen3.8-27b262K$0.45$3
kilo/qwen/qwen3.8-max1.0M$2$6
kilo/rekaai/reka-edge16K$0.10$0.10
kilo/rekaai/reka-flash-366K$0.10$0.20
kilo/relace/relace-apply-3256K$0.85$1
kilo/relace/relace-search256K$1$3
kilo/sakana/fugu-ultra1.0M$5$30
kilo/sakana/sakana-namazu262K$0.95$4
kilo/sao10k/l3-lunaris-8b8K$0.04$0.05
kilo/sao10k/l3.1-euryale-70b131K$0.85$0.85
kilo/sao10k/l3.3-euryale-70b131K$0.65$0.75
kilo/stealth/claude-opus-4.61.0M$4$20
kilo/stealth/claude-opus-4.71.0M$4$20
kilo/stealth/claude-opus-4.81.0M$4$20
kilo/stealth/claude-sonnet-4.61.0M$2$12
kilo/stealth/gpt-5.6-sol1.1M$4$24
kilo/stealth/qwen3.6-plus1.0M$0.25$2
kilo/stepfun/step-3.5-flash262K$0.10$0.30
kilo/stepfun/step-3.7-flash256K$0.20$1
kilo/stepfun/step-3.7-flash:free262K——
kilo/tencent/hunyuan-a13b-instruct131K$0.14$0.57
kilo/tencent/hy3262K$0.14$0.58
kilo/tencent/hy3-preview262K$0.18$0.60
kilo/tencent/hy3:free262K——
kilo/thedrummer/cydonia-24b-v4.1131K$0.30$0.50
kilo/thedrummer/rocinante-12b66K$0.25$0.50
kilo/thedrummer/skyfall-36b-v233K$0.55$0.80
kilo/thedrummer/unslopnemo-12b1.0M$0.40$0.40
kilo/thinkingmachines/inkling524K$0.95$4
kilo/thinkingmachines/inkling-small524K$0.45$1
kilo/undi95/remm-slerp-l2-13b6K$0.45$0.65
kilo/upstage/solar-pro-3131K$0.15$0.60
kilo/upstage/solar-pro4524K$0.30$1
kilo/writer/palmyra-x51.0M$0.60$6
kilo/x-ai/grok-4.202.0M$1$3
kilo/x-ai/grok-4.20-multi-agent2.0M$1$3
kilo/x-ai/grok-4.31.0M$1$3
kilo/x-ai/grok-4.5500K$2$6
kilo/x-ai/grok-4.6500K$2$6
kilo/x-ai/grok-build-0.1256K$1$2
kilo/xiaomi/mimo-v2.51.0M$0.14$0.28
kilo/xiaomi/mimo-v2.5-pro1.0M$0.43$0.87
kilo/z-ai/glm-4.5131K$0.60$2
kilo/z-ai/glm-4.5-air131K$0.13$0.85
kilo/z-ai/glm-4.5v66K$0.60$2
kilo/z-ai/glm-4.6203K$0.50$2
kilo/z-ai/glm-4.6v131K$0.30$0.90
kilo/z-ai/glm-4.7203K$0.40$2
kilo/z-ai/glm-4.7-flash203K$0.06$0.40
kilo/z-ai/glm-5198K$0.60$2
kilo/z-ai/glm-5-turbo203K$1$4
kilo/z-ai/glm-5.1200K$1$4
kilo/z-ai/glm-5.21.0M$1$4
kilo/z-ai/glm-5.31.0M$1$4
kilo/z-ai/glm-5v-turbo203K$1$4
360 available models

Advanced configuration
Direct link to Advanced configuration

Custom headers
Direct link to Custom headers

src/mastra/agents/my-agent.ts
const agent = new Agent({
  id: "custom-agent",
  name: "custom-agent",
  model: {
    url: "https://api.kilo.ai/api/gateway",
    id: "kilo/ai21/jamba-large-1.7",
    apiKey: process.env.KILO_API_KEY,
    headers: {
      "X-Custom-Header": "value"
    }
  }
});

Dynamic model selection
Direct link to Dynamic model selection

src/mastra/agents/my-agent.ts
const agent = new Agent({
  id: "dynamic-agent",
  name: "Dynamic Agent",
  model: ({ requestContext }) => {
    const useAdvanced = requestContext.task === "complex";
    return useAdvanced
      ? "kilo/~x-ai/grok-latest"
      : "kilo/ai21/jamba-large-1.7";
  }
});
On this page