Nebius
Table of contents
Use Nebius AI models with docker-agent.
Overview
Nebius provides AI models through an OpenAI-compatible API. docker-agent includes built-in support for Nebius as an alias provider.
Setup
Get an API key from Nebius AI
Set the environment variable:
export NEBIUS_API_KEY=your-api-key
Usage
Inline Syntax
The simplest way to use Nebius:
agents:
root:
model: nebius/deepseek-ai/DeepSeek-V3
description: Assistant using Nebius
instruction: You are a helpful assistant.Named Model
For more control over parameters:
models:
nebius_model:
provider: nebius
model: deepseek-ai/DeepSeek-V3
temperature: 0.7
max_tokens: 8192
agents:
root:
model: nebius_model
description: Assistant using Nebius
instruction: You are a helpful assistant.Available Models
Nebius hosts various open models. Check the Nebius documentation for the current model catalog.
| Model | Description |
|---|---|
deepseek-ai/DeepSeek-V3 | DeepSeek V3 model |
Qwen/Qwen2.5-72B-Instruct | Qwen 2.5 72B instruction-tuned |
meta-llama/Llama-3.3-70B-Instruct | Llama 3.3 70B instruction-tuned |
How It Works
Nebius is implemented as a built-in alias in docker-agent:
- API Type: OpenAI-compatible (
openai_chatcompletions) - Base URL:
https://api.studio.nebius.com/v1 - Token Variable:
NEBIUS_API_KEY
Example: Code Assistant
agents:
coder:
model: nebius/deepseek-ai/DeepSeek-V3
description: Code assistant using DeepSeek
instruction: |
You are an expert programmer using DeepSeek V3.
Write clean, well-documented code.
Follow best practices for the language being used.
toolsets:
- type: filesystem
- type: shell
- type: think