Skip to content
Documentation
About Inference API
Search
User Guides
Overview
User Guides
Services Overview
Locations and Sustainability
Account
Overview
Account & Access
Billing
Audit Logs
Products
Overview
Instances
Clusters
Serverless Containers
Inference API
Storage
Developer tools
Overview
Resources Overview
Verda CLI
Infrastructure as Code
Integrations
Support
Contact Support
FAQ
Release notes
General
Instant Clusters
Verda API changes
Documentation
User Guides
User Guides
User Guides
Services Overview
Locations and Sustainability
Account
Account
Account & Access
Account & Access
Team Projects
API Credentials
Shared Responsibility Model
Billing
Billing
Pricing and Billing
How to receive credits
How to redeem credits
Audit Logs
Audit Logs
Supported events
Public API
Products
Products
Instances
Instances
Get started
Get started
Overview
Create an instance
Manage SSH keys
Connect to your server
How to guides
How to guides
Secure your instance
Add a new user
Access JupyterLab
Use Jupyter with VS Code
Remote desktop access
Shutdown and delete
Confidential Compute
Troubleshoot SSH
Tips and tricks
Tips and tricks
Startup environment and variables
Copy files between block devices
Clusters
Clusters
Get started
Get started
Overview
Deploy an Instant Cluster
How to guides
How to guides
Environments
Containers
Monitoring
Validation
Customized GPU clusters
Reference
Reference
Good to know
Architecture
Networking and ports
Tutorials
Tutorials
Deploying vLLM Inference on Instant Cluster using Ray
Gang-scheduled Multi-node Training with SkyPilot + Kueue
Deploying NVIDIA Dynamo on a Kubernetes Instant Cluster
Job Orchestrators
Job Orchestrators
Kubernetes
Kubernetes
Getting started
Running multi-node workloads
Job queueing (Kueue)
Storage
Observability
Health checks
Slinky (Slurm on Kubernetes)
Slinky (Slurm on Kubernetes)
Getting started
User management
Shared jail
Containers (Apptainer)
Observability
Health checks
Tutorials
Vanilla / custom image
Local Users
Local Users
Workshop use case
Serverless Containers
Serverless Containers
Get started
Get started
Overview
How to guides
How to guides
Container registries
Scaling and health check
Batching and streaming
Async inference
Storage
Batch jobs
Reference
Reference
Tutorials
Tutorials
Quickstart: deploy with vLLM
Quickstart: migrate from Runpod
Quickstart: GPT-OSS 120B with Ollama
In depth: deploy with TGI
In depth: deploy with SGLang
In depth: deploy with vLLM
In depth: deploy with Replicate Cog
Async Whisper inference
Publish your first Docker image
Inference API
Inference API
Get started
Get started
Overview
Getting Started
Authorization
Reference
Reference
Language Models
Image Models
Image Models
FLUX.2 [klein]
FLUX.2
FLUX.1 Kontext [dev]
FLUX.1 Kontext [pro]
FLUX.1 Kontext [max]
FLUX.1 Krea [dev]
FLUX.1 [dev]
Whisper
Pricing and Billing
Storage
Storage
Get started
Get started
Overview
Block Volumes
Block Volumes
Attach a block volume
Resize a block volume
Clone a block volume
Shared Filesystem
Shared Filesystem
Create a shared filesystem
Edit share settings
Mount a shared filesystem
Use SFS with a cluster
Container Registry
Container Registry
Quickstart
Reference
Reference
Tag immutability rules
Tag retention rules and runs
Tag rules syntax
Deleting storage
Restore storage
Developer tools
Developer tools
Resources Overview
Verda CLI
Verda CLI
Get started
Get started
Getting Started
Reference
Reference
Instances
Templates
Storage
Object Storage
Container Registry
SSH Keys and Startup Scripts
Cost and Status
Skills
MCP Server
Infrastructure as Code
Infrastructure as Code
Terraform
Terraform
Getting Started
Reference
Reference
Authentication
Provider Configuration
Compute - Instances
Compute - SSH Keys
Compute - Startup Scripts
Storage - Volumes
Containers - Containers
Containers - Serverless Jobs
OpenTofu
OpenTofu
Get Started
Get Started
Getting Started
Using Verda with OpenTofu
Migration from Terraform
Integrations
Integrations
dstack
SkyPilot
Support
Support
FAQ
Release notes
Release notes
Instant Clusters
Verda API changes
Products
Inference API
About Inference API
¶
Placeholder page — what the Inference API is and what it's used for.
Back to top