Serverless Container Tutorials¶
Use these tutorials for end-to-end examples that deploy models, migrate workloads, and prepare container images for Verda Serverless Containers.
-
Deploy with vLLM
Quickstart for deploying an inference endpoint with vLLM.
-
Migrate from Runpod
Move an existing Runpod-style container workflow to Verda.
-
GPT-OSS 120B with Ollama
Deploy GPT-OSS 120B with Ollama on Serverless Containers.
-
Deploy with TGI
In-depth guide for serving models with Text Generation Inference.
-
Deploy with SGLang
In-depth guide for serving models with SGLang.
-
Deploy with Replicate Cog
In-depth guide for packaging and deploying a Cog model.
-
Async Whisper inference
Run asynchronous inference requests with Whisper.
-
Publish a Docker image
Build and publish your first Docker image for container deployments.