About Serverless AI
Read about how Serverless AI works and how to choose between endpoints and jobs
Getting started with jobs
Create your first job that runs nvidia-smi and prints information about GPUs in use
Getting started with endpoints
Launch a simple endpoint and send authenticated requests to it
Deploying an LLM
Deploy a large language model on an endpoint and chat with it
Fine-tuning an LLM
Run a job that fine-tunes a large language model by using Axolotl
Monitoring
Track resource utilization to schedule quota increases and to quickly identify anomalies