Audry Hsu introduces infrastructure options for model deployment and explains the distinction between persistent containers and serverless workersServerless computing lets a provider start and manage the workers that run application code on demand. that scale with demand.
Audry Hsu demonstrates configuring an LLM endpoint, selecting model settings and worker limits, sending a request and observing initialization and execution times. The demonstration uses RunPod’s interface.
Watch on YouTube
