
Thousands of Fine-Tuned Models
MLOps.community
00:00
Orchestration Layer: Dynamic Model Planner
Jaipal proposes an OS-level orchestrator that loads specialized models per task and offloads them when done.
Play episode from 33:25
Transcript

Jaipal proposes an OS-level orchestrator that loads specialized models per task and offloads them when done.