AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Key Insights on Lemmings and Speed of Inference
Lems, the speed of inference, and the current infrastructure are all obstacles to certain use cases./nThere is a need for better developer tooling to support massive models./nCustom tooling is needed to help with output validation and prompt tracking.