Navigating Trade-offs in Open Source AI Models

Mark Huang is Co-Founder of Gradient, the platform for enterprise agentic automation. Gradient recently open sourced their 4M context window finetune of Llama-3, which is the longest context window available today.

Gradient has raised $10M from investors including Wing VC, Mango Capital, and Tokyo Black.

In this episode, we dig into enterprise readiness for LLM-backed applications today, Gradient's approach to pushing context lengths for foundation models and the benefits to open sourcing their Llama-3 finetune model, their focus on healthcare and finance verticals, how they're finding their place in the noisy GenAI infra space & more!