Val Bercovici

Val Bercovici, Chief AI Officer at Weka and a veteran in storage infrastructure, delves into the fascinating world of disaggregated pre-fill and decode for AI workloads. He discusses how inference is now taking center stage in AI spending and the challenges it presents. Bercovici explains how the split between pre-fill and decode enhances GPU utilization and efficiency, likening it to an assembly-line architecture. He highlights Weka's innovative solutions in software-defined memory, which promise to revolutionize memory management and scalability in AI-heavy environments.