AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Rise of Deep Learning in Machine Learning
I started working on distributed systems for large-scale machine learning in the context of Apache Spark at the AMPLUB. And I think what I learned there and having been a practitioner building models and kind of shipping product around models for a living was that as soon as we got to the scale of data where it no longer fit in memory on my laptop, all of my tooling broke down really, really hard. So I felt like there was a good opportunity to go to grad school and invent the future that I wanted to live in. We were responsible for the design and initial implementation of the standard library for machine learning in Apache Spark called MLLive.