Enhancing Data Analytics with Custom Scripts and AI Integration

Bento is Meta’s internal distribution of Jupyter Notebooks, an open-source web-based computing platform. Host Pascal is joined by Steve who worked with his team on building many features on top of Jupyter, including scheduled notebooks, sharing with colleagues and running notebooks without a remote server component by leveraging Webassembly in the browser.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Scheduling Jupyter Notebooks at Meta: https://engineering.fb.com/2023/08/29/security/scheduling-jupyter-notebooks-meta/

• Serverless Jupyter Notebooks at Meta: https://engineering.fb.com/2024/06/10/data-infrastructure/serverless-jupyter-notebooks-bento-meta/

• Jupyter Notebooks: https://jupyter.org/ 

Timestamps

• Intro 0:06

• Who is Steve? 1:49

• What are Jupyter and Bento? 2:48

• Who is Bento for? 3:40

• Internal-only Bento features 4:42

• Scheduled notebooks 11:39

• Integrating with existing batch jobs 17:10

• The case for serverless notebooks 20:59

• Enter wasm 24:29

• Upgrade paths from serverless to server 26:29

• Bringing more Python libraries to the browser 30:21

• Adding magick(s) 31:52

• DataFrame magic and AI 36:41

• What's next? 38:29

• Outro 43:17