The Evolution of the MPT Model

MosaicML’s VP Of Engineering, Hagay Lupesko, joins us today to discuss generative AI!  We talk about how to use existing models as well as ways to finetune these models to a particular task or domain.

00:01:28 Introductions

00:02:09 Hagay’s circuitous career journey

00:08:25 Building software for large factories

00:17:30 The reality of new technologies

00:28:10 AWS

00:29:33 Pytorch’s leapfrog advantage

00:37:24 MosaicML’s mission

00:39:29 Generative AI

00:44:39 Giant data models

00:57:00 Data access tips

01:10:31 MPT-7B

01:27:01 Careers in Mosaic

01:31:46 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

Subscribe to the podcast on Youtube: https://www.youtube.com/@programmingthrowdown4793

Links:

• Hagay Lupesko:
  • Linkedin: https://www.linkedin.com/in/hagaylupesko/
  • Twitter: https://twitter.com/hagay_lupesko
  • Github: https://github.com/lupesko
• MosaicML:
  • Website: https://www.mosaicml.com/
  • Careers: https://www.mosaicml.com/careers
  • Twitter: https://twitter.com/MosaicML
  • Linkedin: https://www.linkedin.com/company/mosaicml/
• Others:
  • Amp It Up (Amazon): https://www.amazon.com/Amp-Unlocking-Hypergrowth-Expectations-Intensity/dp/1119836115
  • Hugging Face Hub: https://huggingface.co/

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM | Youtube

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon