Super Data Science: ML & AI Podcast with Jon Krohn

733: OpenAssistant: The Open-Source ChatGPT Alternative, with Dr. Yannic Kilcher

Nov 21, 2023

Join Dr. Yannic Kilcher, a leading ML YouTuber and DeepJudge CTO, as he discusses OpenAssistant project, open-source vs closed-source challenges, alternative formulas for LLMs, adversarial examples in ML, future AI prospects, and startup challenges with Jon Krohn. Unpack the impact of open-source ML projects, the influence on tech industry dynamics, and the importance of mathematics in AI. Dive into legal tech applications, enhancing semantic search technology, and advancements in open-source LLM technology. Learn about diversifying information sources, exploring AI models, and navigating challenges in AI startup environments.

01:40:19

Episode guests

Yannic Kilcher

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

OpenAssistant project aims at enhancing LLMs with alternative formulas.

Alignment issues exist between open-source and closed-source technologies.

Understanding adversarial examples is crucial for securing neural networks in ML applications.

Deep dives

Adversarial Examples in Neural Networks

Adversarial examples are imperceptible changes made to input data that can cause a neural network to drastically change its classification. These perturbations, while invisible to humans, are targeted to exploit the network's decision-making dynamics, pushing it to predict something entirely different from the original input, showcasing an out-of-distribution behavior.

Intro

3min

Open Assistant Project and the Debates on Open-source vs Proprietary LLMs

11min

Exploring the Impact of Open-Source Initiatives in the Tech Industry

4min

Impact and Innovations in Open-source AI Projects

13min

Exploring Cloud Computing Skills and Legal Tech Applications

5min

Enhancing Semantic Search Technology for Human Profiles in Talent and Sales Acquisition

7min

Importance of Mathematics in Data Science and Machine Learning & Advancements in Search Functionalities

4min

Advancements in Open Source LLM Technology and Challenges in Staying Informed

7min

Diversifying Information Sources and History Simplified

6min

10.

Exploring AI Models and Adversarial Examples in Neural Networks

23min

11.

Challenges and Lessons in AI Startup

14min

12.

Exploring the Open Assistant Project and ML Research Trends

3min

Yannic Kilcher, a leading ML YouTuber and DeepJudge CTO, teams up with Jon Krohn this week to delve into the open-source ML community, the technology powering Yannic’s Swiss-based startup, and the significant implications of adversarial examples in ML. Tune in as they also unpack Yannic's approach to tracking ML research, future AI prospects and his startup challenges.

This episode is brought to you by Gurobi, the Decision Intelligence Leader, and by CloudWolf, the Cloud Skills platform. Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.

In this episode you will learn:
• About OpenAssistant project [03:39]
• Alignment issues in open-source vs closed-source [08:36]
• Alternative formulas vital for crafting superior LLMs [20:29]
• Strategies to foster open-source LLM ecosystems [27:07]
• Yannic's pioneering work in legal document processing at DeepJudge [31:31]
• Comprehensive overview of adversarial examples [1:04:02]
• The future AI's landscape [1:18:08]
• Startup challenges [1:25:35]

Additional materials: www.superdatascience.com/733

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more