Navigating Generative AI and Human Oversight

Summary
In this episode of the AI Engineering Podcast Ron Green, co-founder and CTO of KungFu AI, talks about the evolving landscape of AI systems and the challenges of harnessing generative AI engines. Ron shares his insights on the limitations of large language models (LLMs) as standalone solutions and emphasizes the need for human oversight, multi-agent systems, and robust data management to support AI initiatives. He discusses the potential of domain-specific AI solutions, RAG approaches, and mixture of experts to enhance AI capabilities while addressing risks. The conversation also explores the evolving AI ecosystem, including tooling and frameworks, strategic planning, and the importance of interpretability and control in AI systems. Ron expresses optimism about the future of AI, predicting significant advancements in the next 20 years and the integration of AI capabilities into everyday software applications.


Announcements

• Hello and welcome to the AI Engineering Podcast, your guide to the fast-moving world of building scalable and maintainable AI systems
• Seamless data integration into AI applications often falls short, leading many to adopt RAG methods, which come with high costs, complexity, and limited scalability. Cognee offers a better solution with its open-source semantic memory engine that automates data ingestion and storage, creating dynamic knowledge graphs from your data. Cognee enables AI agents to understand the meaning of your data, resulting in accurate responses at a lower cost. Take full control of your data in LLM apps without unnecessary overhead. Visit aiengineeringpodcast.com/cognee to learn more and elevate your AI apps and agents. 
• Your host is Tobias Macey and today I'm interviewing Ron Green about the wheels that we need for harnessing the power of the generative AI engine

Interview

• Introduction
• How did you get involved in machine learning?
• Can you describe what you see as the main shortcomings of LLMs as a stand-alone solution (to anything)?
• The most established vehicle for harnessing LLM capabilities is the RAG pattern. What are the main limitations of that as a "product" solution?
• The idea of multi-agent or mixture-of-experts systems is a more sophisticated approach that is gaining some attention. What do you see as the pro/con conversation around that pattern?
• Beyond the system patterns that are being developed there is also a rapidly shifting ecosystem of frameworks, tools, and point solutions that plugin to various points of the AI lifecycle. How does that volatility hinder the adoption of generative AI in different contexts?
  • In addition to the tooling, the models themselves are rapidly changing. How much does that influence the ways that organizations are thinking about whether and when to test the waters of AI?
• Continuing on the metaphor of LLMs and engines and the need for vehicles, where are we on the timeline in relation to the model T Ford?
  • What are the vehicle categories that we still need to design and develop? (e.g. sedans, mini-vans, freight trucks, etc.)
• The current transformer architecture is starting to reach scaling limits that lead to diminishing returns. Given your perspective as an industry veteran, what are your thoughts on the future trajectory of AI model architectures?
  • What is the ongoing role of regression style ML in the landscape of generative AI?
• What are the most interesting, innovative, or unexpected ways that you have seen LLMs used to power a "vehicle"?
• What are the most interesting, unexpected, or challenging lessons that you have learned while working in this phase of AI?
• When is generative AI/LLMs the wrong choice?

Contact Info

• LinkedIn

Parting Question

• From your perspective, what are the biggest gaps in tooling, technology, or training for AI systems today?

Closing Announcements

• Thank you for listening! Don't forget to check out our other shows. The Data Engineering Podcast covers the latest on modern data management. Podcast.__init__ covers the Python language, its community, and the innovative ways it is being used.
• Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.
• If you've learned something or tried out a project from the show then tell us about it! Email hosts@aiengineeringpodcast.com with your story.
• To help other people find the show please leave a review on iTunes and tell your friends and co-workers.

Links

• Kungfu.ai
• Llama open generative AI models
• ChatGPT
• Copilot
• Cursor
• RAG == Retrieval Augmented Generation
  • Podcast Episode
• Mixture of Experts
• Deep Learning
• Random Forest
• Supervised Learning
• Active Learning)
• Yann LeCunn
• RLHF == Reinforcement Learning from Human Feedback
• Model T Ford
• Mamba selective state space
• Liquid Network
• Chain of thought
• OpenAI o1
• Marvin Minsky
• Von Neumann Architecture
• Attention Is All You Need
• Multilayer Perceptron
• Dot Product
• Diffusion Model
• Gaussian Noise
• AlphaFold 3
• Anthropic
• Sparse Autoencoder

The intro and outro music is from Hitman's Lovesong feat. Paola Graziano by The Freak Fandango Orchestra/CC BY-SA 3.0