Tom Smoker, Cofounder of WhyHow.ai, discusses using knowledge graphs in multi-agent systems. Topics include mitigating hallucination issues, optimizing search with knowledge graphs, agile problem-solving, and integrating vector databases. The conversation explores agents in multi-agent systems, stepping back for growth, and using AI models for automated content creation and revenue generation.
Read more
AI Summary
Highlights
AI Chapters
Episode notes
auto_awesome
Podcast summary created with Snipd AI
Quick takeaways
Knowledge graphs enhance RAG reliability by focusing on 'exactly wrong' for deterministic AI systems.
Utilizing knowledge graphs allows for extensibility and adaptability in dynamic data environments.
Multi-agent systems structure software effectively, emphasizing the need for reliable, well-tested development frameworks.
Deep dives
Using Knowledge Graphs for Reliable RAG Systems
Tom Smoker discussed how he leverages knowledge graphs to enhance the reliability of RAG systems by aiming to be 'exactly wrong' rather than 'exactly right.' This approach focuses on creating a deterministic system with AI, utilizing knowledge graphs to ensure accuracy. Smoker emphasized the importance of understanding that the same term can have different meanings based on context, highlighting the need for a knowledge graph that can distinguish nuances.
Scalability and Flexibility of Knowledge Graphs
Smoker highlighted the extensibility and adaptability of knowledge graphs, especially in dynamic data environments. He emphasized the advantage of representing structured data in graphs, enabling easy querying, adaptable schema changes, and extensibility in representing evolving information. Smoker pointed out the efficiency of using smaller, well-connected subgraphs initially and expanding them incrementally to meet specific requirements.
Multi-Agent Systems and Software Structuring
Smoker discussed the benefits of utilizing multi-agent systems to structure software effectively, particularly in ensuring reliable AI systems. By breaking down tasks into steps and orchestrating them through functional programs, Smoker stressed the importance of well-tested and well-structured software development. He highlighted the significance of using frameworks like PyData, FastAPI, and LineChain to implement natural language instructions and integrate LLM calls in a structured and reliable manner.
Rise to Farmer, Rise to Chef: Enhancing Agent Performance
Improving agent accuracy and optimizing workflows within a multi-agent system is crucial for achieving higher performance. By focusing on enhancing the accuracy of individual agents and iteratively refining their capabilities, the overall system can achieve a significant boost in reliability. This approach aims to minimize uncertainty and improve overall system efficiency, especially in complex workflows like international supply chain management.
The Future of Agent Systems in Automation
The future of automation lies in modular multi-agent systems, where each agent performs specialized tasks efficiently. This approach allows for personalized control within complex workflows, enabling users to interact with the system at a granular level. While challenges like reliability and trust remain, the potential for creating automated processes with high levels of personalization and scalability is promising. As the next generation embraces autonomous systems, the evolution of agent systems could revolutionize various industries and business operations.
Tom Smoker is the cofounder of an early stage tech company empowering developers to create knowledge graphs within their RAG pipelines. Tom is a technical founder, and owns the research and development of knowledge graphs tooling for the company.
Managing Small Knowledge Graphs for Multi-agent Systems // MLOps podcast #236 with Tom Smoker, Technical Founder of whyhow.ai.
A big thank you to @latticeflow for sponsoring this episode! LatticeFlow - https://latticeflow.ai/
// Abstract
RAG is one of the more popular use cases for generative models, but there can be issues with repeatability and accuracy. This is especially applicable when it comes to using many agents within a pipeline, as the uncertainty propagates. For some multi-agent use cases, knowledge graphs can be used to structurally ground the agents and selectively improve the system to make it reliable end to end.
// Bio
Technical Founder of WhyHow.ai. Did Masters and PhD in CS, specializing in knowledge graphs, embeddings, and NLP. Worked as a data scientist to senior machine learning engineer at large resource companies and startups.
// MLOps Jobs board
https://mlops.pallet.xyz/jobs
// MLOps Swag/Merch
https://mlops-community.myshopify.com/
// Related Links
A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Models: https://arxiv.org/abs/2401.01313Understanding the type of Knowledge Graph you need — Fixed vs Dynamic Schema/Data: https://medium.com/enterprise-rag/understanding-the-type-of-knowledge-graph-you-need-fixed-vs-dynamic-schema-data-13f319b27d9e
--------------- ✌️Connect With Us ✌️ -------------
Join our slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: https://mlops.community/
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Tom on LinkedIn: https://www.linkedin.com/in/thomassmoker/
Timestamps:
[00:00] Tom's preferred coffee
[00:33] Takeaways
[03:04] Please like, share, leave a review, and subscribe to our MLOps channels!
[03:23] Academic Curiosity and Knowledge Graphs
[05:07] Logician
[05:53] Knowledge graphs incorporated into RAGs
[07:53] Graphs & Vectors Integration
[10:49] "Exactly wrong"
[12:14] Data Integration for Robust Knowledge Graph
[14:53] Structured and Dynamic Data
[21:44] Scoped Knowledge Retrieval Strategies
[28:01 - 29:32] LatticeFlow Ad
[29:33] RAG Limitations and Solutions
[36:10] Working on multi agents, questioning agent definition
[40:01] Concerns about performance of agent information transfer
[43:45] Anticipating agent-based systems with modular processes
[52:04] Balancing risk tolerance in company operations and control
[54:11] Using AI to generate high-quality, efficient content
[01:03:50] Wrap up
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode