Enabling Agents In The Enterprise With A Platform Approach
Data Engineering Podcast
00:00
Navigating Large-Scale Data and Agentic Systems
This chapter examines the evolution of agentic systems and their role in enabling non-technical stakeholders to leverage AI and machine learning within organizations. It addresses the shift towards flexible programming practices, the challenges of managing complex data in enterprises, and the importance of building efficient data ingestion pipelines. Additionally, it highlights the need for a pragmatic approach in implementing new protocols and the significance of experimentation to enhance enterprise knowledge management.
Transcript
Play full episode
Transcript
Episode notes
Summary
In this episode of the Data Engineering Podcast Arun Joseph talks about developing and implementing agent platforms to empower businesses with agentic capabilities. From leading AI engineering at Deutsche Telekom to his current entrepreneurial venture focused on multi-agent systems, Arun shares insights on building agentic systems at an organizational scale, highlighting the importance of robust models, data connectivity, and orchestration loops. Listen in as he discusses the challenges of managing data context and cost in large-scale agent systems, the need for a unified context management platform to prevent data silos, and the potential for open-source projects like LMOS to provide a foundational substrate for agentic use cases that can transform enterprise architectures by enabling more efficient data management and decision-making processes.
Announcements
Parting Question
In this episode of the Data Engineering Podcast Arun Joseph talks about developing and implementing agent platforms to empower businesses with agentic capabilities. From leading AI engineering at Deutsche Telekom to his current entrepreneurial venture focused on multi-agent systems, Arun shares insights on building agentic systems at an organizational scale, highlighting the importance of robust models, data connectivity, and orchestration loops. Listen in as he discusses the challenges of managing data context and cost in large-scale agent systems, the need for a unified context management platform to prevent data silos, and the potential for open-source projects like LMOS to provide a foundational substrate for agentic use cases that can transform enterprise architectures by enabling more efficient data management and decision-making processes.
Announcements
- Hello and welcome to the Data Engineering Podcast, the show about modern data management
- Data migrations are brutal. They drag on for months—sometimes years—burning through resources and crushing team morale. Datafold's AI-powered Migration Agent changes all that. Their unique combination of AI code translation and automated data validation has helped companies complete migrations up to 10 times faster than manual approaches. And they're so confident in their solution, they'll actually guarantee your timeline in writing. Ready to turn your year-long migration into weeks? Visit dataengineeringpodcast.com/datafold today for the details.
- This episode is brought to you by Coresignal, your go-to source for high-quality public web data to power best-in-class AI products. Instead of spending time collecting, cleaning, and enriching data in-house, use ready-made multi-source B2B data that can be smoothly integrated into your systems via APIs or as datasets. With over 3 billion data records from 15+ online sources, Coresignal delivers high-quality data on companies, employees, and jobs. It is powering decision-making for more than 700 companies across AI, investment, HR tech, sales tech, and market intelligence industries. A founding member of the Ethical Web Data Collection Initiative, Coresignal stands out not only for its data quality but also for its commitment to responsible data collection practices. Recognized as the top data provider by Datarade for two consecutive years, Coresignal is the go-to partner for those who need fresh, accurate, and ethically sourced B2B data at scale. Discover how Coresignal's data can enhance your AI platforms. Visit dataengineeringpodcast.com/coresignal to start your free 14-day trial.
- Your host is Tobias Macey and today I'm interviewing Arun Joseph about building an agent platform to empower the business to adopt agentic capabilities
- Introduction
- How did you get involved in the area of data management?
- Can you start by giving an overview of how Deutsche Telekom has been approaching applications of generative AI?
- What are the key challenges that have slowed adoption/implementation?
- Enabling non-engineering teams to define and manage AI agents in production is a challenging goal. From a data engineering perspective, what does the abstraction layer for these teams look like?
- How do you manage the underlying data pipelines, versioning of agents, and monitoring of these user-defined agents?
- What was your process for developing the architecture and interfaces for what ultimately became the LMOS?
- How do the principles of operatings systems help with managing the abstractions and composability of the framework?
- Can you describe the overall architecture of the LMOS?
- What does a typical workflow look like for someone who wants to build a new agent use case?
- How do you handle data discovery and embedding generation to avoid unnecessary duplication of processing?
- With your focus on openness and local control, how do you see your work complementing projects like Oumi
- What are the most interesting, innovative, or unexpected ways that you have seen LMOS used?
- What are the most interesting, unexpected, or challenging lessons that you have learned while working on LMOS?
- When is LMOS the wrong choice?
- What do you have planned for the future of LMOS and MASAIC?
Parting Question
- From your perspective, what is the biggest gap in the tooling or technology for data management today?
- Thank you for listening! Don't forget to check out our other shows. Podcast.__init__ covers the Python language, its community, and the innovative ways it is being used. The AI Engineering Podcast is your guide to the fast-moving world of building AI systems.
- Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.
- If you've learned something or tried out a project from the show then tell us about it! Email hosts@dataengineeringpodcast.com with your story.
- LMOS
- Deutsche Telekom
- MASAIC
- OpenAI Agents SDK
- RAG == Retrieval Augmented Generation
- LangChain
- Marvin Minsky
- Vector Database
- MCP == Model Context Protocol
- A2A (Agent to Agent) Protocol
- Qdrant
- LlamaIndex
- DVC == Data Version Control
- Kubernetes
- Kotlin
- Istio
- Xerox PARC)
- OODA (Observe, Orient, Decide, Act) Loop
The AI-powered Podcast Player
Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
