Enabling Agents In The Enterprise With A Platform Approach

63 snips

Jun 29, 2025

Arun Joseph, an AI engineering leader and entrepreneur, discusses his journey in developing multi-agent systems. He emphasizes the transformative potential of agentic capabilities in businesses and shares insights on building robust data models and orchestration loops. Arun tackles the challenges of managing large-scale data contexts, the importance of unified context management to avoid silos, and the shift toward open-source platforms like LMOS. He also explores how these innovations can enhance decision-making and streamline enterprise data management.

Ask episode

AI Snips

Chapters

Transcript

Episode notes

ANECDOTE

Arun Joseph's Background

Arun Joseph has extensive experience building large-scale distributed and AI systems in enterprises like Deutsche Telekom.
He recently transitioned to entrepreneurship focusing on multi-agent systems for agentic capabilities.

INSIGHT

Agentic Orchestration Feedback Loop

Agentic orchestration works as a feedback loop enabling systems to iteratively refine actions toward a goal.
This paradigm allows business users to specify objectives which the system autonomously executes and improves.

ADVICE

Start Simple with Existing APIs

Start integrating language models with existing APIs simply before adopting new protocols like MCP or A2A.
Build incrementally and add complex layers as scalability demands increase, following the KISS principle.

Get the Snipd Podcast app to discover more snips from this episode

Get the app

Summary
In this episode of the Data Engineering Podcast Arun Joseph talks about developing and implementing agent platforms to empower businesses with agentic capabilities. From leading AI engineering at Deutsche Telekom to his current entrepreneurial venture focused on multi-agent systems, Arun shares insights on building agentic systems at an organizational scale, highlighting the importance of robust models, data connectivity, and orchestration loops. Listen in as he discusses the challenges of managing data context and cost in large-scale agent systems, the need for a unified context management platform to prevent data silos, and the potential for open-source projects like LMOS to provide a foundational substrate for agentic use cases that can transform enterprise architectures by enabling more efficient data management and decision-making processes.

Announcements

Hello and welcome to the Data Engineering Podcast, the show about modern data management
Data migrations are brutal. They drag on for months—sometimes years—burning through resources and crushing team morale. Datafold's AI-powered Migration Agent changes all that. Their unique combination of AI code translation and automated data validation has helped companies complete migrations up to 10 times faster than manual approaches. And they're so confident in their solution, they'll actually guarantee your timeline in writing. Ready to turn your year-long migration into weeks? Visit dataengineeringpodcast.com/datafold today for the details.
This episode is brought to you by Coresignal, your go-to source for high-quality public web data to power best-in-class AI products. Instead of spending time collecting, cleaning, and enriching data in-house, use ready-made multi-source B2B data that can be smoothly integrated into your systems via APIs or as datasets. With over 3 billion data records from 15+ online sources, Coresignal delivers high-quality data on companies, employees, and jobs. It is powering decision-making for more than 700 companies across AI, investment, HR tech, sales tech, and market intelligence industries. A founding member of the Ethical Web Data Collection Initiative, Coresignal stands out not only for its data quality but also for its commitment to responsible data collection practices. Recognized as the top data provider by Datarade for two consecutive years, Coresignal is the go-to partner for those who need fresh, accurate, and ethically sourced B2B data at scale. Discover how Coresignal's data can enhance your AI platforms. Visit dataengineeringpodcast.com/coresignal to start your free 14-day trial.
Your host is Tobias Macey and today I'm interviewing Arun Joseph about building an agent platform to empower the business to adopt agentic capabilities

Interview

Introduction
How did you get involved in the area of data management?
Can you start by giving an overview of how Deutsche Telekom has been approaching applications of generative AI?
- What are the key challenges that have slowed adoption/implementation?
Enabling non-engineering teams to define and manage AI agents in production is a challenging goal. From a data engineering perspective, what does the abstraction layer for these teams look like?
- How do you manage the underlying data pipelines, versioning of agents, and monitoring of these user-defined agents?
What was your process for developing the architecture and interfaces for what ultimately became the LMOS?
- How do the principles of operatings systems help with managing the abstractions and composability of the framework?
Can you describe the overall architecture of the LMOS?
- What does a typical workflow look like for someone who wants to build a new agent use case?
- How do you handle data discovery and embedding generation to avoid unnecessary duplication of processing?
With your focus on openness and local control, how do you see your work complementing projects like Oumi
What are the most interesting, innovative, or unexpected ways that you have seen LMOS used?
What are the most interesting, unexpected, or challenging lessons that you have learned while working on LMOS?
When is LMOS the wrong choice?
What do you have planned for the future of LMOS and MASAIC?

Contact Info

Parting Question

From your perspective, what is the biggest gap in the tooling or technology for data management today?

Closing Announcements

Thank you for listening! Don't forget to check out our other shows. Podcast.__init__ covers the Python language, its community, and the innovative ways it is being used. The AI Engineering Podcast is your guide to the fast-moving world of building AI systems.
Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.
If you've learned something or tried out a project from the show then tell us about it! Email hosts@dataengineeringpodcast.com with your story.

Links

The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA