Theresa Parker, a seasoned technology executive with 25 years of experience, and Sudhi Balan, the CTO for AI & Cloud at Rocket Software, delve into the challenges of creating high-quality AI applications. They discuss retrieval augmented generation's role in enhancing text quality and its practical applications in customer support. The duo also highlights the significance of robust data governance, innovative testing strategies, and the transformative potential of AI in streamlining processes like loan approvals and improving customer service.
51:28
forum Ask episode
web_stories AI Snips
view_agenda Chapters
auto_awesome Transcript
info_circle Episode notes
question_answer ANECDOTE
Loan Origination Challenges
Theresa Parker's son, a former loan officer, found the loan origination process tedious.
He had to review numerous documents, making it a slow and laborious task.
volunteer_activism ADVICE
Start with a Clear Goal
Define your objectives and desired outcomes before implementing RAG or AI.
Consider the costs and benefits, and avoid treating AI as a magic solution.
volunteer_activism ADVICE
Respect Existing Governance
Integrate RAG technology with existing data governance policies, like retention schedules and access controls.
Test the implementation thoroughly to ensure compliance and avoid circumvention of established rules.
Get the Snipd Podcast app to discover more snips from this episode
AI features and products are the hottest area of software development. Creating high quality AI software is both essential and challenging for many businesses. In this episode, we look at retrieval augmented generation, an important technique for improving text generation quality in AI applications. Beyond technical measures, we look at the broader quality problem for AI applications. How do you ensure your AI applications are effective and secure? What steps should you take to integrate AI into your existing data governance frameworks? And how do you measure the success of these AI-driven solutions?
Theresa Parker is the Director of Product Management at Rocket Software. She has 25 years of experience as a technology executive with a focus on software development processes, consultancy, and business development. Her recent work in content management focuses on the use of AI and RAG to improve content discoverability.
Sudhi Balan is the Chief Technology Officer for AI & Cloud. He leads the AI and data teams for data modernization, driving AI adoption of Rocket's structured and unstructured data products. He also shapes AI strategy for Rocket’s infrastructure and app portfolio. He has earned patents for safe and scalable applications of transformational technology. Previously, he led digital transformation and hybrid cloud strategy for Rocket’s unstructured data business and was Senior Director of Product Development at ASG.
In the episode, Richie, Theresa, and Sudhi explore retrieval-augmented generation, its applications in customer support and loan processing, the importance of data governance and privacy, the role of testing and guardrails in AI, cost management strategies, and the potential of AI to transform customer experiences, and much more.