CSAIL Alliances Podcasts Me, Myself, and AI: Building Better Answers With AI Agents, featuring SAP’s Walter Sun (Bonus Episode!)
Jul 24, 2025
Walter Sun, Senior VP and Global Head of AI at SAP, discusses the transformative role of generative AI in business. He explains the development of a generative AI hub with access to over 30 large language models and how smaller models can outperform larger ones in specific tasks. Walter shares insights into empowering employees through 'AI Days' and the importance of minimizing hallucinations through fine-tuned agents. He also emphasizes the need for trust and transparency in enterprise AI systems, shaping the future of industry strategies.
AI Snips
Chapters
Transcript
Episode notes
SAP's Generative AI Hub Strategy
- SAP builds a generative AI hub with access to over 30 large language models rather than creating their own LLM.
- They recommend the best model for a customer’s business use case based on benchmarks and cost effectiveness.
Empowering Employees with AI Days
- Train your employees with AI Days to get hands-on experience with enterprise-grade large language models.
- Encourage detailed prompting to improve model responses and enhance partnership productivity internally.
Flight Booking Example Highlights Hallucinations
- Walter Sun uses the example of booking flights from Lexington to Palo Alto to show hallucinations in general language models.
- Specialized small language models, or agents, avoid hallucinations by using real-world context like commercial airports and user preferences.