Ep083: Navigating the AWS Bedrock Journey: Planview's AI Evolution

Richard Sonnenblick and Lee Rehwinkel of Planview discuss their transition to Amazon Bedrock for a multi-agent AI system while sharing valuable implementation and user experience lessons.

Topics Include:

• Introduction to Planview's 18-month journey creating an AI co-pilot.
• Planview builds solutions for strategic portfolio and agile planning.
• 5,000+ companies with millions of users leverage Planview solutions.
• Co-pilot vision: AI assistant sidebar across multiple applications.
• RAG used to ingest customer success center documents.
• Tracking product data, screens, charts, and tables.
• Incorporating industry best practices and methodologies.
• Can ingest customer-specific documents to understand company terminology.
• Key benefit: Making every user a power user.
• Key benefit: Saving time on tedious and redundant tasks.
• Key benefit: De-risking initiatives through early risk identification.
• Cost challenges: GPT-4 initially cost $60 per million tokens.
• Cost now only $1.20 per million tokens.
• Market evolution: AI features becoming table stakes.
• Performance rubrics created for different personas and applications.
• Multi-agent architecture provides technical and organizational scalability.
• Initial implementation used Azure and GPT-4 models.
• Migration to AWS Bedrock brought model choice benefits.
• Bedrock allowed optimization across cost, benchmarking, and speed dimensions.
• Added AWS guardrails and knowledge base capabilities.
• Lesson #1: Users hate typing; provide clickable options.
• Lesson #2: Users don't like waiting; optimize for speed.
• Lesson #3: Users take time to trust AI; provide auditable answers.
• Question about role-based access control and permissions.
• Co-pilot uses user authentication to access application data.
• Question about subscription pricing for AI features.
• Need to educate customers about AI's value proposition.
• Question about reasoning modes and timing expectations.
• Showing users the work process makes waiting more tolerable.

Participants:

• Richard Sonnenblick - Chief Data Scientist, Planview
• Lee Rehwinkel – Principal Data Scientist, Planview

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/