Richard Sonnenblick and Lee Rehwinkel of Planview discuss their transition to Amazon Bedrock for a multi-agent AI system while sharing valuable implementation and user experience lessons.

Topics Include:

Introduction to Planview's 18-month journey creating an AI co-pilot.
Planview builds solutions for strategic portfolio and agile planning.
5,000+ companies with millions of users leverage Planview solutions.
Co-pilot vision: AI assistant sidebar across multiple applications.
RAG used to ingest customer success center documents.
Tracking product data, screens, charts, and tables.
Incorporating industry best practices and methodologies.
Can ingest customer-specific documents to understand company terminology.
Key benefit: Making every user a power user.
Key benefit: Saving time on tedious and redundant tasks.
Key benefit: De-risking initiatives through early risk identification.
Cost challenges: GPT-4 initially cost $60 per million tokens.
Cost now only $1.20 per million tokens.
Market evolution: AI features becoming table stakes.
Performance rubrics created for different personas and applications.
Multi-agent architecture provides technical and organizational scalability.
Initial implementation used Azure and GPT-4 models.
Migration to AWS Bedrock brought model choice benefits.
Bedrock allowed optimization across cost, benchmarking, and speed dimensions.
Added AWS guardrails and knowledge base capabilities.
Lesson #1: Users hate typing; provide clickable options.
Lesson #2: Users don't like waiting; optimize for speed.
Lesson #3: Users take time to trust AI; provide auditable answers.
Question about role-based access control and permissions.
Co-pilot uses user authentication to access application data.
Question about subscription pricing for AI features.
Need to educate customers about AI's value proposition.
Question about reasoning modes and timing expectations.
Showing users the work process makes waiting more tolerable.

Participants:

Richard Sonnenblick - Chief Data Scientist, Planview
Lee Rehwinkel – Principal Data Scientist, Planview

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

3.3 Austrian economics part 2