AWS Podcast #700: re:Invent 2024 - Swami Sivasubramanian Keynote
10 snips
Dec 4, 2024 Discover groundbreaking AI advancements, including over 100 new foundation models and multimodal features that simplify generative AI costs and processing. Explore educational initiatives aimed at underserved learners, featuring enhancements in data visualization tools and the new Amazon Q for SageMaker Canvas. The discussion highlights how these innovations are set to transform the landscape of AI and education, making powerful technologies more accessible.
AI Snips
Chapters
Transcript
Episode notes
Leverage Bedrock Marketplace for Diverse Models
- Access over 100 publicly available and proprietary foundation models on Amazon Bedrock Marketplace.
- Deploy these models via SageMaker endpoints, selecting desired instances and types, using unified APIs and Converse APIs.
Ensure Responsible AI with Bedrock Guardrails
- Use Amazon Bedrock Guardrails for responsible GenAI application scaling.
- Detect and filter undesirable image content with configurable thresholds, ensuring safe visuals.
Optimize with Prompt Caching
- Reduce generative AI costs and latency with Amazon Bedrock's prompt caching.
- Cache frequent prompts across API calls, saving up to 90% on cost and 85% on latency.