#608: Generative AI Roundup - August 2023
AWS Podcast
How to Reduce Training Costs With AWS Inferentia 2
AWS Inferentia 2 is an accelerator that's designed by AWS to deliver high performance at the lowest cost for your deep learning inference applications. It gives you four times higher throughput and 10 times lower latency compared to Inferentia. And we expect this to help customers get about 40% lower training costs. Now, with any new domain, there's a lot to learn and often it's daunting. So we've released some training that should help.
00:00
Transcript
Play full episode
Transcript
Episode notes
Simon takes you on a tour of your GenAI options. From software development, to AI policy, to trialling FMs, to new instance types, and CPUs.
Referenced Links:
- URL: https://aws.amazon.com/blogs/devops/optimize-software-development-with-amazon-codewhisperer/
Title: Optimize software development with Amazon CodeWhisperer | AWS DevOps Blog
- URL: https://aws.amazon.com/blogs/devops/10-ways-to-build-applications-faster-with-amazon-codewhisperer/
Title: 10 ways to build applications faster with Amazon CodeWhisperer | AWS DevOps Blog
- URL: https://aws.amazon.com/blogs/big-data/build-data-integration-jobs-with-ai-companion-on-aws-glue-studio-notebook-powered-by-amazon-codewhisperer/
Title: Build data integration jobs with AI companion on AWS Glue Studio Notebook powered by Amazon CodeWhisperer
- URL: https://aws.amazon.com/blogs/machine-learning/use-generative-ai-foundation-models-in-vpc-mode-with-no-internet-connectivity-using-amazon-sagemaker-jumpstart/
Title: Use generative AI foundation models in VPC mode with no internet connectivity using Amazon SageMaker JumpStart | AWS Machine Learning Blog
- URL: https://aws.amazon.com/blogs/machine-learning/llama-2-foundation-models-from-meta-are-now-available-in-amazon-sagemaker-jumpstart/
Title: Llama 2 foundation models from Meta are now available in Amazon SageMaker JumpStart | AWS Machine Learning Blog
- URL: https://aws.amazon.com/blogs/machine-learning/use-stable-diffusion-xl-with-amazon-sagemaker-jumpstart-in-amazon-sagemaker-studio/
Title: Use Stable Diffusion XL with Amazon SageMaker JumpStart in Amazon SageMaker Studio | AWS Machine Learning Blog
- URL: https://aws.amazon.com/blogs/machine-learning/efficiently-train-tune-and-deploy-custom-ensembles-using-amazon-sagemaker/
Title: Efficiently train, tune, and deploy custom ensembles using Amazon SageMaker | AWS Machine Learning Blog
- URL: https://aws.amazon.com/blogs/machine-learning/quickly-build-high-accuracy-generative-ai-applications-on-enterprise-data-using-amazon-kendra-langchain-and-large-language-models/
Title: Quickly build high-accuracy Generative AI applications on enterprise data using Amazon Kendra, LangChain, and large language models | AWS Machine Learning Blog
- URL: https://aws.amazon.com/bedrock/features/
Title: Foundation Model API Service – Amazon Bedrock Features – AWS
- URL: https://aws.amazon.com/blogs/aws/preview-enable-foundation-models-to-complete-tasks-with-agents-for-amazon-bedrock/
Title: Preview – Enable Foundation Models to Complete Tasks With Agents for Amazon Bedrock | AWS News Blog
- URL: https://aws.amazon.com/blogs/business-intelligence/announcing-generative-bi-capabilities-in-amazon-quicksight/
Title: Announcing Generative BI capabilities in Amazon QuickSight | AWS Business Intelligence Blog
- URL: https://aws.amazon.com/about-aws/whats-new/2023/05/amazon-rds-postgresql-pgvector-ml-model-integration/
Title: Amazon RDS for PostgreSQL now supports pgvector for simplified ML model integration
- URL: https://aws.amazon.com/blogs/big-data/introducing-the-vector-engine-for-amazon-opensearch-serverless-now-in-preview/
Title: Introducing the vector engine for Amazon OpenSearch Serverless, now in preview | AWS Big Data Blog
- URL: https://aws.amazon.com/blogs/aws/new-amazon-ec2-p5-instances-powered-by-nvidia-h100-tensor-core-gpus-for-accelerating-generative-ai-and-hpc-applications/
Title: New – Amazon EC2 P5 Instances Powered by NVIDIA H100 Tensor Core GPUs for Accelerating Generative AI and HPC Applications | AWS News Blog
- URL: https://aws.amazon.com/blogs/machine-learning/maximize-stable-diffusion-performance-and-lower-inference-costs-with-aws-inferentia2/
Title: Maximize Stable Diffusion performance and lower inference costs with AWS Inferentia2 | AWS Machine Learning Blog
- URL: https://aws.amazon.com/blogs/machine-learning/new-technical-deep-dive-course-generative-ai-foundations-on-aws/
Title: New technical deep dive course: Generative AI Foundations on AWS | AWS Machine Learning Blog
- URL: https://aws.amazon.com/blogs/machine-learning/aws-offers-new-artificial-intelligence-machine-learning-and-generative-ai-guides-to-plan-your-ai-strategy/
Title: AWS offers new artificial intelligence, machine learning, and generative AI guides to plan your AI strategy | AWS Machine Learning Blog
- URL: https://aws.amazon.com/blogs/machine-learning/aws-reaffirms-its-commitment-to-responsible-generative-ai/
Title: AWS Reaffirms its Commitment to Responsible Generative AI | AWS Machine Learning Blog
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
