The Cloudcast

Explore AWS's future position in the evolving cloud market and their readiness to cross the chasm. Discuss their dominance, wide range of services, and significant investments. Evaluate their differentiation, innovation pace, and partnership strategy. Examine potential challenges and transformations ahead, including new leadership and market dynamics.

Gaetan Castelein (@gaetcast, VP Marketing at @tectonai) talks about the complexities of building AI models, features and deploying AI into production for real-time applications. SHOW: 745CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"SHOW SPONSORS:AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player. Cloudfix HomepageFind "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and SpotifyKeep up to data with Enterprise Tech with theCUBEReduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle.  Learn more about Panoptica at panoptica.appSHOW NOTES:Tecton (homepage)State of Applied Machine Learning 2023 ReportHello Fresh adopts Tecton - Good article on features and feature storesWhat is real-time machine learning?Feature Platform vs. Feature StoreTopic 1 - Welcome to the show. Tell us a little bit about your backgroundTopic 2 - Let’s start with some terminology. A lot of our listeners might be relatively new to Machine Learning. I’m still coming up to speed and I actually spent more time than usual just wrapping my head around the concepts and terms and piecing them all together. What is a feature? Why is it important? How many features does ChatGPT 3 have or ChatGPT4?Topic 3 - How is a feature different from a model? Both are needed, why?Topic 4 - I’ve always wondered exactly what a data scientist does. Is this where the term Feature Engineering comes into play? Who turns the data into features and picks the appropriate model? Topic 5 - Early Machine Learning was analytical ML (offline/batch), correct? How is that different from operational ML (online/batch) and real-time ML?Topic 6 - Now that we have all that out of the way. What is a Feature Platform? How does it integrate into an organization’s existing Devops workflows and/or CI/CD pipelines? (Features as Code) How is it different from a Feature Store?Topic 7 - How do you know if the features + model yield a good result? How is prediction accuracy typically measured?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

If every company has become a software company, is it still easy to be a profitable software company? Lots of things are changing around the economics of software.SHOW: 744CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"SHOW SPONSORS:Datadog Application Monitoring: Modern Application Performance MonitoringGet started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.CloudZero – Cloud Cost Visibility and Savings​​CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spendSHOW NOTES:Hashicorp adopts Business Source LicenseNew Relic to be acquiredDatadog Consumption TrendsCloud Giants Q2 TrendsHugging Face adds new licensingThe open source licensing war is overBEING A SOFTWARE COMPANY - JUST BUILD A MOATAre we sure every company wants to become a software company?Lots of software licensing changes in the newsMaking money as a software business, at scale, is difficultPEOPLE DON’T LIKE MOATS AROUND THEIR SOFTWAREOpen source is good for collaborationOpen source could be good for marketingSoftware margins attract VCsOpen source mostly hates software marginsWhat happens to all the software companies funded by VCs over the last 3 yrs?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

API security trends and breaches are discussed. The guest, Filip Verloy, talks about his background in API security. Common problems faced by organizations and the role of APIs in breaches are explored. The chapter on AIML in API security is also highlighted.

Does it ever feel like all the technologies are just things layered on top of each other? Does it ever feel like platforms are a combination of Pizza Hut and Taco Bell? SHOW: 742CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"SHOW SPONSORS:GCore - Global Hosting, CDN, Edge and Cloud ServicesUse promocode “CLOUDCAST” to receive a €100 credit on Gcore servicesCloudZero – Cloud Cost Visibility and Savings​​CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spendDatadog Application Monitoring: Modern Application Performance MonitoringGet started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.SHOW NOTES:The Combination Pizza Hut and Taco BellTaco Town2023 ACC PreviewWHEN EVERYTHING IS A PLATFORM, FOR PLATFORM ENGINEERING TEAMSIs everything really now on the shoulders of the Platform Engineering team?Are all platform engineering teams all combined together?BE CAREFUL ABOUT CREATING THINGS WITH NO MEANING“It still stands as the best summary of the state of living we call Now imaginable. No business or brand means anything, no meaning cannot be bundled for the purpose of the sales team, nothing is too special that it can’t be balled up into a late night chaos meal thrown straight into the mouth of drunken capitalism.” - Holly Anderson and Spencer Hall, Channel 6FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

Dave Vellante (@dvellante, Cofounder & Co-CEO SiliconANGLE Media, co-host of @theCUBE) gives an update on the status of SuperClouds and talks about the recent SuperCloud 3 event. SHOW: 741CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"SHOW SPONSORS:GCore - Global Hosting, CDN, Edge and Cloud ServicesUse promocode “CLOUDCAST” to receive a €100 credit on Gcore servicesFind "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and SpotifyKeep up to data with Enterprise Tech with theCUBEReduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle.  Learn more about Panoptica at panoptica.appSHOW NOTES:2022 Look Ahead to SuperClouds (Cloudcast Eps.586)SuperCloud 3 (event)SuperCloud 2 (event)The Rise of SuperCloud (2021)theCUBE (homepage)Topic 1 - Welcome back to the show. You cover everything, but where are your main focuses these days?Topic 2 - For anyone that’s new to Cloudcast, or new to this concept of SuperCloud (which has evolved over time), give us the high-level overview of the concept.Topic 3 - Let’s dive right into SuperCloud, since you just finished the SuperCloud 3 event. What were the big trends within the event?Topic 4 - The new focus on AI seems to have shown a new light on the location of data, and how well isolated data (and models) are from other companies. How do you see the concept of SuperCloud playing with new AI demands around data locality? Topic 5 - It seems like nobody is going to be able to afford the CAPEX required to do AI (GPUs) at scale except the big three hyperclouds. They are all going through various levels of economic challenges. Do you expect to see infrastructure becoming an AI bottleneck soon? Topic 6 - Are you seeing any companies or technologies breaking away from the pack with regard to the SuperCloud capabilities? Topic 7 - Where are you focusing on the next SuperCloud event and research? FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

What does the future of the software business look like? How much of an impact will SaaS and AI have on the profitability of software? SHOW: 740CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"SHOW SPONSORS:Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle.  Learn more about Panoptica at panoptica.appSHOW NOTES:Are Software Companies Bad Business? - Clouded Judgment Aggregation Theory - StratecherySOME VCs ARE QUESTIONING IF SOFTWARE IS A GOOD BUSINESSVCs are concerned about the rate of return (and cash-flow) or software.Is the future of open source software always SaaS offerings? Have we seen enough success with that model to say it’s a viable future business model?WHAT ARE THE EVOLVING DYNAMICS OF THE SOFTWARE BUSINESS?Is SaaS too fragmented, or will aggregated platforms emerge?How much will AI add to the costs (or COGS) of software? If software (especially SaaS) is bought by end-users or teams, will they appreciate AI automation vs. concern about jobs?How does the pricing of SaaS evolve? Is it still per-seat, if AI can reduce the number of seats?Are there channels for PLG software? If every company is a software company, is software becoming a commodity?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

Dr. Ronen Dar (Co-Founder/ CTO of @runailabs) talks about the challenges of running compute infrastructure for AI, the GPU ecosystem, sizing LLMs and more. SHOW: 739CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"SHOW SPONSORS:GCore - Global Hosting, CDN, Edge and Cloud ServicesUse promocode “CLOUDCAST” to receive a €100 credit on Gcore servicesEquinix Global Data Centers and Networking Learn more and signup at https://deploy.equinix.com/. Use the coupon code CLOUDCAST to get $500 in credits to get started.Datadog Kubernetes Solution: Maximum Visibility into Container EnvironmentsStart monitoring the health and performance of your container environment with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.SHOW NOTES:Run:ai - Build Your Next Large Model (homepage)Ronen Dar, Run:AI's CTO, on managing computation resources in ML pipelinesTopic 1 - Welcome to the show. Tell us a little bit about your background, and what you focus on at Run:ai.Topic 2 - Let’s begin by talking about the challenges of running AI applications. What unique characteristics and requirements do AI applications have?Topic 3 - Most AI applications run on GPUs. How do things change when using GPUs vs. CPUs to power AI applications? What is needed to get the most out of GPUs?Topic 4 - As environments grow larger, what is needed to scale-up environments, both in terms of scheduling applications and managing the underlying GPU infrastructure?Topic 5 - GPUs are not only expensive resources, but also in high-demand. How are companies doing capacity planning with GPUs? What struggles are you seeing companies have as they manage planning for AI projects?Topic 6 - Are the new Large Language Models (LLMs) much different in size than AI models of the past? Topic 7 - How well is the industry prepared to deal with the new interest in AI from across the industry? FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

Some recent events in the tech industry have questioned the spirit of open source, the value of contributions, and the standards that various entities should be held to. This is not a new concept, and it’s often complicated.SHOW: 738CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"SHOW SPONSORS:GCore - Global Hosting, CDN, Edge and Cloud ServicesUse promocode “CLOUDCAST” to receive a €100 credit on Gcore servicesEquinix Global Data Centers and Networking Learn more and signup at https://deploy.equinix.com/. Use the coupon code CLOUDCAST to get $500 in credits to get started.Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and SpotifyKeep up to data with Enterprise Tech with theCUBESHOW NOTES:Meta’s LLAMA-2 is not Open Source (OSI opinion)LLAMA-2 doesn’t fit the definition of open source (Twitter)Are Software Companies Bad Businesses? (Clouded Judgment)John Rockefeller Jr. and Grand Teton National ParkGrand Tetons National Park (Wyoming, USA)History of Standard Oil, Trusts and MonopoliesTHE TECH WORLD HAS A STRANGE RELATIONSHIP WITH FREEThis past week I didn’t think about tech very oftenBut coincidentally the world I was in had a historic overlap with some discussions in the tech world.FREE IS GOOD RIGHT? WHAT ABOUT WHEN IT’S DEEMED TO BE NOT GOOD?When do we determine that free is a good thing or a bad thing?When do we determine that work or contributions are valuable? Or invaluable?Are there always good actors and bad actors when something of value is involved?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

Addison Huddy (@addisonhuddy, Sr Dir of PM @Confluentinc) talks about the evolution of cloud-based Kafka platforms, and how this might reshape how all OSS software moves into the cloud.SHOW: 737CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"SHOW SPONSORS:Equinix Global Data Centers and Networking Learn more and signup at https://deploy.equinix.com/. Use the coupon code CLOUDCAST to get $500 in credits to get started.Datadog Security Solution: Modern Monitoring and SecurityStart investigating security threats before it affects your customers with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.GCore - Global Hosting, CDN, Edge and Cloud ServicesUse promocode “CLOUDCAST” to receive a €100 credit on Gcore servicesSHOW NOTES:Cloud-native Service for Apache Kafka (Confluent) Apache Kafka - Open Source Event Streaming PlatformKora: The Cloud-Native Engine for Apache KafkaKora Engine - 10x Better than Apache KafkaTopic 1 - Welcome to the show. Tell us a little bit about your background, and what you focus on at Confluent.Topic 2 - Let’s start with Confluent Cloud. What happens when you take an open source project and make it a cloud service?Topic 3 - After many years of learning, Confluent decided to build Kora. Walk us through that design process and the goals of this new 10x Kafka-compatible service. Topic 4 - As I’m looking through the capabilities of Kora (see below), can you give us a sense of how these compare to the previous Confluent Cloud?Topic 5 - Kora remains compatible with existing Kafka. How did you go about essentially maintaining the API/protocol while essentially re-writing the entire backend of the system?Topic 6 - Obviously you can’t speak for other open source projects, but given what Confluent has learned with Kora, do expect to see other companies potentially trying to build cloud-specific versions? (e.g. Kubernetes)Topic 7 - What sort of feedback do you get from users of the Kora system vs. the previous Confluent Cloud?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet