The Cloudcast

The podcast discusses barriers to entry for AI & ML, the challenges of implementing models into production applications, the complexity of integrating generative AI, the use of off-the-shelf models vs training from scratch, and OctoML as a platform for model deployment.

Challenges Enterprises face with AI, from data and GPU location to biases and privacy. How AI will impact businesses and the IT industry. Different perspectives on enterprise AI and old AI. The evolution of AI and its democratization. Concerns about misinformation and bias in AI.

Yaniv Ben Hemo, Founder/CEO at Memphis Dev, discusses Memphis Cloud, an alternative architecture for delivering streaming data. He explains why a streaming alternative like Memphis is needed, the differences between a broker and a streaming stack, and the challenges with existing tools like Kafka. The podcast also explores the shift from batch processing to real-time streaming in data processing.

Explore AWS's future position in the evolving cloud market and their readiness to cross the chasm. Discuss their dominance, wide range of services, and significant investments. Evaluate their differentiation, innovation pace, and partnership strategy. Examine potential challenges and transformations ahead, including new leadership and market dynamics.

Gaetan Castelein (@gaetcast, VP Marketing at @tectonai) talks about the complexities of building AI models, features and deploying AI into production for real-time applications. SHOW: 745CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"SHOW SPONSORS:AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player. Cloudfix HomepageFind "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and SpotifyKeep up to data with Enterprise Tech with theCUBEReduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle.  Learn more about Panoptica at panoptica.appSHOW NOTES:Tecton (homepage)State of Applied Machine Learning 2023 ReportHello Fresh adopts Tecton - Good article on features and feature storesWhat is real-time machine learning?Feature Platform vs. Feature StoreTopic 1 - Welcome to the show. Tell us a little bit about your backgroundTopic 2 - Let’s start with some terminology. A lot of our listeners might be relatively new to Machine Learning. I’m still coming up to speed and I actually spent more time than usual just wrapping my head around the concepts and terms and piecing them all together. What is a feature? Why is it important? How many features does ChatGPT 3 have or ChatGPT4?Topic 3 - How is a feature different from a model? Both are needed, why?Topic 4 - I’ve always wondered exactly what a data scientist does. Is this where the term Feature Engineering comes into play? Who turns the data into features and picks the appropriate model? Topic 5 - Early Machine Learning was analytical ML (offline/batch), correct? How is that different from operational ML (online/batch) and real-time ML?Topic 6 - Now that we have all that out of the way. What is a Feature Platform? How does it integrate into an organization’s existing Devops workflows and/or CI/CD pipelines? (Features as Code) How is it different from a Feature Store?Topic 7 - How do you know if the features + model yield a good result? How is prediction accuracy typically measured?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

If every company has become a software company, is it still easy to be a profitable software company? Lots of things are changing around the economics of software.SHOW: 744CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"SHOW SPONSORS:Datadog Application Monitoring: Modern Application Performance MonitoringGet started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.CloudZero – Cloud Cost Visibility and Savings​​CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spendSHOW NOTES:Hashicorp adopts Business Source LicenseNew Relic to be acquiredDatadog Consumption TrendsCloud Giants Q2 TrendsHugging Face adds new licensingThe open source licensing war is overBEING A SOFTWARE COMPANY - JUST BUILD A MOATAre we sure every company wants to become a software company?Lots of software licensing changes in the newsMaking money as a software business, at scale, is difficultPEOPLE DON’T LIKE MOATS AROUND THEIR SOFTWAREOpen source is good for collaborationOpen source could be good for marketingSoftware margins attract VCsOpen source mostly hates software marginsWhat happens to all the software companies funded by VCs over the last 3 yrs?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

API security trends and breaches are discussed. The guest, Filip Verloy, talks about his background in API security. Common problems faced by organizations and the role of APIs in breaches are explored. The chapter on AIML in API security is also highlighted.

Does it ever feel like all the technologies are just things layered on top of each other? Does it ever feel like platforms are a combination of Pizza Hut and Taco Bell? SHOW: 742CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"SHOW SPONSORS:GCore - Global Hosting, CDN, Edge and Cloud ServicesUse promocode “CLOUDCAST” to receive a €100 credit on Gcore servicesCloudZero – Cloud Cost Visibility and Savings​​CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spendDatadog Application Monitoring: Modern Application Performance MonitoringGet started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.SHOW NOTES:The Combination Pizza Hut and Taco BellTaco Town2023 ACC PreviewWHEN EVERYTHING IS A PLATFORM, FOR PLATFORM ENGINEERING TEAMSIs everything really now on the shoulders of the Platform Engineering team?Are all platform engineering teams all combined together?BE CAREFUL ABOUT CREATING THINGS WITH NO MEANING“It still stands as the best summary of the state of living we call Now imaginable. No business or brand means anything, no meaning cannot be bundled for the purpose of the sales team, nothing is too special that it can’t be balled up into a late night chaos meal thrown straight into the mouth of drunken capitalism.” - Holly Anderson and Spencer Hall, Channel 6FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

Dave Vellante (@dvellante, Cofounder & Co-CEO SiliconANGLE Media, co-host of @theCUBE) gives an update on the status of SuperClouds and talks about the recent SuperCloud 3 event. SHOW: 741CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"SHOW SPONSORS:GCore - Global Hosting, CDN, Edge and Cloud ServicesUse promocode “CLOUDCAST” to receive a €100 credit on Gcore servicesFind "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and SpotifyKeep up to data with Enterprise Tech with theCUBEReduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle.  Learn more about Panoptica at panoptica.appSHOW NOTES:2022 Look Ahead to SuperClouds (Cloudcast Eps.586)SuperCloud 3 (event)SuperCloud 2 (event)The Rise of SuperCloud (2021)theCUBE (homepage)Topic 1 - Welcome back to the show. You cover everything, but where are your main focuses these days?Topic 2 - For anyone that’s new to Cloudcast, or new to this concept of SuperCloud (which has evolved over time), give us the high-level overview of the concept.Topic 3 - Let’s dive right into SuperCloud, since you just finished the SuperCloud 3 event. What were the big trends within the event?Topic 4 - The new focus on AI seems to have shown a new light on the location of data, and how well isolated data (and models) are from other companies. How do you see the concept of SuperCloud playing with new AI demands around data locality? Topic 5 - It seems like nobody is going to be able to afford the CAPEX required to do AI (GPUs) at scale except the big three hyperclouds. They are all going through various levels of economic challenges. Do you expect to see infrastructure becoming an AI bottleneck soon? Topic 6 - Are you seeing any companies or technologies breaking away from the pack with regard to the SuperCloud capabilities? Topic 7 - Where are you focusing on the next SuperCloud event and research? FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet

What does the future of the software business look like? How much of an impact will SaaS and AI have on the profitability of software? SHOW: 740CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"SHOW SPONSORS:Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle.  Learn more about Panoptica at panoptica.appSHOW NOTES:Are Software Companies Bad Business? - Clouded Judgment Aggregation Theory - StratecherySOME VCs ARE QUESTIONING IF SOFTWARE IS A GOOD BUSINESSVCs are concerned about the rate of return (and cash-flow) or software.Is the future of open source software always SaaS offerings? Have we seen enough success with that model to say it’s a viable future business model?WHAT ARE THE EVOLVING DYNAMICS OF THE SOFTWARE BUSINESS?Is SaaS too fragmented, or will aggregated platforms emerge?How much will AI add to the costs (or COGS) of software? If software (especially SaaS) is bought by end-users or teams, will they appreciate AI automation vs. concern about jobs?How does the pricing of SaaS evolve? Is it still per-seat, if AI can reduce the number of seats?Are there channels for PLG software? If every company is a software company, is software becoming a commodity?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet