Get the latest scoop from KubeCon NA 2024 with insights on major funding rounds and industry trends, including the rising demand for multi-cluster management tools. Discover innovations like Snyk's acquisition for API security and AI-driven solutions like Nutanix's Enterprise AI. Hear about Akamai's new app platform aimed at improving distributed application deployment and explore the significant advancements in Kubernetes version 1.32. Plus, enjoy some lighthearted chats about winter activities and pet antics along the way!

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Tobi Knaup, VP and General Manager of Cloud Native at Nutanix about all things Kubernetes and AI. The discussion focuses on how Kubernetes has evolved since the early days, and why it's architecture is a perfect fit for accelerating adoption of AI workloads inside organizations.   Check out our website at https://kubernetesbytes.com/   #kubernetes #aimodels #AIonKubernetes #machinelearning #hybridcloud #multicloud #modeltraining

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Diego Devalle and Anoop Gopalakrishnan from Guidewire to talk about how they went through an application modernization journey and adopted Kubernetes and cloud over the last 5 years.   Diego and Anoop share their experiences around how they drove this modernization inside Guidewire by both championing organizational change, and introducing Kubernetes and cloud technologies, while at the same time ensuring that they serve their existing customers in the insurance industry.   Check out our website at https://kubernetesbytes.com/ Show links:   https://medium.com/@guidewire-engineering https://www.youtube.com/@GuidewireSoftware https://www.youtube.com/watch?v=N-WaEneeIJs https://www.youtube.com/watch?v=bKCwMO4UeJ8 https://www.guidewire.com/about/careersTimestamps:  00:05:24 Interview with Diego and Anoop 01:02:37 Key takeaways

In this episode, we sit down with Nilesh Agarwal, co-founder of Inferless, a platform designed to streamline serverless GPU inference. We’ll cover the evolving landscape of model deployment, explore open-source tools like KServe and Knative, and discuss how Inferless solves common bottlenecks, such as cold starts and scaling issues. We also take a closer look at real-world examples like CleanLab, who saved 90% on GPU costs using Inferless.Whether you’re a developer, DevOps engineer, or tech enthusiast curious about the latest in AI infrastructure, this podcast offers insights into Kubernetes-based model deployment, efficient updates, and the future of serverless ML. Tune in to hear Nilesh's journey from Amazon to founding Inferless and how his platform is transforming the way companies deploy machine learning models.Subscribe now for more episodes! Show Links: OpenShift 4.17 is GA https://www.youtube.com/live/DvKHwz-c11c?si=6Zap6hk_GsQfdX2m Policy SBOM from Styra: https://www.styra.com/blog/introducing-policy-sbom/ NVIDIA GEForce NOW runs on KubeVirt https://thenewstack.io/now-nvidia-scaled-its-cloud-services-with-kubevirt/ CBT feedback https://thenewstack.io/kubernetes-advances-cloud-native-data-protection-share-feedback CNCF KUBEEDGE Grad https://www.devopsdigest.com/cncf-announces-kubeedge-graduation?utm_source=tldrdevops Palumi Operator 2.0 https://www.pulumi.com/blog/pulumi-kubernetes-operator-2-0Inferless LInks: https://www.inferless.com/blog/cleanlab-saves-90-on-gpu-costs-with-inferless-serverless-inference https://www.inferless.com/blog/how-spoofsense-scaled-their-ai-inference-with-inferless-dynamic-batching-autoscaling https://www.inferless.com/  https://docs.inferless.com/introduction/introduction  LinkedIn - https://www.linkedin.com/in/nilesh-agarwal/  X- https://x.com/nilesh_agarwal2  Medium Blog https://nilesh-agarwal.medium.com/

In this discussion, Ofir Cohen, the CTO of Container Security at Wiz, dives deep into cloud-native security challenges. He emphasizes the transition businesses must make from traditional environments to cloud, and how vital it is to weave security into the development lifecycle. Topics like advanced credential management, the importance of monitoring and compliance, and the innovative strategies Wiz employs to enhance security come to light. Cohen also sheds light on how developers can ensure robust security while managing workflows effectively.

Sam Alba, a former Docker engineer and co-founder of Dagger, dives into the complexities of modern CI systems and how they can slow down productivity. He explores how Dagger acts as a programmable CI/CD pipeline engine, simplifying workflows and enhancing portability across environments. Discover the innovative aspects of Dagger, including reusable modules and its integration capabilities with existing tools like Jenkins. Alba also shares insights on best practices for optimizing Dagger functions, making CI automation more efficient and developer-friendly.

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand.   Check out our website at https://kubernetesbytes.com/  Cloud Native News: https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito https://orca.security/resources/blog/kubernetes-testing-environment/ https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available  Show links: Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/ KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15) KubeRay repository: https://github.com/ray-project/kuberay Ray repository: https://github.com/ray-project/ray Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform  Timestamps:  00:02:40 Cloud Native News  00:07:20 Interview with Kai  00:49:15 Key takeaways

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Alex Lines and Vara Bonthu from AWS to talk about the Data on EKS project. The discussion dives into why AWS decided to build the Data on EKS project and provide patterns for EKS customers to use to deploy data platforms, machine learning and GenAI tools on EKS clusters. They talk about what's included and what's not included with each of these patterns and whats coming down the line.   Check out our website at https://kubernetesbytes.com/  Cloud Native News:  https://kubernetes.io/blog/2024/08/16/kubernetes-1-31-prevent-persistentvolume-leaks-when-deleting-out-of-order/ https://kubernetes.io/blog/2024/08/16/matchlabelkeys-podaffinity/ https://kubernetes.io/blog/2024/08/15/kubernetes-1-31-volume-attributes-class/ https://roadmap.vcluster.com/changelog/vcluster-v020-ga https://www.cloudbees.com/blog/cloudbees-acquires-launchable-to-enable-development-teams-to-iterate-faster?Product=Launchable&Tag=Blog%2CAI%2CLaunchable%20Update  Show links: https://awslabs.github.io/data-on-eks/ https://www.youtube.com/watch?v=G9aNXEu_a8k  https://github.com/awslabs/data-on-eks  https://www.linkedin.com/in/alex-lines-aws/  https://www.linkedin.com/in/varaprofile/  Timestamps:  00:01:45 Cloud Native News  00:12:15 Interview with Alex and Vara  00:58:21 Key takeaways

Sachi Desai, a Product Manager specializing in AI technologies, and Paul Yu, a Senior Cloud Advocate at Microsoft, dive into the KAITO project for deploying open source LLM models on Kubernetes. They discuss how KAITO simplifies running AI applications alongside LLM models and enables users to bring and fine-tune their own models. The conversation highlights innovative techniques like LoRa and Q-LoRa for efficient model training. Additionally, they emphasize community engagement's role in enhancing AI model deployment and future capabilities.

Danielle Cook, VP of Marketing at appCD and Co-chair of the CNCF Cartografos Working Group, dives into the business case for adopting cloud-native technologies. She discusses how technical contributors can align their strategies with business goals, emphasizing growth and efficiency. The conversation explores the Cloud Native Maturity Model, addressing the challenges organizations face during adoption. Danielle also highlights the importance of effective communication tailored for different executive roles to build a compelling case for modernization.