The Ruby AI Podcast

Chris Hasinski, an AI and Ruby expert with a machine learning background from UC Davis, shares impactful insights into self-hosting AI models. He discusses the benefits of control and cost savings, along with challenges like latency. Chris recounts his ML journey, covering applications beyond text and fine-tuning techniques. He highlights Ruby's potential in ML, the importance of quality data, and nuances of local model performance. With insights into monitoring and developer experience, his vision includes enhancing Ruby's role in the evolving AI landscape.

Carmine Paolino, a developer and creator of the Ruby LLM project, delves into the rapid success of Ruby LLM, driven by his philosophy of simplicity and adaptability. He discusses innovative topics like progressive disclosure in APIs, multi-agent systems, and context management to enhance efficiency. Notably, he emphasizes the importance of flexible library design and practical applications, alongside tackling challenges in concurrency using Async. Carmine's insights will inspire Ruby developers to leverage AI tools more effectively.

In this discussion, Avi Flombaum, founder of Flatiron School, shares insights on teaching programming and the evolving impact of AI on software development. He emphasizes the importance of product thinking alongside coding skills and advocates for using AI as a powerful tool in the learning process. Avi reveals how integrating AI can enhance developer workflows and increase output efficiency. He also discusses the need for a modern curriculum that deeply engages students, promoting problem-solving and practical challenges to prepare them for real-world scenarios.

In this episode of the Ruby AI Podcast, co-hosts Valentino Stoll and Joe Leo engage in a lively discussion with guest Justin Searls. They explore the evolving landscape of software development with agentic AI tools, comparing traditional agile methodologies with emerging AI-driven practices. Justin Searls his experiences with refactoring and the challenges of integrating AI tools into development workflows. The conversation touches on the suitability of AI in coding, philosophical perspectives on reinforcing proper software practices, and the future potential of these technologies. Justin also provides valuable insights on configuring AI tools for better productivity and discusses his personal coping strategies with the frustrations of modern AI capabilities.00:00 Introduction and Hosts Banter00:30 Guest Introduction: Justin Searls03:13 Justin's Career and Conference Talks07:52 The Evolution of Agile and Development Practices16:07 Challenges with AI and Iterative Development27:47 Recalibrating Development Processes28:00 Adoption of Pivotal Labs' Methods28:28 Continuous Integration and Testing29:21 AI in Development: Current State and Challenges30:16 The Role of AI Agents in Development32:17 Frustrations with AI Tools35:03 Philosophical Reflections on AI in Development36:16 Generative vs. Subtractive AI37:06 The Future of AI in Software Development39:27 Balancing Coding Enjoyment and Productivity44:02 Capability vs. Suitability in AI Tools46:35 Prompt Engineering Tips and Tricks52:39 Closing Thoughts and Plugs

In this discussion, Amanda Bizzinotto, a machine learning and data science expert at Ombu Labs, shares her insights on AI's role in Rails projects. She outlines innovative AI tools for automating Rails upgrades and a Slack bot designed to streamline knowledge management. Amanda also tackles the challenges of integrating AI into consultancy and emphasizes the importance of observability in AI systems. Additionally, she dives into advanced prompting techniques and the benefits of multi-agent architectures, providing a glimpse into the future of AI in software development.

Valentino and Joe dive into the reality behind AI salaries, discussing the disparity between hype and actual compensation. They debate whether any company can truly dominate the LLM market, emphasizing incremental improvements over clear winners. The hosts explore the complexities of benchmarking AI models and the necessity for customized evaluation tools. New OpenAI features that enhance prompt engineering are discussed, alongside the balance between playful experimentation and standardization in Ruby, highlighting its role in AI development.

Chad Fowler, a veteran Rubyist and forward-thinking investor, joins the discussion with Valentino Stoll and Joe Leo to explore the future of programming in an AI-driven world. He emphasizes generative AI as the next layer of abstraction, transforming how code is generated. The trio debates the merits of Ruby versus Python, cognitive load within frameworks, and the balance between micro-services and monoliths. They also discuss the importance of manageable code and the impact of AI on legacy systems and developer careers.

Kieran Klaassen, a Ruby developer and the mind behind the AI tools Cora and Leva, shares his passion for AI and Rails. He dives into the creation of the Leva gem, designed for evaluating large language models, and discusses his journey in AI product development. The conversation covers best practices in AI tool creation, the importance of continuous evaluation, and effective workflow management. Kieran highlights the collaborative spirit of the Ruby community and the joy found in integrating AI into Ruby on Rails projects.

Obie Fernandez, a Ruby expert and Shopify Principal Engineer with 20 years of experience, joins Valentino Stoll and Joe Leo for an engaging discussion. They delve into the launch of Roast, an open-source Ruby framework for AI workflows. Key topics include innovative AI orchestration, the evolution of AI in coding practices, and the interplay between creativity and software development. Obie highlights the importance of effective prompting, navigating knowledge silos in AI, and the transformative potential of AI in both music production and tech.

Justin Bowen, a Ruby developer with 17 years of experience, shares insights about Active Agent, his innovative Rails-native framework for integrating AI. He discusses challenges in shipping AI, emphasizing the importance of context and real-world testing. Bowen also critiques the hype around AI, comparing it to crypto trends. The conversation explores the balance between open-source sustainability and monetization, community involvement, and the evolution of Ruby in the AI landscape, while highlighting exciting projects like Osmo AI and the upcoming Ruby AI hackathon.