Scrum Master Toolbox Podcast: Agile storytelling from the trenches

Join Sander Schulhoff, a specialist in prompt engineering, Philip Resnik, a computational linguistics professor, and Dennis Peskoff from Princeton as they delve into the cutting-edge world of AI. They explore the security risks of prompt hacking and its implications for military use. Discussion highlights include the evolving role of generative AI across various fields, innovative techniques for improving AI self-criticism, and the pressing need for energy-efficient large language models. Their insights offer a fascinating glimpse into the future of AI research.

Hugo speaks with three leading figures from the world of AI research: Sander Schulhoff, a recent University of Maryland graduate and lead contributor to the Learn Prompting initiative; Philip Resnik, professor at the University of Maryland, known for his pioneering work in computational linguistics; and Dennis Peskoff, a researcher from Princeton specializing in prompt engineering and its applications in the social sciences. This is Part 1 of a special two-part episode, prompted—no pun intended—by these guys being part of a team, led by Sander, that wrote a 76-page survey analyzing prompting techniques, agents, and generative AI. The survey included contributors from OpenAI, Microsoft, the University of Maryland, Princeton, and more. In this first part, we’ll explore the critical role of prompt engineering, & diving into adversarial techniques like prompt hacking and the challenges of evaluating these techniques. we’ll examine the impact of few-shot learning and the groundbreaking taxonomy of prompting techniques from the Prompt Report. Along the way, we’ll uncover the rich history of natural language processing (NLP) and AI, showing how modern prompting techniques evolved from early rule-based systems and statistical methods. we’ll also hear how Sander’s experimentation with GPT-3 for diplomatic tasks led him to develop Learn Prompting, and how Dennis highlights the accessibility of AI through prompting, which allows non-technical users to interact with AI without needing to code. Finally, we’ll explore the future of multimodal AI, where LLMs interact with images, code, and even music creation. Make sure to tune in to Part 2, where we dive deeper into security risks, prompt hacking, and more. LINKS The livestream on YouTube The Prompt Report: A Systematic Survey of Prompting Techniques Learn Prompting: Your Guide to Communicating with AI Vanishing Gradients on Twitter Hugo on Twitter Vanishing Gradients' lu.ma calendar Vanishing Gradients on YouTube

In this enlightening discussion, Dr. Chelle Gentemann, an Open Science Program Scientist at NASA, delves into NASA's groundbreaking efforts to integrate AI into the research lifecycle. She explores innovative metrics developed to measure the impact of open science, moving beyond traditional publication metrics. Gentemann also shares insights on AI applications in various NASA projects, from oceanography to the universe's origins, and discusses the challenges of implementing open science in government. Moreover, she highlights the need for reform in academic incentives to promote data sharing and collaboration.

Guests Ines Montani and Matthew Honnibal, founders of Explosion AI and creators of the widely-used spaCy library, discuss the evolution of natural language processing (NLP) in industry. They share insights on balancing large and small AI models, challenges in modularity and privacy, and the impact of regulation on innovation. Their transition to a smaller company highlights lessons learned in the AI startup world. The conversation touches on the importance of data quality and open-source tools while celebrating the practical applications of AI for data scientists and enthusiasts alike.

Hugo speaks with Dan Becker and Hamel Husain, two veterans in the world of data science, machine learning, and AI education. Collectively, they’ve worked at Google, DataRobot, Airbnb, Github (where Hamel built out the precursor to copilot and more) and they both currently work as independent LLM and Generative AI consultants. Dan and Hamel recently taught a course on fine-tuning large language models that evolved into a full-fledged conference, attracting over 2,000 participants. This experience gave them unique insights into the current state and future of AI education and application. In this episode, we dive into: The evolution of their course from fine-tuning to a comprehensive AI conference The unexpected challenges and insights gained from teaching LLMs to data scientists The current state of AI tooling and accessibility compared to a decade ago The role of playful experimentation in driving innovation in the field Thoughts on the economic impact and ROI of generative AI in various industries The importance of proper evaluation in machine learning projects Future predictions for AI education and application in the next five years We also touch on the challenges of using AI tools effectively, the potential for AI in physical world applications, and the need for a more nuanced understanding of AI capabilities in the workplace. During our conversation, Dan mentions an exciting project he's been working on, which we couldn't showcase live due to technical difficulties. However, I've included a link to a video demonstration in the show notes that you won't want to miss. In this demo, Dan showcases his innovative AI-powered 3D modeling tool that allows users to create 3D printable objects simply by describing them in natural language. LINKS The livestream on YouTube Educational resources from Dan and Hamel's LLM course Upwork Study Finds Employee Workloads Rising Despite Increased C-Suite Investment in Artificial Intelligence Episode 29: Lessons from a Year of Building with LLMs (Part 1) Episode 30: Lessons from a Year of Building with LLMs (Part 2) Dan's demo: Creating Physical Products with Generative AI Build Great AI, Dan's boutique consulting firm helping clients be successful with large language models Parlance Labs, Hamel's Practical consulting that improves your AI Hamel on Twitter Dan on Twitter Vanishing Gradients on Twitter Hugo on Twitter

Join Shreya Shankar, a UC Berkeley researcher specializing in human-centered data management systems, as she navigates the exciting world of large language models (LLMs). Discover her insights on the shift from traditional machine learning to LLMs and the importance of data quality over algorithm issues. Shreya shares her innovative SPaDE framework for improving AI evaluations and emphasizes the need for human oversight in AI development. Plus, explore the future of low-code tools and the fascinating concept of 'Habsburg AI' in recursive processes.

In this discussion, Vincent Warmerdam, a senior data professional at :probabl, challenges conventional data science approaches with innovative insights. He emphasizes the importance of real-world problem exposure and effective visualization. The conversation dives into framing problems accurately and determining if algorithms truly solve them. Vincent advocates for simple models, discusses the role of UI in data science tools, and examines the potential and limitations of LLMs. He highlights the need for community knowledge sharing through blogging and open dialogue.

Explore insights from Eugene Yan, Bryan Bischof, Charles Frye, Hamel Husain, and Shreya Shankar on building end-to-end systems with LLMs, the experimentation mindset for AI products, strategies for building trust in AI, the importance of data examination, and evaluation strategies for professionals. These lessons apply broadly to data science, machine learning, and product development.

Experts from Amazon, Hex, Modal, Parlance Labs, and UC Berkeley share lessons learned from working with Large Language Models. They discuss the importance of evaluation and monitoring in LLM applications, data literacy in AI, the fine-tuning dilemma, real-world insights, and the evolving roles of data scientists and AI engineers.

Alan Nichol, Co-founder and CTO of Rasa, shares insights on using LLMs in chatbots, the evolution of conversational AI, and the challenges of supervised learning. He emphasizes the importance of balancing traditional techniques with new advancements. The podcast also includes a live demo of Rasa's CALM system, showcasing the separation of business logic from language models for reliable conversational flow execution.