Rosenfeld Review Podcast

Giving feedback to subordinates can be just as stressful as receiving it. Yet evaluations are a critical component of retention, employer/employee expectations, and production in general. Having an evaluation framework and system in place creates efficiencies, fills voids, and benefits everyone on the team. Enter Ignacio Martinez, associate director at Grand Studio in Chicago. He’ll be delivering a talk at the Design Ops Summit in September, “Fair and Effective Designer Evaluation”. In this podcast episode, Ignacio and Lou explore the importance of a well-structured evaluation framework that highlights “glows and grows” in the areas of craft, quality, client interaction, and teamwork. Ignacio’s system, built on the very accessible Google Sheets, combines quantitative metrics with qualitative feedback to reduce bias and offer a comprehensive assessment of designers' performance. His framework allows for continuous feedback from peers, project directors, and supervisors. What You'll Learn from this Episode: - The principles and methodologies behind creating a fair and effective designer evaluation system - How contributions from peers, career managers, and directors can create a robust evaluation system - The importance of a structured framework with clear categories and traits such as craft, quality, client interaction, and teamwork. - The benefits of incorporating both quantitative metrics and qualitative feedback to minimize bias and provide comprehensive evaluations. - How to create a framework for continuous ongoing feedback from peers, project directors, and supervisors - How evaluation criteria may evolve based on internal priorities Quick Reference Guide: 0:13 - Intro of Ignacio 3:54 - Evaluating designers then and now 6:32 - Gut feelings versus using a system 8:27 - Defining desired traits and levels 11:49 - The framework of the documentation 14:54 - The Rosenverse 17:34 - Who are the evaluators? Are they biased? Are they anonymous? 21:33 - The frequency of evaluations 22:36 - Consider what makes the business run 26:05 - The importance of transparency 26:51 - Ignacio’s gift for listeners Resources and Links from Today's Episode: Blurb of Ignacio’s “Fair and Effective Designer Evaluation” https://rosenfeldmedia.com/designops-summit/2024/sessions/fair-and-effective-designer-evaluation/ DesignOps Summit virtual conference - September 23-25 https://rosenfeldmedia.com/designops-summit/2024/ Rosenverse https://rosenfeldmedia.com/rosenverse/ Donald Glover https://www.imdb.com/name/nm2255973/

Kate Towsey has certainly left her mark on research operations, pioneering the practice, helping launch the ResearchOps community, and now through writing Research That Scales: The Research Operations Handbook, which Rosenfeld Media is publishing in September of 2024. In her interview with Lou, Kate reflects on her journey from content strategist to a pivotal figure in the research operations community. She recounts her early days at the UK Government Digital Service, where she unexpectedly found herself building research labs, and later at Atlassian, where she helped develop systems to manage vast amounts of research data. Through her work, Kate realized the need for a more structured approach to research operations, leading to facilitating a global ResearchOps community. Oh, and along the way, she coined the term “PWDR” (“People Who Do Research”). The conversation delves into the strategic importance of ResearchOps, emphasizing that it’s much more than just administrative support—it's about designing systems that enable organizations to effectively learn and innovate. Kate likens research operations to city planning, highlighting the need for strategy to build successful, sustainable systems. What You'll Learn from this Episode: - How Kate’s early work in content strategy and her experiences at the UK - Government Digital Service (GDS) led to the work she does today - The importance of aligning research operations with a clear research strategy - How research operations have evolved over the years - The distinction between research and insights, and the value of turning research findings into actionable insights that drive decision-making Quick Reference Guide: 0:27 - Introduction of Kate and her book 3:32 - Kate’s ah-ha moment 9:38 - Facilitating a global conversation before writing the book 11:47 - 8 elements unique to operations 14:09 - The Rosenverse 16:56 - Defining research operations 16:15 - Strategy in operations 20:50 - A story from overlooking the Hudson River in 2018 23:58 - On insight 27:14 - Human-centered research 32:04 - Kate’s gift for listeners Resources and Links from Today's Episode: Research That Scales: The Research Operations Handbook by Kate Towsey https://rosenfeldmedia.com/books/research-that-scales/ Cha-Cha Club https://chacha.club/

Ben Reason, founder of LiveWork Studio and co-author on service design, teams up with Patrick Quattlebaum, founder of Harmonic Design, to discuss the future of service design. They explore its evolution and the need for deeper integration with practices like agile and product management. The pair emphasizes the importance of communication across organizations, particularly in complex industries like healthcare. They also introduce an upcoming conference aimed at inspiring a new generation of service designers with real-world case studies and innovative methodologies.

Leah Buley and Joe Natoli have teamed up to make something great (check out the reviews on Amazon!) even greater. How? Well, considering that The User Experience Team of One: A Research and Design Survival Guide was written more than a decade ago, it was time to revisit the content and make it even more relevant for today’s UX teams. After all, times have changed. But the fundamental principles of the original book haven’t changed. They are as solid today as they were 11 years ago. What has changed is that the methods have been adapted for the speed of change in today’s businesses. Joe says it best: “These methods are shorter. They're simpler. They’re more direct in a lot of ways, and they cut to the chase in a way that longer processes don’t. I've met plenty of senior people who are throwing up their hands and going, ‘We're doing all the things. Why isn't this working?’ And the truth is, they're kind of overworking and overthinking. Everything in this book is practical and direct and gets you from point A to B. I just don't think there's any better way to get there.”

Have you ever thought about the similarities between art and science? Or about how math is the language of the universe? No? Welcome to a perspective shift. Ultimately this episode is about making things better, not just different. But how we get there is through a thoughtful and entertaining discussion with the witty and philosophical Erin Weigel. Erin Weigel wants us to make things better, not just different. But how do we get there? Lou had a thoughtful and entertaining discussion with Erin, always witty and philosophical—and often funny as hell. Join them on a perspective-shifting conversation that bridges disciplines and challenges conventional thinking, all in the pursuit of genuine improvement. Erin is the author of the recently published Design for Impact: Your Guide to Designing Effective Product Experiments. She brings a fresh, accessible, and humor-filled take on what may seem like a dry topic: experimentation. Erin digs into the role of experimentation in design, advocating for always defaulting to experiments even if they’re the quick and dirty kind. Erin and Lou also cover the following: - Wonky stuff like normal distributions, the central limit theorem, and what can be learned from outliers - The power of experiments to unite multidisciplinary teams by getting away from opinions and finding the truth - How professionals can use the principles of experimentation to navigate uncertainties and drive meaningful improvements - Discerning the impact of changes made What You'll Learn from this Episode: - How Erin, with a fine arts background, became the principal designer at Booking.com and the Senior Group Product Design Manager at Deliveroo - The fundamental similarities between art and science - Why you should never skip the experimental phase - How experimentation unites people across disciplines - The difference between making things different and making them better Quick Reference Guide: 0:32 - Introduction of Erin; similarities between art and science 4:05 - Barriers between art and science 5:58 - Statistics is fun! 12:37 - Defaulting to experimentation 18:06 - Break - 5 reasons to use the Rosenverse 20:36 - Experimentation as a uniting force 25:49 - Make things better, not just different 28:32 - Erin’s gift for listeners Resources and Links from Today's Episode: Design for Impact: Your Guide to Designing Effective Product Experiments by Erin Weigel: https://rosenfeldmedia.com/books/design-for-impact/ Ologies Podcast with Allie Ward: https://www.alieward.com/ologies Rosenverse: https://rosenfeldmedia.com/rosenverse/ Factfulness: 10 Reasons We’re Wrong About the World and 10 Reasons Why Things are Better Than You Think by Hans Rosling: https://www.amazon.com/Factfulness-Reasons-World-Things-Better/dp/1250107814

In the latest episode of the Rosenfeld Review, Lou sits down with old friend Peter van Dijck, author of Information Architecture for Designers: Structuring Websites for Business Success, one of the first books ever written on Information Architecture. Peter is now a partner of Simply Put, a Colombian company that builds and designs useful AI Agents—including the soon-to-launch Rosenbot! Peter offers insight into the world of AI. Having been one of the first to speak about IA, it is fascinating to hear what he now has to say about AI. Join Lou and Peter as they take you through the journey where language itself is transforming from design to technology. What You'll Learn from this Episode: - An introduction to the Rosenbot, an AI bot that Peter’s company is developing for Rosenfeld Media - Some basic vocabulary for speaking about AI and ML so you “don’t feel like an idiot” - Mind-blowing truths about the potential of Generative AI’s language capabilities - How writing has transformed from a design to a technology and learn what that means for how we interact with the data - About the importance of highly curated information when training bots and the tricky balance that comes when you want to present less polished sources like unedited conversations - The importance of the human side of things - The biggest surprise that has come from working in the industry Quick Reference Guide [0:15] - Lou’s introduction of Peter Van Dijck [3:00] - AI on a basic level [4:59] - Generative AI’s language capabilities [18:08] - How we interact with metadata and writing as a technology [20:00] - How real-use cases make technology more exciting and instantaneous [22:19] - Information about the new Designing With AI Conference [23:33] - Some of the jargon around AI and IA [24:16] - Introduction to Lou’s Chat Bot, the Rosen Bot [24:39] - The importance of training bots on highly curated information [28:34] - The tricky balance of curated and less polished content [30:26] - The human side of things [31:55] - Different interaction models [37:58] - The biggest surprise working in the industry [38:30] - A Gift For You Resources and Links from Today's Episode: Peter Van Dijck Linkedin: https://www.linkedin.com/in/petervandijck/ Peter’s Company, Simply Put: https://www.getsimplyput.ai/ Information Architecture for Designers: Structuring Websites for Business Success https://www.amazon.com/dp/B00YDJPPCM The My Climate Journey Podcast: https://www.mcjcollective.com/media/podcast

In a time of massive layoffs across the tech industry, and with the inevitable advancement of AI, is it time for tech workers to organize — as in, unionize? I know, I know. You thought unions were for 1950’s factory workers. Not so. Ethan Marcotte, author of You Deserve a Tech Union (and coiner of the term “responsive web design”) thinks it’s high time for tech workers to protect themselves by coming together and deciding what’s most important to them as a collective. Certainly, tech workers don’t face the same kind of potential life-threatening working conditions of industrial America, but they still deserve a seat at the table when important decisions about their work are being discussed. With issues related to equality, transparency, workplace harassment, and how AI is shifting roles and affecting how work gets done, there’s a lot to talk about. Ethan will bring his perspective on tech workers and how they’re being impacted by AI to the upcoming Designing with AI virtual conference in June. What You'll Learn from this Episode: - What’s attractive about unionizing for tech workers of the 2020s - What tech workers would change if they could - About tech walkouts and unions that have already happened - Helpful resources for starting conversations with coworkers - The potential relationship among AI, reskilling, and worker unions Quick Reference Guide: 0:20 - Introduction of Ethan 3:35 - How Ethan became interested in the idea of tech unions 6:04 - “Weren’t unions for the manufacturing industry in the 1950s?” 9:32 - The things tech workers would change if they could 11:14 - Conversations among employees – are they safe? Are they protected? 13:28 - On organizing for the greater good of humanity 17:11 - Plug for Managing Priorities: How to Create Better Plans and Make Smarter Decisions by Harry Max 19:06 - How we should feel about AI 22:36 - AI, reskilling, and when workers don’t want to leave mundane tasks behind 31:08 - Employees “voting with their feet” is costly for organizations 33:24 - How future workers may organize as it relates to AI 36:30 - Ethan’s gift for listeners Resources and Links from Today's Episode: Designing with AI virtual conference, June 4-5, 2024 https://rosenfeldmedia.com/events/futures/ You Deserve a Tech Union by Ethan Markcotte https://www.amazon.com/Deserve-Tech-Union-Ethan-Marcotte/dp/1952616603 WorkerOrganizing.org https://workerorganizing.org/ Tech Workers Coalition https://techworkerscoalition.org/ TheFutureIsLikePie.com https://thefutureislikepie.com/

Dan Hill, the Director of the Melbourne School of Design and author, shares his insights on the intersection of AI and urban infrastructure. He argues that AI should be integrated thoughtfully to improve everyday life, while also addressing the challenges it poses. Hill critiques the ride-sharing model as an example of AI's pitfalls and advocates for collaborative approaches to design, drawing lessons from successful cities like Helsinki. He emphasizes the critical role of perspective in urban planning and the importance of improving communication in systems like healthcare.

Jodi Forlizzi has taken an unusual path to get where she is today. With an art degree from the University of Arts in Philadelphia, she began working as a technical illustrator at the University of Pennsylvania. Transitioning into UX design as the internet expanded, she pursued a Master's in Interaction Design at Carnegie Mellon University where she is now a professor. Jodi's work focuses on responsible AI and diversity in computer science. Her talk at the upcoming Designing with AI 2024 conference will explore the evolving role of AI in design processes and products. Jodi distinguishes between "designing with AI" and "designing AI," arguing the importance of designers' involvement in the entire product development lifecycle. She highlights the challenges of AI innovation, such as data availability, value generation, customer adoption, and ethical considerations and emphasizes that designers have a place in all realms of AI development. Jodi's interview offers a glimpse into the evolving landscape of AI-driven design and the pivotal role of designers in shaping its future. With a blend of historical context, personal anecdotes, and insights, she inspires designers of all stripes to embrace the challenges and opportunities presented by AI innovation. What You'll Learn from this Episode: - How Jodi went from a Master of Fine Arts degree to working on responsible AI at Carnegie Mellon - Why designers are needed in all phases of AI development - How careers morph as technologies develop and become obsolete - Lessons from history and the “friendly vending machine” - Why solving for “Drunk Island” problems is usually more helpful than chasing a loftier issue Quick Reference Guide 0:25 - Introducing Jodi 2:59 - On boundaries around innovating with AI 6:40 – 4 reasons AI models fail 8:07 – The role of designers and the challenge of starting the design process from the middle of the double diamond 11:49 - The role of bridge builders 14:48 - The morphing of careers due to the emergence and prevalence of AI 17:19 - Commercial break - Managing Priorities: How to Create Better Plans and Make Smarter Decisions by Harry Max 18:26 - AI as a design material 21:08 - Constraints and structure on AI as a design material 24:39 - Jodi’s gift for the audience Resources and Links from Today's Episode: Managing Priorities: How to Create Better Plans and Make Smarter Decisions by Harry Max https://rosenfeldmedia.com/books/managing-priorities/ Designing with AI 2024, June 4-5 https://rosenfeldmedia.com/events/futures/ Friendly vending machines https://nextnature.net/story/2010/friendly-vending-machine

In the latest episode of the Rosenfeld Review, Lou sits down with social scientist Tricia Wang, coiner of the term “thick data,” and formerly a partner at Sudden Compass. Tricia is passionate about research and AI. She envisions massively improved research outcomes and opportunities for researchers, but only if researchers take the lead in incorporating AI into their work. Rather than seeing themselves as “users” of AI tools, researchers must work as AI’s “shapers,” serving as its senior partner. Tricia’s vision is to cease the fear-mongering surrounding the subject of AI and instead embrace the amazing opportunities for growth and better work by becoming active in the control of AI’s future. What You'll Learn from this Episode: - The truth about the potential for AI use in research and the gift that it actually is - The difference between a “user” and a “shaper” in the digital age - The importance of taking an active role in the development of AI in the future - How being an asset class dehumanizes us as people Quick Reference Guide: [0:16] - Lou’s introduction of Tricia Wang [2:52] - Tricia discusses our future and how we talk about AI [3:49] - Thoughts on the narrative of fear-mongering we have in the West about AI [5:47] - The relationship between humans and AI [5:59] - A new framework: users vs shapers [9:07] - The problem with taking on a passive role with a technology unlike anything we have ever seen [11:06] - People who use AI successfully are active shapers [15:33] - Info on Advancing Research 2024 [17:23] - How users, shapers, and AI affect the field of research [20:42] - The existential question of what it really means to be a researcher [31:28] - Tricia’s advice concerning using AI in research [35:07] - Tricia’s gift for the audience [38:34] - Tricia wants to hear from you Resources and Links from Today's Episode: Tricia Wang https://www.triciawang.com/ Sudden Compass https://www.suddencompass.com/ James Bridle, Ways of Being: Animals, Plants, Machines: The Search For A Planetary Intelligence https://www.amazon.com/Ways-Being-Machines-Planetary-Intelligence/dp/0374601119 Brett Christopher, Rentier Capitalism: Who Owns the Economy, And Who Pays For It? https://www.amazon.com/Rentier-Capitalism-Owns-Economy-Pays/dp/1788739728 Advancing Research 2024 https://rosenfeldmedia.com/advancing-research/2024/