Anastasios Angelopoulos and Wei-Lin Chiang, both PhD students at UC Berkeley, lead the Chatbot Arena—a pioneering platform for AI evaluation. They discuss the evolution of crowdsourced benchmarking and the philosophical challenges of measuring AI intelligence. Emphasizing the limitations of static benchmarks, they advocate for user-driven assessments. The duo also tackles human biases in evaluations and the significance of community engagement, showcasing innovative strategies in AI red teaming and collaboration, all aimed at refining how language models are compared.