Last Week in AI cover image

#137 - Salesforce Copilot, Chip Crunch, Meta Rival to ChatGPT, AI for paralysis patients

Last Week in AI

CHAPTER

Skepticism Over Language Model Benchmarking and Open Source Initiatives

This chapter examines the doubts surrounding benchmarking methods for large language models, particularly criticizing the MMLU for its superficial insights. It also emphasizes the importance of collaboration in the AI community, highlighting contributions from companies like Accubits Technology and funding initiatives from a16z.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner