The Impact of Chatbot GPT on Performance

5min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

Princeton computer scientist Arvin Narayanan says, a new paper is being interpreted as saying that GPT-4 has gotten worse since its release. He points out the research only evaluated primality testing on prime numbers. In reality, all four models are equally awful and guess based on the way they were calibrated.Narayanan: We don't know for sure if there's any truth to the rumors of intentional performance degradation but we are sure that the paper does not offer evidence of it.

A new research paper from Stanford and Berkeley says that yes, indeed ChatGPT has gotten worse. However others are calling the methodology into question. NLW explores the debate. Before that on The Brief, OpenAI shuts down AI detection tool; Sec. Blinken writes AI op-ed; Egypt using AI to restore Mummies. Today's Sponsor: Supermanage - AI for 1-on-1's - https://supermanage.ai/breakdown ABOUT THE AI BREAKDOWN The AI Breakdown helps you understand the most important news and discussions in AI. Subscribe to The AI Breakdown newsletter: https://theaibreakdown.beehiiv.com/subscribe Subscribe to The AI Breakdown on YouTube: https://www.youtube.com/@TheAIBreakdown Join the community: bit.ly/aibreakdown Learn more: http://breakdown.network/