
PC Pro Podcast 640
The PC Pro Podcast
00:00
AI Chatbots: The Worst Performance Ever
A website called Hacker Noon has run a four-way head-to-head asking for AI chatbots to write code to solve a specific problem involving manipulating strings. The first bot, or rather the worst performing bot it tried was Claude Plus which scored just one out of 121 in terms of results. GPT-4 spat out quite lengthy bit of Python that impressively got the work perfectly well and could be used by humans if they were feeling particularly trusting. And when pitted against human attempts to solve the same problem, the code produced by Bing was shorter than 37% of entries,. So it seems like if you want to write a programme to do a particular thing, flip a coin, you
Transcript
Play full episode