The Pragmatic Engineer cover image

Design Engineering with Maggie Appleton

The Pragmatic Engineer

00:00

Capability Gaslighting Makes AI Hard To Trust

  • Models can perform brilliantly on one task and fail unpredictably on another, creating an inflated sense of their overall competence.
  • Unlike human experts, models may repeatably change performance with prompting, context, randomness, or model updates.
Play episode from 57:26
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app