Questioning the Trustworthiness of AI Performance Claims

This chapter examines the reliability of AI performance claims from major companies like OpenAI and Google, raising concerns about misinformation. It critiques the assumptions surrounding a new model's scoring metrics and its general applicability against competitors.