The Measure of AI Intelligence

The measurement of AI intelligence can only be done experimentally through benchmarks like MMLEU and other challenging tests that can even trip up expert researchers. Training AI to perform tasks within its training data distribution raises the question of whether it is actually solving problems through intelligence or just recalling and matching data. This distinction highlights how machines learn differently from humans, potentially in a backward manner starting from math and moving towards language, unlike human evolutionary learning.