Sinan Ozdemir

Sinan Ozdemir, Founder and CTO of Loop Genius and author of 'The Quick Start Guide to Large Language Models', dives deep into AI benchmarking's shortcomings. He discusses how transparency in training data is often compromised and argues for human-led quality checks to curb AI hallucinations. Sinan criticizes existing benchmarks, calling for more tailored evaluations and domain-specific measures. He also touches on the evolution of language models and the future of AI assessment, prompting listeners to rethink what's truly effective in AI development.