Evolution of Small Language Models and Critiques of Phi Team

Exploring the journey of Phi one, Phi two, and Phi three language models, their training on textbooks, performance benchmarks, and the controversial aspects surrounding their release and discontinuation. Also, discussing the architecture of Phi three and Apple's introduction of small scaling suite LLMs.