The difference between open source and closed source models lies in their scale and generality. Open source models like open AI, GPT, or anthropic cloud are proficient in handling general queries, while smaller scale models such as llama three are better suited for specialized tasks. Specialization through routing queries to specialist models is crucial in open source due to the inherent economics; smaller models are easier to fine-tune and specialize. Despite advancements in open source models, they might always lag behind closed source models in terms of generality, making specialization and routing essential to bridge this gap.