The barriers to entry for training a model like GPT3 are mostly capital and talent.
The people needed are still very specialized and very smart, and you need lots of money to pay for GPUs.
Beyond that, I don't see that much secret sauce.
What is a large language model? How can it be used to enhance your business? In this conversation, Ali Rowghani, Managing Director of YC Continuity, talks with Raza Habib, CEO of Humanloop, about the cutting-edge AI powering innovations today—and what the future may hold. They discuss how large language models like Open AI's GPT-3 work, why fine-tuning is important for customizing models to specific use cases, and the challenges involved with building apps using these models. If you're curious about the ethical implications of AI, Raza shares his predictions about the impact of this quickly developing technology on the industry and the world at large.