Elon Musk says he wants to design a quote, maximum truth-seeking AI. Dolly or Dolly 2.0 is the first open source instruction following large language model for commercial use that has been fine-tuned on a human generated data set and is open source. Red Pajama starts by reproducing LAMA training data set of over 1.2 trillion tokens. Ben's Bites: You've got to love the determination of open source to go toe to toe with big tech.
Some argue that open source AI is the key to making AI's benefits to the entire world, as well as making AI safer. Others think that open source can multiply risks. With a slate of new projects being announced this week, the conversation is heating up.
Discussed in this episode:
Elon Musk's planned TruthGPT
Dolly 2.0, an open source LLM based on the EleutherAI pythia model built by Databricks
RedPajama, an open source proxy of Facebook/Meta's LLaMA, from Together
MiniGPT, an open source AI model that can extract information from images
Stable Diffusion XL, the latest open source text-to-image model from Stability AI