AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- NUS Research started as a collaborative name among a few individuals passionate about open-source language models and evolved into an open-source research organization with over 40 contributors, focusing on the development of innovative language models like Hermes, Yarn, and Capybara.
- NUS Research pioneers the use of data distillation and data synthesis techniques, such as compressing large models' knowledge into a more concise format and generating synthetic data for training smaller models, which have shown significant boosts in performance and unlock further potential in the field of language models.
Deep dives
The Journey of NUS Research
NUS Research is an open-source research organization that is also a company focused on language models. The organization started as a collective of individuals passionate about open-source language models. They began by tinkering with models like GPT2 and LAMA and experimenting with fine-tuning and data synthesis. As they gained more experience and expertise, they gained attention for their models and started working on more concrete projects. What began as a collaborative name among a few people evolved into an open-source research org with over 40 contributors. Their models, such as Hermes, Yarn, and Capybara, have gained popularity and have become innovative examples in the field. They continue to prioritize open-source research and development while also exploring opportunities as a company.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode