Jacob and Jordan sit down with EleutherAI's Aran Komatsuzaki to discuss the future of open-source models, thought cloning, his work on GPT-J and more.
0:00 intro
01:06 Aran’s background
02:58 starting work on gpt-j
05:49 gathering data for Lion and gpt-j
08:51 history of EleutherAI
11:16 open vs. closed-source models
19:06 how will open-source models be used going forward
21:33 thought cloning
25:51 building AI models that understand video
29:35 one model to rule them all
31:58 influence of academia in the LLM space
34:33 over-hyped/under-hyped
38:01 Aran’s thoughts on AGI
With your co-hosts:
@jasoncwarner
- Former CTO GitHub, VP Eng Heroku & Canonical
@ericabrescia
- Former COO Github, Founder Bitnami (acq’d by VMWare)
@patrickachase
- Partner at Redpoint, Former ML Engineer LinkedIn
@jacobeffron
- Partner at Redpoint, Former PM Flatiron Health
@jordan_segall
- Partner at Redpoint
Unsupervised Learning