[ML News] BLOOM: 176B Open-Source | Chinese Brain-Scale Computer | Meta AI: No Language Left Behind

#mlnews #bloom #ai 

Today we look at all the recent giant language models in the AI world!

OUTLINE:

0:00 - Intro

0:55 - BLOOM: Open-Source 176B Language Model

5:25 - YALM 100B

5:40 - Chinese Brain-Scale Supercomputer

7:25 - Meta AI Translates over 200 Languages

10:05 - Reproducibility Crisis Workshop

10:55 - AI21 Raises $64M

11:50 - Ian Goodfellow leaves Apple

12:20 - Andrej Karpathy leaves Tesla

12:55 - Wordalle

References:

BLOOM: Open-Source 176B Language Model

https://bigscience.huggingface.co/blo...

https://huggingface.co/spaces/bigscie...

https://huggingface.co/bigscience/blo...

YALM 100B

https://github.com/yandex/YaLM-100B

Chinese Brain-Scale Supercomputer

https://www.scmp.com/news/china/scien...

https://archive.ph/YaoA6#selection-12...

Meta AI Translates over 200 Languages

https://ai.facebook.com/research/no-l...

Reproducibility Crisis Workshop

https://reproducible.cs.princeton.edu/

AI21 Raises $64M

https://techcrunch.com/2022/07/12/ope...

Ian Goodfellow leaves Apple

https://twitter.com/goodfellow_ian/st...

Andrey Karpathy leaves Tesla

https://mobile.twitter.com/karpathy/s...

https://www.businessinsider.com/repor...

Wordalle

https://huggingface.co/spaces/hugging...

Links:

Homepage: https://ykilcher.com

Merch: ykilcher.com/merch

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://ykilcher.com/discord

LinkedIn: https://www.linkedin.com/in/ykilcher

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):

SubscribeStar: https://www.subscribestar.com/yannick...

Patreon: https://www.patreon.com/yannickilcher

Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq

Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2

Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m

Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n