[ML Olds] Meta Research Supercluster | OpenAI GPT-Instruct | Google LaMDA | Drones fight Pigeons

#mlnews #rsc #gpt3

Some things we've missed in recent weeks!

OUTLINE:

0:00 - Intro & Overview

0:40 - Meta builds AI Research Supercluster (RSC)

2:25 - OpenAI trains GPT-3 to follow instructions

4:10 - Meta AI releases multilingual language models

4:50 - Google LaMDA dialogue models

5:50 - Helpful Things

8:25 - Training the alpha matte generator for Pixel 6

10:15 - Drones used to deter pigeons on buildings

11:05 - IBM sells some Watson Health assets for USD 1B

Merch: store.ykilcher.com

References:

https://ai.facebook.com/blog/ai-rsc/?...

https://openai.com/blog/instruction-f...

https://cdn.openai.com/papers/Trainin...

https://openai.com/blog/deep-reinforc...

https://twitter.com/MetaAI/status/148...

https://arxiv.org/pdf/2112.10668.pdf

https://github.com/pytorch/fairseq/tr...

https://ai.googleblog.com/2022/01/lam...

https://arxiv.org/pdf/2201.08239.pdf

https://evolutiongym.github.io/?utm_s...

https://evolutiongym.github.io/all-tasks

https://evolutiongym.github.io/docume...

https://arxiv.org/pdf/2201.09863.pdf

https://github.com/EvolutionGym

https://huggingface.co/blog/sb3

https://twitter.com/Sentdex/status/14...

https://github.com/lvwerra/trl?utm_so...

https://ai.googleblog.com/2022/01/acc...

https://polyhaven.com/hdris

https://ieeexplore.ieee.org/document/...

https://www.bloomberg.com/news/articl...

https://archive.ph/xadf9

Links:

TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://discord.gg/4H8xxDF

BitChute: https://www.bitchute.com/channel/yann...

LinkedIn: https://www.linkedin.com/in/ykilcher

BiliBili: https://space.bilibili.com/2017636191

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):

SubscribeStar: https://www.subscribestar.com/yannick...

Patreon: https://www.patreon.com/yannickilcher

Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq

Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2

Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m

Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n