[ML News] DeepMind builds Gopher | Google builds GLaM | Suicide capsule uses AI to check access

#mlnews #gopher #glam

Your updates on everything going on in the Machine Learning world.

Sponsor: Weights & Biases

https://wandb.me/yannic

OUTLINE:

0:00 - Intro & Overview

0:20 - Sponsor: Weights & Biases

3:05 - DeepMind releases 3 papers on large language models

11:45 - Hugging Face Blog: Training CodeParrot from scratch

14:25 - Paper: Pre-Training vision systems with noise

15:45 - DeepMind advances Quantum Mechanics

16:45 - GoogleAI trains GLaM: 1 Trillion Parameters Mixture of Experts Model

18:45 - Colin Raffel calls for building ML models like we build Open-Source software

22:05 - A rebuke of the hype around DeepMind's math paper

24:45 - Helpful Things

32:25 - Suicide Capsule plans AI to assess your mental state before use

35:15 - Synthesia raises 50M to develop AI avatars

Weights & Biases Embedding Projector

https://twitter.com/_ScottCondron/sta...

https://docs.wandb.ai/ref/app/feature...

https://wandb.ai/timssweeney/toy_data...

DeepMind releases 3 papers on large language models

https://deepmind.com/blog/article/lan...

https://arxiv.org/pdf/2112.04426.pdf

https://kstatic.googleusercontent.com...

https://arxiv.org/pdf/2112.04359.pdf

https://deepmind.com/research/publica...

Hugging Face Blog: Training CodeParrot from scratch

https://huggingface.co/blog/codeparro...

Paper: Pre-Training vision systems with noise

https://mbaradad.github.io/learning_w...

DeepMind advances Quantum Mechanics

https://deepmind.com/blog/article/Sim...

https://storage.googleapis.com/deepmi...

https://github.com/deepmind/deepmind-...

GoogleAI trains GLaM: 1 Trillion Parameters Mixture of Experts Model

https://ai.googleblog.com/2021/12/mor...

Colin Raffel calls for building ML models like we build Open-Source software

https://colinraffel.com/blog/a-call-t...

A rebuke of the hype around DeepMind's math paper

https://arxiv.org/abs/2112.04324?s=09

Helpful Things

https://twitter.com/huggingface/statu...

https://docs.cohere.ai/prompt-enginee...

https://github.blog/2021-12-08-improv...

https://huggingface.co/blog/data-meas...

https://huggingface.co/spaces/hugging...

https://blogs.microsoft.com/ai-for-bu...

https://techcommunity.microsoft.com/t...

https://github.com/minitorch/minitorc...

https://minitorch.github.io/

https://pandastutor.com/

https://pandastutor.com/vis.html

https://github.com/IAmPara0x/yuno

https://colab.research.google.com/dri...

https://www.reddit.com/r/MachineLearn...

https://www.drivendata.org/competitio...

https://www.reddit.com/r/MachineLearn...

https://www.uttt.ai/

https://arxiv.org/abs/2112.02721?utm_...

https://arxiv.org/pdf/2112.02721.pdf

https://github.com/GEM-benchmark/NL-A...

https://www.reddit.com/r/MachineLearn...

Suicide Capsule plans AI to assess your mental state before use

https://www.swissinfo.ch/eng/sci-tech...

Synthesia raises 50M to develop AI avatars

https://techcrunch.com/2021/12/08/syn...

https://www.synthesia.io/

Links:

TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://discord.gg/4H8xxDF

SubscribeStar: https://www.subscribestar.com/yannick...

Patreon: https://www.patreon.com/yannickilcher

Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq