Bing vs. Bard, US-China STEM Competition, and Embryo Screening — #30
Manifold
00:00
The Impact of Large Scale Machine Learning on Investor Psychology
Large language models are trained on huge amounts of data, often scraped from the internet. The objective function tests whether the model can predict the next word after being given earlier words in a sentence or paragraph. It turns out that task is difficult enough that it forces the LLM neural net to encode all kinds of understanding about human language relationship between concepts used by humans and then translate back. A consequence of really large scale training with sentence completion as the objective function is that these large language models really do have a good sense of the English language for humans.
Transcript
Play full episode
