The Importance of Generative Models in Machine Learning

2min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

The idea that you can sort of remix what you've seen into things you've never seen might prepare you for new cases in the real world. I remember seeing a machine learning paper once where they actually generated new training data by basically using generative models to construct new training data and then plugged it back into the algorithm. And I don't know if that work has really made much impact or not, but that idea is interesting.

Read the full transcript here.

What is "The Index"? What are some benefits of externally compiling and organizing one's knowledge? When is spaced repetition useful? How can we co-opt our visual systems to boost memory? Would we all be more interested in producing an external personal knowledgebase if we could feel on a visceral level how much information is constantly being forgotten? How and when should we move up and down the ladder of abstraction? What sorts of problems can be solved by simulation? What is a generative model (as opposed to a predictive model)? How can constraints improve creativity? How useful are credentials as a guide to how much a person knows and whether or not a person is "allowed" to have an opinion on a topic? What do credentials actually signal about a person? What are "fox" and "hedgehog" thinking? What is deugenesis?

Jeremy is the founder of Consilience, an immersive information retrieval company. Previously he did machine learning research at Google Brain and studied Applied Mathematics at Harvard University. Jeremy works relentlessly towards aggregating knowledge, acquiring knowledge, and creating new knowledge. Find him on Twitter at @jvnixon or email him at jnixon2@gmail.com.

Staff