Combining Attention Mechanism and Compositionality

Yujia Huang (Website) is a PhD student at Caltech, working at the intersection of deep learning and neuroscience.  She worked on optics and biophotonics before venturing into machine learning. Now, she hopes to design “less artificial” artificial intelligence.

Highlights from our conversation:

🏗 How recurrent generative feedback, a neuro-inspired design, improves adversarial robustness and and can be more efficient (less labels)

🧠 Adapting theories from neuroscience and classical research for machine learning

📊 What a new Turing test for “less artificial” or generalized AI could look like

💡 Tips for new machine learning researchers!