Properties of Data for In Context Learning

Sharath Chandra Raparthy on In-Context Learning for Sequential Decision Tasks, GFlowNets, and more!  

Sharath Chandra Raparthy is an AI Resident at FAIR at Meta, and did his Master's at Mila.  

Featured Reference 

Generalization to New Sequential Decision Making Tasks with In-Context Learning   
Sharath Chandra Raparthy , Eric Hambro, Robert Kirk , Mikael Henaff, , Roberta Raileanu 

Additional References  

• Sharath Chandra Raparthy Homepage  
• Human-Timescale Adaptation in an Open-Ended Task Space, Adaptive Agent Team 2023
• Data Distributional Properties Drive Emergent In-Context Learning in Transformers, Chan et al 2022  
• Decision Transformer: Reinforcement Learning via Sequence Modeling, Chen et al  2021