Transitioning to Model Evaluation at OpenAI

Our guest today is Reah Miyara. Reah is currently working on LLMs evaluation at OpenAI and previously worked at Google and IBM.

In our conversation, Reah shares his experience working as a product lead for Google's graph-based machine learning portfolio. He then explains how he joined OpenAI and his role there. We finally talk about LLMs evaluation, AGI, LLMs safety and the future of the field.

If you enjoyed the episode, please leave a 5 star review and subscribe to the AI Stories Youtube channel.

Link to Train in Data courses (use the code AISTORIES to get a 10% discount): https://www.trainindata.com/courses?affcode=1218302_5n7kraba

Follow Reah on LinkedIn: https://www.linkedin.com/in/reah/

Follow Neil on LinkedIn: https://www.linkedin.com/in/leiserneil/  

---

(00:00) - Intro

(03:09) - Getting into AI and Machine Learning

(08:33) - Why Stay in AI?

(11:39) - From Software Engineer to Product Manager

(18:27) - Experience at Google

(25:28) - Applications of Graph ML 

(31:10) - Joining OpenAI

(35:15) - LLM Evaluation

(44:30) - The Future of GenAI and LLMs 

(55:48) - Safety Metrics for LLMs

(1:00:30) - Career Advice