How to Get an Embedding for a Natural Language Question

Jerry Liu is the co-founder and creator of LlamaIndex (formerly known as GPT-Index), an interface that allows users to connect their data to LLM’s such as Chat-GPT. He has a B.S. in Computer Science from Princeton and has worked at companies such as Quora, Uber, and Robust Intelligence prior to starting LlamaIndex.

Host: David Wu

Twitter: @davidjhwu

Audio Producer: Aaron Schumacher

LinkedIn: Aaron Schumacher 

Video Editor + Art: Saurin Kantesaria

Instagram: saorange314

Social Media: Nikhil Kapur

Time Stamps:

01:25 The path to starting LlamaIndex + initial ideas

07:09 LLMs like Chat-GPT vs traditional machine learning

10:00 4 steps of traditional machine learning

10:45 How do large LLMs change the game?

14:11 How does LlamaIndex help LLMs work with unstructured data?

18:08 How do you work with gigabytes of private data?

19:57 Organizing words and paragraphs by topic with embeddings

24:55 The importance of structuring data

26:00 3 key abstractions in LlamaIndex

29:25 Medical use cases for LlamaIndex

31:29 Increasing efficiency in medicine

33:25 An AI medical Research Assistant (Insight)

34:31 Other methods of connecting LLMs to data

36:55 What is langchain?

39:56 What work in the AI and LLM space excites you the most?

42:23 Do you ever feel scared about the developments of AI?

43:45 Llamas and Machine Learning

45:36 What do you think the future of AI in medicine will look like in 10-20 years?

47:24 What advice would you give to grad students, med students, and other early career professionals getting into AI and medicine?