Introduction

Hey everyone, thank you so much for watching the 49th episode of the Weaviate Podcast!! This podcast features Professor Laura Dietz from the University of New Hampshire! I came across Dr. Dietz's tutorial at ECIR on Neuro-Symbolic Approaches for Information Retrieval and am so grateful that she was interested in joining the Weaviate Podcast! I learned so much about Neurosymbolic Search, especially around the role of Entity Linking and Entity Re-Ranking -- as well as the topic of Knowledge Graphs and Vector Search. We also discussed Prof. Dietz and collaborators latest perspectives paper on Large Language Models for Relevance Judgment. TLDR this describes the idea of using LLMs to either generate synthetic queries for documents or say annotate the relevance for query, document pairs. We discussed this kind of idea with Leo Boytsov and his work on InPars, and have presented Promptagator on past episodes of the Weaviate Air show. Although this idea comes with a lot of potential, Dr. Dietz explains the potentials for bias and poor judgements, as well as generally diving more into the details of this kind of idea! I really hope you enjoy the podcast, we are more than happy to answer any questions you might have about these ideas, or discuss any of your ideas! Thanks so much for watching! Check out Laura Dietz's Publications here: https://scholar.google.com/citations?user=IIXpJ8oAAAAJ&hl=en&oi=ao ECIR 23 Tutorial: Neuro-Symbolic Approaches for Information Retrieval: https://www.cs.unh.edu/~dietz/appendix/dietz2023neurosymbolic.pdf Please check this paper out below, I think this is a severely underrated work in the Search / Information Retrieval community: Perspectives on Large Language Models for Relevance Judgment: https://arxiv.org/pdf/2304.09161.pdf Chapters 0:00 Introduction 0:15 Neurosymbolic Search 4:50 Entity Parsing and Vector Semantics 10:56 Query Intent Understanding 15:35 Knowledge Graphs and Vector Search 17:37 Symbolic Re-Ranking 22:10 ColBERT and Entity Ranking 26:25 Example - South America and Zika Virus IR 29:15 Knowledge Graph Query Languages with LLMs 35:10 We need more Knowledge Graphs!! 37:30 PrimeKG from Harvard BMI 39:40 Filtered Vector Search 42:20 LLM Entity Linking - “The” example 47:30 Cross Encoder Entity Focus? 48:25 Perspectives on LLMs for Relevance Judgments 55:28 Spectrum of Human-Machine Collaboration for Labeling 57:30 Use LLM to Create Relevance Labeling Interfaces 1:02:30 Importance for Weaviate 1:03:45 12 Authors’ 3 Conclusions 1:04:40 IR Research Community Challenge 1:06:55 Query Generation for Weaviate Users 1:13:05 Clustering Queries 1:17:30 Final Thoughts