arxiv preprint - WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia

In this episode we discuss WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia by Sina J. Semnani, Violet Z. Yao, Heidi C. Zhang, Monica S. Lam. The paper introduces WikiChat, a chatbot that uses a few-shot Large Language Model (LLM) grounded in Wikipedia to provide accurate, engaging responses with minimal hallucinations. WikiChat was distilled into a smaller 7 billion-parameter model from GPT-4, improving response times and reducing costs without much loss in quality. It outperforms other chatbots in terms of factual accuracy and knowledge coverage, according to a unique evaluation involving human-and-LLM interactions, achieving highly accurate responses and favorable user feedback.