Expanding Language Models into Multimodal Capabilities

This chapter discusses the development of large language models with multimodal capabilities, including analyzing photos, interpreting images, and splitting up complicated bar tabs. It explores the potential usefulness of these capabilities for people with disabilities. The chapter also focuses on the capabilities of chatch EPT, its accurate directions and additional advice, and the competition it faces from Google's Bard.