Transformations in NLP: The Impact of BERT and GPT-2

This chapter explores the advancements in Natural Language Processing driven by transfer learning, particularly focusing on BERT and GPT-2. It discusses their contributions to query understanding, text generation, and the challenges of coherence in storytelling. The chapter also highlights the complexities of evaluating narrative generation and the ongoing pursuit of improvements in AI's ability to reflect common sense in storytelling.