Introduction

This chapter discusses the concept of scaling in relation to the development of artificial general intelligence (AGI), highlighting a debate between a believer and a skeptic. It explores the potential impact of scaling language models, the need for vast amounts of data, and the challenges faced in data acquisition and efficiency.