Elon Musk: AI, Space, X, Mars, speed and hardcore
In Good Company with Nicolai Tangen
00:00
Challenges of Training Grock 3: Nvidia H100 and Data Problems
Training Grock 3 with Nvidia H100 requires significantly more training data, approximately a hundred thousand, which is half an order of magnitude more. This increase in training data leads to data problems, necessitating either the creation of synthetic data or the use of real-world video. Tesla holds a substantial advantage in real-world video as it possesses the largest repository of such data.
Play episode from 05:36
Transcript
