Data Loader Scalability Problems

The Tesla transport protocol moves data seamlessly across host, tiles, and ingest processors. We then built the dojo network interface card, the DNIC, to leverage TTP over ethernet. After these optimizations went in, our occupancy went from 4% to 97%. So the data loading sections have reduced. What it really means is that networks that took more than a month to train now take less than a week.

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.