All about AI Accelerators: GPU, TPU, Dataflow, Near-Memory, Optical, Neuromorphic & more (w/ Author)

#ai #gpu #tpu

This video is an interview with Adi Fuchs, author of a series called "AI Accelerators", and an expert in modern AI acceleration technology.

Accelerators like GPUs and TPUs are an integral part of today's AI landscape. Deep Neural Network training can be sped up by orders of magnitudes by making good use of these specialized pieces of hardware. However, GPUs and TPUs are only the beginning of a vast landscape of emerging technologies and companies that build accelerators for the next generation of AI models. In this interview, we go over many aspects of building hardware for AI, including why GPUs have been so successful, what the most promising approaches look like, how they work, and what the main challenges are.

OUTLINE:

0:00 - Intro

5:10 - What does it mean to make hardware for AI?

8:20 - Why were GPUs so successful?

16:25 - What is "dark silicon"?

20:00 - Beyond GPUs: How can we get even faster AI compute?

28:00 - A look at today's accelerator landscape

30:00 - Systolic Arrays and VLIW

35:30 - Reconfigurable dataflow hardware

40:50 - The failure of Wave Computing

42:30 - What is near-memory compute?

46:50 - Optical and Neuromorphic Computing

49:50 - Hardware as enabler and limiter

55:20 - Everything old is new again

1:00:00 - Where to go to dive deeper?

Read the full blog series here:

Part I: https://medium.com/@adi.fu7/ai-accele...

Part II: https://medium.com/@adi.fu7/ai-accele...

Part III: https://medium.com/@adi.fu7/ai-accele...

Part  IV: https://medium.com/@adi.fu7/ai-accele...

Part V: https://medium.com/@adi.fu7/ai-accele...

Links:

Merch: store.ykilcher.com

TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://discord.gg/4H8xxDF

BitChute: https://www.bitchute.com/channel/yann...

LinkedIn: https://www.linkedin.com/in/ykilcher

BiliBili: https://space.bilibili.com/2017636191

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):

SubscribeStar: https://www.subscribestar.com/yannick...

Patreon: https://www.patreon.com/yannickilcher

Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq

Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2

Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m

Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n