3min chapter

The Analytics Engineering Podcast cover image

What Does Apache Arrow Unlock for Analytics? (w/ Wes McKinney)

The Analytics Engineering Podcast

CHAPTER

Is There a Synergistic Relationship Between Application Development and Hardware Development?

I think one of the reasons is that the algorithms themselves are pretty, you know, are pretty complicated. So my intuition is that I think designing custom chips for doing some of those things is more difficult in some ways than tensor operations. We're going to work with the PyTorch community to make sure there's a well-defined interface between the hardware and thePyTorch runtime so we can expose our hardware to PyTorch users without it being intrusive to them. That vision has been significantly more realized in the machine learning community, but it's not yet something that's possible or widely available.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode