Navigating GPU Inefficiencies and the Importance of Market Intelligence

This chapter examines the challenges associated with leveraging NVIDIA GPUs for inference workloads, particularly their bandwidth inefficiencies. It emphasizes the necessity of reliable market intelligence and suggests collaboration with an AI platform to enhance business success amidst competitive pressures.

Transcript

chevron_right

Play full episode

chevron_right

Transcript

Episode notes

Today’s show:

In this founder-focused episode of This Week in Startups, we sit down with Republic’s Kendrick Nguyen to learn more about the company’s efforts to make the private markets accessible to the common investor. Best known for its work in equity crowdfunding, the Valor-backed startup now offers access to secondary shares, tokenized assets, and much more. Following, TWiST spoke with Positron CEO Mitesh Agrawal to learn more about his company’s inference-focused AI compute hardware. Related to fellow TWiST500 company Etched, Positron is building custom chips to take on the computing work required to deliver your AI query results faster and with less power draw than what GPUs can offer. With AI inference compute demand rising, the fellow Valor-backed startup has even more powerful systems coming to market in 2026 that have our hopes up that the AI cost curve can continue to point downward.

Timestamps:

(0:00) A future with more efficient and accessible intelligence(0:41) the following sponsors are mentioned: AlphaSense, Vanta, and Oracle Cloud Infrastructure(1:26) Introduction to the episode and the two featured companies, Republic and Positron(2:43) The history and purpose of Republic, a financial crowdfunding platform(5:39) Discussion of the current state and growth of equity crowdfunding(9:19) Kendrick Nguyen explains Republic's role as a financial infrastructure company, not a competitor to venture capital firms(11:17) Oracle - Try OCI and save up to 50% on your cloud bill at https://w⁠⁠⁠⁠ww.oracle.com/twist⁠⁠ (12:25) Republic's different products, Republic Capital and Republic Venture, are explained(14:00) The challenges and progress of secondary trading for non-accredited investors(20:14) Vanta - Get $1000 off your SOC 2 at https://www.vanta.com/twist(21:21)The concept of a unified "e-finance" infrastructure is introduced(25:45) Positron CEO Mitesh Agarwal discusses the future of AI chips and the limitations of current GPUs for inference workloads(31:12) Alphasense - Get deeper insights into your business with the power of AI search and market intelligence. Start with a free trial at https://www.alpha-sense.com/twist(32:22) Discussion on the inefficiency of GPUs for inference and how Positron's Atlas system addresses it(38:30) Positron's strategy of using their Atlas system to prove their technology and generate revenue(42:51) The market shift from AI training to inference and the future of Positron's chips(51:14) The confidence in Positron's capital efficiency and their ability to compete with NVIDIA(52:47) Positron's focus on linear algebra acceleration rather than just transformers

Subscribe to the TWiST500 newsletter: https://ticker.thisweekinstartups.com

Check out the TWIST500: https://www.twist500.com

Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcp

Follow Lon:

X: https://x.com/lons

Follow Alex:

X: https://x.com/alex

LinkedIn: ⁠https://www.linkedin.com/in/alexwilhelm

Follow Jason:

X: https://twitter.com/Jason

LinkedIn: https://www.linkedin.com/in/jasoncalacanis

Thank you to our partners: