The Future of Language Models

3min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

In terms of fundamental breakthroughs that are needed, you know, everybody's contributing towards larger context windows is obviously one of them. I think on a larger scale, the ability to actually plan and reason and work with tools reliably and follow instructions without necessarily needing like 800,000 examples or whatever would also be helpful. Beyond that, I actually think it's just a bunch of boring work that is the main model deck or the thing that's missing.

In this episode, Nathan sits down with Tyler Angert, Product Designer at Replit, to discuss the future of software development. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Tyler and Nathan discuss how Replit is leveraging AI to enhance its current product, bot-bot interactions, the design and ethical considerations around AI agents, and more. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive

We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.

TIMESTAMPS:

(00:00) Episode Preview

(01:10) Nathan’s Intro

(09:24) Tyler's role at Replit

(11:37) Replit as the "perfect substrate for AGI"

(14:55) Sponsor: Netsuite | Omneky

(15:45) Defining AGI

(19:26) How AI agents might interact with Replit

(23:20) Replit's "virtual developer" product

(31:11) Current state of Replit's AI features like Ghostwriter

(41:48) Measuring productivity boost from AI coding tools

(45:29) Potential for massive developer productivity gains from AI

(48:34) Technical gaps still remaining to achieve advanced AI agents

(51:45) Core AI breakthroughs have already occurred

(57:35) Timeline for functional AI agents interacting online

(01:01:20) Safety considerations for powerful AI agents on Replit

(01:08:47) Ethical considerations around AI and consciousness

(01:20:36) What constitutes consciousness in an AI system

(01:26:30) Should AI systems have rights and protections?

(01:30:32) Being polite to AI systems

(01:31:59) Advice for beginners looking to leverage AI

(01:36:58) Using AI with a Neuralink brain implant

(01:43:02) Hopes and fears about AI's impact on society

LINKS:

https://replit.com/

@tylerangert (Tyler)

@labenz (Nathan)

@eriktorenberg (Erik)

@cogrev_podcast

SPONSORS: Shopify | NetSuite | Omneky

Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive

-NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months.

-Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM

This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.