"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

OpenAI Fine-Tuning Update, Acceleration Debate, and Bundling AI Services

Sep 26, 2023

01:18:49

Snipd AI

The podcast discusses OpenAI GPT-3.5 fine-tuning updates, using GPT-4 outputs for training, when to accelerate AI, and the potential of AI bundles. They also explore training models on synthetic data, improving model performance with chain of thought prompts, and the displacement of human roles by AI. The podcast dives into policies and risks in AI development, job displacement concerns, and the challenges of coordinating businesses for AI bundling.

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Training on synthetic data using GPT-4 can significantly improve the performance of models like GPT 3.5, offering cost and time savings.

The concept of AI bundles, similar to cable bundles, can provide affordable and accessible access to multiple AI apps, benefiting both customers and developers.

Delegation mode allows for significant time savings by separating tasks that just need to get done from tasks that require more attention, enabling confident delegation of work.

Deep dives

GPT 3.5 Turbo Fine Tuning Update

GPT 3.5 turbo fine-tuning has been a great experience, with fast and easy-to-use models. The process of training on chain of thought has shown impressive results, significantly improving performance. Synthetic data generation from GPT-4 and fine-tuning on 3.5 has proven successful, providing cost and time savings. This approach of training on synthetic data shows promise and could be a game-changer in various industries. There is also potential for a bundle model, similar to cable bundles, where users can access multiple AI apps through a single subscription. This concept could help address the high churn rate and cost of multiple subscriptions faced by AI app developers and customers.

The Importance of Chain of Thought in Training

01:52

Exploring Delegation Mode and AI Work Hierarchy

02:19

ChatGPT enterprise is only $60 per month??

02:24

Introduction

5min

Fine-tuning GPT-3.5 with analysis and reasoning

10min

Protecting Client Data, Training on Synthetic Data, and Future Improvement of AI Applications

6min

Policies and Risks in AI Development

16min

Debate on Value Distribution, Job Displacement, and Revenue Growth

5min

The Challenge of Bundling AI Services

31min

Challenges of Coordinating Businesses and Potential for AI Bundling

5min

Nathan and Erik chat OpenAI GPT-3.5 fine tuning updates, using GPT 4 outputs to fine-tune 3.5, when to accelerate, and AI bundles. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive

We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.

SPONSORS: Shopify | NetSuite | Omneky

Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive

NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

TIMESTAMPS:

(00:00) - Intro and GPT-3.5 fine tuning update

(05:50) - Using GPT-4 to generate training data for GPT-3.5

(09:54) - Potential for training models on synthetic/cleaned data

(10:24) - Using chain of thought prompts to improve model performance

(15:02) - Sponsors: Netsuite | Omneky

(19:39) - Accelerating applications vs new AI models

(20:40) - What to accelerate vs what to slow down

(26:07) - AI as a co-pilot vs fully automating tasks

(30:12) - When to delegate to AI

(36:40)- Displacement of human roles by AI systems

(40:39) - Does training on synthetic data solve a problem?

(45:10) - The idea of an AI bundle/subscription

(50:28) - Bundling in other industries like cable and SaaS

(54:27) - Churn and retention challenges for AI apps

(01:02:54) - Low retention for easy-to-use AI apps

(01:03:57) - Incentives for AI companies to join a bundle

(01:04:39) - Potential for collaboration between AI companies

(01:12:01) - Leading AI firms creating separate bundles

(01:16:43) - Outro

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

OpenAI Fine-Tuning Update, Acceleration Debate, and Bundling AI Services