Llama 2 Unleashed, Open-Source Vs OpenAI, Instructions for ChatGPT & Fine Tuning with Llama2 | EP24

19 snips

Jul 21, 2023

The podcast discusses the release of Llama 2, a commercially available open-source AI model. They explore how open-source models threaten the business models of OpenAI and others. Other topics include Instructions for ChatGPT, fine-tuning smaller models, Google's Generative AI Enterprise Search product, Bing Enterprise Chat, AppleGPT rumors, and the state of AI startups and VC funding.

Ask episode

Chapters

Transcript

Episode notes

Introduction

00:00 • 2min

The Shift towards Open Source and Commercialization

02:04 • 18min

OpenAI's Acceptable Use Policy and Safety Controls

19:36 • 18min

Speculation on the Release and Control of Voice Training Technology

37:30 • 2min

Advocating for an AI Sanctuary and Unrestricted Technology Use

39:03 • 2min

OpenAI's Latest News

40:41 • 9min

Fine-tuning Specialist Models with Llamas

49:16 • 7min

The Limitations of Chat Interface and the Potential of Apple GPT

56:03 • 17min

Controversy over AI-detected US Constitution, Humorous Text Exchange, and Listener Feedback

01:12:52 • 3min

In Episode 24 we discuss the release of Llama 2, what it means for the open-source community, developers and the future of AI LLMs with it being commercially available. We discuss what threat open-source models now pose to the business models of OpenAI and others, and also take a look at Instructions for ChatGPT. We have a long discussion on fine tuning smaller models and cover news including Google's Generative AI Enterprise Search product, Bing Enterprise Chat, AppleGPT rumors and finally end with the state of AI startups, fundraising, VC and what makes good AI investment.

If you like this podcast, please consider leaving us a review and sharing with friends/family.

CHAPTERS:

00:00 - Lizard Man is now a Hero (cold open)
00:49 - Meta’s Llama 2 release and what it means
21:18 - Llama 2 alignment, Is fine tuning just censorship?
27:02 - What is Meta’s strategy with Llama 2? Will it hurt OpenAI?
31:56 - OpenAI fears GPT-4 Vision will offend someone
40:40 - ChatGPT Plus Users get GPT-4 Rate Limits Doubled
41:56 - ChatGPT Custom Instructions
46:15 - Does Llama Threaten OpenAI with Smaller Refined Fine Tuned Models?
54:39 - Google’s Generative AI Enterprise Search (Gen App Builder) Announcement
56:16 - Microsoft’s Bing Chat Enterprise
1:02:19 - AppleGPT “AJAX” rumor
1:05:49 - The State of AI Startups, VC and fundraising
1:12:32 - AI LOLs & Memes

SOURCES:

https://huggingface.co/chat/
https://about.fb.com/news/2023/07/llama-2/
https://openai.com/blog/custom-instructions-for-chatgpt
https://www.nytimes.com/2023/07/18/technology/openai-chatgpt-facial-recognition.html
https://cloud.google.com/blog/products/ai-machine-learning/enterprise-search-on-gen-app-builder
https://blogs.microsoft.com/blog/2023/07/18/furthering-our-ai-ambitions-announcing-bing-chat-enterprise-and-microsoft-365-copilot-pricing/
https://www.zdnet.com/article/apple-sneaks-into-the-ai-chatbot-race-with-apple-gpt/
https://twitter.com/0xsamhogan/status/1680725207898816512?s=46&t=uXHUN4Glah4CaV-g2czc6Q
https://www.zerohedge.com/technology/ai-detectors-think-us-constitution-was-written-ai
https://www.reddit.com/r/ChatGPT/comments/154fck9/girl_gave_me_her_number_and_it_ended_up_being_gpt
https://twitter.com/patrickc/status/1681699442817368064?s=46&t=uXHUN4Glah4CaV-g2czc6Q