Hallway Chat cover image

Building entropically, Gemini, Prompt engineerings revenge, and Superpowered

Hallway Chat

Prompt Engineering and Improving Long Text Retrieval

19min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

The chapter explores the challenges of prompt engineering in chat GPT, focusing on the problem of finding information in the middle of a long document or chat. It discusses the technique of adding a specific line to the prompt to improve the model's accuracy in pulling out relevant sentences. The implications and potential impact of this technique on different models and their performance are also explored.

Nabeel and Fraser briefly discuss Google's new AI model, Gemini, and keeping authenticity in startup pitches. They discuss the perils of trying to simplify when technology is lending towards complexity. How to stay authentic to yourself when pitching and fundraising. The new findings of Claude prompting, and the likely continued need for prompt engineering. Finally, they talk about the startup SuperPowered, its potential pivot, and how passion for problem-solving can impact a company's direction.

* Google Gemini's excellent product video "demo"
* History of Razorfish
* Claude 2.1 Prompting Technique
* AI Meeting notes from Superpowered.me

(00:00) - Building when entropy is increasing
(01:00) - Introduction and Welcome
(01:15) - Discussing the Frequency of AI Developments
(01:45) - Google's AI Developments and the Gemini Team
(02:19) - Explaining Gemini and its Significance
(05:04) - Analyzing Google Gemini from afar
(18:02) - You are 5 words away from being done
(27:00) - The analogy of the early web vs early LLMs
(30:05) - Do we need the Razorfish of AI
(33:27) - The Future of AI Tools and Platforms
(34:11) - The Importance of Implementation Engineers in AI
(35:54) - Are we in an entropic or de-entropy phase?
(37:57) - The Importance of Authenticity in Marketing
(38:53) - Founders just being real
(47:28) - How would you fundraise differently now?
(50:15) - Superpowered.me and AI Note Taking Startups

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

App store banner

Play store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode