Explore the vulnerabilities of large language models, the history of the transformer architecture, and the basics of LLM inference. Discuss the challenges of recipe hacking and password guessing. Learn about a red teaming event for large language models and the origins of GPT models. Delve into the motivations behind the transformer and enjoy some light-hearted banter.
34:00
forum Ask episode
web_stories AI Snips
view_agenda Chapters
auto_awesome Transcript
info_circle Episode notes
question_answer ANECDOTE
Recipe App Vulnerability
The "Pak 'n' Save Mule Bot" app initially allowed users to input any ingredients.
This led to users generating recipes for dangerous substances like chlorine gas, highlighting prompt injection vulnerabilities.
volunteer_activism ADVICE
Prompt Injection Protection
Protect your language model-powered apps from prompt injection.
Consider whitelisting allowed inputs, like the recipe app eventually did.
question_answer ANECDOTE
Prompt Hacking Gandalf
Roland and Anthony played a prompt injection game with "Gandalf the White."
They tricked the model into revealing passwords using jokes and poems, demonstrating prompt hacking techniques.
Get the Snipd Podcast app to discover more snips from this episode
In this podcast episode of Generally AI, Roland Meertens and Anthony Alford explore the world of large language models, focusing on their vulnerabilities and security measures. Additionally, they delve into the history of the transformer architecture and Google's role in its development, along with the basics of LLM inference.
Read a transcript of this interview: https://bit.ly/3HALTMV
Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:
https://www.infoq.com/software-architects-newsletter
Upcoming Events:
QCon London (April 8-10, 2024)
Discover new ideas and insights from senior practitioners driving change and innovation in software development.
https://qconlondon.com/
InfoQ Dev Summit Boston (June 24-25, 2024)
Actionable insights on today’s critical dev priorities.
https://devsummit.infoq.com/
QCon San Francisco (November 18-22, 2024)
Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.
https://qconsf.com/
The InfoQ Podcasts:
Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:
- The InfoQ Podcast https://www.infoq.com/podcasts/
- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture
Follow InfoQ:
- Mastodon: https://techhub.social/@infoq
- Twitter: twitter.com/InfoQ
- LinkedIn: www.linkedin.com/company/infoq
- Facebook: bit.ly/2jmlyG8
- Instagram: @infoqdotcom
- Youtube: www.youtube.com/infoq
Write for InfoQ:
Learn and share the changes and innovations in professional software development.
- Join a community of experts.
- Increase your visibility.
- Grow your career.
https://www.infoq.com/write-for-infoq