Anthropic has created a constitutional AI model to address the problem of misaligned behavior. High pre-training costs and unfathomable data sets are also big challenges, says Andrew Keen. The company is working with Google on an open source version of its system that could be used by other tech companies in the future.
NLW reviews a recent research paper which provides a comprehensive overview of the state of LLM development and organizes remaining challenges and problems to be solved -- along with prospective solutions. Before that on the Brief: OpenAI launches GPTBot to crawl the web for AI training purposes; Zoom has to back off ToS changes that would allow them to collected data for AI training purposes. Plus a terrifying new cyberattack that can tell what you typed just by listening to your keystrokes.
Read the paper: https://arxiv.org/abs/2307.10169
Today's Sponsor:
Giskard - the testing framework for ML models - https://www.giskard.ai/
ABOUT THE AI BREAKDOWN
The AI Breakdown helps you understand the most important news and discussions in AI.
Subscribe to The AI Breakdown newsletter: https://theaibreakdown.beehiiv.com/subscribe
Subscribe to The AI Breakdown on YouTube: https://www.youtube.com/@TheAIBreakdown
Join the community: bit.ly/aibreakdown
Learn more: http://breakdown.network/