775: What will humans do when machines are vastly more intelligent? With Aleksa Gordić
Apr 16, 2024
auto_awesome
Tech entrepreneur Aleksa Gordić discusses self-directed learning, traits for tech entrepreneurship, and the social impact of artificial superintelligence with Jon Krohn. Topics include motivating oneself to become an entrepreneur, sustainable solutions for LLMs, next major developments in AI, and why formal education needs change.
Success in tech entrepreneurship requires self-motivation and strategic learning approaches.
Traits for a successful CTO involve specific skills and qualities in tech leadership.
Sustainable solutions are needed to address the energy demands of large language models (LLMs).
Integrating fast intuitive processing with slow deliberate reasoning enhances AI problem-solving capabilities.
Deep dives
Language Models and Innovation in AI Technology
Innovations in AI technology have shifted towards leveraging large language models (LLMs) like transformers to achieve significant progress. The podcast explores how increasing the scale of data and tokens, as well as incorporating multiple modalities such as vision and speech, are key to advancing AI capabilities.
Addressing Environmental Concerns in AI Development
Discussions around the energy demands of LLMs and AI models highlight potential sustainability challenges. However, the belief in technological progress and the development of energy-efficient solutions like fusion reactors may mitigate these concerns.
The Value of Next Token Prediction in AI Systems
Understanding the power of next token prediction in AI systems as highlighted by Elias Skiver and its role in enhancing comprehension and predictive accuracy. Leveraging this mechanism can lead to significant advancements in AI, aiding in achieving general intelligence.
Combining System 1 and System 2 Thinking in AI Development
Exploring the incorporation of both fast, intuitive processing (System 1) and slow, deliberate reasoning (System 2) in AI approaches for enhanced problem-solving and decision-making capabilities. Current AI methods blend these approaches and may benefit from combining transformers with advanced algorithmic strategies for improved outcomes.
AI and Entrepreneurship
Alexa discusses how leaving big tech to become an entrepreneur was a clear choice for him, as the entrepreneurial experience could enhance his career opportunities. He also delves into scaling sensory token data sets for achieving artificial super intelligence.
Productivity and Learning Cycles
Alexa emphasizes the importance of balancing productivity with relaxation, highlighting that taking breaks is crucial for optimal performance. He shares his learning approach, involving three-month macro cycles focusing on a new topic and two-week micro cycles alternating between information intake and output creation.
Transformation in Education and Book Recommendations
Alexa envisions AI revolutionizing education through AI tutors. He recommends books, such as biographies by Walter Isaacson, 'Never Split the Difference' by Chris Voss, and 'Meditations' by Marcus Aurelius, highlighting their impact on personal and professional growth.
Tech entrepreneurship, artificial superintelligence, and the future of education: Aleksa Gordić speaks to Jon Krohn about his strategies for self-directed learning, the traits that help people succeed in moving from big tech to entrepreneurship, and the social impact of artificial superintelligence.
This episode is brought to you by Ready Tensor, where innovation meets reproducibility. Interested in sponsoring a SuperDataScience Podcast episode? Visit passionfroot.me/superdatascience for sponsorship information.
In this episode you will learn: • How to motivate yourself to become a tech entrepreneur [17:02] • Aleksa’s checklist for the perfect CTO [35:00] • Potential sustainable solutions for LLMs [41:51] • The next major developments in AI and tech [48:29] • How hobbies have a knock-on effect for a person’s career [1:01:53] • How and why formal education needs to change [1:09:24]
