May 5th, 2023 | On Todays' HN Recap: The HN Recap
Hacker News Recap
00:00
Unlimaformer: A Groundbreaking Approach for Transformer-Based Models
Unlimaformer is a groundbreaking approach for transformer-based models, transcending the confines of predefined input length. By wrapping any existing pre-trained encoder-decoder transformer and offloading attention computation to a single K-nearest neighbor index, Unlimaformer achieves astonishing results on long-document and multi-document summarization benchmarks. The innovative method enhances pre-trained models like BART and long-former, enabling them to handle unlimited inputs without extra-learned weights or code modifications. A Financial Times journalist discovers she was surveilled by TikTok, the popular social media app. This gripping personal account brings to light the urgent questions and concerns about privacy, user data,
Transcript
Play full episode
