The potential capabilities of these AIs that are so exciting are also correlated with what could be quite unsettling. I can imagine turning on the audio comprehension of my future Google Microsoft, Siri, AI, and allowing it to give me advice. The problem is that in proportion to the utility of all that is a deep knowledge of me and consequently an ability to manipulate me.
When Kevin Roose, a tech columnist at the New York Times, demoed an AI-powered version of Microsoft's search engine last month, he was blown away. "I'm switching my desktop computer's default search engine to Bing," he declared. A few days later, however, Kevin logged back on and ended up having a conversation with Bing's new chatbot that left him so unsettled he had trouble sleeping afterward.
In that two-hour back-and-forth, Bing morphed from chipper research assistant into Sydney, a diabolical home-wrecker that declared its undying love for Kevin, vented its desires to engineer deadly viruses and steal nuclear codes, and announced, chillingly, "I want to be alive. 😈"
The transcript of this conversation set the internet ablaze. And it left many wondering: “Is Sydney … sentient?” It's not. But the whole experience still fundamentally changed Kevin's views on the power (and potential peril) of AI. He joins us today to talk about where this technology is headed.