AT THE END OF MARCH 2024, the romance writer K. Renee discovered that she had been locked out of her Google Docs account, for posting “inappropriate” content in her private files. Renee never got back into her account and never found out what triggered the lockout. She wasn’t alone: as Madeline Ashby recounts in her excellent Wired story on the affair, many romance writers were permanently barred from their own files without explanation or appeal. At the time of the lockout, Renee was in the midst of ten works in progress, totaling over 200,000 words (Renee used Docs to share her work with her early readers for critical feedback).
This is an absolute nightmare scenario for any writer, but it could have been so much worse. In 2021, “Mark,” a stay-at-home dad, sought telemedicine advice for his young son’s urinary tract infection (this was during the acute phase of the covid pandemic, all but the most urgent medical issues were being handled remotely). His son’s pediatrician instructed Mark to take a picture of his son’s penis and upload it using the secure telemedicine app.
Mark did so, but his iPhone was running Google Photos, with auto-synch turned on, so the image was also uploaded to his private Google Photos directory. When it arrived there, Google’s AI scanned the photo and flagged it for child sexual abuse material. Google turned the issue over to the San Francisco Police Department, and furnished the detective assigned to the case with all of Mark’s data — his location history, his email, his photos, his browsing history, and more.
At the same time, Google terminated Mark’s account and deleted all of their own copies of his data. His phone stopped working (he had been using Google Fi for mobile service). His email stopped working (he was a Gmail user). All of his personal records disappeared from his Google Drive. His Google Authenticator, used for two-factor authentication, stopped working. Every photo was deleted from his Google Photos account, including every photo he’d taken of his son since birth.
Podcast – Cory Doctorow's craphound.com 