Pluralistic: Linkrot (21 May 2024)

Today's links

A 1994 Yahoo homepage. It is animated. The blue links blur and then disappear.

Linkrot (permalink)

Here's an underrated cognitive virtue: "object permanence" – that is, remembering how you perceived something previously. As Riley Quinn often reminds us, the left is the ideology of object permanence – to be a leftist is to hate and mistrust the CIA even when they're tormenting Trump for a brief instant, or to remember that it was once possible for a working person to support their family with their wages:

The thing is, object permanence is hard. Life comes at you quickly. It's very hard to remember facts, and the order in which those facts arrived – it's even harder to remember how you felt about those facts in the moment.

This is where blogging comes in – for me, at least. Back in 1997, Scott Edelman – editor of Science Fiction Age – asked me to take over the back page of the magazine by writing up ten links of interest for the nascent web. I wrote that column until the spring of 2000, then, in early 2001, Mark Frauenfelder asked me to guest-edit Boing Boing, whereupon the tempo of my web-logging went daily. I kept that up on Boing Boing for more than 19 years, writing about 54,000 posts. In February, 2020, I started, my solo project, a kind of blog/newsletter, and in the four-plus years since, I've written about 1,200 editions containing between one and twelve posts each.

This gigantic corpus of everything I ever considered to be noteworthy is immensely valuable to me. The act of taking notes in public is a powerful discipline: rather than jotting cryptic notes to myself in a commonplace book, I publish those notes for strangers. This imposes a rigor on the note-taking that makes those notes far more useful to me in years to come.

Better still: public note-taking is powerfully mnemonic. The things I've taken notes on form a kind of supersaturated solution of story ideas, essay ideas, speech ideas, and more, and periodically two or more of these fragments will glom together, nucleate, and a fully-formed work will crystallize out of the solution.

Then, the fact that all these fragments are also database entries – contained in the back-end of a WordPress installation that I can run complex queries on – comes into play, letting me swiftly and reliably confirm my memories of these long-gone phenomena. Inevitably, these queries turn up material that I've totally forgotten, and these make the result even richer, like adding homemade stock to a stew to bring out a rich and complicated flavor. Better still, many of these posts have been annotated by readers with supplemental materials or vigorous objections.

I call this all "The Memex Method" and it lets me write a lot (I wrote nine books during lockdown, as I used work to distract me from anxiety – something I stumbled into through a lifetime of chronic pain management):

Back in 2013, I started a new daily Boing Boing feature: "This Day In Blogging History," wherein I would look at the archive of posts for that day one, five and ten years previously:

With Pluralistic, I turned this into a daily newsletter feature, now stretching back to twenty, fifteen, ten, five and one year ago. Here's today's:

This is a tremendous adjunct to the Memex Method. It's a structured way to review everything I've ever thought about, in five-year increments, every single day. I liken this to working dough, where there's stuff at the edges getting dried out and crumbly, and so your fold it all back into the middle. All these old fragments naturally slip out of your thoughts and understanding, but you can revive their centrality by briefly paying attention to them for a few minutes every day.

This structured daily review is a wonderful way to maintain object permanence, reviewing your attitudes and beliefs over time. It's also a way to understand the long-forgotten origins of issues that are central to you today. Yesterday, I was reminded that I started thinking about automotive Right to Repair 15 years ago:

Given that we're still fighting over this, that's some important perspective, a reminder of the likely timescales involved in more recent issues where I feel like little progress is being made.

Remember when we all got pissed off because the mustache-twirling evil CEO of Warners, David Zaslav, was shredding highly anticipated TV shows and movies prior to their release to get a tax-credit? Turns out that we started getting angry about this stuff twenty years ago, when Michael Eisner did it to Michael Moore's "Fahrenheit 911":

It's not just object permanence: this daily spelunk through my old records is also a way to continuously and methodically sound the web for linkrot: when old links go bad. Over the past five years, I've noticed a very sharp increase in linkrot, and even worse, in the odious practice of spammers taking over my dead friends' former blogs and turning them into AI spam-farms:

The good people at the Pew Research Center have just released a careful, quantitative study of linkrot that confirms – and exceeds – my worst suspicions about the decay of the web:

The headline finding from "When Online Content Disappears" is that 38% of the web of 2013 is gone today. Wikipedia references are especially hard-hit, with 23% of news links missing and 21% of government websites gone. The majority of Wikipedia entries have at least one broken link in their reference sections. Twitter is another industrial-scale oubliette: a fifth of English tweets disappear within a matter of months; for Turkish and Arabic tweets, it's 40%.

Thankfully, someone has plugged the web's memory-hole. Since 2001, the Internet Archive's Wayback Machine has allowed web users to see captures of web-pages, tracking their changes over time. I was at the Wayback Machine's launch party, and right away, I could see its value. Today, I make extensive use of Wayback Machine captures for my "This Day In History" posts, and when I find dead links on the web.

The Wayback Machine went public in 2001, but Archive founder Brewster Kahle started scraping the web in 1996. Today's post graphic – a modified Yahoo homepage from October 17, 1996 – is the oldest Yahoo capture on the Wayback Machine:*/

Remember that the next time someone tells you that we must stamp out web-scraping for one reason or another. There are plenty of ugly ways to use scraping (looking at you, Clearview AI) that we should ban, but scraping itself is very good:

And so is the Internet Archive, which makes the legal threats it faces today all the more frightening. Lawsuits brought by the Big Five publishers and Big Three labels will, if successful, snuff out the Internet Archive altogether, and with it, the Wayback Machine – the only record we have of our ephemeral internet:

Libraries burn. The Internet Archive may seem like a sturdy and eternal repository for our collective object permanence about the internet, but it is very fragile, and could disappear like that.

Hey look at this (permalink)

A Wayback Machine banner.

This day in history (permalink)

#15yrsago Got a cell-phone? FCC claims the right to search your house

#15yrsago Infinite Typewriters: Goats webcomic collection is transcendantly silly without being forced

#15yrsago Fight terrorism by arresting terrorists, not by looking at our genitals at airports

#15yrsago Lessig reviews Helprin’s embarrassing infinite copyright, bloggers-are-stupid, Creative Commons is evil book

#10yrsago Podcast: Firefox’s adoption of closed-source DRM breaks my heart

#10yrsago Interviews with & portraits of sex-machine makers

#10yrsago Steve Wozniak explains Net Neutrality to the FCC

#10yrsago Disneyland’s original prospectus revealed!

#10yrsago Jo Walton’s “My Real Children”: infinitely wise, sad and uplifting novel

#5yrsago That billionaire who paid off a graduating class’s student loans also supports the hedge-fundie’s favorite tax loophole

#5yrsago TOSsed out: EFF catalogs the perverse ways that platform moderation policies hurt the people they’re supposed to protect

#5yrsago How Warner Chappell was able to steal revenues from 25% of a popular Minecraft vlogger’s channels

#5yrsago Notorious forum for account-thieves hacked, login and messages stolen and dumped

#5yrsago A look back at the sales training for Radio Shack’s Model 100, a groundbreaking early laptop

#5yrsago DRM and terms-of-service have ended true ownership, turning us into “tenants of our own devices”

#5yrsago Research shows that 2FA and other basic measures are incredibly effective at preventing account hijacking

#5yrsago A deep dive into the internal politics, personalities and social significance of the Googler Uprising

#1yrago Dumping links like Galileo dumped the orange

Upcoming appearances (permalink)

A photo of me onstage, giving a speech, holding a mic.

A screenshot of me at my desk, doing a livecast.

Recent appearances (permalink)

A grid of my books with Will Stahle covers..

Latest books (permalink)

A cardboard book box with the Macmillan logo.

Upcoming books (permalink)

  • Picks and Shovels: a sequel to "Red Team Blues," about the heroic era of the PC, Tor Books, February 2025

  • Unauthorized Bread: a graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, 2025

Colophon (permalink)

Today's top sources: Michael Dimock.

Currently writing:

  • A Little Brother short story about DIY insulin PLANNING

  • Picks and Shovels, a Martin Hench noir thriller about the heroic era of the PC. FORTHCOMING TOR BOOKS JAN 2025

  • Vigilant, Little Brother short story about remote invigilation. FORTHCOMING ON TOR.COM

  • Spill, a Little Brother short story about pipeline protests. FORTHCOMING ON TOR.COM

Latest podcast: No One Is the Enshittifier of Their Own Story

This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to

Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution.

How to get Pluralistic:

Blog (no ads, tracking, or data-collection):

Newsletter (no ads, tracking, or data-collection):

Mastodon (no ads, tracking, or data-collection):

Medium (no ads, paywalled):

Twitter (mass-scale, unrestricted, third-party surveillance and advertising):

Tumblr (mass-scale, unrestricted, third-party surveillance and advertising):

"When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla