Pluralistic: The AI hype bubble is the new crypto hype bubble (09 Mar 2023)


Today's links



A graph depicting the Gartner hype cycle. A pair of HAL 9000's glowing red eyes are chasing each other down the slope from the Peak of Inflated Expectations to join another one that is at rest in the Trough of Disillusionment. It, in turn, sits atop a vast cairn of HAL 9000 eyes that are piled in a rough pyramid that extends below the graph to a distance of several times its height.

The AI hype bubble is the new crypto hype bubble (permalink)

Back in 2017 Long Island Ice Tea – known for its undistinguished, barely drinkable sugar-water – changed its name to "Long Blockchain Corp." Its shares surged to a peak of 400% over their pre-announcement price. The company announced no specific integrations with any kind of blockchain, nor has it made any such integrations since.

LBCC was subsequently delisted from NASDAQ after settling with the SEC over fraudulent investor statements. Today, the company trades over the counter and its market cap is $36m, down from $138m.

https://cointelegraph.com/news/textbook-case-of-crypto-hype-how-iced-tea-company-went-blockchain-and-failed-despite-a-289-percent-stock-rise

The most remarkable thing about this incredibly stupid story is that LBCC wasn't the peak of the blockchain bubble – rather, it was the start of blockchain's final pump-and-dump. By the standards of 2022's blockchain grifters, LBCC was small potatoes, a mere $138m sugar-water grift.

They didn't have any NFTs, no wash trades, no ICO. They didn't have a Superbowl ad. They didn't steal billions from mom-and-pop investors while proclaiming themselves to be "Effective Altruists." They didn't channel hundreds of millions to election campaigns through straw donations and other forms of campaing finance frauds. They didn't even open a crypto-themed hamburger restaurant where you couldn't buy hamburgers with crypto:

https://robbreport.com/food-drink/dining/bored-hungry-restaurant-no-cryptocurrency-1234694556/

They were amateurs. Their attempt to "make fetch happen" only succeeded for a brief instant. By contrast, the superpredators of the crypto bubble were able to make fetch happen over an improbably long timescale, deploying the most powerful reality distortion fields since Pets.com.

Anything that can't go on forever will eventually stop. We're told that trillions of dollars' worth of crypto has been wiped out over the past year, but these losses are nowhere to be seen in the real economy – because the "wealth" that was wiped out by the crypto bubble's bursting never existed in the first place.

Like any Ponzi scheme, crypto was a way to separate normies from their savings through the pretense that they were "investing" in a vast enterprise – but the only real money ("fiat" in cryptospeak) in the system was the hardscrabble retirement savings of working people, which the bubble's energetic inflaters swapped for illiquid, worthless shitcoins.

We've stopped believing in the illusory billions. Sam Bankman-Fried is under house arrest. But the people who gave him money – and the nimbler Ponzi artists who evaded arrest – are looking for new scams to separate the marks from their money.

Take Morganstanley, who spent 2021 and 2022 hyping cryptocurrency as a massive growth opportunity:

https://cointelegraph.com/news/morgan-stanley-launches-cryptocurrency-research-team

Today, Morganstanley wants you to know that AI is a $6 trillion opportunity.

They're not alone. The CEOs of Endeavor, Buzzfeed, Microsoft, Spotify, Youtube, Snap, Sports Illustrated, and CAA are all out there, pumping up the AI bubble with every hour that god sends, declaring that the future is AI.

https://www.hollywoodreporter.com/business/business-news/wall-street-ai-stock-price-1235343279/

Google and Bing are locked in an arms-race to see whose search engine can attain the speediest, most profound enshittification via chatbot, replacing links to web-pages with florid paragraphs composed by fully automated, supremely confident liars:

https://pluralistic.net/2023/02/16/tweedledumber/#easily-spooked

Blockchain was a solution in search of a problem. So is AI. Yes, Buzzfeed will be able to reduce its wage-bill by automating its personality quiz vertical, and Spotify's "AI DJ" will produce slightly less terrible playlists (at least, to the extent that Spotify doesn't put its thumb on the scales by inserting tracks into the playlists whose only fitness factor is that someone paid to boost them).

But even if you add all of this up, double it, square it, and add a billion dollar confidence interval, it still doesn't add up to what Bank Of America analysts called "a defining moment — like the internet in the ’90s." For one thing, the most exciting part of the "internet in the '90s" was that it had incredibly low barriers to entry and wasn't dominated by large companies – indeed, it had them running scared.

The AI bubble, by contrast, is being inflated by massive incumbents, whose excitement boils down to "This will let the biggest companies get much, much bigger and the rest of you can go fuck yourselves." Some revolution.

AI has all the hallmarks of a classic pump-and-dump, starting with terminology. AI isn't "artificial" and it's not "intelligent." "Machine learning" doesn't learn. On this week's Trashfuture podcast, they made an excellent (and profane and hilarious) case that ChatGPT is best understood as a sophisticated form of autocomplete – not our new robot overlord.

https://open.spotify.com/episode/4NHKMZZNKi0w9mOhPYIL4T

We all know that autocomplete is a decidedly mixed blessing. Like all statistical inference tools, autocomplete is profoundly conservative – it wants you to do the same thing tomorrow as you did yesterday (that's why "sophisticated" ad retargeting algorithms show you ads for shoes in response to your search for shoes). If the word you type after "hey" is usually "hon" then the next time you type "hey," autocomplete will be ready to fill in your typical following word – even if this time you want to type "hey stop texting me you freak":

https://blog.lareviewofbooks.org/provocations/neophobic-conservative-ai-overlords-want-everything-stay/

And when autocomplete encounters a new input – when you try to type something you've never typed before – it tries to get you to finish your sentence with the statistically median thing that everyone would type next, on average. Usually that produces something utterly bland, but sometimes the results can be hilarious. Back in 2018, I started to text our babysitter with "hey are you free to sit" only to have Android finish the sentence with "on my face" (not something I'd ever typed!):

https://mashable.com/article/android-predictive-text-sit-on-my-face

Modern autocomplete can produce long passages of text in response to prompts, but it is every bit as unreliable as 2018 Android SMS autocomplete, as Alexander Hanff discovered when ChatGPT informed him that he was dead, even generating a plausible URL for a link to a nonexistent obit in The Guardian:

https://www.theregister.com/2023/03/02/chatgpt_considered_harmful/

Of course, the carnival barkers of the AI pump-and-dump insist that this is all a feature, not a bug. If autocomplete says stupid, wrong things with total confidence, that's because "AI" is becoming more human, because humans also say stupid, wrong things with total confidence.

Exhibit A is the billionaire AI grifter Sam Altman, CEO of OpenAI – a company whose products are not open, nor are they artificial, nor are they intelligent. Altman celebrated the release of ChatGPT by tweeting "i am a stochastic parrot, and so r u."

https://twitter.com/sama/status/1599471830255177728

This was a dig at the "stochastic parrots" paper, a comprehensive, measured roundup of criticisms of AI that led Google to fire Timnit Gebru, a respected AI researcher, for having the audacity to point out the Emperor's New Clothes:

https://www.technologyreview.com/2020/12/04/1013294/google-ai-ethics-research-paper-forced-out-timnit-gebru/

Gebru's co-author on the Parrots paper was Emily M Bender, a computational linguistics specialist at UW, who is one of the best-informed and most damning critics of AI hype. You can get a good sense of her position from Elizabeth Weil's New York Magazine profile:

https://nymag.com/intelligencer/article/ai-artificial-intelligence-chatbots-emily-m-bender.html

Bender has made many important scholarly contributions to her field, but she is also famous for her rules of thumb, which caution her fellow scientists not to get high on their own supply:

  • Please do not conflate word form and meaning

  • Mind your own credulity

As Bender says, we've made "machines that can mindlessly generate text, but we haven’t learned how to stop imagining the mind behind it." One potential tonic against this fallacy is to follow an Italian MP's suggestion and replace "AI" with "SALAMI" ("Systematic Approaches to Learning Algorithms and Machine Inferences"). It's a lot easier to keep a clear head when someone asks you, "Is this SALAMI intelligent? Can this SALAMI write a novel? Does this SALAMI deserve human rights?"

Bender's most famous contribution is the "stochastic parrot," a construct that "just probabilistically spits out words." AI bros like Altman love the stochastic parrot, and are hellbent on reducing human beings to stochastic parrots, which will allow them to declare that their chatbots have feature-parity with human beings.

At the same time, Altman and Co are strangely afraid of their creations. It's possible that this is just a shuck: "I have made something so powerful that it could destroy humanity! Luckily, I am a wise steward of this thing, so it's fine. But boy, it sure is powerful!"

They've been playing this game for a long time. People like Elon Musk (an investor in OpenAI, who is hoping to convince the EU Commission and FTC that he can fire all of Twitter's human moderators and replace them with chatbots without violating EU law or the FTC's consent decree) keep warning us that AI will destroy us unless we tame it.

There's a lot of credulous repetition of these claims, and not just by AI's boosters. AI critics are also prone to engaging in what Lee Vinsel calls criti-hype: criticizing something by repeating its boosters' claims without interrogating them to see if they're true:

https://sts-news.medium.com/youre-doing-it-wrong-notes-on-criticism-and-technology-hype-18b08b4307e5

There are better ways to respond to Elon Musk warning us that AIs will emulsify the planet and use human beings for food than to shout, "Look at how irresponsible this wizard is being! He made a Frankenstein's Monster that will kill us all!" Like, we could point out that of all the things Elon Musk is profoundly wrong about, he is most wrong about the philosophical meaning of Wachowksi movies:

https://www.theguardian.com/film/2020/may/18/lilly-wachowski-ivana-trump-elon-musk-twitter-red-pill-the-matrix-tweets

But even if we take the bros at their word when they proclaim themselves to be terrified of "existential risk" from AI, we can find better explanations by seeking out other phenomena that might be triggering their dread. As Charlie Stross points out, corporations are Slow AIs, autonomous artificial lifeforms that consistently do the wrong thing even when the people who nominally run them try to steer them in better directions:

https://media.ccc.de/v/34c3-9270-dude_you_broke_the_future

Imagine the existential horror of a ultra-rich manbaby who nominally leads a company, but can't get it to follow: "everyone thinks I'm in charge, but I'm actually being driven by the Slow AI, serving as its sock puppet on some days, its golem on others."

Ted Chiang nailed this back in 2017 (the same year of the Long Island Blockchain Company):

There’s a saying, popularized by Fredric Jameson, that it’s easier to imagine the end of the world than to imagine the end of capitalism. It’s no surprise that Silicon Valley capitalists don’t want to think about capitalism ending. What’s unexpected is that the way they envision the world ending is through a form of unchecked capitalism, disguised as a superintelligent AI. They have unconsciously created a devil in their own image, a boogeyman whose excesses are precisely their own.

https://www.buzzfeednews.com/article/tedchiang/the-real-danger-to-civilization-isnt-ai-its-runaway

Chiang is still writing some of the best critical work on "AI." His February article in the New Yorker, "ChatGPT Is a Blurry JPEG of the Web," was an instant classic:

[AI] hallucinations are compression artifacts, but—like the incorrect labels generated by the Xerox photocopier—they are plausible enough that identifying them requires comparing them against the originals, which in this case means either the Web or our own knowledge of the world.

https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web

"AI" is practically purpose-built for inflating another hype-bubble, excelling as it does at producing party-tricks – plausible essays, weird images, voice impersonations. But as Princeton's Matthew Salganik writes, there's a world of difference between "cool" and "tool":

https://freedom-to-tinker.com/2023/03/08/can-chatgpt-and-its-successors-go-from-cool-to-tool/

Nature can claim "conversational AI is a game-changer for science" but "there is a huge gap between writing funny instructions for removing food from home electronics and doing scientific research." Salganik tried to get ChatGPT to help him with the most banal of scholarly tasks – aiding him in peer reviewing a colleague's paper. The result? "ChatGPT didn’t help me do peer review at all; not one little bit."

The criti-hype isn't limited to ChatGPT, of course – there's plenty of (justifiable) concern about image and voice generators and their impact on creative labor markets, but that concern is often expressed in ways that amplify the self-serving claims of the companies hoping to inflate the hype machine.

One of the best critical responses to the question of image- and voice-generators comes from Kirby Ferguson, whose final Everything Is a Remix video is a superb, visually stunning, brilliantly argued critique of these systems:

https://www.youtube.com/watch?v=rswxcDyotXA

One area where Ferguson shines is in thinking through the copyright question – is there any right to decide who can study the art you make? Except in some edge cases, these systems don't store copies of the images they analyze, nor do they reproduce them:

https://pluralistic.net/2023/02/09/ai-monkeys-paw/#bullied-schoolkids

For creators, the important material question raised by these systems is economic, not creative: will our bosses use them to erode our wages? That is a very important question, and as far as our bosses are concerned, the answer is a resounding yes.

Markets value automation primarily because automation allows capitalists to pay workers less. The textile factory owners who purchased automatic looms weren't interested in giving their workers raises and shorting working days.
'
They wanted to fire their skilled workers and replace them with small children kidnapped out of orphanages and indentured for a decade, starved and beaten and forced to work, even after they were mangled by the machines. Fun fact: Oliver Twist was based on the bestselling memoir of Robert Blincoe, a child who survived his decade of forced labor:

https://www.gutenberg.org/files/59127/59127-h/59127-h.htm

Today, voice actors sitting down to record for games companies are forced to begin each session with "My name is ______ and I hereby grant irrevocable permission to train an AI with my voice and use it any way you see fit."

https://www.vice.com/en/article/5d37za/voice-actors-sign-away-rights-to-artificial-intelligence

Let's be clear here: there is – at present – no firmly established copyright over voiceprints. The "right" that voice actors are signing away as a non-negotiable condition of doing their jobs for giant, powerful monopolists doesn't even exist. When a corporation makes a worker surrender this right, they are betting that this right will be created later in the name of "artists' rights" – and that they will then be able to harvest this right and use it to fire the artists who fought so hard for it.

There are other approaches to this. We could support the US Copyright Office's position that machine-generated works are not works of human creative authorship and are thus not eligible for copyright – so if corporations wanted to control their products, they'd have to hire humans to make them:

https://www.theverge.com/2022/2/21/22944335/us-copyright-office-reject-ai-generated-art-recent-entrance-to-paradise

Or we could create collective rights that belong to all artists and can't be signed away to a corporation. That's how the right to record other musicians' songs work – and it's why Taylor Swift was able to re-record the masters that were sold out from under her by evil private-equity bros:

https://pluralistic.net/2023/02/26/united-we-stand/

Whatever we do as creative workers and as humans entitled to a decent life, we can't afford to drink the Blockchain Iced Tea. That means that we have to be technically competent, to understand how the stochastic parrot works, and to make sure our criticism doesn't just repeat the marketing copy of the latest pump-and-dump.

(Image: Cryteria, CC BY 3.0, modified)


Hey look at this (permalink)



A Wayback Machine banner.

This day in history (permalink)

#20yrsago NYT reviews Down and Out in the Magic Kingdom https://www.nytimes.com/2003/03/09/books/does-that-mean-we-can-defrost-walt.html

#20yrsago Notes from “Doing Good Online” https://web.archive.org/web/20030604125836/http://cheesedip.com/?p=archives/week_2003_03_02.phtml

#20yrsago Left-wing media bias? In your dreams https://web.archive.org/web/20030411094341/weblog.siliconvalley.com/column/dangillmor/archives/000838.shtml

#15yrsago Air Force lawyers send DMCA notice to YouTube https://www.wired.com/2008/03/air-force-cyber-2/

#15yrsago Cal State U forced to re-hire Quaker math teacher who inserted “non-violently” into loyalty oath https://www.latimes.com/archives/la-xpm-2008-mar-08-me-loyaltyoath8-story.html

#10yrsago AP: Chavez made “meager” gains, only reduced poverty, didn’t build the world’s tallest building https://fair.org/home/ap-chavez-wasted-his-money-on-healthcare-when-he-could-have-built-gigantic-skyscrapers/

#15yrsago Society of Automotive Engineers kills DRM on its journal following MIT boycott https://web.archive.org/web/20080308131031/http://news-libraries.mit.edu/blog/following-removal/1024/

#15yrsago Flowchart: How D&D is a gateway drug to every flavor of nerdiness https://www.nytimes.com/2008/03/09/opinion/09rogers.html

#10yrsago Welcome to your Awesome Robot: instructional comic turns kids & cardboard boxes into AWESOME ROBOTS! https://memex.craphound.com/2013/03/09/welcome-to-your-awesome-robot-instructional-comic-turns-kids-cardboard-boxes-into-awesome-robots/

#10yrsago US Ninth Circuit says forensic laptop searches at the border without suspicion are unconstitional https://www.techdirt.com/2013/03/08/9th-circuit-appeals-court-4th-amendment-applies-border-also-password-protected-files-shouldnt-arouse-suspicion/

#10yrsago Austin Chronicle on Aaron Swartz and the future of computers https://www.austinchronicle.com/screens/2013-03-08/invaluable-information/

#10yrsago Random House responds to SFWA on its Hydra ebook imprint https://www.publishersweekly.com/pw/by-topic/digital/content-and-e-books/article/56244-rh-responds-to-sfwa-slamming-its-hydra-imprint.html

#10yrsago NYPD will arrest you for carrying condoms: the women/trans/genderqueer version of stop-and-frisk https://www.vice.com/en/article/3b5mx9/new-york-cops-will-arrest-you-for-carrying-condoms

#10yrsago Canada’s National Post pretends fair dealing doesn’t exist, presents you with bill to copy a single word https://web.archive.org/web/20130311104536/https://www.michaelgeist.ca/content/view/6802/125/

#5yrsago A mechanical, wooden Turing machine https://www.youtube.com/watch?v=vo8izCKHiF0

#5yrsago Florida students succeed where so many have failed, force state legislature to pass gun control rules despite ferocious NRA lobbying https://www.washingtonpost.com/politics/florida-legislature-backs-new-gun-restrictions-after-parkland-school-shooting/2018/03/07/f97057ea-2229-11e8-badd-7c9f29a55815_story.html

#5yrsago Vendor lock-in, DRM, and crappy EULAs are turning America’s independent farmers into tenant farmers https://www.vice.com/en/article/a34pp4/john-deere-tractor-hacking-big-data-surveillance

#5yrsago A critical statistics education that fits on a postcard https://timharford.com/2018/03/your-handy-postcard-sized-guide-to-statistics/

#5yrsago An algorithm that converts 3D meshes into machine-knitting patterns https://textiles-lab.github.io/publications/2018-autoknit/

#5yrsago After Airbnb hosts converted New York’s available housing stock to unlicensed hotel rooms, rents soared https://www.mcgill.ca/newsroom/files/newsroom/channels/attach/airbnb-report.pdf

#5yrsago The company that turned Grenfell Tower into a deathtrap reports profits up 50% and anticipates no downside from the disaster https://www.theguardian.com/business/2018/mar/08/rydon-profit-rises-grenfell-tower-contractor

#5yrsago The Warrior Within: a tight science fiction novella about a warrior who contains multitudes https://memex.craphound.com/2018/03/08/the-warrior-within-a-tight-science-fiction-novella-about-a-warrior-who-contains-multitudes/

#5yrsago How denialists weaponize media literacy and what to do about it https://www.youtube.com/watch?v=0I7FVyQCjNg

#5yrsago Machine learning models keep getting spoofed by adversarial attacks and it’s not clear if this can ever be fixed https://www.wired.com/story/ai-has-a-hallucination-problem-thats-proving-tough-to-fix/

#5yrsago RIP John Sulston, open science hero and father of the Human Genome Project https://phys.org/news/2018-03-john-sulston-decoded-human-genome.html

#1yrago The cruelty isn't the point: The point is power https://pluralistic.net/2022/03/09/turkeys-voting-for-christmas/#culture-wars

#1yrago The Dawn of Everything: An essential reminder that we are in charge of our own destiny https://pluralistic.net/2022/03/08/three-freedoms/#anti-fatalism

#1yrago How and why to break up Big Tech https://pluralistic.net/2022/03/08/three-freedoms/#alphabet-soup



Colophon (permalink)

Today's top sources: Slashdot (https://slashdot.org/), Memex 1.1 (https://memex.naughtons.org/).

Currently writing:

  • Picks and Shovels, a Martin Hench noir thriller about the heroic era of the PC. Yesterday's progress: 590 words (113834 words total)

  • The Bezzle, a Martin Hench noir thriller novel about the prison-tech industry. FIRST DRAFT COMPLETE, WAITING FOR EDITORIAL REVIEW

  • A Little Brother short story about DIY insulin PLANNING

  • Vigilant, Little Brother short story about remote invigilation. ON SUBMISSION

  • Moral Hazard, a short story for MIT Tech Review's 12 Tomorrows. FIRST DRAFT COMPLETE, ACCEPTED FOR PUBLICATION

  • Spill, a Little Brother short story about pipeline protests. ON SUBMISSION

Latest podcast: Twiddler https://craphound.com/news/2023/02/27/twiddler/

Upcoming appearances:

Recent appearances:

Latest books:

Upcoming books:

  • Red Team Blues: "A grabby, compulsive thriller that will leave you knowing more about how the world works than you did before." Tor Books, April 2023

  • The Internet Con: A nonfiction book about interoperability and Big Tech, Verso, September 2023

  • The Lost Cause: a post-Green New Deal eco-topian novel about truth and reconciliation with white nationalist militias, Tor Books, November 2023


This work licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net.

https://creativecommons.org/licenses/by/4.0/

Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution.


How to get Pluralistic:

Blog (no ads, tracking, or data-collection):

Pluralistic.net

Newsletter (no ads, tracking, or data-collection):

https://pluralistic.net/plura-list

Mastodon (no ads, tracking, or data-collection):

https://mamot.fr/@pluralistic

Medium (no ads, paywalled):

https://doctorow.medium.com/

(Latest Medium column: "They're still trying to ban cryptography" https://pluralistic.net/2023/03/05/theyre-still-trying-to-ban-cryptography/)

Twitter (mass-scale, unrestricted, third-party surveillance and advertising):

https://twitter.com/doctorow

Tumblr (mass-scale, unrestricted, third-party surveillance and advertising):

https://mostlysignssomeportents.tumblr.com/tagged/pluralistic

"When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla