2 Sources
[1]
How to burst the AI bubble: Strike at its roots
Last year we featured a lengthy interview with tech journalist/science fiction author Cory Doctorow about his book, Enshittification: Why Everything Suddenly Got Worse and What To Do About It. The prolific Doctorow is back with a provocative new book that serves as a follow-up of sorts, focusing on AI and related issues: The Reverse Centaur's Guide to Life After AI. Doctorow doesn't actually enjoy talking about AI, but he's constantly being asked to comment on it. "I made the tactical error of being sick of talking about AI," Doctorow told Ars. "So I wrote a book about why I think it's a dumb thing to keep asking people to talk about, and now I have to talk about it." Reverse Centaur is Doctorow's attempt to "sort out the bullshit from the material reality." In automation theory, per Doctorow, a "centaur" describes a human augmented with a technology, like machine learning, or even just driving a car, or using autocomplete. A reverse centaur "is a machine head on a human body, a person who is serving as a squishy meat appendage for an uncaring machine," Doctorow said in a speech last December. He gave the example of an Amazon delivery driver, surrounded by AI cameras monitoring their driving, who essentially serves as a peripheral to the delivery van. Being a centaur is generally viewed as a positive thing; few people relish being a reverse centaur. And yet the AI industry seems intent on using those tools to create more reverse centaurs. It's one thing to incorporate AI tools in the medical field to help radiologists process X-ray images and spot possible tumors they might otherwise have missed. It's quite another to fire nine out of 10 radiologists and let AI make the diagnoses, with the remaining radiologist solely responsible for checking the AI's work -- and, ultimately, taking the blame for any errors. Doctorow is not virulently anti-AI; he uses AI tools regularly and sees potential in many of those tools as useful plugins or cool new apps. But he is nonetheless alarmed at all the hype surrounding AI, the enormous capital expenditures, the unrealistic expectations and self-serving messaging, and the potentially catastrophic economic consequences when the AI bubble inevitably pops. "The bubble doesn't want cheap useful things," Doctorow said. "It wants expensive 'disruptive' things: big foundational models that lose billions of dollars every year. When the AI investment mania halts, most of the models are going to disappear, because it just won't be economical to keep the data centers running. The collapse of the AI bubble is going to be ugly. Seven AI companies currently account for more than a third of the stock market, and they endlessly pass around the same $100 billion IOU. AI is the asbestos in the walls of our technological society, stuffed with wild abandon by a finance sector and tech monopolists run amok. We will be excavating it for a generation or more." Naturally Doctorow has some ideas about how to push back against the prevailing narrative of AI's inevitability. Ars caught up with him to learn more. Macmillan Publishing Macmillan Publishing Macmillan Publishing Macmillan Publishing Macmillan Publishing Macmillan Publishing Ars Technica: We touched briefly on AI last year when we chatted about your prior book. Reverse Centaur seems like a natural outgrowth of that. Cory Doctorow: Enshittification is primarily a thesis about how firms in the absence of constraint get tilted to the bad, but it's also a thesis about how the constraint of competition, when it falls away, produces all kinds of perverse outcomes. One of those perverse outcomes is that firms that have saturated their markets can no longer grow, and they have to find other markets. There's a ticking bomb when you saturate your market because it's only a matter of time until investors start to worry that you're not a growth stock, you're a mature stock. Mature stocks trade at a small fraction of the multiple that growth stocks do. There's an enormous amount of liquidity in growth stocks, which means that you can use growth stocks to grow. You can buy other companies with shares, and shares are an endogenous substance that you make on the premises by typing zeros into a spreadsheet. Firms with growth stocks can grow by typing zeros, whereas firms that are mature, they have to use money if they want to grow, and you're not allowed to make money on the premises. If you do, the Treasury Department shows up and takes you away in handcuffs. So you can see why firms would be very anxious to maintain the perception that they have room for growth even after they have 90 percent market shares. "The capital markets have the object permanence of a toddler, and they would lose a game of peekaboo if they were drafted to play in the league." That's why those firms started promoting stories about how they were going to conquer imaginary markets. Imaginary markets have no agreed-upon valuation because you just made them up. Unless you can turn an imaginary market into a real market pretty quickly, you need to come up with another imaginary market and announce that this is the new imaginary market you're going to conquer. It's easier than you'd think because the capital markets have the object permanence of a toddler, and they would lose a game of peekaboo if they were drafted to play in the league. So you can say, "Oh, actually, it's not metaverse. It's crypto. It's not crypto. It's Web3. It's not Web3. It's something else." And the markets will forgive you, provided you do it quickly enough. But something different happened with AI. It is much, much bigger in terms of capitalization than anything we've ever seen -- not just bigger than other tech bubbles, bigger than other bubbles. When I wrote the book, capital expenditure (CapEx) globally was $700 billion, now it's $1.4 trillion. Meta wasted $60 billion on the metaverse. They spent $150 billion in the last three years on AI, and they say they're going to spend another $150 billion this year. So this is a much bigger bet, and it raises the question: If the material basis for this is creating a narrative so that you can continue to grow by dint of having a highly liquid growth stock, what's the ideological basis? Why are people willing to make such a bigger bet? Some of it is that there's more "there" there with AI. It's real computer science. It was remarkable 10 years ago, when a couple of computer scientists and their grad students took some existing techniques, applied them in a new way, and got a very surprising result that turned out to not only produce dividends the first time around, but to have somewhat linear returns on investment, which is not usually the case. There was a lot of low-hanging fruit in AI, although it's tapering off now because, as they say in finance, anything that can't go on forever has to stop. So we're losing the end of that growth period in terms of returns to scale. Ars Technica: Why do you think AI is so appealing to political and business leaders in particular? Cory Doctorow: It's not just that it makes for a good demo. AI really appeals to a fantasy that I think all of us have to some extent, but that powerful people really have, of a world without people in it -- because hell really is other people. You can't get stuff done without other people helping you. You can't have romance without a romantic partner. You can't have social media without people to socialize with. You can't play a board game, or do a startup, or build a bridge, or build a house, or do politics without other people. And other people stubbornly refuse to organize everything they do to make you happy. Particularly if you're rich and powerful, it's very galling. So AI is very attractive. One of the reasons DOGE fired so many government workers was because it played into the fantasy that you can have a government without government employees. In the corporate sphere, it's the fantasy of a business without workers, because every corporate leader is haunted by the secret fear that if they don't show up for work, everything goes on just fine. But if the workers don't show up, everything shuts down. Maybe they're not really driving the car, maybe they're strapped in the backseat with a toy steering wheel. If that's the case, AI will let them wire the toy steering wheel directly into the drivetrain. So you can have an amazing idea as a corporate visionary, and you don't have to have any ego-shattering confrontations with people who know how to do things, who tell you you're actually an idiot. You just type some stuff to the chatbot, and it shits out your product. If you combine those two things -- the material necessity to have a growth narrative and the ideological attractiveness of a world without people -- you get $1.4 trillion in CapEx for a sector that is turning over $50 billion a year and has to replace all of its assets every 24 to 30 months. Ars Technica: You raised an interesting point recently on your blog: workers actually wanted earlier technological breakthroughs and often had to fight to get them into the workplace. With AI, people are more likely to feel that the technology is being shoved down our throats; some workers are even required to use it. Cory Doctorow: I think that's entirely right. One of the things that I've been attending to a lot lately is the difference between the bubbles that we had before and the bubble that we're having now. People will say, "Oh, Amazon wasn't profitable, and it became profitable. And the web wasn't profitable, and it became profitable. The web was a bubble." Of course the web was a bubble. You don't get pets.com and all those Super Bowl ads without a bubble. But it is a very obvious error of logic to say, "Once, there was a thing that lost money and then it made money, therefore, if you are losing money, someday you'll make money." "AI is the money-losingest thing our species has ever done. We have never lost as much money as we've lost on AI." The thing that made the web profitable was not that it was unprofitable, it was things like good unit economics, where every time someone started using the web, the web got less unprofitable. Every time a web user used the web again, the total profits generated went up. Every generation of web technology made the web more profitable. That's the opposite of AI. Every AI customer loses money for the company, every use of AI by that customer loses money for the company, and every generation of AI loses more money than the last one. AI is the money-losingest thing our species has ever done. We have never lost as much money as we've lost on AI. Another giant material difference is the social reception. If you look back to the business press of the aughts and the late '90s, it's full of hand-wringing editorials about how bosses will cope with workers who are smuggling in the web. You look at those same press outlets today, and it's full of people saying, "What are we going to do about the fact that no one in the workplace wants to use AI?" -- along with ads for firms that will spy on your workers for you so that you can punish the workers who refuse to use AI. Ars Technica: AI nonetheless does have thoughtful, sensible defenders. Cory Doctorow: One of the paradoxes that I try to explore in this book is the workers who are not fools, who are historic good, reliable narrators of their own experience, and who tell you that AI is making their lives better. The foundational idea of science fiction is that what the gadget does is less important than who it does it for and who it does it to. I call those people centaurs. They are workers who are assisted by technology and who decide how that technology is going to assist them. Whereas the workers who hate it are workers who are being asked to produce more with AI at the expense of quality, at a higher speed, at the expense of their own wellbeing, and who understand that they're being recruited to be what Dan Davies calls accountability sinks -- to take the blame when the AI screws up their job. Once you put it that way, it's very easy to see why some workers would say, "Oh yeah, I found a thing that AI is good for and I use it, and that's fine. I'm even excited about it." And why other workers would be like, "This is making me miserable." It's the difference between the words on the Greek temple, "Know thyself," and your boss shining 16 cameras in your face and going, "I know you better than you do. And by the way, I think you could work an extra hour a day without breaking a sweat." Ars Technica: You make a point of emphasizing that you are not fundamentally anti-AI, despite sharply criticizing the industry. Cory Doctorow: I have many comrades who describe themselves as anti-AI, and I've had some very spirited, productive but heated debates with those people because I don't think AI is exceptional. That means that I don't think it's exceptionally evil. The argument that it's the fruit of the poisonous tree, that it was made by bad people in bad ways, so you shouldn't use it -- I think it's very foolish. That is not the merit on which we judge technology. You can talk about whether giving money to these companies is bad. I think it is. You can talk about whether the environmental impact of using foundation models is unsustainable and unsupportable. I think, by and large, it is. But that is not to say that statistical inference using convoluted deep neural networks is bad or -- and this is where I get into many arguments -- that scraping the web to train a convoluted neural network is bad. I think it's fine. Scraping is good actually. I think it's very dangerous to say, "The way that we're going to fix the problems we have with AI is to make it illegal to make a record of what's on the Internet." I think that's catastrophic. That's how we never again will know what was on CBS News before it turned into Chud News. Everything Nate Silver ever published on his website was just zeroed out by Disney. You can only see it at the Internet Archive because we scrape. It's just bonkers to say, "It is theft to make transient copies of works, to analyze those transient copies, to publish the results of your analysis." Those are all socially beneficial activities, and we will all lose if we prohibit it -- not least because the firms that creative workers are worried about it, the big media companies, are extremely capable of entering into arrangements with the Big Tech companies to license their corpuses to them in order to try and put us all out of a job. If we get the right to decide who can train an AI with our work, our bosses are just going to modify our contracts to say, "Great, you now must license that right to me. And it's non-negotiable." Failure to learn from that lesson is not tragedy. It is farce. Rather than ask for a new copyright law, we could make a new labor law, because the only people who've ever beaten AI are the Hollywood screenwriters and actors. And the reason they were able to beat them is because uniquely, among workers in America, they are exempt from the Taft-Hartley Act's prohibition on what's called sectoral bargaining, which is when all the workers in a sector bargain with all the employers in a sector. Now, there are so few workers in America who aren't media workers, who care about copyright, that it rounds to zero, but every single worker in America would benefit from extending sectoral bargaining across the board. Ars Technica: It could be catastrophic, economically speaking, when the AI bubble finally bursts. But you point out that there might very well be something useful left over when that happens. Cory Doctorow: I advise to go long on laser tag arenas because you can definitely turn a data center into one of those. There's not much else you can do with them, unfortunately. A bubble is a way for insiders to pump, and then dump, some mania to the normy investors, to people who've been flushed into the capital markets because they've been denied a defined benefits pension and who are only really offered market-based pensions. That means you have to be the sucker at the table. You have to put your money into the market if you don't want to die homeless and starving after you retire. The dot-com bubble was very bad. It separated a lot of pension funds and ordinary investors from their money, but it left behind something very useful. In the early years of the aughts, there was, amidst the carnage, quite a liberating vibe where all the stupid money went home and you could get servers for pennies on the dollar. Everybody knew how to code. A generation of humanities undergraduates were induced to drop out of university and learn Python, Pearl, and HTML, and a lot of them were really creative. Your rent dropped by two-thirds in San Francisco. I bought six $1,200 Steelcase Leap chairs, still in the plastic wrap, from a failed dot-com guy on a sidewalk on 19th Street in the Mission District for $25-$50 each and used them as a dining room set for the next 10 years. So there was a very productive residue that was left behind by the dot-com bubble. It gave rise to a more robust form of the web, Web 2.0, full of things that were more useful, more interesting, more thought-through, more creative, more innovative than the stuff that the bubble threw off in Web 1.0. There are other examples of bubbles that are less likely to throw off that residue. Around that time, we also had Enron. Enron produced nothing, although I do have a pad of Enron stationery that a friend in Austin bought at the bankruptcy auction and sent to me. "We can distinguish between bubbles with productive residues and unproductive bubbles while still not saying that bubbles are good. Bubbles are bad and destructive." So we can distinguish between bubbles with productive residues and unproductive bubbles while still not saying that bubbles are good. Bubbles are bad and destructive. When the cryptocurrency bubble bursts, all that's going to be left are shitty monkey JPEGs and worse Austrian economics. But when AI bursts, you're going to be able to buy GPUs for pennies on the dollar. You're going to have your pick of applied statisticians, many of whom are very creative and have interesting ideas for things you could build with AI, but are stuck building the things their bosses want to build. There are going to be these open source models that have barely been touched. Any time someone tries to optimize them, they find so many opportunities to make them run on lower-end and commodity hardware. DeepSeek was a spin-out of a Chinese hedge fund; the fund gave them $6 million and said, "Go play with these open source models. See what you can squeeze out of them." When they launched, their model was so good running on commodity hardware that the market did a mass sell off, $600 billion in 24 hours -- the largest 24-hour decapitalization of any firm in the history of markets. If you've got cheap hardware, and you've got applied statisticians, you've got these open source models and you've got a technology that fundamentally is interesting, and has done useful things, and will do useful things in the future -- that's a better setup than one in which we're all running around arguing about whether the word-guessing program is going to wake up, become God, and turn us into paperclips. Ars Technica: You also push back a little on the "AI is coming for your job" messaging. Cory Doctorow: I think we have to distinguish between the AI doing your job, and the AI being incapable of doing your job, but your boss is such a sucker that he fires you and replaces you with the AI anyway. There's infinite evidence for the second one. I think that there's very little evidence for the first one, at least so far. A lot of the stories we've heard, when you interrogate them, just turn out to be nonsense. There's a chapter in the book about how many of the demos for AI have just turned out to be people in India pretending to be robots. The most egregious example was when Amazon announced that cashiers were now out of a job because now you could just walk into [an Amazon Go store], grab stuff off the shelf, and walk out again, and the AI knows what you took. There wasn't an AI. It was three people in India watching each customer through a network of cameras in the ceiling trying to guess what you put in your bag. I think there's lots of things that skilled workers will ask AI to do that will help them do their jobs. There's lots of things that skilled workers will ask AI to do that they'll be wrong about and that won't help them do their jobs. And there's probably space at the margin to replace humans with AI, at least in some cases. But the idea that we're at a "jobspocalypse" is such a self-serving narrative. If you're trying to convince people that the way you're going to turn $1.4 trillion in CapEx into more than $1.4 trillion in revenue is by convincing bosses to fire workers and replace them with chatbots, you have to have a story about how the chatbot can do anyone's job. Here's a wager. If you ever have the opportunity to interview Dario Amodei or Sam Altman, I want you to ask them this. Someday, you will retire. Right now, I want you to make a binding decision. Will the thing that wipes your ass and takes care of you when you are too old and frail to take care of yourself be a person or an AI? We're just going to use whatever it is that's around at that time, and you get to choose. I think we should ask anyone who says they know how to fix things, would they themselves go to an old folk's home run according to the principles they're establishing? Ars Technica: We are now starting to see news stories about how companies that invested in AI are suddenly getting hefty bills. Cory Doctorow: They're getting the bill because the AI companies are trying to get out before they're stuck holding the bag. They want to do IPOs, and to do IPOs, they need to clean up their balance sheet. So they're like, "I bet these [companies] are pretty price insensitive. Let's just jack it. Let's go from a 90 percent subsidy to a 40 percent subsidy and more than double everyone's prices. They'll hang in there." And then you get the CTO of Uber saying, "I'm not sure why we put AI in the business to begin with, and I really don't know why we'd use it if it was $20,000 a seat. So, I don't know that we are going to use AI anymore." This is quite a backfire. It actually shows you how insulated these people are from any sense of how their products are received, from what people think of them, from the actual fundamentals of real businesses that have to bring in more money than they spend. It's weird. I'm hardly a captain of industry or one of the great champions of markets, but I do understand that, by and large, firms should bring in more money than they spend if they are to be an attractive investment prospect. Ars Technica: We hear plenty about the negative aspects of AI. What do you like about it? Cory Doctorow: I have a couple of local models on my computer, which is just a framework laptop running Ubuntu. It doesn't even have a GPU. I use Whisper to transcribe audio. I will sometimes want to cite something I've heard in a podcast and not remember where I heard it. One time, I just threw the last 30 hours of audio I'd listened to at Whisper, and it shot out verbatim logs that were good enough that when I searched the full text, I could find it. And it gave me time codes so I could check the transcript. That's amazing. The idea that I might someday have a computer full of audio and video files with full text indexing is great. I could even imagine conversational interfaces to that: "Where's the photo of my daughter at her birthday party where she's dressed like a pirate?" AI doesn't have to be 100 percent accurate for that to be useful. It doesn't have to be free from false positives. It can just be okay. That stuff's running on your own computer. It's not burning down a rainforest. It's not consuming the last three drops of potable water left in Nevada. There is a certain kind of person who is performatively horrified by AI: "But, but, but that's energy you wouldn't have used." I'm like, "You have never said that about someone who turns cell shading on while playing an MMORPG." Everything you do with your computer burns electricity. I've been using another chatbot where I paste my daily blog post in and say, "Find my typos." It finds a lot of the errors that are normally not caught by a regular spell checker: doubled up words, punctuation marks, or words that are actual words but are misspellings for other words. When you dial up the sensitivity to the point where it actually catches all of those, it also gets a lot of false positives. That's fine for 1,500 to 3,000 words. I never feed it a book. On a 100,000-word manuscript, it's going to give me thousands of false positives and it just won't be useful. I treat this like a plugin to my word processor. It's fine. Sometimes it's good and sometimes it's not. I have a friend, Patrick Ball, who is the best programmer I know, and he founded and works at an NGO called the Human Rights Data Analysis Group (HRDAG). They're one of the most important NGOs that no one's ever heard of. What they do is very rigorous statistical extrapolations of information that's not in the record, about wars, civil wars, coups, oppressive states, and they're used for truth and reconciliation, human rights tribunals, war crimes trials. They've worked on every high-profile war crimes trial in the century. Patrick is using a bunch of Copilots to write software to do a lot of special-purpose stuff. For example, they work with Innocence Project of New Orleans, which has exonerated a bunch of [wrongly convicted] people. They can go through all the arrest reports from the New Orleans PD and find the ones that have linguistic correlates that match successful exonerations. Then they give those to the lawyers who would otherwise just be starting alphabetically or chronologically, sorting to the top the ones that are most like the ones that led to a successful exoneration. It's not like they're asking the chatbot to write a brief for them, but this is a hugely important function, and it is getting innocent people out of prison. You don't want innocent people in prison. That should be the least controversial thing in the world. That's just good, and the proof is in the pudding.
[2]
'You can't make billions without hurting people': Cory Doctorow on Elon Musk, the AI bubble and bosses' cruel fantasies
The writer who coined the word 'enshittification' tells us why AI will never deliver what it promises - and why it still appeals so much to those in power A "centaur", in automation theory, is a person assisted by a machine, and a "reverse centaur", hero of Cory Doctorow's new book, The Reverse Centaur's Guide to Life After AI, is a "human who is conscripted into acting as an assistant to a machine". Every warehouse worker who ever had to urinate in a water bottle because they couldn't otherwise meet the fulfilment targets set by an algorithm is a reverse centaur. Reaching into the future, everyone who has to sit in a self-driving truck to make sure it doesn't crash, presumably on minimum rather than truck-driver wages, is a reverse centaur; as is every lawyer no longer on lawyer's money checking Gemini's command of precedent, every indie band scraping a living doing covers of AI-generated hits, and so on. That, anyway, is the promise: AI is coming for your job, and it is coming for your kids' jobs, and there is no point fighting it because the future's already here. Wiping out the world of work, and with it our ability to sustain ourselves and live autonomous lives, is only the beginning, if you listen to AI's architects. Elon Musk has called it the single greatest threat to human civilisation, Sam Altman has said it will "most likely lead to the end of the world" and Dario Amodei, CEO of Anthropic, memorably forecast that AI would come to see us the way we see animals: cute to have around but ultimately a resource to be exploited. "AI people claim they're about to create God, by teaching words to a word-guessing programme," Doctorow says. "It's grandiose." Doctorow bursts into our video-call conversation as if we're already two hours in, his delivery puckish and urgent. He's not happy with his new AI camera, which "supposedly tracks your face, and then doesn't, and just points in arbitrary directions. I mean, this is where my camera thinks my face is," he says, and indeed, it is nowhere near his face. "Thanks, camera. Glad I'm wearing trousers." AI cannot and will never render us obsolete, Doctorow says. "It's a conjuring trick. That's probably the most important thing to get across." A machine has been invented that is really good at building sentences by predicting what word would usually come next, and we invest it with meaning, insight, omnipotence. But we're "imputing intentionality to this thing that intends nothing. It's not because, objectively, it seems intentional, but because, in a state of nature, we don't encounter sentences that don't have sentence writers, we don't encounter images that don't have painters, and so on." We marvel when it does things right, and conveniently ignore what it gets wrong, or indulge its "hallucinations", which is just a fancy word for "errors". "Where I think the word 'hallucination' is useful," he says, "is not to describe what the AI is doing, but what we do when we encounter a word salad, and we impute a writer to the word salad." If you think AI can become conscious, he suggests, it's because you've forgotten what consciousness is. But that doesn't mean there's no threat. This technology can absolutely wreak global havoc; it'll just be of a very old-fashioned kind. A vast amount of investment has gone into AI. "When I wrote this book [last year], it was a $700bn bubble. It's a $1.4tn bubble now. The only thing worse than a $1.4tn bubble is a $2.4tn bubble, which we're headed for," he says. Nine tech companies in the US account for 35% of its entire stock market valuation, which was illustrated rather sharply when the war in Iran had a greater impact on European and Asian stock markets than America's - they were "insulated" by the dominance of the tech sector, people said at the time. But insulated might not be the right word. Doctorow describes "two poles in finance law. One is Stein's Law: anything that can't go on for ever eventually stops. And the other is Keynes: the market can remain irrational longer than you can remain solvent. So it's hard to predict when bubbles are gonna pop. But it's easy to predict that bubbles will pop." Doctorow, 54, is in Los Angeles; he divides his time between there and London (his British wife, Alice Taylor, runs the BBC's AI Creative Lab, which isn't ironic but it would slow us down to explain why not). He came to mass attention as a tech writer with his book Enshittification: Why Everything Suddenly Got Worse and What to Do About It; it's hard to believe it was only published last year, and impossible to remember what we did without that word. People now use "enshittification" for everything, from the degradation of public services post-austerity to climate-crisis-related chaos events, when in fact Doctorow's proposition had quite a specific use regarding tech: giant platforms lock you in and then make your experience worse on purpose. "I'm not frustrated by that at all. I think it's glorious. My first two languages are English and Yiddish, languages that don't have language academies, where dictionaries are descriptive, not proscriptive, where words change meaning." He's Canadian, his early life dotted with signs of an independent spirit and tech-curious mind: he dropped out of high school and graduated from Seed, an "alternative" school in Toronto; he spent time in the 00s setting up OpenCola, a free peer-to-peer software company, then editing Boing Boing, which was vastly popular for a time as an online muster point for discussing tech, futurism and the left. He has an honorary doctorate in computer science from the Open University, has held numerous academic residencies and is professor-at-large at Cornell University. Alongside his nonfiction, he's an extremely prolific sci-fi writer, three-time winner of the Prometheus award (for young adult novels Little Brother, Pirate Cinema and Homeland). He writes graphic novels, authored a children's picture book named after his daughter, Poesy, who is now 18, and publishes a newsletter almost daily. I wonder whether he's dismissive of AI's takeover because he finds writing, creating and communicating so effortless that maybe he doesn't realise that for many people it's like pulling teeth, and they wish a machine would do it. Absolutely not, he says - but more important than all the things AI can't do, and will never be able to do, from call centre operations to radiology, is to understand the motivation behind all the feverish claims for it. Why, he wonders, are capital allocators allocating so much capital to this? It's because of a promise as old as the loom: that bosses will be able to replace their workers with machines. This isn't just about money - often, when the machine is ultimately not as good as a human, or needs so much supervision from a human that it becomes more expensive, there's still tremendous appetite for automation. "The one thing a boss does not want is co-determination. Bosses are haunted by the knowledge that even though they fancy that they're driving the car, if they don't show up, everything continues to work. Whereas if the workers don't show up, everything shuts down. And so perhaps they're in the back seat with a toy steering wheel. AI is the promise of wiring that toy steering wheel directly into the drivetrain of the car. It's products without product designers. Workplaces without workers, screenplays without screenwriters, movies without actors, hospitals without doctors and nurses. This is the promise." Once that promise is made, of course, it feeds an insecurity in the workforce, because if we all really were obsolete, that would be pretty consequential, and we can already see harbingers in our youth unemployment figures and our self-service checkouts. But then we become our own (second) worst enemy, because of what Doctorow, quoting Lee Vinsel from Virginia Tech, calls "criti-hype" - critique that both feeds off and feeds into the hype, and makes the doomsday scenarios more plausible. This may never have been more pronounced - government ministers have spoken openly about all the time and money they'll save once routine tasks are automated. "Do you not remember when they said cryptocurrency would replace all of the world's financial systems? They told us that the metaverse would be the default, that we wouldn't have tourism or sex any more," Doctorow says, with vaudeville outrage. "We have such poor object permanence!" (This is fancy, child-development vocabulary for "really bad memories".) Another powerful AI critic, the journalist Karen Hao, has argued that when apocalyptic claims are made for AI, there's often a veiled threat behind it: "Let us experiment as we wish, have our datacentres, because otherwise Chinese companies will get there first." Doctorow agrees. "You don't want a Confucian God. You want an Old Testament God. Different smiting." Essentially, though, he thinks the big talk has a simpler motivation: anything to keep the investment flowing. Whenever an exercise in automation fails and is abandoned - you may remember Amazon's staff-less grocery stores, which actually required three people to be constantly watching each shopper on CCTV and guessing what they were putting in their baskets - it never dents the AI cheerleaders' confidence that they're speeding towards a post-worker world; nor, so far, the enthusiasm of investors. It's got to the point where it's more important to keep the narrative afloat than to consider whether it's realistic. "You don't have to believe that a face cream is gonna make women look younger to believe that there will be women who will buy a face cream marketed to make them look younger. It doesn't have to work. Are investors investing in the face cream because they think the face cream works? What I'm saying is maybe they're investing in the face cream because they're familiar with patriarchy." The problem is, people can see AI all around them, working better today than it did yesterday - turning out more convincing AI slop, answering their personal problems, turning fully clothed women into naked ones, analysing 18th-century poetry. It feels as if it can do anything, but none of that is the material basis for the investment. "I think it's very important to be critical of things like Elon Musk's Grok AI that allow users to turn out child porn [in January, Musk's Grok AI was found to be capable of generating non-consensual sexualised images of people, including children, and xAI was rolling out 'technological measures' to restrict Grok's ability to undress people in photos]. But we can't pretend that there's anyone who invested in his AI company, who looked at the prospectus and said, 'I see you have a line item here for the expected revenues for child porn - that's great, that's why I'm here.'" In other words, go ahead and ban child porn - "we should do that anyway" - but no one's going to take their money out. "If we want to actually target the harm that Musk is doing, we have to make his investors think he can't make money." Fundamentally, this is a Marxist analysis, I suggest: that labour and capital are elementally at odds, and the latter will exploit the former even if all value is lost in the process. "I don't necessarily disagree, but that's not the argument I'm making. The argument I'm making is that bosses resent and work relentlessly to end co-determination as a class." But that's the same, I insist, and he shrugs, as if to say: we can bicker about Marx after we've stopped this runaway train. What Marx didn't have to contend with is the trillionaire, even in old money. "There is something about being very rich and insulated from the consequences of your actions that makes you solipsistic. You cannot make billions of dollars without hurting lots of people. And you can't hurt lots of people without, in some sense, believing that they're not really people." He raises Musk's publicly acknowledged ketamine use. "I have a chronic pain condition, and I've had ketamine administered, and one of the things about ketamine is that it feels like the whole world is a thing you imagined. Like you're the only real person in the world. I don't think it's a coincidence that Elon Musk calls the people who disagree with him NPCs, non-player characters, because he doesn't think they're really real." The larger problem than Musk's personality, or even your average billionaire's, though, is that bubble: "The more of the stock market there is wound up in it, the more economic harm there will be in the blast radius of AI, which is not to the capital allocators who've given them $1.4tn to play with - it's everyone else. We have a quarter of a century's experience now with popped bubbles, and we use them as an excuse to do the austerity that our politicians dream of doing anyway."
Share
Copy Link
Tech journalist Cory Doctorow's new book The Reverse Centaur's Guide to Life After AI tackles the growing economic threat posed by AI industry hype. He warns that the AI bubble has grown from $700bn to $1.4tn, with nine tech companies now accounting for 35% of US stock market valuation. Doctorow argues AI is a conjuring trick rather than genuine intelligence, yet its collapse could trigger widespread economic damage.
Tech journalist and science fiction author Cory Doctorow has released a provocative new book, The Reverse Centaur's Guide to Life After AI, that challenges the prevailing narratives around artificial intelligence. Following his bestselling work on enshittification, Doctorow turns his critical lens toward what he describes as unchecked technological hype that threatens both workers and the broader economy
1
.
Source: Ars Technica
The book introduces the concept of the reverse centaur—a worker who serves as "a human who is conscripted into acting as an assistant to a machine" rather than being augmented by technology
2
. While traditional centaurs in automation theory describe humans enhanced by tools, reverse centaurs are reduced to "squishy meat appendages for uncaring machines." Amazon delivery drivers surrounded by AI cameras monitoring their every move exemplify this dynamic, essentially serving as peripherals to their delivery vans1
.Doctorow warns that the AI bubble has expanded dramatically, growing from $700bn when he wrote the book to $1.4tn currently. Nine tech companies in the US now account for 35% of the entire stock market valuation, creating dangerous concentration
2
. "The only thing worse than a $1.4tn bubble is a $2.4tn bubble, which we're headed for," he cautions. Seven AI companies currently account for more than a third of the stock market, endlessly passing around "the same $100 billion IOU"1
.The economic unsustainability of AI stems from the industry's preference for expensive foundational models that lose billions annually rather than cheap, useful applications. "The bubble doesn't want cheap useful things," Doctorow explains. "It wants expensive 'disruptive' things: big foundational models that lose billions of dollars every year"
1
. When investment mania halts, most models will disappear because running the data centers won't be economical.Doctorow dismisses AI's existential risks as grandiose fantasy, calling it a conjuring trick rather than genuine intelligence. "AI people claim they're about to create God, by teaching words to a word-guessing programme," he notes
2
. The technology excels at predicting which word comes next in a sentence, but humans impute intentionality to something that intends nothing. We marvel when it succeeds and ignore its "hallucinations"—a fancy term for errors.Despite not being virulently anti-AI and using AI tools regularly himself, Doctorow sees the societal impact of AI unfolding through labor precarity and AI displacement rather than machine consciousness. Warehouse workers forced to urinate in bottles to meet algorithmic targets, future truck drivers earning minimum wage to supervise self-driving vehicles, and lawyers checking AI output for fraction of their former salaries all represent AI augmentation gone wrong
2
.Related Stories
The rush toward AI reflects deeper problems with corporate power and financial irrationality. Doctorow connects this to his enshittification thesis: firms with saturated markets face pressure to maintain growth stock status, which trades at much higher multiples than mature stocks. Growth stocks allow companies to acquire others by "typing zeros into a spreadsheet" rather than using actual money
1
.This creates monopolistic outcomes where companies promote stories about conquering imaginary markets with no agreed-upon valuation. Doctorow invokes two principles: Stein's Law—anything that can't go on forever eventually stops—and Keynes's observation that markets can remain irrational longer than individuals can remain solvent. While timing the bubble's collapse proves difficult, its inevitability seems certain
2
.Doctorow distinguishes between AI as a tool of control versus genuine human augmentation. Using AI tools to help radiologists spot tumors they might miss represents positive application. Firing nine out of ten radiologists and forcing the remaining one to check AI diagnoses—while taking blame for errors—exemplifies the reverse centaur problem
1
.The collapse will prove ugly, Doctorow predicts. "AI is the asbestos in the walls of our technological society, stuffed with wild abandon by a finance sector and tech monopolists run amok. We will be excavating it for a generation or more"
1
. His book attempts to push back against narratives of AI's inevitability and sort "the bullshit from the material reality" surrounding these technologies.🟡 Atkinson's book tries to push back against narratives of AI's inevitability and sort "the bullshit from the material reality" surrounding these technologies.🟡 Atkinson's book attempts to push back against narratives of AI's inevitability and sort "the bullshit from the material reality" surrounding these technologies.Summarized by
Navi
[1]
27 Jan 2025•Policy and Regulation

13 Jun 2025•Technology

03 Jun 2025•Technology
