Companies keep rolling out AI features that boil down various kinds of text. They're making us dumber.
One phrase encapsulates the methodology of nonfiction master Robert Caro: Turn Every Page. The phrase is so associated with Caro that it's the name of the recent documentary about him and of an exhibit of his archives at the New York Historical Society. To Caro it is imperative to put eyes on every line of every document relating to his subject, no matter how mind-numbing or inconvenient. He has learned that something that seems trivial can unlock a whole new understanding of an event, provide a path to an unknown source, or unravel a mystery of who was responsible for a crisis or an accomplishment. Over his career he has pored over literally millions of pages of documents: reports, transcripts, articles, legal briefs, letters (45 million in the LBJ Presidential Library alone!). Some seemed deadly dull, repetitive, or irrelevant. No matter -- he'd plow through, paying full attention. Caro's relentless page-turning has made his work iconic.
In the age of AI, however, there's a new motto: There's no need to turn pages at all! Not even the transcripts of your interviews. Oh, and you don't have to pay attention at meetings, or even attend them. Nor do you need to read your mail or your colleagues' memos. Just feed the raw material into a large language model and in an instant you'll have a summary to scan. With OpenAI's ChatGPT, Google's Gemini, and Anthropic's Claude as our wingmen, summary reading is what now qualifies as preparedness.
LLMs love to summarize, or at least that's what their creators set them about doing. Google now "auto-summarizes" your documents so you can "quickly parse the information that matters and prioritize where to focus." AI will even summarize unread conversations in Google Chat! With Microsoft Copilot, if you so much as hover your cursor over an Excel spreadsheet, PDF, Word doc, or PowerPoint presentation, you'll get it boiled down. That's right -- even the condensed bullet points of a slide deck can be cut down to the ... more essential stuff? Meta also now summarizes the comments on popular posts. Zoom summarizes meetings and churns out a cheat sheet in real time. Transcription services like Otter now put summaries front and center, and the transcription itself in another tab.
Why the orgy of summarizing? At a time when we're only beginning to figure out how to get value from LLMs, summaries are one of the most straightforward and immediately useful features available. Of course, they can contain errors or miss important points. Noted. The more serious risk is that relying too much on summaries will make us dumber.
Summaries, after all, are sketchy maps and not the territory itself. I'm reminded of the Woody Allen joke where he zipped through War and Peace in 20 minutes and concluded, "It's about Russia." I'm not saying that AI summaries are that vague. In fact, the reason they're dangerous is that they're good enough. They allow you to fake it, to proceed with some understanding of the subject. Just not a deep one.
As an example, let's take AI-generated summaries of voice recordings, like what Otter does. As a journalist, I know that you lose something when you don't do your own transcriptions. It's incredibly time-consuming. But in the process you really know what your subject is saying, and not saying. You almost always find something you missed. A very close reading of a transcript might allow you to recover some of that. Having everything summarized, though, tempts you to look at only the passages of immediate interest -- at the expense of unearthing treasures buried in the text.
