The Rise of AI-Powered Laptops: Revolutionizing Personal Computing

What's the future of AI laptops?

How NPU-powered AI laptops will accelerate computing power for creatives, gamers and general users. By now, you've probably heard of AI laptops. Chances are that your first impression may have been to assume that the term was a bit of marketing gimmick. But, as we've seen in our piece on what is an AI laptop? and our comparison of the best AI laptops on the market, NPU-powered laptops have some real potential advantages for many users, including creatives. With most of the major laptop brands now focusing heavily on AI laptops, we're going to be hearing the phrase more and more, and AI laptops are likely to become the norm. But how will the technology advance? In this article, we explore the hardware's current potential and what the future of AI laptops may look like. This article is part of our Next Gen Creative Tech week. To recap for those still wondering what makes an AI laptop different from a non-AI one, the key is the NPU, or neural processing unit. Standard laptops have a central processing unit, or CPU. This is the main processor: the circuitry that carries out instructions for things like arithmetic, logic and input/output operations. Laptops also have a graphics processing unit or GPU, specialised electronic circuitry for digital image processing and accelerating computer graphics. This is a separate component in more powerful laptops or integrated in the CPU on more economic devices. An NPU is a newer class of specialised hardware designed to accelerate artificial intelligence and machine learning applications, including artificial neural networks. On consumer-focused AI laptops, it's usually integrated in the CPU, as in the cases of the AMD's Ryzen 9 8040 CPUs and Qualcomm's Snapdragon X Elite processors. AI laptops allow generative AI models to be run more efficiently locally on the device. For example, you could run the AI image generator Stable Diffusion on your laptop rather than in the cloud. But while NPUs are most associated with AI-driven tasks, they are optimised for data-heavy parallel computing and can more generally process masses of multimedia data like video, images and data for neural networks. For the moment, software manufacturers have a bit of catching up to do, and there aren't so many programs taking advantage yet. But laptop manufacturers are convinced that AI laptops will become the norm and will provide benefits to general users for everything from interacting with AI chatbots like Microsoft's Copilot to speeding up specific tools in creative software. For more specialist use cases, AI laptops can also be used for research through knowledge mining huge reference sets of data. With major chip makers like Intel, AMD and Qualcomm putting NPUs on their latest processors, the use of AI laptops is almost certain to accelerate. And like CPUs and GPUs, NPUs are likely to get more powerful with each new iteration, which will mean more efficient, streamlined AI processing. AI laptops will be able to perform AI tasks faster, resulting in quicker data processing times and more convenience. The idea is they will also be able to learn and adapt to users' needs, using machine learning algorithms to enhance user experience, optimise performance based on use and personalise interactions. For the moment, the majority of general users might not find themselves reaching for the Copilot button on an AI laptop very often. But in the longer term, the ability to interact with an AI chatbot from startup is likely to bring benefits for productivity, which will probably become ubiquitous. We will be able to interact by voice to ask our laptop to summarise documents for us, schedule our meetings or recommend a recipe to cook or a movie to watch based on our personal tastes. AI-powered tools will be able to automatically apply noise cancellation when we enter a video call, make it look like we're making eye contact and translate both text and audio automatically. And because this would be on device rather than online, it would potentially be more convenient and more secure than using browser to use the likes of ChatGPT or Midjourney. Another security benefit will be AI facial recognition to prevent non-authorised use of a laptop. And since NPUs lessen the load on CPUs and GPUs, AI laptops should also lead to faster computing in general. For an idea of what AI laptops might look like, consider the Lenovo Auto Twist AI PC. Only a concept for now, it blurs the line between laptop and robot. It responds to voice commands and, using its dual rotation automatic hinge, can open the lid, enter tablet mode and close itself, without the user having to touch it. Our ecommerce writer took part in a demo at IFA Berlin (see the video above) and found it to be a surreal experience. But opening and closing the lid on command is the least of what AI PCs will be able to do. Essentially, whatever task you perform on your laptop, it's likely that NPUs will eventually play a role in how it's processed. There are already some examples of specific tools in creative software that make use of NPUs. DaVinci Resolve, one of the best video editing software programs, can use NPU-acceleration to speed up Magic Mask, while the music mixing software djay Pro uses it for NeuralMix. Adobe has plans to optimise future versions of Premiere Pro for NPUs, and, given Adobe's commitment to AI, it's likely that it will find uses for the technology to enhance the speed of certain tasks in other Creative Cloud apps too. This could mean faster video editing and AI filters. AI laptops should also make it easier for creatives to organise, categorise and search through their assets by automatically tagging content according to things like subject, theme and location simplify file management and make it easier to find the photos you want from your last shoot or a design iteration that a client's asked to see again. Asus has already launched its StoryCube application, which does some of this now. AI laptops could also become a personal assistant for brainstorming, allowing us to toss ideas back and forth with our device without having to open ChatGPT in our browser. Creatives may also start to use AI laptops as to bounce ideas of. Sticking with Asus, it's launched MuseTree, a king of sandbox for ideas with on-device AI image generation built in. AI laptops are also entering the gaming sphere. MSI's AI Engine can automatically detect different user scenarios to activate suitable performance settings, sound effects and display modes, for example, switching to Extreme Performance Mode. Updates are likely to reduce the amount of changes that a user has to make automatically. AI laptops could also allow voice interaction in-game, allowing the player to consult their laptop during scenarios in the title they're playing. Another benefit we're likely to see in the future of AI laptops is a major change in support. Dell has been exploring self-healing automation, using AI to diagnose and resolve issues without requiring human intervention. Using telemetry to find issues in both hardware and software layers, AI could remotely fix problems and reduce downtime in both business and consumer devices. Considering that the likes of Asus, Dell, HP and MSI are planning to include NPUs across their flagship devices, it's safe to stay that AI laptops are here to stay. The tech market analyst Canalys expects 48 million AI-capable PCs to ship worldwide this year. That would be about 18% of all PC shipments. According to Statista, the proportion is expected to rise to 40% in 2025 and 60% by 2027. If the term 'AI laptop' disappears into the past as a mere marketing buzzword, it will simply be because every laptop has become an AI laptop, and the AI has started to become more seamless and invisible

What Is an AI PC?

Let's not start this trip on overinflated tires: Neither PCMag as a whole, nor this writer, will tell you that AI is a glorious godsend that will radically improve your life right now. Instead, it's a technology shimmering with potential, and a decade from now, it will likely be baked into everything we do, in unrecognizable forms and ways we haven't yet imagined. For now, though, it's better at helping you do things than at outright doing things for you. Still, we can hardly blame you for being interested in AI. Massive hype and news coverage have made it the top trending pair of initials, with a particular focus on a new breed of computer called an "AI PC" -- Intel has certainly hyped that term alongside its first-generation "Meteor Lake" processors equipped with neural engines. And the AI PC has gotten further exposure in what Microsoft calls the "Copilot+ PC," its own spin on the concept. Chromebooks and Macs are getting in on the AI action, too. (We'll look at them in a minute.) Let's take a snapshot of the state of laptop and desktop artificial intelligence as of today. What's a Copilot+ PC? New Hardware for a New Ad Campaign AI is the buzzword of the year because operating system colossus Microsoft has twisted laptop makers' arms to add a trigger button for its Copilot AI assistant to their keyboards, and convinced most of the key laptop vendors to introduce what it dubs Copilot+ PCs. These are systems with neural processing units (NPUs) strong enough to handle artificial intelligence tasks like real-time translation and image generation locally, instead of outsourcing them to cloud servers. Until recently, the very latest Intel and AMD processors had modest NPUs built in that were not capable of the 40 trillion operations per second (TOPS, another hot new acronym) the Copilot+ PC spec requires. So while we wait for Intel's next laptop chip release, the Core Ultra 2 series or "Lunar Lake," the first wave of Copilot+ laptops swap the long-dominant x86 architecture for Arm processors. Specifically, they use chips from Qualcomm's Snapdragon X Elite and X Plus lines, which incorporate an NPU named "Hexagon." The Hexagon NPU delivers 45 TOPS of power, compared to roughly 12 and 16 TOPS for those of Intel's "Meteor Lake" Core Ultra and AMD's Ryzen 8000 series (its first NPU-equipped family), respectively. AMD's new Ryzen AI 300 series chips, just out this summer and dubbed "Strix Point," feature an NPU capable of 50 TOPS, edging the 48 TOPS of Intel's coming "Lunar Lake" silicon. Microsoft has noted that it will make Copilot+ features available for users of these latest-gen NPU-enabled AMD and Intel processors in November. (They'll arrive via Windows Update.) For the record, all these neural processing units are 98-pound weaklings compared to the Nvidia silicon that's mostly powering the AI craze. Nvidia's data-center AI chips like the H100 and H200 power generative AI and have made Nvidia an absolute mint. And on the desktop, the flagship GeForce RTX 4090 graphics card is capable of 1,300 TOPS. The initial launch of Copilot+ PCs on Qualcomm chips is significant because the history of Windows on Arm is checkered, with historically slower performance than Windows on x86. (Indeed, it couldn't have gotten off to a worse start than it did in 2012, with a Microsoft Surface tablet that no one bought, running a Windows variant called Windows RT that had no software.) But newly optimized versions of the OS, the über-dominant Microsoft 365 office suite, and popular programs from Adobe and other software vendors have closed the gap. Non-optimized x86 apps run on the new PCs via an emulation layer called Prism, which actually works pretty well, though your mileage -- or rather, your specific or specialized application -- may vary. So, What Can a Copilot+ PC Do? Microsoft's May 20, 2024, launch touted Copilot+ PCs as "the fastest, most intelligent Windows PCs ever," with all-day battery life -- well, up to 15 hours of web browsing or 22 hours of video playback on a charge -- and built-in encryption for enhanced security. It also singled out several new tricks for the old dog that is Windows. One, Studio Effects for the Windows Camera app, predates the Copilot+ launch. It boosts your laptop's webcam with new videoconferencing effects processed on an NPU, including automatic framing; portrait lighting to even out overly bright or dark room environments; a bit of CGI rendering to give the illusion of maintaining eye contact even when you don't; and a quasi-green-screen option to blur your background or replace it with an image of your choice. Live Captions is a feature that detects foreign-language audio in a video call or app and provides instantaneous, automatic English captions visible by all participants in a conference call. It works with both live and prerecorded sound and can translate from 44 different languages. Other tools enhance Windows' Photos and Paint apps with the ability to generate or apply effects to images on your PC, without waiting for other traffic on Microsoft Designer's Dall-E 3 servers (though it does require Internet access and a Microsoft account). Cocreator and Image Creator let you produce images from text prompts or requests. Restyle Image lets you change what you've generated. ("Let me see it as an oil painting" or "Make it steampunk.") One of Microsoft's proudest announcements on May 20, Recall, takes a snapshot of your screen every few seconds, saving the shots to your laptop's solid-state drive as an encrypted timeline that you can scroll through or search to make it easier to get back to content you were viewing, or a document you were working in. However, users and reporters instantly reacted not as if Recall was the Lady of the Lake handing them Excalibur, but a boss installing a keystroke logger to snoop on employees ogling porn or applying for another job while at work. Microsoft backtracked on Recall so fast it left skid marks, first making Recall opt-in instead of inescapable, then postponing the introduction of the feature altogether. (The latest: It should appear as a beta release to Windows Insiders in October.) Meanwhile, Google and Apple... Eight days after Microsoft's Copilot+ PC kickoff, Google announced new AI features for its Chromebook Plus platform. Help Me Write brings suggestions and shortcuts like Rephrase, Elaborate, Formalize, and Shorten to word processing, web apps, or PDF forms. Generative AI lets you dream up your own Chromebook wallpapers and videoconferencing backgrounds. The Google Photos app gains a Magic Editor button for repositioning or resizing objects in images or tweaking the lighting and background. The Chromebook Plus home screen now includes Google's AI assistant Gemini. New Chromebook Plus buyers get 12 free months of the Google One AI Premium plan, which combines 2TB of cloud storage with Gemini help in Docs, Sheets, Slides, and Gmail, as well as access to Gemini Advanced. As for recent MacBooks, iMacs, iPads, and iPhones, there's Apple Intelligence, which the company calls "AI for the rest of us." Coming in beta-test form this fall, it will "draw on your personal context while setting a new standard for privacy in AI." Apple Intelligence supercharges the Siri assistant with richer language understanding, the ability to type as well as speak queries, and awareness of what's on screen -- for instance, Apple says, handling "Add this address to her contact card" when Mary sends you an updated address. (Siri will also appear as a snazzy glowing light around the edges of the iPhone display.) Apple promises that new Writing Tools will proofread your text, polish different versions of it (e.g., more businesslike or casual), and summarize and draft responses to emails. Both Siri and Writing Tools will incorporate OpenAI's ChatGPT, with no subscription needed for access (but paid features available). There'll be image-creation tools and custom Genmoji; Image Wand to turn a rough sketch into a pretty picture in the Notes app; and an Image Playground app to let you try out illustration and animation. Don't Fall for Hype, But Don't Turn Down Help The AI landscape is young and unformed, or at most just beginning its Wild West phase. While assistive AI -- making summaries of lengthy documents or emails, or helping turn a Word document into a PowerPoint deck -- is showing real potential, generative AI is proving to be part sizzle, part steak, and all sorts of enmeshed in ethical and accuracy concerns. Unfortunately, most media coverage of AI has been closer to breathless hype than the bubble-bursting of critics like Ed Zitron, who recently wrote "Generative AI was always unsustainable, always dependent on reams of training data that necessitated stealing from millions of people ... These men have burned hundreds of billions of dollars on a machine that boils lakes to make the most mediocre version of the past...the loudest people in tech trying to convince people that a Large Language Model that can generate text and images that kind of suck is tantamount to the launch of the iPhone." Our own view, you won't be surprised to learn, is somewhere in between. PCMag will do its utmost to bring you both the good and bad of artificial intelligence and hands-on reviews of every AI PC. Right now, rolling into the fall of 2024, you're not missing much if you're not yet on the bandwagon, but you're doing yourself a disservice if you don't keep an eye on the field.