34 Sources
34 Sources
[1]
As Windows 10 Support Ends, Microsoft Is 'Rewriting' Windows 11 Around AI
Microsoft saved its most powerful AI tools for paying customers in the first phase of its AI evolution. Now, the company has announced a series of Copilot features coming to all Windows 11 PCs, including Voice, Copilot Vision, and Copilot Actions. Alongside the update, Microsoft is launching an ad campaign to expose people to these new features. The timing isn't an accident. Windows 10 support ended on October 14, and we're about to see a wave of people upgrade to Windows 11; Microsoft seems intent on putting advanced Copilot features at the fingertips of as many people as possible -- and convincing them they're worth using. "Hey, Copilot." That's the wake word for the AI assistant in voice mode, now coming to all Windows 11 computers. Whether you like it or not, Microsoft wants you to start talking to your computer. The company is introducing new Copilot features across all Windows 11 devices, featuring direct voice interaction with Copilot in apps and throughout the operating system. This capability has been available on smartphones for many years with varying degrees of success, as well as Microsoft's own Copilot+ line of laptops. "It's been almost four decades since the PC changed the way you interact with it, which is primarily mouse and keyboard," says Yusuf Mehdi, consumer chief marketing officer at Microsoft. "But what if you can go beyond that and talk to it? In our minds, voice would become the third input mechanism to use with your PC." The push to speak directly to your PC has some data behind it. Mehdi cited Microsoft's own observations of how people interact with its PCs via voice, such as through dictation, note-taking, voice typing, and transcriptions. Mehdi also says people use the Copilot app twice as much when using voice instead of typing, due to ease of use. "People talk through their computer, they don't talk to their computer or with their computer," he says. "But we think that's what's actually going to change a lot."
[2]
Microsoft's Push Into Agentic AI Begins With 'Hey Copilot' Voice Assistant in Windows 11
Microsoft says Copilot will be an always-listening AI tool in Windows 11 for those who give it permission to function. Microsoft announced Thursday that it's integrating agentic artificial intelligence into Windows 11, making its Copilot AI software more accessible as a voice or text assistant. In a blog post and video, the tech giant detailed the ways people can use Copilot with the voice command "Hey Copilot," not unlike similar services from Apple (Siri), Amazon (Alexa) and Google. Don't miss any of our unbiased tech content and lab-based reviews. Add CNET as a preferred Google source. The always-on version of Copilot is not enabled by default. You must enable it in the Copilot app's settings. "You'll see the Copilot microphone appear on your screen, along with a chime to indicate that Copilot is listening," the blog said. To end a Copilot conversation, you can say "Goodbye" or hit the X. You can also wait for Copilot to end after a few moments without an interaction. Microsoft began rolling out the "Hey Copilot" feature to members of the Windows Insider program in May. The company is making big bets on agentic AI, a newer generation of artificial intelligence from generative AI that is more focused on independent action and decision-making. Microsoft sees AI agents as the next wave of AI technology. The voice version of Copilot should be able to answer questions and perform tasks in the same way as a text prompt for Copilot can -- which works similarly to the natural-language prompts in ChatGPT. But Microsoft says the updates it's putting out for Windows 11 can do more. "We believe this shift to conversational input will be as transformative as the mouse and keyboard in terms of unlocking new capabilities on the PC for the broadest set of people," the company said in the blog post. Microsoft says that Copilot should be able to perform Windows tasks you request in natural language, and that a sister feature, Copilot Vision, can analyze what's on your screen and make recommendations, answer questions and coach you out loud on how to improve a project. That help can extend to Office apps, including PowerPoint and Word. The company recently introduced a Premium version of its Microsoft 365 software, rolling out more AI features at $20 monthly. In the blog post, Microsoft previewed some features that it will first share with Windows Insider members, like a redesigned Copilot-driven Windows taskbar and Copilot Actions, which will allow web activity such as booking a table at a restaurant or ordering groceries.
[3]
Ready to talk to your PC? Here are all the upgrades coming to Copilot in Windows 11
Stronger security with a cautious design and built-in guardrails. Microsoft just announced a handful of significant updates to its Copilot AI in Windows 11, making an evolutionary jump from text prompts to multi-modal AI you can speak to, show what's on your screen, and command to take actions on your behalf. "We've seen the first evolution of AI in the form of chatbots," Yusuf Mehdi, Microsoft's EVP, said in a recent press briefing. "We're on the cusp of the next evolution, not just in the chatbot, but integrated AI." Also: This new Copilot trick will save you tons of time in Windows 11 - here's how Microsoft wants to employ this integrated AI across Windows so you can speak to it naturally in Copilot Voice, allow it to "see" what you're doing with Copilot Vision, and take actions on your PC, from anything as simple as opening an app to as complex as booking a plane ticket with Copilot Actions. Yes, these features are rife with security concerns, but Microsoft is taking a different approach after its controversial Recall feature generated enough pushback to send it back to the drawing board. Essentially, Copilot will need explicit permission to do anything, its boundaries are clearly defined (as opposed to an "always on" AI), and the user can take control or revoke access at any time. The new features are reserved for members of the Windows Insider program for now, but will eventually roll out to all PCs on Windows 11 -- regardless of whether or not it's considered a "Copilot+ PC." Let's take a look at what's coming in the upgrade. The biggest feature rolling out in Windows 11 is Copilot Actions, an AI agent that doesn't just respond to your questions, but actually takes action on your behalf, including opening and closing apps, typing, scrolling, and performing complex chains of actions. Microsoft's goal here is to transform AI agents beyond the passive "question and answer" chatbot into digital collaborators that can carry out tasks for you on the PC: updating documents, writing and sending emails, or even booking airline tickets in the browser. Microsoft is taking a more conservative approach to the way agents work in Windows 11, relegating the feature to a separate account, on a separate desktop called the "Agent Workspace," with strict permissions to what it can access. Also: You can test Microsoft's new in-house AI image generator model now - here's how It starts with limited permissions and will prompt the user for any changes it wants to make to the device. Additionally, access can be turned off at any time. The intention is to provide a clearly defined boundary as to what the agent has access to, along with what it's doing at any given time. Once you grant the agent access, it will be able to see your local files, apps, and data to gain insight into what's on your PC, allowing the user to use natural language to make requests in existing apps, documents, or files with no context, and have the agent automatically understand what you're referring to. Also: I unleashed Copilot on my Microsoft and Google accounts - here's what happened It's a big jump forward in Copilot's breadth of abilities, and it doesn't come without significant security concerns. The last time Microsoft tried launching a feature with sweeping access to user data, it didn't go well. Microsoft Recall went back in development and was relaunched with changes to its functionality. Microsoft really wants you to talk to your computer, and Copilot's voice support is geared to make your Windows 11 PC the "computer you talk to." Microsoft says its goal here is to open up new ways of interacting with your PC outside of the keyboard and mouse -- an interesting concept -- but, in practice, it reveals a handful of obvious concerns. Also: Copilot Chat arrives free for Microsoft 365 users - check if you have it Copilot Voice is designed to bridge the gap between AI "prompting" -- a skill all its own -- and being actually useful for tasks relevant to the average user. This includes locating keywords in documents, tracking down an email, and finding the random folder where you downloaded that file, etc., all while leveraging natural language, not search keywords. There is something to be said about decoupling prompting skill from effectiveness, as up until now, these two things were inherently connected. But it ultimately depends on how well it actually works at delivering results. This is important, because Copilot has had not-so-stellar results at doing even the most basic tasks in Windows. Also: How to upgrade your 'incompatible' Windows 10 PC to Windows 11 - 2 free options Then there's the security issue. In an office full of workers dealing with potentially sensitive data, do we really want everyone talking at their PCs? Luckily, during a press briefing, I received confirmation from Microsoft that Copilot Voice is not replacing text input, it's merely an additional feature that users can choose to use -- or not. Copilot's new approach to multi-modal AI is being called Copilot Vision, which lets the AI "see" what you're currently doing on the PC and give you suggestions, instructions, or information either verbally or through text. Vision became available for Windows Insiders to test earlier this year, but it is included as a facet of Copilot's core functionality with the new features. Also: Microsoft Copilot AI can now pull information directly from Outlook, Gmail, and other apps Vision is not "on" all the time; instead, like Voice, it has to be invoked. It works in Windows, Microsoft Edge, or on mobile, and it can't take action on your behalf. Instead, it just analyzes what's on the screen and responds with directions, feedback, or summaries. The design here includes some immediate security guardrails on its usability. For one, you have to manually select which app you want Vision to have access to, and you can only select up to two apps at once. At launch, it will only be available with voice, but Microsoft has confirmed that text will be available shortly after. Also: Microsoft lets you pick a character for your AI - with its new Copilot Portraits feature To activate, click the glasses icon in Copilot, then tell it which app to look at. A floating toolbar will pop up, and after a short voice prompt, you can ask questions in natural language. Again, it won't take actions, but it can show you where something is located on the screen by activating its own cursor. In addition to these new functionalities, Copilot can also now interface directly with Microsoft 365 (FKA Microsoft Office) apps, including OneDrive, Outlook, and Google Drive. Using Voice and Vision, Copilot can not only respond to prompts about your own documents (that you've granted access to), but create, export, design, and write documents in those apps -- all via requests in natural language. Also: Microsoft Copilot now offers Claude models - how to try them This feature is also still in testing and currently available for members of Copilot's Insider program, and it was announced earlier in October. Get the morning's top stories in your inbox each day with our Tech Today newsletter.
[4]
Microsoft wants you to talk to your PC and let AI control it
As Microsoft bids farewell to Windows 10 and gets ready to mark the 40-year milestone of its operating system, it's looking forward to what's next for Windows. Microsoft might not be ready to announce Windows 12 just yet, but it clearly wants to turn every Windows 11 PC into an AI PC that Copilot controls and users talk to. "We think we're on the cusp of the next evolution, where AI happens not just in that chatbot and gets naturally integrated into the hundreds of millions of experiences that people use every day," says Yusuf Mehdi, executive vice president and consumer chief marketing officer at Microsoft, in a briefing with The Verge. "The vision that we have is: let's rewrite the entire operating system around AI, and build essentially what becomes truly the AI PC."
[5]
Microsoft wants you to talk to Windows 11 PCs again -- Copilot gets 'conversational' input to complement your mouse and keyboard
Microsoft is pushing to make every Windows 11 PC an AI PC. In new updates, the company is focusing on further integrating AI into Windows 11 apps and experiences (not just chatbots), and making voice as much of an input option as the keyboard and mouse. The idea, Microsoft says, is that AI on a PC should be easy and natural to interact with in either text or voice; that it should be able to see your screen and information and help; and that it should be able, with your permission, to "take action on your behalf." "Voice will become the third input mechanism to using your PC," Microsoft executive vice president and consumer chief marketing officer Yusf Mehdi said on a call with reporters ahead of the announcement. He mentioned that the idea is for talking to be additive, not replacing keyboards and mice altogether. Mehdi authored a blog post on the new features. You will be able to talk to Microsoft's Copilot AI by invoking a "Hey, Copilot" wake word, or use the established Win+C shortcut or Copilot button. With your permission, Copilot will be able to see your screen and make suggestions or provide help. (To enable the feature, you'll have to opt in in settings.) In example videos, we saw someone talk to Copilot in a music player app, and the AI walked the user through steps to get the best sound quality. In another, someone watched a YouTube video and asked Copilot to identify the microphone the host was using, and then the AI pointed out that Best Buy had it available. This feature, among others that Microsoft is announcing today, won't require a Copilot+ PC (with one exception), but will instead work on any system running Windows 11. When asked whether people will want to speak to their computers, particularly in offices with other people, Mehdi said that people already have all sorts of talk in these spaces, and that, between office chit chat and using headphones, workers will find ways to learn how to deal with it. Microsoft is also making Copilot Vision available anywhere in the world where Copilot is offered. Windows Insiders will soon be able to interact with Copilot Vision using text (previously, you could only talk to it). Microsoft is bringing a handful of new Copilot features to Windows Insider before they go wide, with plenty of opt-in security controls..These include a new feature to build Copilot into the taskbar, called "Ask Copilot," that takes the place of the traditional search bar. Microsoft says this will let you use just one click to jump into chat, search for files, or use Copilot Voice or Vision. This, like many of Microsoft's Copilot features, is opt-in.There's also a new mode called Copilot Actions, which will let Copilot take action on your behalf. An experimental feature will go beyond the web and even let the AI use your local files, including sorting photos and finding information in documents. Copilot Actions will let you observe every step it takes, and you can take over at any point. It will launch in Copilot Labs with a narrow set of use cases, and Navjot Virk, corporate vice president of Windows Experiences, said that these will include more complicated tasks as the model is trained. Actions will be turned off by default, and may request additional consent before doing anything deemed important. Windows users will also be able to connect Copilot to services, including OneDrive and Outlook, as well as Google services like Gmail, Google Drive, and Google Calendar. From here, Copilot will be able to see your calendar and other personal data to help you find personalized information like appointments, contact details, and documents.The Copilot Connections will also let you export text from Copilot to Microsoft 365, letting you put results into homework or presentations. Lastly, Microsoft is integrating Manus, a general AI agent, into File Explorer. This AI, which is also available through a native app on Windows 11, can use your documents to complete tasks like creating a website, without you needing to code. There's only one AI announcement for Copilot+ computers. The Click-to-Do feature will now be able to add actions from Zoom. For example, if you hover over an email address, there will be an option to invite that person to a Zoom meeting. In other Windows news, earlier this week, Microsoft dropped support for Windows 10 and is encouraging customers to update to Windows 11 with new and improved devices. Extended support for Windows 10 is available to some customers as well as businesses.
[6]
Microsoft: Here's Why You Should Talk to Your Windows 11 PC
When he's not battling bugs and robots in Helldivers 2, Michael is reporting on AI, satellites, cybersecurity, PCs, and tech policy. Don't miss out on our latest stories. Add PCMag as a preferred source on Google. Set aside your mouse and keyboard. Microsoft really wants you to talk to your Windows 11 PC. Today, the company unveiled new features for its Copilot AI assistant, also highlighting how it believes voice interactions can sometimes provide a better experience than typing and clicking. "You should be able to talk to a PC and have it understand you," Microsoft Consumer Chief Marketing Officer Yusuf Mehdi told journalists. "In our minds, voice will become the third input mechanism to use on your PC." Talking to your computer or phone is nothing new (remember Cortana?). But Microsoft is signaling its ongoing enhancements to Copilot have made the assistant smart enough to excel at understanding natural conversation and carrying out the commands. The improvements also apply to all Windows 11 PCs, not just Copilot+ hardware. According to Mehdi, this can make today's Windows 11 machines truly "AI PCs," a term the tech industry has been promoting but is still working to achieve. A key differentiator from other chatbot tech is how Copilot can be used across the OS, the browser, Microsoft programs, and even for a few third-party apps through a recently announced "Connector" function. "We think we're on the cusp of the next evolution, which is where AI happens not just in that chatbot, but gets naturally integrated into the hundreds of millions of experiences that people use every day," Mehdi added. As part of this push, Microsoft is making "Hey, Copilot" the default wake word for the assistant across Windows 11, following its initial rollout to Insiders in May. The voice command "goodbye" has also been added as a convenient way to end a conversation. In addition, the company is displaying a new "Ask Copilot" text box in the Windows 11 taskbar, making the assistant even more visible. Perhaps the most intriguing new feature is Copilot Actions, which can complete tasks on your behalf. The company already introduced the function for the web, enabling the assistant to book an online dinner reservation for you or buy a book. That said, it doesn't offer full automation and requires the user to submit information periodically, as our hands-on testing found. Microsoft now wants to test Copilot Actions for local files on your PC. The experimental mode will be available to beta users in Windows Insiders in Copilot Labs, enabling Copilot to sort through your photos, extract information from PDFs, or edit files in bulk. The same function can interact with both desktop and web applications, as long as you grant it permission. "While this is happening, you can choose to focus on other tasks. At any time, you can take over the task or check in on the progress of the action, including reviewing what actions have been taken," Microsoft says. Despite the voice emphasis, Microsoft also acknowledges that the keyboard and mouse remain primary inputs. On Wednesday, the company demoed some of the Copilot functions to PCMag through voice commands. But interestingly, Copilot struggled to function normally because the demo was happening in a noisy restaurant. It's why the company is adding text support to Copilot Vision, which lets the AI assistant view and understand what's displayed on your PC's desktop to answer your queries. "Previously, you could only use Vision using voice, and Copilot would coach you through it aloud," Microsoft noted in a blog post. But in an upcoming release for Windows Insiders, Copilot Vision can work with your keyboard and display the corresponding answer with text. The company is touting these features when 40% of Windows desktop users remain on the older, now-unsupported Windows 10. Market analysts also say the PC market has stagnated, suggesting consumers don't see a major need to upgrade. The new Copilot push might convince some to finally buy in. Still, there are drawbacks with voice commands. They can expose your private details to anyone nearby while generating noise, especially if everyone else is talking to their computer. To operate, Microsoft's Copilot also needs to collect some data from your PC, although the company says: "Once the Copilot Vision session ends, all images, audio, and context are deleted." The other issue is how generative AI can hallucinate. Microsoft itself notes that Copilot Actions could produce the wrong output or even be susceptible to "prompt injection attacks," where text in a web page or document is misinterpreted as a command and executed. As a safeguard, Microsoft is asking users to opt in to the Copilot experiences first. The company is also imposing limits on the capabilities, explaining, "There is a well-defined boundary for the agent's actions, and it has no ability to make changes to your device without your intervention. This access can be revoked at any time." In terms of privacy, Microsoft tells PCMag: "Your personal interactions with our services are kept private and are not disclosed without your permission. We remove information that may identify you, like names, phone numbers, device or account identifiers, sensitive personal data, physical addresses, and email addresses, before training AI models."
[7]
Microsoft adds always-listening, always-watching Copilot
As if pulling support for Windows 10 was not punishment enough for long-suffering customers, Microsoft has decided to shove Copilot down everyone's throats with a new voice activation feature and even more control over your PC. Soon, a Copilot box may even replace the search box on your taskbar. According to Yusuf Mehdi, Microsoft's consumer marketing chief, Copilot Voice and Copilot Vision are coming to "every Windows 11 device where Copilot is available." Users can bark instructions with the wake word "Hey Copilot," and have Copilot Vision analyze what's on their screens without investing in Copilot+ hardware. The features are on a gradual rollout and Microsoft hasn't said exactly when everyone can expect to get them. However, The Register's US Editor, Avram Piltch, got access this morning to the always-listening feature on a virtual machine he was running with Windows 11 Beta Channel installed. When he launched the Copilot app, Piltch saw a button allowing him to enable the feature (or not). After he had turned it on, Piltch was able to invoke Copilot by saying "Hey Copilot," but he had to actively click a Copilot Vision button for the assistant to see what was on his screen. After clicking the button, he watched a web video about a mechanical keyboard and asked Copilot "what keyboard is that" to which it correctly replied "the Keychron K2 HE" (note that the name of the keyboard was on the web page). He then asked Copilot for pricing and the assistant responded correctly that it's $139. However, when Piltch asked Copilot to perform some actions, it only told him what to do, rather than doing it for him. For example, he asked Copilot to go to the website to purchase the keyboard, but instead of pointing the Edge browser toward a URL, the assistant told him to find a link on the YouTube page and click it himself. It also refused to open apps like Notepad. It wouldn't change settings for him either. Piltch also found that you can't see the text output from Copilot while you are in voice mode and this can be annoying. He clicked the Copilot Vision button and went to visit his LinkedIn profile in Edge browser and then asked Copilot to "write my resume based on this LinkedIn profile," and had to listen while it read him the resume it was writing slowly, via voice. To read and copy the actual text (which was just a summary of LinkedIn), he had to hit stop and close out of voice mode. Yapping at a PC is not particularly new, but now Microsoft has stirred Copilot as an opt-in function into the mix. The wake word starts the AI listening, and saying "Goodbye" or tapping X will stop it. Alternatively, give Copilot the silent treatment for a few seconds, and it will also terminate the conversation. While voice-control is a boon for accessibility, we'd have to wonder if there are that many people out there who really want to interact with their PCs in this way. Imagine the increase in volume in open-plan offices, or some jerk saying: "Hey Copilot, format C, goodbye," as they walk past a victim's cubicle. We jest, of course, and at least the feature is opt-in. Copilot Vision gives the assistant access to the desktop to come up with helpful tips and "see" entire Excel, Word, or PowerPoint documents, not just what is on the screen. As a reminder, it is just over a year since Microsoft's catastrophic launch of Recall, a tool that screenshots your every move, even financial and personal info, which caused uproar in the privacy and security communities. Copilot Vision can only be used with voice at present, but Windows Insiders will soon be able to interact with it using text in that same chat window. Microsoft is also tinkering with the taskbar and adding an "Ask Copilot" function. As part of an opt-in experience, the Windows giant wants the taskbar to be a "dynamic hub... transforming everyday interactions into moments of productivity and delight." When you opt into this experience - something Piltch was not able to test - a Copilot box replaces your search box entirely. It's unclear what happens if you just try to search for an app or file from this Copilot box. We're concerned that eventually this Copilot promotion could replace search as everyone's default taskbar UI. According to Microsoft: "This experience leverages existing Windows APIs to return your apps, files, and settings, like the Windows Search experience, and does not grant Copilot access to your content." Microsoft is also making good on its threat to let Copilot loose on local files, at least for Windows Insiders. Copilot Actions has already been shown off, booking tables or ordering groceries. Microsoft wants to extend this. It said: "Simply describe the task you want to complete in your own words, and the agent will attempt to complete it by interacting with desktop and web applications." In a demo video, Microsoft shows a user asking Copilot to change the orientation of a folder full of photos. A voiceover says you can also use Copilot to read PDFs for you. The theory goes that a user can do other things while the magic happens. In reality, we suspect that many users will want to keep a close eye on the assistant in case something unpredictable happens. Microsoft acknowledged this, saying: "You may see the agent make mistakes or encounter challenges with complex interfaces, which is why real-world testing of this experience is so critical to help us apply learnings to make this experience more capable and streamlined." That's also why a very narrow set of use cases will be rolled out first. Microsoft has also announced Manus, an agent that can perform several tasks on a user's PC, such as building websites based on local documents. Zoom functionality is also to be implemented for Click To Do Copilot+ PC users. Microsoft did not provide a timeline for when the features would roll out to end users or Windows Insiders. It's a scattergun approach, and it is difficult to escape the feeling that Microsoft is shoveling AI tech into Windows as soon as it emerges from the lab, hoping that something, anything will chime with users. Do users need Copilot throughout their operating system, or would they rather Microsoft focus instead on releasing updates that don't break previously working functionality? We suspect we know the answer, even if Microsoft is too busy talking to Copilot to hear it. ®
[8]
Microsoft debuts Copilot Actions for agentic AI-driven Windows tasks
Microsoft announced today a new Windows 11 Copilot feature called Copilot Actions that enables AI agents to perform real tasks on local files and applications. The feature will be rolling out soon to Windows Insiders in Copilot Labs, expanding the earlier web-based Copilot Actions introduced in May and taking us one step closer to Microsoft's vision of integrating AI directly in the Windows desktop environment. "Copilot Actions is an AI agent that completes tasks for you by interacting with your apps and files, using vision and advanced reasoning to click, type and scroll like a human would," explains Microsoft. "This transforms agents from passive assistants into active digital collaborators that can carry out complex tasks for you to enhance efficiency and productivity - like updating documents, organizing files, booking tickets or sending emails." Each agentic app will manage its own Agent Workspace, providing an isolated environment where the agent operates independently from the user's desktop. This ensures that agents acting on behalf of different apps remain isolated from one another. Microsoft told BleepingComputer that there will be no change to the Windows 11 hardware requirements and that they are optimizing the workspaces to minimize any impact on Windows' performance. Microsoft states that it is securing Copilot AI agents through four security and privacy principles: using distinct agent accounts, limiting agent privileges on files and folders, ensuring operational trust through digitally signed agents, and ensuring that agents are governed by the Microsoft Privacy Statement and Responsible AI Standard. Each AI agent will run under its own distinct "standard" Windows account, which means it does not have administrative privileges. As each agent uses its own account, it means Windows can restrict agents based on applications and file system access rules. At launch, agents will only have access to the standard Windows data folders, such as Documents, Downloads, Desktop, and Pictures, and other "resources" available to all accounts. Access to other file locations can be configured using the Windows access control lists (ACLs). BleepingComputer asked Microsoft if they would be adding easier ways to manage file system access for agents and was told that more granular security controls would be coming at a later date. Microsoft further told BleepingComputer that each Agent Workspace, where Copilot Actions performs its tasks, is implemented as a Windows Remote Desktop child session, rather than as a virtual machine or within a Windows Sandbox. A Windows Remote Desktop child session is a distinct, isolated desktop environment tied to a user's existing session, preventing the agent from directly viewing or interacting with the user's desktop. "Each agentic app will manage their own agent workspace. For isolation purposes, there will not be crossover of workspaces across apps," Microsoft told BleepingComputer. While the AI agent can't access a user's desktop, Microsoft plans to implement a way for users to authorize, monitor, and take control of agent actions in the workspace. Copilot Actions is turned off by default and must be manually enabled by going to Settings > System > AI components > Agent tools > Experimental agentic features. To increase security, agents are cryptographically signed, allowing Microsoft to revoke compromised or malicious agent certificates when detected. According to Microsoft, these features are part of its Secure Future Initiative, and feedback from the preview program will help guide the development of the feature ahead of its full release later this year.
[9]
Microsoft wants you to talk to your PC by saying 'Hey Copilot'
* Microsoft adds 'Hey, Copilot' wake word; opt-in with likely prompt nudges to enable it. * Copilot Actions can edit local files and act for you, but starts with a narrow set of use cases. * Gaming Copilot beta on ROG Xbox Ally offers tips but few optimizations. Microsoft's Pavan Davuluri caught some backlash when he said that your PC should be something that you can talk to, but the company's plans are coming to fruition. There's a big Copilot rollout being announced, and part of that is the ability to launch Copilot by using the wake term, "Hey, Copilot". While that's probably the biggest news, there's actually quite a bit being unveiled. Hey Copilot is the new Hey Cortana When briefing the press on this news, one thing that was mentioned constantly was that this is all opt-in. Microsoft says you'll have to turn this on in Settings, but let's be clear. Microsoft wouldn't be Microsoft is there weren't annoying pop-ups telling you to do it. After all, how else do you boost engagement metrics? Once you do, you can say the wake word and it'll indicate you're talking to Copilot, and you can say "Goodbye" to end the conversation. And Copilot is becoming more powerful. Copilot Actions can actually do things on your behalf, again, with your permission. It's already been able to interact with services on your behalf, but now it will be able to take action on your own local files. Copilot connectors are going to let you integrate not only Microsoft services, but Google services too. You can interact with Google Drive, Calendar, Gmail, and more. Unfortunately, Copilot Actions is starting with "a narrow set of use cases", which means that your initial experience with this is going to be that you're told it can't do most of the things you want it to, an obstacle that can be difficult for services to overcome in future iterations. Indeed, it's hard to retrain users if they think the product just doesn't work. Copilot is coming to gaming handhelds too Microsoft also introduced Gaming Copilot, available in beta on the new Asus ROG Xbox Ally series. The idea is that you'll be able to ask for help, get recommendations, and things like that. Microsoft's announcement really didn't get into what Gaming Copilot can actually do, or why you'd want it. It seems like it's just searching the web for game tips, unlike HP's OMEN AI services that will actually help you fine-tune your system settings for optimal game performance. Indeed, being that this is exclusive to gaming handhelds that, by definition, have a different power envelope than a console (there is no mention of this coming to Xbox consoles), you'd think optimizations would be a key value proposition for something like this. Notably, however, is that the new ROG Xbox Ally handhelds are Copilot+ PCs, meaning they have powerful NPUs. That might be a reason for the exclusivity, at least for now. Most of these features will arrive as an update to the Copilot app, while some will come to Windows Insiders a bit later. Again, Microsoft said that everything mentioned is opt-in.
[10]
Microsoft will test a Copilot AI feature that performs work on local files in Windows 11
The software company is enticing people to upgrade their PCs with a slate of artificial intelligence features it will test in Windows 11, the successor to Windows 10. Those who participate in both the Windows Insider Program and the Copilot Labs group for trying AI experiments will gain access to an updated Copilot assistant app in Windows 11 that can use desktop and web applications to complete certain tasks, such as resizing photos, with locally stored files. Or perhaps a person could tell Copilot to put all available Brian Eno songs into a Spotify playlist and have the assistant push play, Yusuf Mehdi, Microsoft's consumer marketing chief, told reporters in a briefing. Anthropic, Google and OpenAI have all developed AI models known as computer-use agents that accept people's directives to perform actions in multiple steps that involve typing and clicking. Microsoft has brought this technology to corporate workers who build AI agents, and consumers with premium subscriptions can try a computer-use agent called Copilot Actions. Now the software company is planning a variant for Windows 11. Copilot Actions will be turned off by default. If enabled, it will operate in a contained environment with its own desktop, Microsoft said. People can watch the software working step by step and take over at any point, although they're free to navigate away and do other things on their PCs as the work happens in the background.
[11]
Microsoft's next Windows 11 AI gamble: Just say "Hey Copilot"
Over a decade since Microsoft tried to make talking to Cortana on PCs a thing -- and spectacularly failed in the process -- the Windows giant is taking another swing at voice commands with its Copilot AI assistant in Windows 11. Starting today, the company is rolling out an upgrade to its existing Copilot Voice and Vision features which will let you say "Hey, Copilot" and then ask your PC a question based on what's on the screen. If you're looking at pictures of Hawaii, for example, you could ask your Windows 11 PC where exactly they were taken, have it plot you a flight plan and potentially even give you some budgeting tips to afford that island vacation. Microsoft's jaunty promotional videos for the Copilot features, set to Vampire Weekend's almost two-decade-old "A Punk," make the process look practically seamless. One user asks Copilot to show them how to stream their music in the "best possible quality," and the AI proceeds to highlight the exact location of the streaming settings in Spotify, while suggesting they choose the lossless option. Another person asks Copilot to write up a short biography based on their photo portfolio. Now Copilot isn't just about searching the web or generating novelty AI art, it's making it easy for users to perform practical tasks without much effort. Microsoft is clearly striving for the convenience of the Star Trek ship computer, a dream that also pushed Amazon to invest billions in its Echo devices and Alexa. The difference with Copilot is that you're not just talking to a faceless speaker -- Microsoft is also trying to make Windows 11 aware of what you're doing on your screen. The "Hey Copilot" feature and all of the Copilot Vision are cloud-based, so you'll have to live with image data of your desktop making its way to Microsoft's servers. That involves a level of trust the company has lost with many users, especially after the messy debut of Recall, its first flagship AI-powered feature. It doesn't help that many people are still peeved about the death of Windows 10 support this week. Unsurprisingly, the company stresses that "Hey, Copilot" is a purely opt-in feature that's buried in the Copilot app settings. (Of course, that can always change, especially if the company wants to juice AI engagement stats in a few years.) I suspect it'll be even harder for users to swallow where Microsoft wants to take Copilot: Giving it the ability to perform Windows tasks on its own. That's the goal of the experimental Copilot Actions feature, which initially debuted as a tool that could perform tasks on websites. Once enabled, Copilot Actions can be prompted to handle manual tasks, like resizing and straightening an a folder of photos. If any questions pop up, it can prompt you to answer them within the Copilot app. And as Copilot Actions is handling its job in the background, you're free to do anything else you'd like on your computer. Conceptually, Copilot Actions sounds similar to handing off a task to a real life assistant -- but just like a human assistant, there's always a chance something could go wrong along the way. It's also not hard to imagine the feature being coopted by nefarious malware down the line, since it's basically a Windows script in a better interface. Microsoft says it's tested Copilot Actions "extensively" internally, and it's rolling out the feature slowly to gather feedback. Just like "Hey, Copilot," it's entirely opt-in, and you can see everything Copilot Actions is doing step-by-step in the Copilot app. Microsoft says you'l be able to jump in and take control of a Copilot Action job at any point, as well as control the permissions of AI agents in Windows 11's user settings. Copilot tasks are also performed in a contained environment, according to Microsoft, which allows for even more specific permissions controls as well as runtime isolation (so Copilot can't affect the rest of your system beyond its specific task). And as if we're not already inundated with Copilot all over Windows 11 already, Microsoft also plans to add an "Ask Copilot" search function right on Windows 11's taskbar. The company claims it's part of a mission to make the taskbar "a dynamic hub" for accomplishing tasks, but personally I like to keep my taskbar clear so I can cram in more app windows. Like everything Microsoft is announcing today, the Ask Copilot bar will also be entirely opt-in. As someone who's been skeptical of Microsoft's Copilot initiatives so far, I could actually see myself using "Hey Copilot" if it works as advertised. It sounds far more practical than the old Siri voice commands, which were limited by simplistic language models from a decade ago. Microsoft is also expanding AI actions built into Windows 11, including a new integration with Manus, an AI agent that can do things like turn several documents into a website, as well as Filmora, which lets you create AI videos right from the File Explorer. The new "Hey Copilot" and Copilot Vision features are available today on all Windows 11 PCs that have access to Copilot. Microsoft is also making Copilot Vision broadly available around the world today where Copilot is available. Copilot Actions and the Ask Copilot taskbar feature will "gradually" become available to Windows 11 Insiders, according to Microsoft.
[12]
Microsoft pushes AI updates in Windows 11 as it ends support for Windows 10
Microsoft is encouraging people to talk to their laptops as it rolls out new artificial intelligence updates to Windows 11 and pushes users to phase out its predecessor, Windows 10. Microsoft ended free security support for Windows 10 this week, though millions of people still use personal computers running the older operating system. To entice people to upgrade, the software giant on Thursday announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Among the features is a voice mode that enables users to dictate "Hey, Copilot" to start chatting with their computer instead of typing or clicking a touchpad. Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. But many people around the world still are using Windows 10, particularly those with older computers that can't upgrade to Windows 11. Consumer advocates have spent months petitioning Microsoft to extend technical support for an estimated hundreds of millions of devices that will no longer get automatic security fixes. "With the end of Windows 10, users face the choice between exposing themselves to cyberattacks or discarding their old computers and buying new ones," said Brenna Stevens of the Oregon State Public Interest Research Group, which advocated on behalf of local repair shops, students and others. Microsoft has said people can pay extra for a year of extended security support through October 2026. Some users, including those in the European Union as well as U.S. users who can synchronize with Microsoft's cloud service, will be able to get that extended support for free. But most people faced with unsupported devices are likely to either keep using them despite the vulnerabilities or throw them away, which "creates both a security problem and an environmental problem," generating huge amounts of toxic electronic waste, said Nathan Proctor, who leads PIRG's Right to Repair campaign. Both PIRG and Microsoft urge those who are replacing their computers to avoid sending their older models to the landfill. Those concerns were not a focus of Microsoft's Windows 11 announcements Thursday. Instead, Yusuf Mehdi, an executive vice president and chief marketing officer for Microsoft's consumer division, argued that conversing with a laptop will be "as transformative as the mouse and keyboard" in shaping the PC experience. Microsoft says all Windows 11 users will also now have access to Copilot Vision, an AI feature that can analyze and give feedback on the documents, video games and other activities happening on the screen. Mehdi acknowledged it could take some adjustment to get used to human-computer conversations in shared workspaces. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen," Mehdi told reporters. The updates are Microsoft's latest attempt to make its widely used Windows operating system a gateway to hook people on its suite of generative AI tools. The tech giant competes heavily on AI services with Apple, Google and startups like Anthropic and OpenAI. Mehdi said the updates are "not a replacement for Recall," a screen-tracking feature on some Windows computers that gives Copilot a "photographic memory" of a user's virtual activity. Microsoft CEO Satya Nadella described it last year as a step toward machines that "instantly see us, hear, reason about our intent and our surroundings," but the idea was met with criticism from privacy and security experts and took a year before it started to roll out.
[13]
Microsoft Desperately Wants Users To Talk to Their Windows PCs
Thought Copilot was invasive before? Watch it completely take over your PC. The next version of Windows will be stuffed to the gills with AI. You may be asking, “Even more than before?†Yes, and Microsoft hopes to train you to quit using your keyboard and mouse to handle your PC. The company hopes you’ll use your voice to command your PC, like you’re some domineering captain on a ship and your crew is a hapless chatbot who’s desperate to understand your vague whims. Starting Thursday, Microsoft is pushing more “experimental†features and future apps that will put the company’s Copilot AI directly in front of your Windows experience. Microsoft already ensured there would be a Copilot key on all new PCs that access Microsoft’s chatbot. Now, once you enable it in the Copilot app settings, you can start talking to your computer by screaming “Hey, Copilot†at your screen. If anybody still misses Cortana, now’s your time to shed a single tear. Microsoft already had its Copilot Vision function available on Edge browsers, but now it's stretching its legs within the wider Windows software suite. Unlike past voice assistants, the new version of Copilot will have AI image recognition, and it should be able to comprehend what’s happening on your screen. This should mean you may have to issue less detailed prompts to the AI to get it to do what you want. And what does Microsoft expect you to use AI for? Well, it could replace all those how-to articles you see online. If you tell Copilot, “Show me how to get better quality audio in Spotify,†Microsoft said it will highlight the setting you need to hit on your screen. Microsoft sat me down for a demo with the new Copilot Vision feature, though I've yet to try it using my own voice. The Voice dialogue was surprisingly fast in responding to queries about a math problem or about buying a dress online. However, when the user tried to get the AI to point out the right controls for changing image resolution on their Shopify account, the AI circled the wrong part of the page. It's the curse of all live demos that something will likely go awry, but we can expect some idiosyncracies as Microsoft tries to get us talking to our Windows machines. Microsoft said this AI vision system can look at an image on your screen and offer descriptions of what it sees. Apparently users would use this to type out a resume based on their own portfolio. In another example, Microsoft showed Copilot humming a mindless tune for a musician to riff off (no, the tune did not sound especially appealing). Copilot can now look at all your browser tabs at once and find products based on what you’re looking at. Google has also promoted AI shopping, though with more virtual “try on†features that create an AI image of yourself to imagine your body in that dress. You’re going to start seeing new Copilot commercials real soon. These are designed to “teach†you about the fun and pleasure of using Copilot with your voice. But that’s not all. There are more full-blown features supposed to get you using AI. Windows Insiders will be able to access beta features that will put a Copilot function crowding out the other functions on your taskbar, replacing the regular Windows search bar (you can still use it to search for files or settings, just as before). Microsoft said users already talk to their PCs, though usually for the sake of dictation or notetaking. Plus, speech recognition is already a standardized feature for accessibility purposes. Still, there’s a wide gulf between those use cases and literally talking to your PC without annoying your deskmates trying to work just a few feet away. Instead of offering the ability to type to Copilot Vision out of the gate, Microsoft is limiting it to Windows Insiders beta testers to start. Beta testers will also be first to try out the newfangled Copilot Actions app. Microsoft described the application as an “AI agent†that can take actions for you across different apps and files. In AI circles, an “agent†is essentially multiple AI models working together to complete a more complicated task. On Windows, this means it could essentially take over your PC, run programs for you, and fulfill your demands. Anthropic's Claude AI showed off similar PC-takeover capabilities last year. Over the last few years, Microsoft has tried promoting hardware-specific AI capabilities, first with “AI PCs†in 2023 and then “Copilot+ PCs†in 2024. Now, according to Microsoft, “every Windows 11 PC†is an AI PC once it’s connected up with Microsoft’s cloud-based AI. Microsoft itself admitted the AI PC “hasn’t really come alive yet.†You could lay some of the blame for that at the Windows maker’s feet. Last year, it tried to push Recall, a feature that would screenshot everything you do on a PC. An AI would scrape those screenshots and let users search through their past activity to find old web pages or documents they were working on. Security researchers found the feature could screenshot sensitive data like bank info, and anybody with access to the PC could find it. Microsoft pulled Recall and didn’t release it for an entire year. Even after a big push for security, the feature still isn’t foolproof, and several companies have blocked it over fears it could lead to sensitive data being shared. The Copilot Actions app and all the other features are “opt in.†The Actions app is turned off by default, and you need to enable it through settings. Microsoft promised you can take control “at any time,†and the program may ask for permission for specific actions. No matter what, since these features are cloud-based, your data will need to be processed on a foreign server, not on your device. Microsoft promises it isn’t storing or abusing your prompts or whatever appears on your screen. After the Recall snafi, it's increasingly difficult to trust the Windows maker. Now that Microsoft wants you to put privacy concerns aside for the sake of its ever-present AI, it's going to have to offer a more compelling use case than an AI that hums on command.
[14]
Microsoft's new AI features aim to give Windows a voice and mind of its own
"Are you talking to your computer?" That line from a new Microsoft Windows ad, spoken by a confused bystander, will double as a litmus test for the company's latest attempt to bring its flagship operating system into the era of artificial intelligence. Microsoft announced a series of new and updated AI features for Windows 11 on Thursday morning, aiming to move people beyond typing and clicking toward more human-like interactions with computers. Among the new features: * "Hey Copilot," a new wake word that lets users activate Microsoft's AI assistant by voice and ask it to assist with basic tasks or answer questions using voice commands. * The expansion of "Copilot Actions" agentic features beyond the browser to the PC, letting the AI carry out actions on its own, such as organizing files or running tasks on the computer, with user approval. * An updated Windows search feature, designed to return faster and more relevant results across apps, files, and settings. * A redesigned Windows taskbar, bringing Copilot directly into the main Windows interface for quicker access to voice and vision tools. * The global rollout of Copilot Vision, which lets the AI see what's on-screen so it can provide guidance or help inside apps and games. * New links between Copilot, File Explorer, and cloud services, allowing the assistant to find information in files, emails, and online storage without opening separate apps. A third input mechanism It's part of a larger push by Microsoft to redefine the personal computer around AI. Company executives say the shift to conversational input and autonomous capabilities could prove as significant to personal computing as the arrival of the mouse and keyboard decades ago. "In our minds, voice now will become the third input mechanism to use in your PC," said Yusuf Mehdi, Microsoft's consumer chief marketing officer, in a briefing with reporters. "It doesn't replace the keyboard and mouse, necessarily. It's an additive thing. But this will be pretty profound." More broadly, the company is betting that Windows users will begin treating their PCs less as tools and more as collaborators. After pushing AI into its Office apps and cloud services, Microsoft is now embedding it directly into the OS. It's a way of making AI unavoidable on the PC, and testing whether the idea of the "AI computer" will resonate with everyday users rather than just early adopters. The PC is also the battleground that Microsoft still controls. The company largely missed the smartphone era and has struggled for relevance on mobile devices that run on operating systems from Apple and Google. With AI quickly becoming the next major platform shift, Microsoft wants that transition to start on Windows, not somewhere else. New capabilities and risks Apart from the new voice interactions, the biggest update is the expansion of Copilot Actions agentic capabilities across the PC. Microsoft says it will launch as an experimental feature in Copilot Labs for people enrolled in the Windows Insider program, starting with a narrow set of use cases. This agentic feature also creates new security risks. Microsoft says it has built a new security framework for Copilot Actions, which is disabled by default and runs the AI agent in its own contained workspace and dedicated user account with limited access to user folders. More broadly, the announcement signals a change in Microsoft's AI strategy for Windows. The company's big "AI PC" push began last year with the announcement of Copilot+ PCs, which have a special NPU chip designed for AI tasks. However, the rollout has been rocky, and its flagship "Recall" feature was delayed repeatedly over security and privacy concerns. With these latest updates, Microsoft is now focusing more on AI features that will work on any Windows 11 PC, not just the models with special hardware. Microsoft insists it isn't abandoning the NPU strategy but simply broadening the AI capabilities to reach all Windows 11 users. Copilot+ PCs will get some exclusive features to set them apart, like a new integration for scheduling Zoom meetings using the "Click to Do" feature. The timing of these announcements is notable, as Microsoft recently ended support for Windows 10, the version of the operating system that debuted in 2015. Part of the goal is to give millions of legacy Windows users a new reason to upgrade to new hardware.
[15]
Meet Copilot Actions, Windows 11's most revolutionary AI feature yet
What happens when you ask AI to start mining and collating and adjusting your files, giving AI agents essentially the same user accounts you might give to members of your family? Microsoft is giving you tools to monitor this voluntary service, but... whew. It's a monumental shift. In a briefing with reporters, Microsoft executives gave the impression that with Windows 10 relegated to the back burner, it's time for Windows 11 -- and whatever comes after it -- to go full speed ahead. Copilot Actions is Microsoft's current answer, and it's one of Microsoft's biggest AI features of 2025. The demo consisted of "uploading" multiple files to Copilot Actions, then telling it (via a Copilot prompt) to adjust their orientations and eliminate any duplicates. "We really feel that the vision that we have is, let's rewrite the entire operating system around AI and build essentially what becomes truly the AI PC," Yusuf Mehdi, a senior vice president and Microsoft's chief consumer officer, told reporters in a briefing. "Now people have talked about an AI PC, but it hasn't really come to life yet. There's been many reasons that hasn't happened." One reason? Performance. Just two years ago, Microsoft began talking about the AI PC in terms of a new addition to chip architecture (called the NPU). Today, AI is largely split between the cloud (e.g., Copilot, ChatGPT, Claude, etc.) and local PCs, where chipmakers like AMD, Intel, and Qualcomm have struggled to find a killer app use case. The NPUs, Copilot+ PCs, and 40+ TOPS requirement has split the PC market, even though Copilot+ PC sales have been a tiny fraction of the overall market. Microsoft's Mehdi sounds like he's willing to toss all of that aside. "One of the big things that I think really came to us is, while Copilot+ PCs really are the tip of the spear and are gaining fast traction, the big thing was, let's bring that AI capability to all Windows 11 PCs and make it really simple for anyone to try it."
[16]
Copilot is getting a major upgrade: Here's the biggest new features coming to Windows 11
Microsoft announced some new features coming to Copilot this week that will make Windows 11's built-in AI assistant easier to talk to and more capable of helping you get things done. These additions appear just days after the company issued the final Windows 10 security patch, effectively ending support for Windows 10 unless you pay for another year of security updates. Keep that context in mind as you read the Microsoft blog post outlining the new Copilot features coming to Windows 11, as I suspect it's no coincidence Microsoft included a list of suggested Copilot+ Windows 11 PCs to upgrade to along with its laundry list of new AI-assisted toys to play with. I'll explain all the new Copilot features coming to Windows 11 in depth below, but here's the gist: Microsoft is working to integrate AI more deeply into Windows 11. Some of the new features should be available today (October 16) for Windows 11 Copilot+ PCs, with others coming soon in beta form to Windows Insiders before they roll out to everyone. Folks who update their Copilot+ Windows 11 PCs this week should get a new feature that lets you use a wakeword to talk to Copilot and ask it questions, just like other AI assistants -- so instead of "Hey Siri..." or "Hey Google...", you say "Hey Copilot..." and start talking. Microsoft also laid out plans to integrate two new AI agents into File Explorer that let you do more within the app, as well as a new Gaming Copilot feature that lets you ask Copilot questions while gaming with the press of a button. There are also new experimental features coming to Copilot, most notably an expansion of its ability to do actions for you on the web. Soon, you'll be able to ask Copilot to do complex tasks on your PC using your data, allowing you to execute Copilot Actions on local files. There's a lot to chew on here, so let's get into it! Starting today, there are two notable upgrades coming to Copilot in Windows 11: A new wakeword and the global rollout of Copilot Vision to Windows 11 users worldwide. The wakeword bit is pretty straightforward: as mentioned earlier, it allows you to open Copilot and ask questions by saying "Hey Copilot..." and then asking your question. Copilot has had the option to ask questions via voice for some time, but the new wakeword function will allow you to interact with Copilot entirely hands-free. And now you can use voice commands to ask Copilot questions about what you're looking at via Copilot Vision. If you're not familiar, Copilot Vision is the fancy term for the feature that lets you ask Windows 11's Copilot app about what's displayed on your desktop. This basically entails you giving Copilot access to a screenshot of what you're looking at, and then the AI assistant will try to provide contextual assistance as you ask it questions about anything: a website, a game, a photo or whatever else you try it on. Copilot Vision has more reach within the Word, PowerPoint and Excel apps. So while you can ask it general questions about whatever you're looking at on your PC, if you ask it questions about your PowerPoint presentation or term paper in Word, it will be able to review and comment on the entire document, not just the page currently showing on-screen. Finally, there's a feature coming soon to Windows Insiders that will let you chat with Copilot via text when using Copilot Vision. Until that feature rolls out to your PC, you'll be forced to use voice only when interacting with your PC via Copilot Vision. On top of that, Microsoft laid out a slew of experimental Copilot features that are coming soon to folks who look for them. By that, I mean many of these features are coming soon to Windows 11 users who are enrolled in the Windows Insider program, while others will require you to be enrolled in the Copilot Labs program. Both of these programs are free to join and allow you to opt in to less stable, more experimental versions of the software so that you can check out new features before they roll out to everyone. For example, there's a new Ask Copilot taskbar feature coming for Windows Insiders that lets you click on the toolbar to access Copilot Voice or Vision. It also works like the existing Search button the taskbar, so you can use it to search for apps, files and settings on your PC. Windows Insiders should see the Ask Copilot feature integrated alongside the existing Search button on the taskbar. You'll soon be able to connect your Windows 11 Copilot app to Microsoft apps like Outlook and OneDrive as well as Google services like Gmail, Google Calendar and Google Drive. This will allow you to access Copilot in Windows and ask it things using natural language like "when is my next vet appointment?" or "open my Econ 101 term paper", with a reasonable expectation that the AI agent will be able to return the correct answer. In addition to that, you'll soon be able to ask Copilot to export text to Excel, PowerPoint or Word when conducting tasks. So pretty soon, you should be able to not only ask Copilot to find your latest draft of a term paper, you'll be able to ask it to rewrite it for you and then export Copilot's version to a Word doc you can turn in to your teacher. That's probably not how Microsoft intends this tech to be used, of course, but now that you can pretty much ask Windows' built-in AI to do your work for you it's almost certainly going to be used for just that. Earlier this year, Microsoft rolled out a Copilot Actions feature that enabled you to ask Copilot to do things like reserve a table or book a flight for you by connecting to services like Expedia, OpenTable, Priceline and TripAdvisor. Soon, Windows 11 users who are part of the Windows Insiders program and enrolled in Copilot Labs will be able to test out a limited set of Copilot Actions that can do work on your PC using your apps and files. These features will be disabled by default even when you opt in, and you'll need to turn them on by opening your Settings menu and navigating to Settings > System > AI components > Agent tools > Experimental agentic features. To hear Microsoft tell it, this new Copilot feature is basically going to be a "general-purpose agent" that you can ask to do tasks (like sending an email, pulling data out of a PDF or sorting photos) using natural language, and the agent will then go off and try to do the requested action(s) on its own while you get back to whatever you were doing. I mean that fairly literally: Microsoft is claiming that these "AI agents" get their own user-level Microsoft account on your PC (so they can run apps and access files) and have their own contained, isolated "desktop" environment designed to let the agent access what it has to without seeing anything else on your PC. The pitch is that you can ask Copilot to do something like "email my last five photos to my sister" and it will go off and attempt to do that while you get back to watching YouTube or whatever. Microsoft claims you'll be able to check in on the agent to monitor its progress, and that Copilot may pause the work to ask you for permission about important actions or files. So for example, during the preview period, Microsoft claims that local Copilot Actions will be limited by default to local folders like Documents, Downloads, Desktop, or Pictures, and you'll have to give Copilot permission to access anything outside those broadly-accessible directories. Microsoft has been steadily upgrading File Explorer in Windows 11 with useful features like tabs, and now it's taking the plunge and injecting AI directly into the file management app. Butterfly Effect's Manus AI agent is the most notable addition. Manus launched earlier this year as a web agent and also a downloadable AI app that you can install on your Windows PC and ask to do complex tasks by itself, like generating and then deploying code to a live website., Now it's coming to File Explorer as a built-in AI agent that can complete contextual actions for you when you right-click on files and folders. For example, Microsoft claims that you can "select [a] document, right click and select 'create website with Manus' [and] Manus will build a website for you in just minutes - no uploading, no coding." Microsoft is also integrating the AI-powered Filmora into File Explorer, although the description of how it will work is a little more vague -- it will let you "jump right into video editing easily and seamlessly" from within File Explorer. There's a lot to chew on here, and it would be foolish to pronounce judgment on these new features before they're fully functional or widely available. But if we just look at how Microsoft's promoting these new Copilot features, I think you can get a pretty good sense of where the company is taking Windows -- and it's all about AI. Personally, I have mixed feelings about all this. I've been working and gaming on PCs since I was a kid and write for a living, so my hands and wrists are shot. Being able to summon Copilot with my voice and ask it to complete tasks on my PC using natural language is awfully exciting because it could literally save me countless hours of pain and frustration. But on the other hand, it's not hard to prognosticate a future in which AI agents in Windows have all the weaknesses and drawbacks of current AI agents (unreliable responses, untrustworthy data) yet are far more accessible to anyone with a Windows 11 PC. And when you think about the fact that we're already seeing AI agents implicated in encouraging teen suicide and facilitating tragic murder-suicides, not to mention the fact that it can complete basic homework assignments and has caused all sorts of issues for teachers, it's not hard to envision how having enhanced versions of AI tools built directly into millions of Windows 11 PCs worldwide could have some serious consequences.
[17]
Microsoft rolls out new AI features in Windows
Why it matters: Microsoft and Apple are both touting their computers as built for AI, though for most people that still means using them to access a cloud-based service such as ChatGPT. "People have talked about an AI PC, but it hasn't really come to life yet," Microsoft consumer chief marketing officer Yusuf Mehdi said in a briefing with reporters. * Microsoft has been one of the loudest proponents of the notion, debuting last year a new class of computers, dubbed Copilot+, that contained a neural processor and a handful of AI features, including its oft-delayed Recall. Zoom in: The new features include the ability to verbally summon Microsoft's assistant by saying "Hey Copilot." * Another feature allows Windows users to give Copilot access to see their screen -- either one application or the entire desktop. From there people can get help with an application or ask questions about the data shown on the screen. * Microsoft is also expanding Copilot Actions beyond the Web. Available first in preview form, the agentic tool will now be able to sort through photos, extract data out of a document and take other actions from the desktop. Between the lines: The new features are available for all Windows 11 PCs, not just the Copilot+ models that began shipping last year.
[18]
Microsoft launches 'Hey Copilot' voice assistant and autonomous agents for all Windows 11 PCs
Microsoft is fundamentally reimagining how people interact with their computers, announcing Thursday a sweeping transformation of Windows 11 that brings voice-activated AI assistants, autonomous software agents, and contextual intelligence to every PC running the operating system -- not just premium devices with specialized chips. The announcement represents Microsoft's most aggressive push yet to integrate generative artificial intelligence into the desktop computing experience, moving beyond the chatbot interfaces that have defined the first wave of consumer AI products toward a more ambient, conversational model where users can simply talk to their computers and have AI agents complete complex tasks on their behalf. "When we think about what the promise of an AI PC is, it should be capable of three things," Yusuf Mehdi, Microsoft's Executive Vice President and Consumer Chief Marketing Officer, told reporters at a press conference last week. "First, you should be able to interact with it naturally, in text or voice, and have it understand you. Second, it should be able to see what you see and be able to offer guided support. And third, it should be able to take action on your behalf." The shift could prove consequential for an industry searching for the "killer app" for generative AI. While hundreds of millions of people have experimented with ChatGPT and similar chatbots, integrating AI directly into the operating system that powers the vast majority of workplace computers could dramatically accelerate mainstream adoption -- or create new security and privacy headaches for organizations already struggling to govern employee use of AI tools. How 'Hey Copilot' aims to replace typing with talking on Windows PCs At the heart of Microsoft's vision is voice interaction, which the company is positioning as the third fundamental input method for PCs after the mouse and keyboard -- a comparison that underscores Microsoft's ambitions for reshaping human-computer interaction nearly four decades after the graphical user interface became standard. Starting this week, any Windows 11 user can enable the "Hey Copilot" wake word with a single click, allowing them to summon Microsoft's AI assistant by voice from anywhere in the operating system. The feature, which had been in limited testing, is now being rolled out to hundreds of millions of devices globally. "It's been almost four decades since the PC has changed the way you interact with it, which is primarily mouse and keyboard," Mehdi said. "When you think about it, we find that people type on a given day up to 14,000 words on their keyboard, which is really kind of mind-boggling. But what if now you can go beyond that and talk to it?" The emphasis on voice reflects internal Microsoft data showing that users engage with Copilot twice as much when using voice compared to text input -- a finding the company attributes to the lower cognitive barrier of speaking versus crafting precise written prompts. "The magic unlock with Copilot Voice and Copilot Vision is the ease of interaction," according to the company's announcement. "Using the new wake word, 'Hey Copilot,' getting something done is as easy as just asking for it." But Microsoft's bet on voice computing faces real-world constraints that Mehdi acknowledged during the briefing. When asked whether workers in shared office environments would use voice features, potentially compromising privacy, Mehdi noted that millions already conduct voice calls through their PCs with headphones, and predicted users would adapt: "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen." Crucially, Microsoft is hedging its voice-first strategy by making all features accessible through traditional text input as well, recognizing that voice isn't always appropriate or accessible. AI that sees your screen: Copilot Vision expands worldwide with new capabilities Perhaps more transformative than voice control is the expansion of Copilot Vision, a feature Microsoft introduced earlier this year that allows the AI to analyze what's displayed on a user's screen and provide contextual assistance. Previously limited to voice interaction, Copilot Vision is now rolling out worldwide with a new text-based interface, allowing users to type questions about what they're viewing rather than speaking them aloud. The feature can now access full document context in Microsoft Office applications -- meaning it can analyze an entire PowerPoint presentation or Excel spreadsheet without the user needing to scroll through every page. "With 68 percent of consumers reporting using AI to support their decision making, voice is making this easier," Microsoft explained in its announcement. "The magic unlock with Copilot Voice and Copilot Vision is the ease of interaction." During the press briefing, Microsoft demonstrated Copilot Vision helping users navigate Spotify's settings to enable lossless audio streaming, coaching an artist through writing a professional bio based on their visual portfolio, and providing shopping recommendations based on products visible in YouTube videos. "What brings AI to life is when you can give it rich context, when you can type great prompts," Mehdi explained. "The big challenge for the majority of people is we've been trained with search to do the opposite. We've been trained to essentially type in fewer keywords, because it turns out the less keywords you type on search, the better your answers are." He noted that average search queries remain just 2.3 keywords, while AI systems perform better with detailed prompts -- creating a disconnect between user habits and AI capabilities. Copilot Vision aims to bridge that gap by automatically gathering visual context. "With Copilot Vision, you can simply share your screen and Copilot in literally milliseconds can understand everything on the screen and then provide intelligence," Mehdi said. The vision capabilities work with any application without requiring developers to build specific integrations, using computer vision to interpret on-screen content -- a powerful capability that also raises questions about what the AI can access and when. Software robots take control: Inside Copilot Actions' controversial autonomy The most ambitious -- and potentially controversial -- new capability is Copilot Actions, an experimental feature that allows AI to take control of a user's computer to complete tasks autonomously. Coming first to Windows Insiders enrolled in Copilot Labs, the feature builds on Microsoft's May announcement of Copilot Actions on the web, extending the capability to manipulate local files and applications on Windows PCs. During demonstrations, Microsoft showed the AI agent organizing photo libraries, extracting data from documents, and working through multi-step tasks while users attended to other work. The agent operates in a separate, sandboxed environment and provides running commentary on its actions, with users able to take control at any time. "As a general-purpose agent -- simply describe the task you want to complete in your own words, and the agent will attempt to complete it by interacting with desktop and web applications," according to the announcement. "While this is happening, you can choose to focus on other tasks. At any time, you can take over the task or check in on the progress of the action, including reviewing what actions have been taken." Navjot Burke, Microsoft's Windows Experience Leader, acknowledged the technology's current limitations during the briefing. "We'll be starting with a narrow set of use cases while we optimize model performance and learn," Burke said. "You may see the agent make mistakes or encounter challenges with complex interfaces, which is why real-world testing of this experience is so critical." The experimental nature of Copilot Actions reflects broader industry challenges with agentic AI -- systems that can take actions rather than simply providing information. While the potential productivity gains are substantial, AI systems still occasionally "hallucinate" incorrect information and can be vulnerable to novel attacks. Can AI agents be trusted? Microsoft's new security framework explained Recognizing the security implications of giving AI control over users' computers and files, Microsoft introduced a new security framework built on four core principles: user control, operational transparency, limited privileges, and privacy-preserving design. Central to this approach is the concept of "agent accounts" -- separate Windows user accounts under which AI agents operate, distinct from the human user's account. Combined with a new "agent workspace" that provides a sandboxed desktop environment, the architecture aims to create clear boundaries around what agents can access and modify. Peter Waxman, Microsoft's Windows Security Engineering Leader, emphasized that Copilot Actions is disabled by default and requires explicit user opt-in. "You're always in control of what Copilot Actions can do," Waxman said. "Copilot Actions is turned off by default and you're able to pause, take control, or disable it at any time." During operation, users can monitor the agent's progress in real-time, and the system requests additional approval before taking "sensitive or important" actions. All agent activity occurs under the dedicated agent account, creating an audit trail that distinguishes AI actions from human ones. However, the agent will have default access to users' Documents, Downloads, Desktop, and Pictures folders -- a broad permission grant that could concern enterprise IT administrators. Dana Huang, Corporate Vice President for Windows Security, acknowledged in a blog post that "agentic AI applications introduce novel security risks, such as cross-prompt injection (XPIA), where malicious content embedded in UI elements or documents can override agent instructions, leading to unintended actions like data exfiltration or malware installation." Microsoft promises more details about enterprise controls at its Ignite conference in November. Gaming, taskbar redesign, and deeper Office integration round out updates Beyond voice and autonomous agents, Microsoft introduced changes across Windows 11's core interfaces and extended AI to new domains. A new "Ask Copilot" feature integrates AI directly into the Windows taskbar, providing one-click access to start conversations, activate vision capabilities, or search for files and settings with "lightning-fast" results. The opt-in feature doesn't replace traditional Windows search. File Explorer gains AI capabilities through integration with third-party services. A partnership with Manus AI allows users to right-click on local image files and generate complete websites without manual uploading or coding. Integration with Filmora enables quick jumps into video editing workflows. Microsoft also introduced Copilot Connectors, allowing users to link cloud services like OneDrive, Outlook, Google Drive, Gmail, and Google Calendar directly to Copilot on Windows. Once connected, users can query personal content across platforms using natural language. In a notable expansion beyond productivity, Microsoft and Xbox introduced Gaming Copilot for the ROG Xbox Ally handheld gaming devices developed with ASUS. The feature, accessible via a dedicated hardware button, provides an AI assistant that can answer gameplay questions, offer strategic advice, and help navigate game interfaces through natural voice conversation. Why Microsoft is racing to embed AI everywhere before Apple and Google Microsoft's announcement comes as technology giants race to embed generative AI into their core products following the November 2022 launch of ChatGPT. While Microsoft moved quickly to integrate OpenAI's technology into Bing search and introduce Copilot across its product line, the company has faced questions about whether AI features are driving meaningful engagement. Recent data shows Bing's search market share remaining largely flat despite AI integration. The Windows integration represents a different approach: rather than charging separately for AI features, Microsoft is building them into the operating system itself, betting that embedded AI will drive Windows 11 adoption and competitive differentiation against Apple and Google. Apple has taken a more cautious approach with Apple Intelligence, introducing AI features gradually and emphasizing privacy through on-device processing. Google has integrated AI across its services but has faced challenges with accuracy and reliability. Crucially, while Microsoft highlighted new Copilot+ PC models from partners with prices ranging from $649.99 to $1,499.99, the core AI features announced today work on any Windows 11 PC -- a significant departure from earlier positioning that suggested AI capabilities required new hardware with specialized neural processing units. "Everything we showed you here is for all Windows 11 PCs. You don't need to run it on a copilot plus PC. It works on any Windows 11 PC," Mehdi clarified. This democratization of AI features across the Windows 11 installed base potentially accelerates adoption but also complicates Microsoft's hardware sales pitch for premium devices. What Microsoft's AI bet means for the future of computing Mehdi framed the announcement in sweeping terms, describing Microsoft's goal as fundamentally reimagining the operating system for the AI era. "We're taking kind of a bold view of it. We really feel that the vision that we have is, let's rewrite the entire operating system around AI and build essentially what becomes truly the AI PC," he said. For Microsoft, the success of AI-powered Windows 11 could help drive the company's next phase of growth as PC sales have matured and cloud growth faces increased competition. For users and organizations, the announcement represents a potential inflection point in how humans interact with computers -- one that could significantly boost productivity if executed well, or create new security headaches if the AI proves unreliable or difficult to control. The technology industry will be watching closely to see whether Microsoft's bet on conversational computing and agentic AI marks the beginning of a genuine paradigm shift, or proves to be another ambitious interface reimagining that fails to gain mainstream traction. What's clear is that Microsoft is moving aggressively to stake its claim as the leader in AI-powered personal computing, leveraging its dominant position in desktop operating systems to bring generative AI directly into the daily workflows of potentially a billion users. Copilot Voice and Vision are available today to Windows 11 users worldwide, with experimental capabilities coming to Windows Insiders in the coming weeks.
[19]
Microsoft reveals plan to 'make every Windows 11 PC an AI PC' with new voice input, Copilot Vision and supercharged AI powers
Broader AI powers are coming including Copilot Actions that allow AI to interact with the files on your PC Microsoft teased that something big was happening today, and now we've heard all about its plans to make voice interaction a bigger part of the Windows 11 experience - and how AI functionality will be supercharged in the OS. The expectation was that this announcement would be focused on AI, and indeed it is, but the twist is that this isn't just for Copilot+ PCs. Microsoft is promising a "new wave of updates that make every Windows 11 PC an AI PC - with Copilot at the center of it all". As Microsoft's Yusuf Mehdi, VP and Consumer Chief Marketing Officer, makes clear in a blog post, new voice commands are coming to Windows 11 in the form of Copilot Voice, backed with a wider global rollout of Copilot Vision - and the ability for the Copilot app to take more actions on your behalf. Let's start with the voice element first - all you need to do is say "Hey Copilot" (and definitely not "Hey Cortana") to invoke the AI. The Copilot microphone will appear on your screen, and you can issue voice commands or pose a query to the AI. Saying "Goodbye" or closing the panel will end the conversation automatically (with audible chimes confirming both the start of a session, and the end). I should note that you need to opt-in for this voice functionality on the Windows 11 desktop (by enabling it in the settings for the Copilot app). Behind Copilot Voice we have the impending global rollout of Copilot Vision, which has only been available in the US so far. The Vision feature - again, given your opt-in permission - analyzes the content of your screen and can provide help in terms of instructing you on how to use apps, or achieve certain tasks in Windows 11. It can even help with troubleshooting when things have gone wrong in the OS, or provide tips in a game. All of this can be facilitated with your voice, given Copilot Voice and Vision working in tandem. All of which is well and good, but what does AI actually do for you in Windows 11? Microsoft further explains that it has some nifty new powers inbound, which will be in testing (preview releases) soon. First up, the Windows 11 taskbar will get an Ask Copilot bar, complete with one-click access to Copilot Voice and Vision via their icons (goggles and a mic), should you enable this. We're also promised a faster, better Windows search function with this new functionality (it's about time - and notably this doesn't involve giving Copilot access to your files, nothing is changed in that respect under the hood). However, Microsoft's big move with AI (and agents) coming to testing is the introduction of Copilot Actions for the files on your PC. If Copilot Actions rings a bell, it's because this is something Microsoft has previously introduced for the web, meaning the AI can go online for you to complete tasks such as making a hotel booking, or buying tickets for a concert. In a new 'experimental mode' in Copilot Labs for testers, Microsoft will allow for AI Actions to be taken with files on the local drive in Windows 11. That means you can get AI to sort through your recent vacation photos, for example, or pull some specific info from a document. You just need to describe what you want doing (using your voice, if you prefer), and the AI agent will "attempt to complete it by interacting with desktop and web applications", Microsoft informs us. You can leave the AI to it, and pop back to check on its progress as and when you wish. The potential for AI making mistakes is always present, of course, and Microsoft underlines that "real-world testing of this experience is critical" because of this - and that it'll be starting with a "narrow set of use cases" in a slow and cautious manner. Microsoft underlines that security will clearly be a vital consideration here, and defending against new threats that such a system would introduce, such as cross-prompt injection attacks which could override instructions to AI agents. Microsoft says it's establishing a "set of durable security and privacy principles that must be met to make use of new agentic capabilities in Windows", and that includes limiting agentic privileges and permissions (to files you allow the AI to work with). As well as Copilot Actions, Microsoft has a new general AI agent for Windows 11 called Manus, which can tackle complex tasks, with the software giant explaining that it can create a website for you. Using the Manus AI action in File Explorer, you can gather a set of documents and images in a folder, and get Manus to build a website based on that material - which sounds seriously impressive. Microsoft is also bringing in more Copilot connectors, in order to link services like Gmail to the Copilot app, so you can ask the AI about your upcoming appointments logged with Google, for example. The Copilot app will also be able to help fine-tune your PC settings, as Microsoft has already revealed. All of this is in the works, of course, and not even in testing yet - so much of what we're talking about here could be some way off. Particularly the idea of letting Copilot loose to work with your files on the desktop, which Microsoft needs to be very careful with the implementation of, as noted on the security front. Don't underestimate what Microsoft is planning here. The idea of Copilot Actions is that it's an AI agent which takes on tasks you give it and completes them by "interacting with your apps and files, using vision and advanced reasoning to click, type and scroll like a human would." This is partly what Microsoft means by using your mouse and keyboard a lot less. It isn't just about giving voice commands in Windows 11, or voice queries to the Copilot app, it's also about the AI actually doing stuff for you in the operating system: Voice, Vision, and Actions. Microsoft is certainly emphasizing how important voice input is though, noting that the more detail and context you share in an AI query to Copilot, the better the response - but that typing it all out is a pain. Mehdi observes that because of this, when people use voice, "they engage with Copilot twice as much as when they use text", and the new wake word (Hey Copilot) is a way of making interacting with Copilot even easier on the desktop. Mehdi underlines: "We believe this shift to conversational input will be as transformative as the mouse and keyboard in terms of unlocking new capabilities on the PC for the broadest set of people." It's certainly clear that this is a big moment for Windows 11. Thus far, when it comes to AI, much of the criticism is about the features therein being underwhelming - but the powers covered here are more far-reaching and potentially impressive. As is the scope of the abilities coming to the Copilot app broadly for all PCs, not just Copilot+ laptops.
[20]
Microsoft hopes you get work done on Windows 11 PCs by simply talking to Copilot
"Hey Copilot, open the vacation planner sheet and add Kyle to the pool." "Hey Alexa, turn on the kitchen lights." "Hey Google, remind me at 4 to pick up the laundry." Consumers have been talking to assistants and getting work done for years. Now, Microsoft is jumping into the mix, and this shift could forever change how we interact with computers. Say hello to the new language of Windows 11 PCs -- "Hey Copilot." What's changing? Microsoft has today announced that it is turning every Windows 11 PC into an AI PC, and at the center of those ambitions is the Copilot AI assistant. The company has announced that it is rolling out access to Copilot Vision and Copilot Voice to all users. These two multi-modal capabilities will allow users to interact with their PC using voice commands, once they've enabled the conversation feature in the Copilot app. These two features tap into a far more ambitious idea - Copilot Actions -- a system that will be rolled out as a preview first. Think of it as an agent that can work on your behalf. So far, Copilot Actions have been limited to web-based activities. Now, the AI can handle tasks locally by accessing files stored on your computer. Recommended Videos With a simple voice command, Copilot can take actions across files, such as pulling information from a PDF file, opening an app to perform the desired task, or finding pictures. All of this happens autonomously and in the background, so that you can focus on other tasks. It's like interacting with the Copilot agents in Office apps, OpenAI's operator tool, or using Anthropic's Claude to create and handle file edits with natural language commands, without even having to open those files. "We believe this shift to conversational input will be as transformative as the mouse and keyboard in terms of unlocking new capabilities on the PC for the broadest set of people," the company shared in press material. Microsoft assures that when Copilot is working autonomously, users can intervene at any stage and take control. "When sensitive actions or important decisions are involved, Copilot Actions may request additional user approval to take those steps," the company says. What can Copilot do? With Copilot Vision, the AI assistant is aware of whatever is flashing on your screen. That means it can answer your questions, give tips, or even with in-game guidance. This ties in with the "Highlights" feature that will guide users through any task they need. From helping with photo edits to making travel plans, it will assess the on-screen content and offer the necessary step-by-step suggestions. The understanding runs deeper than visuals within Microsoft apps, such as Excel, PowerPoint, and Word. In these apps, Copilot Vision can analyze an entire data sheet or document and get work done. For users who are in the Insider test pool, they will also be able to engage in text-based conversations with Copilot Vision, instead of just speaking and listening. The new Ask Copilot tool in the Windows 11 Taskbar will let users summon Copilot Vision or Voice with a single click. Microsoft is also expanding Copilot Connectors, which allow users to access the AI assistant across services such as OneDrive and Outlook, as well as third-party services such as Google Drive, Gmail, and Contacts. The idea is similar to ChatGPT connectors, and a similar implementation within Perplexity's Comet browser. Simply put, Copilot will access all the data stored across these services and get work done, from giving an overview of meeting schedules to finding documents stored in a cloud drive.
[21]
Microsoft brings you Windows 11, now including AI updates where you talk to your laptop all day | Fortune
Microsoft ended free security support for Windows 10 this week, though millions of people still use personal computers running the older operating system. To entice people to upgrade, the software giant on Thursday announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Among the features is a voice mode that enables users to dictate "Hey, Copilot" to start chatting with their computer instead of typing or clicking a touchpad. Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. But many people around the world still are using Windows 10, particularly those with older computers that can't upgrade to Windows 11. Consumer advocates have spent months petitioning Microsoft to extend technical support for an estimated hundreds of millions of devices that will no longer get automatic security fixes. "With the end of Windows 10, users face the choice between exposing themselves to cyberattacks or discarding their old computers and buying new ones," said Brenna Stevens of the Oregon State Public Interest Research Group, which advocated on behalf of local repair shops, students and others. Microsoft has said people can pay extra for a year of extended security support through October 2026. Some users, including those in the European Union as well as U.S. users who can synchronize with Microsoft's cloud service, will be able to get that extended support for free. But most people faced with unsupported devices are likely to either keep using them despite the vulnerabilities or throw them away, which "creates both a security problem and an environmental problem," generating huge amounts of toxic electronic waste, said Nathan Proctor, who leads PIRG's Right to Repair campaign. Both PIRG and Microsoft urge those who are replacing their computers to avoid sending their older models to the landfill. Those concerns were not a focus of Microsoft's Windows 11 announcements Thursday. Instead, Yusuf Mehdi, an executive vice president and chief marketing officer for Microsoft's consumer division, argued that conversing with a laptop will be "as transformative as the mouse and keyboard" in shaping the PC experience. Microsoft says all Windows 11 users will also now have access to Copilot Vision, an AI feature that can analyze and give feedback on the documents, video games and other activities happening on the screen. Mehdi acknowledged it could take some adjustment to get used to human-computer conversations in shared workspaces. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen," Mehdi told reporters. The updates are Microsoft's latest attempt to make its widely used Windows operating system a gateway to hook people on its suite of generative AI tools. The tech giant competes heavily on AI services with Apple, Google and startups like Anthropic and OpenAI. Mehdi said the updates are "not a replacement for Recall," a screen-tracking feature on some Windows computers that gives Copilot a "photographic memory" of a user's virtual activity. Microsoft CEO Satya Nadella described it last year as a step toward machines that "instantly see us, hear, reason about our intent and our surroundings," but the idea was met with criticism from privacy and security experts and took a year before it started to roll out.
[22]
Microsoft supercharges Copilot with Google integration, smarter vision
Microsoft's Copilot AI technologies will be able to see more and connect to a greater range of files. Copilot Vision's eyesight is improving, as the integrated Windows AI technology will soon be able to see entire documents, plus link to apps like Google Drive via a new connectors function. Separately, Microsoft is adding Copilot to the Windows 11 taskbar and making "Hey Copilot" a wake word for the Windows AI app. It's part of the company's effort to expand its presence across your PC. The biggest update, though, is Copilot Actions, which will let the assistant actually modify files and system settings. Copilot Vision is the "visual" aspect of Copilot, able to "see" your PC's screen and guide you through troubleshooting steps. In my hands-on testing, I found it more than capable of assisting with certain tasks, though it struggled consistently to recognize on-screen symbols in simple games like Solitaire. Microsoft plans to improve it in one key area: right now, it can only see what you see. Soon, in Office apps (Word, PowerPoint, and Excel), it will be able to view the entire document, even sections not currently visible on your screen. Copilot Vision is also rolling out to all markets where Copilot is available, Microsoft said. You won't need a specialized PC either; if you have Copilot, you'll have Vision capabilities. Microsoft's basic Copilot functions are also being beefed up, widening their scope as well. To date, Copilot has been a tool to surf the web. Microsoft sees it as a source of knowledge, a way to browse, pull in contextual information, and eventually serve as a platform for agents that can perform tasks like shopping. Originally, Microsoft indicated that Copilot would be able to adjust Windows settings, such as turning your PC to dark mode. The company later backed off that plan but added a feature called Direct Settings Access, which lets users ask Copilot to guide them to the proper Windows setting. Copilot will soon be able to connect to other services as well, including OneDrive files and Outlook contacts, emails, and calendar events. You can also link it to Google services like Google Drive, Gmail, Google Calendar, and Google Contacts. In addition, you'll be able to take a Copilot response and automatically drop it into a formatted document, spreadsheet, or presentation. Microsoft tipped a version of this feature on October 10th when it announced the feature for Windows Insiders. The connectors allow for more useful, broader queries, including hunting down a particular paper or simply asking Copilot when your dentist appointment is. Of course, you'll have the choice to turn on these connections yourself or else leave Copilot alone. If Statcounter's metrics are right, ChatGPT's usage far surpasses Copilot's, with its 78 percent share outweighing the latter's 10 percent share by about eight to one. Still, Windows and Copilot are among the first things most people see each day, and the company is banking on making it more useful and prominently integrated.
[23]
Microsoft pushes 'transformative' AI updates in Windows 11
Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. Microsoft is encouraging people to talk to their laptops as it rolls out new artificial intelligence (AI) updates to Windows 11 and pushes users to phase out its predecessor, Windows 10. Microsoft ended free security support for Windows 10 this week, though millions of people still use personal computers running the older operating system. To entice people to upgrade, the software giant on Thursday announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Among the features is a voice mode that enables users to dictate "Hey, Copilot" to start chatting with their computer instead of typing or clicking a touchpad. Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. But many people around the world still are using Windows 10, particularly those with older computers that can't upgrade to Windows 11. Consumer advocates have spent months petitioning Microsoft to extend technical support for an estimated hundreds of millions of devices that will no longer get automatic security fixes. "With the end of Windows 10, users face the choice between exposing themselves to cyberattacks or discarding their old computers and buying new ones," said Brenna Stevens of the Oregon State Public Interest Research Group in the United States. Microsoft has said people can pay extra for a year of extended security support through October 2026. Some users, including those in the European Union as well as US users who can synchronise with Microsoft's cloud service, will be able to get that extended support for free. Those concerns were not a focus of Microsoft's Windows 11 announcements on Thursday. Instead, Yusuf Mehdi, an executive vice president and chief marketing officer for Microsoft's consumer division, argued that conversing with a laptop will be "as transformative as the mouse and keyboard" in shaping the PC experience. Microsoft says all Windows 11 users will also now have access to Copilot Vision, an AI feature that can analyse and give feedback on the documents, video games, and other activities happening on the screen. Mehdi acknowledged it could take some adjustment to get used to human-computer conversations in shared workspaces. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen," Mehdi told reporters. The updates are Microsoft's latest attempt to make its widely used Windows operating system a gateway to hook people on its suite of generative AI tools. The tech giant competes heavily on AI services with Apple, Google, and startups like Anthropic and OpenAI. Mehdi said the updates are "not a replacement for Recall," a screen-tracking feature on some Windows computers that gives Copilot a "photographic memory" of a user's virtual activity. Microsoft CEO Satya Nadella described it last year as a step toward machines that "instantly see us, hear, reason about our intent and our surroundings," but the idea was met with criticism from privacy and security experts and took a year before it started to roll out.
[24]
Microsoft pushes AI updates in Windows 11 as it ends support for Windows 10
Microsoft is encouraging people to talk to their laptops as it rolls out new artificial intelligence updates to Windows 11 and pushes users to phase out its predecessor, Windows 10. Microsoft ended free security support for Windows 10 this week, though millions of people still use personal computers running the older operating system. To entice people to upgrade, the software giant on Thursday announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Among the features is a voice mode that enables users to dictate "Hey, Copilot" to start chatting with their computer instead of typing or clicking a touchpad. Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. But many people around the world still are using Windows 10, particularly those with older computers that can't upgrade to Windows 11. Consumer advocates have spent months petitioning Microsoft to extend technical support for an estimated hundreds of millions of devices that will no longer get automatic security fixes. "With the end of Windows 10, users face the choice between exposing themselves to cyberattacks or discarding their old computers and buying new ones," said Brenna Stevens of the Oregon State Public Interest Research Group, which advocated on behalf of local repair shops, students and others. Microsoft has said people can pay extra for a year of extended security support through October 2026. Some users, including those in the European Union as well as U.S. users who can synchronize with Microsoft's cloud service, will be able to get that extended support for free. But most people faced with unsupported devices are likely to either keep using them despite the vulnerabilities or throw them away, which "creates both a security problem and an environmental problem," generating huge amounts of toxic electronic waste, said Nathan Proctor, who leads PIRG's Right to Repair campaign. Both PIRG and Microsoft urge those who are replacing their computers to avoid sending their older models to the landfill. Those concerns were not a focus of Microsoft's Windows 11 announcements Thursday. Instead, Yusuf Mehdi, an executive vice president and chief marketing officer for Microsoft's consumer division, argued that conversing with a laptop will be "as transformative as the mouse and keyboard" in shaping the PC experience. Microsoft says all Windows 11 users will also now have access to Copilot Vision, an AI feature that can analyze and give feedback on the documents, video games and other activities happening on the screen. Mehdi acknowledged it could take some adjustment to get used to human-computer conversations in shared workspaces. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen," Mehdi told reporters. The updates are Microsoft's latest attempt to make its widely used Windows operating system a gateway to hook people on its suite of generative AI tools. The tech giant competes heavily on AI services with Apple, Google and startups like Anthropic and OpenAI. Mehdi said the updates are "not a replacement for Recall," a screen-tracking feature on some Windows computers that gives Copilot a "photographic memory" of a user's virtual activity. Microsoft CEO Satya Nadella described it last year as a step toward machines that "instantly see us, hear, reason about our intent and our surroundings," but the idea was met with criticism from privacy and security experts and took a year before it started to roll out.
[25]
Windows 11 update turns every PC into an "AI PC" with hands-free Copilot
The company says it is "rewriting the operating system around AI" to create the true "AI PC." As Microsoft officially ends support for Windows 10, the company is rolling out a significant update to Windows 11, introducing a suite of new artificial intelligence features designed to transform every PC into an "AI PC." The new capabilities, including a hands-free "Hey, Copilot!" wake word, are not limited to new Copilot Plus hardware and aim to integrate AI more deeply into the daily user experience. Microsoft's goal is to fundamentally change how users interact with their computers, moving beyond the keyboard and mouse to embrace voice as a primary input. "The vision that we have is: let's rewrite the entire operating system around AI, and build essentially what becomes truly the AI PC," said Yusuf Mehdi, Microsoft's consumer chief marketing officer, in a briefing. The company envisions an AI that can understand what a user is doing and seeing on their screen, and with permission, take actions on their behalf. "We want every person making the move to experience what it means to have a PC that's not just a tool, but a true partner," Mehdi added. Central to this vision is the new "Hey, Copilot!" wake word, which is now rolling out to Windows 11 PCs. This allows users to activate the AI assistant hands-free. "In our minds, voice will now become the third input mechanism to use with your PC," said Mehdi. While Microsoft has previously attempted to popularize voice assistants like Cortana with limited success, the company believes the advancements in AI will spark a change in user behavior. Mehdi pointed to the widespread use of voice in Microsoft Teams meetings as evidence that people are already comfortable talking through their computers. To enable the AI to act on a user's behalf, it must first be able to understand the on-screen context. This is handled by Copilot Vision, a feature now rolling out worldwide. Unlike the controversial Recall feature, which automatically took screenshots, Copilot Vision is an opt-in function where a user actively streams their screen to the AI to get help with apps, troubleshoot problems, or receive step-by-step guidance. The next step is Copilot Actions, which allows the AI to perform tasks directly on the PC, such as editing a folder of photos. This feature is launching in a limited preview through Copilot Labs and operates in a "secure and contained environment." Users can watch as the AI agent lists and completes the steps required for a given task. "In the beginning you might see the agent make some mistakes," acknowledged Navjot Virk, corporate vice president of Windows Experiences, explaining the cautious, preview-first approach. To make these new tools accessible, Microsoft is integrating Copilot directly into the Windows 11 taskbar. This update coincides with a new marketing campaign, including television ads with the tagline "meet the computer you can talk to," aimed at encouraging Windows 10 users to upgrade. However, after the significant privacy backlash from its Recall feature last year, Microsoft faces a challenge in convincing users to trust these new, more capable AI features. Building that trust will be critical as the company pushes forward with its vision of a computer that listens, sees, and acts for its user.
[26]
Microsoft pushes AI updates in Windows 11 as it ends support for Windows 10
Microsoft is encouraging people to talk to their laptops as it rolls out new artificial intelligence updates to Windows 11 and pushes users to phase out its predecessor, Windows 10. Microsoft ended free security support for Windows 10 this week, though millions of people still use personal computers running the older operating system. To entice people to upgrade, the software giant on Thursday announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Among the features is a voice mode that enables users to dictate "Hey, Copilot" to start chatting with their computer instead of typing or clicking a touchpad. Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. But many people around the world still are using Windows 10, particularly those with older computers that can't upgrade to Windows 11. Consumer advocates have spent months petitioning Microsoft to extend technical support for an estimated hundreds of millions of devices that will no longer get automatic security fixes. "With the end of Windows 10, users face the choice between exposing themselves to cyberattacks or discarding their old computers and buying new ones," said Brenna Stevens of the Oregon State Public Interest Research Group, which advocated on behalf of local repair shops, students and others. Microsoft has said people can pay extra for a year of extended security support through October 2026. Some users, including those in the European Union as well as U.S. users who can synchronize with Microsoft's cloud service, will be able to get that extended support for free. But most people faced with unsupported devices are likely to either keep using them despite the vulnerabilities or throw them away, which "creates both a security problem and an environmental problem," generating huge amounts of toxic electronic waste, said Nathan Proctor, who leads PIRG's Right to Repair campaign. Both PIRG and Microsoft urge those who are replacing their computers to avoid sending their older models to the landfill. Those concerns were not a focus of Microsoft's Windows 11 announcements Thursday. Instead, Yusuf Mehdi, an executive vice president and chief marketing officer for Microsoft's consumer division, argued that conversing with a laptop will be "as transformative as the mouse and keyboard" in shaping the PC experience. Microsoft says all Windows 11 users will also now have access to Copilot Vision, an AI feature that can analyze and give feedback on the documents, video games and other activities happening on the screen. Mehdi acknowledged it could take some adjustment to get used to human-computer conversations in shared workspaces. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen," Mehdi told reporters. The updates are Microsoft's latest attempt to make its widely used Windows operating system a gateway to hook people on its suite of generative AI tools. The tech giant competes heavily on AI services with Apple, Google and startups like Anthropic and OpenAI. Mehdi said the updates are "not a replacement for Recall," a screen-tracking feature on some Windows computers that gives Copilot a "photographic memory" of a user's virtual activity. Microsoft CEO Satya Nadella described it last year as a step toward machines that "instantly see us, hear, reason about our intent and our surroundings," but the idea was met with criticism from privacy and security experts and took a year before it started to roll out.
[27]
Microsoft is bringing your favorite Windows 10 feature back from the dead: get ready for "Hey Copilot"
Is Microsoft about to reveal Windows 12? Are we about to see a whole new operating system? That's been the speculation, as on the back of Windows 10 reaching its official end of life, Microsoft spent the rest of the week teasing a big reveal set to hit our screens on Thursday. Well, it's Thursday, and we can now reveal that it's time to calm down. Microsoft Copilot is receiving a new voice mode, with a dedicated wake word: "Hey, Copilot." "Hey Cortana" is back This time it's the gateway to AI It's fitting that as Microsoft's Windows 10 chapter closes, it opens the next one with one of its key phrases. When Windows 10 launched in 2015, it had a new virtual assistant at its core: Cortana. The much-maligned virtual desktop assistant's wake word was "Hey Cortana," and from there, you could ask it to complete a variety of tasks to extremely varying levels of success. At the time, articles on removing Cortana and stripping it from Windows 10 were flying off the shelves faster than Microsoft's Christmas Sweaters, and it was largely ridiculed as Clippy but somehow less useful. Now, Microsoft is bringing "Hey Copilot" to your Copilot+ PC or laptop, allowing you to call upon Microsoft's AI assistant without moving your mouse. Once called, you interact with Copilot just as you would using a keyboard, or if you'd opted to use Copilot's voice mode manually. The update focuses on one of the core issues many people have with AI. Knowing how to prompt an AI is an enormous challenge, even for those interested in tech and with an understanding of how AI prompting works. Enabling more direct interaction with Copilot using voice should enable more natural explanations as to what you want to achieve, helping to remove some of the limitations of written prompts. It's worth noting that Copilot has a voice mode already -- this just makes it easier to access. Agentic AI for your desktop Copilot Actions for Windows 11 could be great Now, "Hey Copilot" on its own isn't hugely thrilling. But when paired with another new feature coming to Windows 11, it could be much more useful. In May 2025, Microsoft revealed Copilot Actions, its agentic AI that helps you navigate the web. It's basically like how Opera's Neon browser can be set to a task and just gets on with the job until it's complete. But Microsoft isn't limiting that to your browser any longer. Copilot Actions will be moving into your Windows 11 desktop, able to update documents, organize files, send emails, and more. The experimental mode will be available to Windows Insiders in Copilot Labs first, starting with a limited range of functionality. However, in time, those functions will grow into more complex uses, all the time enabling you to focus on getting other work done as Copilot handles the mundane stuff. There are obviously some considerable security and privacy risks associated with this, mind. Microsoft is using specific agent accounts for your desktop that have limited privileges. Wholesale changes will still require final sign-off from you, and there will be options to limit the files the AI can interact with. During the experimental preview of Copilot Actions, the agent will have access to a limited set of the user's local known folders -- such as Documents, Downloads, Desktop, or Pictures -- and other resources that are accessible to all accounts on the system. Only when the user provides authorization can Copilot Actions access data outside of these folders. Standard Windows security mechanisms like access control lists (ACLs) help prevent unauthorized use. Further to this, Microsoft is using the testing phase to understand more about the level of granular controls required to make a tool like Copilot Actions in Windows 11 a success, with ways to "authorize, monitor, and take over agent actions in agent workspace" currently being worked on. To do all of this, Microsoft is rolling out Copilot Vision worldwide, with full desktop and app sharing. So, it's a really interesting step forward, but one that's still very much under development. AI is coming to your File Explorer, too Automate all the things Interestingly, Microsoft is also opting to integrate the Manus AI agent into File Explorer. I'm not completely clear why Manus is being used here and Copilot is being used for Actions, or how the two will interact in the future, but for now, this AI chatbot will live in File Explorer. Microsoft envisages Manus as acting like a type of AI agent that can help you with "complex tasks." The example given is that you'll be able to select a document and some images, right-click, and select "Create a website with Manus." Then, watch the magic unfold as it presumably builds an entire webpage from scratch. Microsoft says it will use the Model Context Protocol, a new agentic AI framework, to find the right documents, images, and so on, to get the job done. If that's the case, it'll be an impressive implementation of AI on the desktop. Have you had enough Copilot AI yet? Eat up, there is plenty more to come Although Microsoft led its raft of Copilot announcements with the somewhat tame "Hey Copilot" prompt, there are some interesting updates to go with it. And while the official Windows account brought the hype with its teasing tweet, it's not a complete let-down. The issue with these big announcements is that AI fatigue is real, and most folks just don't really care. Copilot+ PCs and laptop sales are increasing, but only because that's becoming the default spec. Most people just don't need this level of AI integration in their lives, and while there will be some uses for it, Microsoft seems focused on more marginal uses at the current time. That said, Copilot Actions in Windows 11 could be really useful if it brings the hands-off-getting-stuff-done productivity of browser-based agentic AI to the desktop. But even that brings its own enormous privacy and security issues, and will take some serious time to get used to, let alone to trust.
[28]
Microsoft Pushes AI Updates in Windows 11 as It Ends Support for Windows 10
Microsoft is encouraging people to talk to their laptops as it rolls out new artificial intelligence updates to Windows 11 and pushes users to phase out its predecessor, Windows 10. Microsoft ended free security support for Windows 10 this week, though millions of people still use personal computers running the older operating system. To entice people to upgrade, the software giant on Thursday announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Among the features is a voice mode that enables users to dictate "Hey, Copilot" to start chatting with their computer instead of typing or clicking a touchpad. Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. But many people around the world still are using Windows 10, particularly those with older computers that can't upgrade to Windows 11. Consumer advocates have spent months petitioning Microsoft to extend technical support for an estimated hundreds of millions of devices that will no longer get automatic security fixes. "With the end of Windows 10, users face the choice between exposing themselves to cyberattacks or discarding their old computers and buying new ones," said Brenna Stevens of the Oregon State Public Interest Research Group, which advocated on behalf of local repair shops, students and others. Microsoft has said people can pay extra for a year of extended security support through October 2026. Some users, including those in the European Union as well as U.S. users who can synchronize with Microsoft's cloud service, will be able to get that extended support for free. But most people faced with unsupported devices are likely to either keep using them despite the vulnerabilities or throw them away, which "creates both a security problem and an environmental problem," generating huge amounts of toxic electronic waste, said Nathan Proctor, who leads PIRG's Right to Repair campaign. Both PIRG and Microsoft urge those who are replacing their computers to avoid sending their older models to the landfill. Those concerns were not a focus of Microsoft's Windows 11 announcements Thursday. Instead, Yusuf Mehdi, an executive vice president and chief marketing officer for Microsoft's consumer division, argued that conversing with a laptop will be "as transformative as the mouse and keyboard" in shaping the PC experience. Microsoft says all Windows 11 users will also now have access to Copilot Vision, an AI feature that can analyze and give feedback on the documents, video games and other activities happening on the screen. Mehdi acknowledged it could take some adjustment to get used to human-computer conversations in shared workspaces. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen," Mehdi told reporters. The updates are Microsoft's latest attempt to make its widely used Windows operating system a gateway to hook people on its suite of generative AI tools. The tech giant competes heavily on AI services with Apple, Google and startups like Anthropic and OpenAI. Mehdi said the updates are "not a replacement for Recall," a screen-tracking feature on some Windows computers that gives Copilot a "photographic memory" of a user's virtual activity. Microsoft CEO Satya Nadella described it last year as a step toward machines that "instantly see us, hear, reason about our intent and our surroundings," but the idea was met with criticism from privacy and security experts and took a year before it started to roll out.
[29]
Microsoft Windows 11 download, new features: What to know after free security support for Windows 10 ends?
Microsoft announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Microsoft is encouraging people to talk to their laptops as it rolls out new artificial intelligence updates to Windows 11 and pushes users to phase out its predecessor, Windows 10. Microsoft ended free security support for Windows 10 this week, though millions of people still use personal computers running the older operating system. Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. To entice people to upgrade, the software giant on Thursday announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Among the features is a voice mode that enables users to dictate "Hey, Copilot" to start chatting with their computer instead of typing or clicking a touchpad. But many people around the world still are using Windows 10, particularly those with older computers that can't upgrade to Windows 11. Consumer advocates have spent months petitioning Microsoft to extend technical support for an estimated hundreds of millions of devices that will no longer get automatic security fixes. "With the end of Windows 10, users face the choice between exposing themselves to cyberattacks or discarding their old computers and buying new ones," said Brenna Stevens of the Oregon State Public Interest Research Group, which advocated on behalf of local repair shops, students and others. Microsoft has said people can pay extra for a year of extended security support through October 2026. Some users, including those in the European Union as well as U.S. users who can synchronize with Microsoft's cloud service, will be able to get that extended support for free. But most people faced with unsupported devices are likely to either keep using them despite the vulnerabilities or throw them away, which "creates both a security problem and an environmental problem," generating huge amounts of toxic electronic waste, said Nathan Proctor, who leads PIRG's Right to Repair campaign. Both PIRG and Microsoft urge those who are replacing their computers to avoid sending their older models to the landfill. Those concerns were not a focus of Microsoft's Windows 11 announcements Thursday. Instead, Yusuf Mehdi, an executive vice president and chief marketing officer for Microsoft's consumer division, argued that conversing with a laptop will be "as transformative as the mouse and keyboard" in shaping the PC experience. Microsoft says all Windows 11 users will also now have access to Copilot Vision, an AI feature that can analyze and give feedback on the documents, video games and other activities happening on the screen. Mehdi acknowledged it could take some adjustment to get used to human-computer conversations in shared workspaces. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen," Mehdi told reporters. The updates are Microsoft's latest attempt to make its widely used Windows operating system a gateway to hook people on its suite of generative AI tools. The tech giant competes heavily on AI services with Apple, Google and startups like Anthropic and OpenAI. Mehdi said the updates are "not a replacement for Recall", a screen-tracking feature on some Windows computers that gives Copilot a "photographic memory" of a user's virtual activity. Microsoft CEO Satya Nadella described it last year as a step toward machines that "instantly see us, hear, reason about our intent and our surroundings," but the idea was met with criticism from privacy and security experts and took a year before it started to roll out. Q1. When was Microsoft Windows 10 first introduced? A1. Microsoft first introduced Windows 10 a decade ago. Q2. When was Microsoft Windows 11 first introduced? A2. Microsoft Windows 11 was first launched in 2021.
[30]
Microsoft Windows 11 Receives Agentic AI Updates
'When you can bring AI sort of natively into some of these experiences, you'll make it easier, you'll make it more intuitive for people,' says Microsoft Consumer Chief Marketing Officer and Executive Vice President Yusuf Mehdi. Days after Microsoft ended support for Windows 10, the vendor is updating its Windows 11 operating system with new capabilities to bring artificial intelligence capabilities beyond Copilot+ PCs, including a way to activate Copilot through voice, analyze content on screen and in files, and move text from one file into a different kind of file. The Redmond, Wash.-based tech giant said that capabilities coming soon to Windows Insider members include talking to Copilot Vision with text, Ask Copilot in the taskbar and leveraging the agentic Copilot Actions for interacting with local files. "We're on the cusp of the next evolution, which is where AI happens not just in that chatbot but gets naturally integrated into the hundreds of millions of experiences that people use every day," Microsoft Consumer Chief Marketing Officer and Executive Vice President Yusuf Mehdi said in a press briefing. "When you can bring AI sort of natively into some of these experiences, you'll make it easier, you'll make it more intuitive for people." [RELATED: MSP Execs Expect Windows 11 Migrations To Continue Long After Tuesday Support End Date] Mark Linton, Microsoft's vice president for device partner sales, told CRN in an email that partners have been "critical in working with customers for all aspects of migration planning." "We've seen strong engagement from across the ecosystem in helping customers plan and execute migrations or manage" extended security updates for giving Win10 users some security after support ended Tuesday, he said. The vendor has about 500,000 partners worldwide. Top channel goals for 2025 include increasing the overall percentage of company revenue that comes through the channel and improving partner profitability, according to CRN's 2025 Channel Chiefs. Mike Wilson, partner and CTO at Mason, Ohio-based Microsoft solution provider Interlink Cloud Advisors -- No. 451 on CRN's 2025 Solution Provider 500 -- told CRN in a recent interview that AI agents have proven a big opportunity for his company. Interlink has been leveraging Microsoft's Copilot Studio to build agents and using Azure AI Foundry to transform traditional business process automation, he said. "Everybody knows, 'I've got to do something with AI for my business,'" Wilson said. "But figuring out what that is is the $1 million challenge for everybody -- both on the reseller side and on the businesses taking advantage of it." Microsoft pledges that, as part of its security commitments with Copilot Actions, the tool is off by default with users having the ability to pause, take control and disable Actions whenever they want. Copilot Actions has a setting for mandating approval requests for specific actions involving sensitive and important decisions. And the vendor said it is seeking any additional security and privacy controls feedback on Actions. With people typing up to 14,000 words a day on their keyboards, voice interaction with PCs is a new modality for users, he said. "It doesn't replace the keyboard and mouse necessarily, but it's an additive thing," he said. "This will be pretty profound." About 1.6 billion PCs run Windows, Mehdi said during the press briefing. The updates are "going to be the key thing to bridge between some of the AI hype we've got and the reality of what people are facing so they can more easily discover and create and achieve what they want on Windows with Copilot at their side." None of the new updates replace the Recall feature Microsoft has been working on to improve search on AI PCs, the CMO said. "We're bringing a lot of these powerful Copilot capabilities to everybody on Windows 11," he said. "People are really loving the capabilities. Can we bring it to more PCs more quickly and enable more innovation?" The ability to activate Copilot Voice through saying, "Hey Copilot" to the Win11 PC is now generally available, according to Microsoft. Users can enable the "wake word" in the settings of the Copilot application. Saying the phrase prompts a Copilot microphone on screen with a chime to signal Copilot is listening. Users can end the conversation by saying "goodbye" or tapping "X." Copilot ends the conversation automatically after a few seconds without interaction, with a chime signaling the conversation ended. Now available in the same markets as Copilot is Copilot Vision, which allows the AI tool to analyze content and answer questions based on desktop and applications shared with the tool. Users can vocally ask Copilot "show me how" to get directions on a task within an app. Use cases include telling users how to improve photos or reviewing travel itineraries with advice on how to improve plans, according to Microsoft. Users can share Word, Excel and PowerPoint files with Copilot Vision, which can read files beyond what is displayed on screen. The text-based way to communicate with Copilot for users who don't want people nearby to hear what they are working on is coming "soon" to Windows Insider members, according to Microsoft. Until then, Vision users only have the option to interact with the tool through their voices, with Copilot speaking aloud. Once text-based communication is enabled, Copilot will respond with text in the same chat window. Mehdi acknowledged that learning to type longer queries to give AI tools all the context they need compared with the 2.3 keywords per query traditional search engine users type on average has been a "big challenge," something Vision might have the ability to ease. Allowing voice-enabled AI should appeal to the "hundreds of millions of people today [who] talk for billions of minutes in offices with headphones," Mehdi said. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen." Users also now have the ability to ask Copilot to export text from one file into a Word, Excel or PowerPoint project, according to the vendor. A new Copilot on Windows integration with Windows Settings allows users to receive guidance on changing device settings. The taskbar Ask Copilot experience becoming an option for Windows Insiders offers one-click access to Copilot Vision and Voice. A preview for Copilot Actions comes "soon" for Windows Insiders in Copilot Labs looking to allow the tool to sort through local files and extract information from them. Copilot Actions is a general-purpose AI agent that tries to complete tasks described in the user's own words, according to Microsoft. It can interact with desktop and web apps, freeing the user to do other tasks while the agent acts. Users have the ability to take over the task the agent is handling whenever they want. They can also check the agent's progress and review actions taken to complete the task, according to the vendor. Microsoft will only allow a narrow set of use cases in the beginning and optimize model performance based on learnings. The company warned that the agent may make mistakes and hit challenges with more complex interfaces. A private preview is available for Windows 11 users who want to use the Manus general AI agent as a native Windows app to make websites with documents in a local folder with one click, no uploading and no coding. Users can leverage Manus from a chat window without leaving the session. Microsoft is also adding the ability to edit videos in File Explorer with Filmora. For Windows Insider members with Copilot+ PCs, a Zoom integration with Click to Do will allow Zoom meeting scheduling through hovering over an email address on screen without switching applications or copying details, according to Microsoft. Microsoft Entra and Microsoft account identity support are part of the defense measures coming soon for Copilot Actions, according to the vendor. Microsoft has also published a series of security and privacy principles meant to help users who leverage AI agents. The vendor also warned agent users about cross-prompt injection when using agents that can result in malicious content embedded in user interface elements or documents overriding agent instructions and leading to data exfiltration or malware installation. Part of those principles is the ability for agents in Windows to operate with dedicated accounts distinct from the user account on the device, giving agents policies that can be different from the rules applied to human user accounts. Human users have the ability to share access to files and other resources to dedicated agent accounts like they do with other device users, according to Microsoft. Agents start with limited permissions and only obtain access to resources given permission by users. Agents can't make changes to devices without human intervention, and users can revoke permissions and access any time. Trusted sources must sign for agents integrated with Windows to allow for certificate validation, antivirus and other defense measures to revoke and block malicious agents, according to Microsoft. Copilot Actions security controls include the agent being disabled by default and an agent workspace contained environment where agents work in parallel with humans with runtime isolation and granular permissions. The agent has its own desktop with limited visibility and access to the user's desktop activity, according to the vendor. Agent accounts also help with distinguishing work by the agent and work by a human PC user. Copilot Actions' experimental preview access will only allow agents to interact with Documents, Downloads, Desktop, Pictures and other local known folders and resources accessible to all accounts on the system, according to Microsoft. Users have to authorize Copilot Actions to access data outside those folders. All the news around agents in Windows follows recent advancements revealed by Microsoft for parts of its productivity portfolio. In recent days, Microsoft has launched the Microsoft 365 Premium subscription for individuals, made Agent Mode in Copilot for Excel available for Frontier program members and made Copilot Chat available in M365 apps for individual subscribers and added Anthropic models to M365 Copilot.
[31]
Microsoft Responds To Google's Search App For Windows By Introducing New Copilot And Agentic Experiences
In the ongoing one-upmanship between Microsoft and Google, the former is now choosing to respond to latter's dedicated search app for Windows by launching sweeping Copilot and agentic experiences, aiming to turn "every Windows 11 PC into an AI PC." Microsoft believes voice commands are the most convenient way to interact with Copilot, Windows' bespoke AI-powered assistant. Therefore, Microsoft is now bringing new wake and goodbye words for Copilot to Windows 11 PCs: Microsoft is now rolling out Copilot Vision in all markets where Copilot is available. Manus AI Agent Introducing Manus, a general AI agent that can perform various tasks on your Windows 11 PC. The agent can perform complex tasks in mere minutes, such as creating a website using the documents in your local folder with just one click. Microsoft is now introducing a personal gaming sidekick, which seamlessly integrates into the Game Bar on Windows 11 PCs. Xbox PC App You can now seamlessly access your gaming library, apps, and play history in one place with Xbox on Windows PCs and supported handheld devices.
[32]
Microsoft Turns Windows 11 Into an Agentic OS with Voice, Vision, and Actions
Plus, Windows 11 is soon getting a general-purpose AI agent that can perform local tasks on your PC. Microsoft has announced a major AI update for all Windows 11 PCs that could transform it into an agentic OS. With the new update, Microsoft is aiming to make every Windows 11 PC an AI PC with Copilot at the center. First of all, Windows 11 is getting a voice-first treatment with the "Hey Copilot" wake word. You can trigger Copilot in Windows 11 hands-free and engage with the OS using your voice. You can have a natural conversation, ask questions, and say "Goodbye" to end the interaction. Microsoft has been testing the "Hey Copilot" wake word on Windows 11 Insider Builds for quite some time now, and now it's coming to all Windows 11 PCs. Besides the voice interaction, Copilot Vision can now see your entire screen and interact with you in real-time using voice. You can share an app window or the whole desktop and ask Copilot Vision questions along the way. This could be helpful for step-by-step visual guidance on the screen. The best part is that Copilot Vision highlights where to click on the screen, offering visual guidance throughout the interaction. You can share Office documents like Word, Excel and PowerPoint to get better insights and support along the way. What is surprising is that Microsoft is planning to replace the Windows 11 search bar with a new "Ask Copilot" search bar on the Taskbar. It brings one-click access to Copilot Voice and Vision. Along with that, local search is integrated into the Copilot search bar. You can search for files, apps, and settings using Copilot search on the Taskbar. Microsoft says Copilot doesn't have access to personal files and it only uses Windows APIs to look for files and apps. The new "Ask Copilot" search bar is coming to Windows Insiders first. Microsoft recently rolled out an AI agent in Windows 11 Settings, but now, Windows 11 is getting a "general-purpose" AI agent that can actually perform tasks on your Windows 11 PC, and it's not limited to the Edge browser. With Copilot Actions, you can simply describe your task and it will perform actions on your local files. For example, you can say "move or rename local files" or "extract data from PDFs or images" or "open PowerPoint and create slides". Copilot Action will interact with your desktop and web applications and complete the task for you. Note that Copilot Actions perform in a virtual environment on your PC, so you can continue doing other tasks. You can monitor the progress, stop the task, and even take control midway through the task. Basically, you get an AI agent on Windows 11 and you can use it to perform various tasks on your computer. Microsoft says it's starting with limited use cases for testing, and it's coming soon to Windows Insider in Copilot Labs. In addition, Copilot Connectors lets you link services like Outlook, Gmail, Calendar, Contacts, and OneDrive with Copilot. This functionality uses the MCP (Model Context Protocol) to connect external services with Copilot. During the Microsoft Build 2025, the company announced that MCP is coming to Windows 11, and it's finally here. You can use this feature in Copilot to find an appointment by pulling information from Outlook, checking Calendar schedule, and more. Microsoft is also integrating the Manus AI agent into Windows 11's File Explorer. You can simply right-click on any document in File Explorer and perform tasks using the Manus AI agent. For instance, you can ask it to create a website using a document on your PC. It will also be available as a standalone app on Windows 11. All in all, with these AI-centric features, Microsoft wants to make Windows 11 an AI-ready platform. And it's not limited to Copilot+ PCs, which means all Windows 11 PCs are eligible to receive these new features.
[33]
Microsoft launches new AI upgrades to Windows 11, boosting Copilot
Users can now use the wake word "Hey Copilot" to activate the AI assistant and execute voice commands in a new opt-in feature on any Windows 11 PC, Microsoft said. Microsoft on Thursday rolled out a series of artificial intelligence upgrades to Windows 11 that would make its Copilot AI assistant more appealing to users by making it easier to automate tasks and connect with services across devices. Users can now use the wake word "Hey Copilot" to activate the AI assistant and execute voice commands in a new opt-in feature on any Windows 11 PC, Microsoft said. The company is also expanding Copilot Vision - which can analyze content on users' screens and answer related questions - to all markets where Copilot is offered. Microsoft said it would also launch a feature for Windows Insiders that would allow users to engage with Vision through text, and not just with voice. The company has been racing to boost adoption and usage of Copilot, to better compete with tech giants Google and Meta that have pushed their own AI assistants through features in devices, applications and browsers. The Microsoft update also includes an experimental 'Copilot Actions' mode that enables its AI assistant to perform real-world tasks for users - such as booking restaurant reservations or ordering groceries - from the desktop. The tool expands on a similar capability first announced for the web browser in May. Microsoft said the agents will start with limited permissions, and would only obtain access to resources that a user explicitly provides. The company also launched its 'Gaming Copilot' embedded Xbox Ally consoles on Thursday, which allows players to engage with the AI assistant for real-time tips, recommendations and support. "We think we're on the cusp of the next evolution, which is where AI happens, not just in that chatbot, but gets naturally integrated into the hundreds of millions of experiences that people use every day," said Yusuf Mehdi, Microsoft's consumer chief marketing officer.
[34]
Microsoft pushes AI updates in Windows 11 as it ends support for Windows 10
Microsoft is encouraging people to talk to their laptops as it rolls out new artificial intelligence updates to Windows 11 and pushes users to phase out its predecessor, Windows 10. Microsoft ended free security support for Windows 10 this week, though millions of people still use personal computers running the older operating system. To entice people to upgrade, the software giant on Thursday announced new Windows 11 features, most of them further integrating the company's AI chatbot, Copilot, into the experience of using a laptop. Among the features is a voice mode that enables users to dictate "Hey, Copilot" to start chatting with their computer instead of typing or clicking a touchpad. Microsoft first introduced Windows 10 a decade ago and launched its successor, Windows 11, in 2021. But many people around the world still are using Windows 10, particularly those with older computers that can't upgrade to Windows 11. Consumer advocates have spent months petitioning Microsoft to extend technical support for an estimated hundreds of millions of devices that will no longer get automatic security fixes. "With the end of Windows 10, users face the choice between exposing themselves to cyberattacks or discarding their old computers and buying new ones," said Brenna Stevens of the Oregon State Public Interest Research Group, which advocated on behalf of local repair shops, students and others. Microsoft has said people can pay extra for a year of extended security support through October 2026. Some users, including those in the European Union as well as U.S. users who can synchronize with Microsoft's cloud service, will be able to get that extended support for free. But most people faced with unsupported devices are likely to either keep using them despite the vulnerabilities or throw them away, which "creates both a security problem and an environmental problem," generating huge amounts of toxic electronic waste, said Nathan Proctor, who leads PIRG's Right to Repair campaign. Both PIRG and Microsoft urge those who are replacing their computers to avoid sending their older models to the landfill. Those concerns were not a focus of Microsoft's Windows 11 announcements Thursday. Instead, Yusuf Mehdi, an executive vice president and chief marketing officer for Microsoft's consumer division, argued that conversing with a laptop will be "as transformative as the mouse and keyboard" in shaping the PC experience. Microsoft says all Windows 11 users will also now have access to Copilot Vision, an AI feature that can analyze and give feedback on the documents, video games and other activities happening on the screen. Mehdi acknowledged it could take some adjustment to get used to human-computer conversations in shared workspaces. "Just like when the mouse came out, people have to figure out when to use it, what's the right way, how to make it happen," Mehdi told reporters. The updates are Microsoft's latest attempt to make its widely used Windows operating system a gateway to hook people on its suite of generative AI tools. The tech giant competes heavily on AI services with Apple, Google and startups like Anthropic and OpenAI. Mehdi said the updates are "not a replacement for Recall," a screen-tracking feature on some Windows computers that gives Copilot a "photographic memory" of a user's virtual activity. Microsoft CEO Satya Nadella described it last year as a step toward machines that "instantly see us, hear, reason about our intent and our surroundings," but the idea was met with criticism from privacy and security experts and took a year before it started to roll out.
Share
Share
Copy Link
Microsoft is integrating advanced AI capabilities into Windows 11, transforming user interaction with PCs. The new Copilot features include voice commands, vision analysis, and autonomous actions, marking a significant shift in operating system design.
Microsoft is embarking on an ambitious journey to redefine the Windows 11 experience through artificial intelligence, with the introduction of advanced Copilot features. This move marks a significant shift in how users interact with their PCs, potentially as transformative as the introduction of the mouse and keyboard
1
.Source: The Verge
One of the most notable additions is the 'Hey Copilot' voice command, which allows users to interact with their PCs using natural language. Microsoft's Yusuf Mehdi envisions voice becoming the third primary input mechanism for PCs, complementing the traditional mouse and keyboard
1
. This feature, while optional, is designed to make AI interactions more intuitive and accessible to a broader range of users2
.Source: Gizmodo
Copilot's capabilities extend beyond voice interactions. Copilot Vision allows the AI to analyze screen content and provide recommendations or answer questions about what it sees
2
. Meanwhile, Copilot Actions takes AI assistance a step further by enabling the AI to perform tasks on behalf of the user, from opening apps to more complex actions like booking flights3
.Source: Wccftech
Addressing potential security concerns, Microsoft has implemented a cautious design with built-in guardrails. Copilot Actions, for instance, operates in a separate 'Agent Workspace' with limited permissions, requiring explicit user consent for any significant actions
3
. Users retain control and can revoke access at any time, ensuring a balance between AI assistance and privacy.Related Stories
Microsoft's ultimate goal is to 'rewrite the entire operating system around AI,' as stated by Yusuf Mehdi
4
. This vision extends beyond chatbots, integrating AI into everyday PC experiences and potentially paving the way for what Microsoft calls the 'AI PC'5
.The new Copilot features are designed to work on all Windows 11 PCs, not just specialized 'Copilot+ PCs.' Microsoft is also introducing Copilot Connections, allowing integration with services like OneDrive, Outlook, and even Google services, enhancing personalized assistance
5
.As Microsoft phases out Windows 10 support, these AI-driven updates to Windows 11 represent a significant step towards a more intelligent and interactive computing experience. The company's bold vision for AI integration in Windows could reshape how we interact with our computers in the coming years.
Summarized by
Navi