9 Sources
9 Sources
[1]
Microsoft responds to Gaming Copilot controversy, says it uses screenshots to understand in-game events, not for training AI models -- optional feature can be turned off, but not easily uninstalled
Microsoft's Gaming Copilot feature recently hit Windows 11 as a public beta, with the company adding the feature to the operating system's built-in Xbox Game Bar. However, one user complained on ResetEra forums, stating that their system's network traffic showed the AI feature sending information about their actions to Microsoft's servers, including private details on their screen. That set off a flurry of media coverage. We reached out to Microsoft for further details and the company sent over an official comment. The controversy began with a forum post. "This installed automatically on my PC, and watching the network traffic, I realised (sic) it was automatically sending everything I was doing to Microsoft (including an NDA'd game I'm playing," user RedbullCola said in the forums. "I checked the settings, and by default, it's set to train on text seen on the screen -- it screenshots everything, and OCRs text from in-game and sends it to MS. MS then uses what you're doing to train their AI models." Tom's Hardware reached out to Microsoft directly about the issue. "When you're actively using Gaming Copilot in Game Bar, it can use screenshots of your gameplay to get a better understanding of what's happening in your game and provide you with more helpful responses. These screenshots are not used to train AI models, and Gaming Copilot is an optional feature that only has access to gameplay when you're playing a game and actively using it," the representative said. "Separately, Gaming Copilot may use its text or voice conversations with players to help train and improve AI. Players can adjust Gaming Copilot's privacy settings by visiting 'Settings' in [the] Game Bar, followed by 'Privacy Settings.'" At the moment, it's unclear if Gaming Copilot sends the screenshot data to an external server or limits it to the system's built-in NPU, and we've sent follow-up questions to Microsoft. Xbox Support does not list the required specifications to run the feature, but the company says it will "begin rolling to players aged 18 and older on PC Game Bar today." We can assume it would work even on devices that aren't Copilot+ certified (i.e., those without built-in NPUs). We even tested it on one of our staff members' old gaming PC with a non-AI processor (who's also enrolled in the Xbox Insider Program), and he confirmed that he has access to Gaming Copilot. The 'Model training on text' toggle does not provide clear information about the type of text it captures. You do not have to turn on Gaming Copilot if you don't want to use it, though. The company says that it only takes screenshots when you're actively using it, and you can also turn off the AI training feature in the settings. Unfortunately, if you really don't like it, there's no easy way to uninstall it as it's built into the Game Bar. You'll have to remove the Xbox Game Bar if you really want it out of your system, but you'll have to muck around in PowerShell with administrator privileges if you really want to go down that route.
[2]
No, we aren't training our gaming Copilot assistant on your gameplay, says Microsoft
* Microsoft says Game Bar Copilot doesn't harvest gameplay to train AI; screenshots are used only when actively using it. * Copilot may use text or voice chats to improve AI; you can change privacy settings in Game Bar. * I'll trust Microsoft's denial until proof emerges, but lying would severely undermine user trust in AI tools. Recently, Microsoft added Copilot to the Game Bar, allowing the AI assistant to hop in and help with your gaming queries. It seemed like a fun way to call up a guide and have it help you navigate a tricky part of a game or ask questions about stuff; however, a report came in claiming that the Copilot assistant on the Game Bar would harvest gameplay data to train itself on. Well, as easy as that may be to believe, Microsoft has made an official statement that, no, it's not actually scanning your gameplay without your permission. As such, until we find some proof to the contrary, we'll believe Microsoft for now. Microsoft denies claims that it's using gameplay data to train Copilot The story begins on the ResetEra forums, where a user spotted something they thought was a little fishy: This installed automatically on my PC, and watching the network traffic I realised it was automatically sending everything I was doing to Microsoft (including an NDA'd game I'm playing). I checked the settings, and by default it's set to train on text seen on the screen - it screenshots everything, and OCRs text from in game and sends it to MS. MS then uses what you're doing to train their AI models. Sounds pretty scary, right? Well, if Microsoft is to be believed, there's nothing to fear. In a statement to Tom's Hardware, Microsoft states that it doesn't harvest gameplay data in the background. Even the photos you send aren't being used for training purposes, says the company: When you're actively using Gaming Copilot in Game Bar, it can use screenshots of your gameplay to get a better understanding of what's happening in your game and provide you with more helpful responses. These screenshots are not used to train AI models, and Gaming Copilot is an optional feature that only has access to gameplay when you're playing a game and actively using it. Separately, Gaming Copilot may use its text or voice conversations with players to help train and improve AI. Players can adjust Gaming Copilot's privacy settings by visiting 'Settings' in [the] Game Bar, followed by 'Privacy Settings.' So, who do you believe: the initial report, or Microsoft? Personally, I'm going to trust Microsoft on this one. Until people find undeniable proof that Microsoft is actually training Copilot on people's gameplays, I'll stick with the official statement. However, I do hope for Microsoft's sake that it is telling the truth, because if people discovered that it lied, it would be a huge hit to its reputation and trustworthiness with future AI tools.
[3]
Microsoft's Gaming Copilot automatically captures screenshots, but you can turn it off
Serving tech enthusiasts for over 25 years. TechSpot means tech analysis and advice you can trust. Facepalm: Microsoft is increasingly pushing its Copilot AI service onto lower-tier Windows users. The company aims to "help" gamers with Gaming Copilot, but the tool may raise privacy concerns by capturing screenshots during gaming sessions. Microsoft appears to be capturing large numbers of screenshots through Gaming Copilot, extracting text from them, and using the data to further train its AI models. A user recently discovered a potential breach of both privacy and trust related to the Copilot tool, which is now automatically installed on Windows 11 PCs alongside the latest OS updates. A ResetEra forum user named "RedbullCola" discovered what Gaming Copilot was doing by analyzing network traffic from his system. According to his findings, the chatbot was sending almost all of his activity to Microsoft, including an unreleased game he was playing under a non-disclosure agreement with the developers. In short, Gaming Copilot was taking screenshots of RedbullCola's gaming session, extracting text using OCR algorithms, and transmitting the data to Microsoft servers. This behavior potentially violated the user's privacy and, paradoxically, placed him at risk of breaching his NDA, meaning he could have been both a victim of Microsoft's AI exploitation and inadvertently implicated in violating confidentiality terms. The automatic screenshot feature is enabled by default, according to RedbullCola, but it can be disabled through the Gaming Copilot settings in the Xbox Game Bar. Microsoft introduced the Copilot for Gaming service earlier this year, promoting it as an "intelligent" assistant that could help players improve performance with tips, narrated walkthroughs, and more. However, Microsoft did not disclose to RedbullCola - or any users - that the service would collect screenshots and other data to improve its AI models. While some may view this as a minor privacy concern, it could also draw scrutiny from EU authorities under GDPR regulations. ResetEra users are now debating whether Microsoft is using Gaming Copilot data to train AI models or merely to enhance the service. The distinction may be largely semantic, given that any collection of personal gaming activity raises potential privacy issues. Copilot and other AI-driven features recently added to Windows PCs are fueling growing unease among users. Some vendors are pushing back, and users concerned about privacy may wish to disable all AI and Copilot features while using Windows.
[4]
Gaming Copilot AI under fire, but Microsoft says it's not training AI models on your data
Specifically, not your screenshots. Voice and text are a different matter A week after Microsoft's Gaming Copilot feature stirred up controversy, the company has released a public statement about the AI tool addressing the backlash. On Wednesday (Oct. 22), a member of the gaming forum ResetEra found that the new Gaming Copilot AI was sending screenshots and captures of everything they played to Microsoft. Allegedly, this data is being used to train the company's AI models. "This installed automatically on my PC, and watching the network traffic I realized it was automatically sending everything I was doing to Microsoft," RedbullCola said in their ResetEra post. "I checked the settings, and by default, it's set to train on text seen on the screen -- it screenshots everything, and OCRs text from in-game and sends it to MS. MS then uses what you're doing to train their AI models." Announced earlier this year, the feature only just went into beta on September 18 for PCs and the Xbox mobile app. The AI tool is advertised as a helpful assistant for players using natural language prompts. Basically, it can act as a game guide while you're playing a game. It is supposed to be able to understand your gaming activity and link you to websites and answer questions. My colleague Tony Polanco tested it out on the Rog Xbox Ally but wasn't sold on it. Our colleagues at Tom's Hardware were told that Gaming Copilot does not send screensheets or data back to Microsoft. "When you're actively using Gaming Copilot in Game Bar, it can use screenshots of your gameplay to get a better understanding of what's happening in your game and provide you with more helpful responses," a spokesperson told them. They went on to say that the screenshots are not used to train AI models and that it's optional. Despite that, the statement also said that Gaming Copilot might "use its text or voice conversations to help train and improve AI." Your screenshots may not be used by Microsoft's AI, but your prompts could be. It's also unclear where this data is potentially going, either to a Microsoft external server or stored locally on your NPU. You can find Gaming Copilot by going to Game Bar, Settings and Privacy Settings. Under the Gaming Pilot section, it should read "Model training on text" by default. You can turn if off in the Privacy settings section but unfortunately, there doesn't appear to be a way to uninstall it unless you uninstall the Xbox Game Bar. To do that you have to fiddle with PowerShell using admin privileges.
[5]
PC gamers claim Windows 11's Gaming Copilot is capturing gameplay for AI training by default - but what it's actually doing is spoiling performance
There's confusion about whether this privacy concern is valid or not, but it's clear that Gaming Copilot can impact your frame rates (slightly) in games While Microsoft is continuously making efforts to improve gaming on Windows 11, most recently with a new 'full-screen experience' mode for handhelds, and also an AI gaming assistant, the latter is currently mired in some controversy. As Wccftech spotted, according to a poster on the ResetEra forum, Windows 11's Gaming Copilot may be actively monitoring and capturing gameplay and sending this back to Microsoft for 'model training' (of the AI) by default. The poster shares a screenshot of the 'model training on text' option being enabled by default, raising concerns over privacy therein. However, there seems to be some disagreement as to whether this is a valid accusation being levelled at Microsoft, or not - so much so that the admins have locked the thread on the forum. For now, then, we have to take this assertion with a good deal of caution - and presume that any training data is only being sent back to Microsoft if you're actually using Gaming Copilot (with the relevant options enabled). Or that this is some kind of an error perhaps (remember, Gaming Copilot is still in beta). As pointed out by another denizen of ResetEra, Microsoft's FAQ for Gaming Copilot clearly states that 'screenshots are not stored or used for model training' and that grabs are only taken when you're actually using Copilot in Windows 11's Game Bar. All this has raised privacy fears for some gamers, as noted, and hopefully Microsoft will be able to cut through the confusion and clear this up. I've contacted the company to this end, and will update this story if I hear anything back. Privacy controversy aside, what's clear enough about Gaming Copilot is the impact it has on performance. I tested the Dead As Disco demo on Steam and noticed that Gaming Copilot is reducing frame rates, although the AI feature doesn't have a major impact. With Gaming Copilot's model training settings turned on in the game's 'Infinite Disco' mode, the frame rate often dipped into the 70s, although it mostly stayed within the 80 to 85 fps range. With Gaming Copilot's model training settings switched off, the game kept within an 84 to 89 fps range, while reaching 90 fps or more occasionally, without any dips into the high 70s range. Microsoft's Edge browser is also required to view and export the data that is captured (via 'Game Assist'), and having that in the background isn't going to help gaming frame rates. Now, while this doesn't sound like a significant frame rate loss, when you stack this up with the rest of Windows 11's bloatware that's limiting performance levels (even with the new handheld mode), it all adds up. Speaking of handhelds, Gaming Copilot will likely have a worse impact on lower-end systems like these gaming portables, where every frame counts due to weaker hardware specs. I've now gotten to a point where I feel as though Microsoft is trying to drive gamers away from its operating system, even if it believes additions like Gaming Copilot are helpful. I'm willing to bet that a decent portion of gamers don't need an AI assistant for game help, and don't want anything that holds back performance (or causes any possible privacy worries for some folks, even if we don't yet know how valid those concerns are). For me, it's just such a shame that seemingly nothing will be done to provide Linux compatibility for games with anti-cheat tools like Battlefield 6 and Call of Duty, because as tempted as I am to switch to SteamOS on my main desktop PC, I'd miss out on some great gaming experiences. (And no, I don't mean Call of Duty, but I'm sure you get my point). I guess my only option at this point is to endure the issues I have with Windows 11 for gaming, and pray that things start to change for Linux regarding anti-cheat tools.
[6]
Microsoft Copilot AI Collects Screenshot Text from Gamers
Microsoft's Gaming Copilot AI has stirred up a wave of privacy debates after users discovered that it quietly collects and analyzes screenshots by default. The feature works by scanning players' screenshots using OCR technology to read any visible text, such as chat messages, in-game options, or menus. That information is then sent to Microsoft servers to help train its AI models. The problem? Most players never knew this was happening in the first place. The discovery came from a Resetera user named "RedbullCola," who noticed strange network activity while testing an unreleased game under a non-disclosure agreement. He realized that Gaming Copilot was transmitting text data from screenshots without asking for permission. Since the game was still under NDA, this could have accidentally leaked confidential details, raising serious privacy and security issues. For anyone working in the gaming industry, this type of data collection is especially risky. Tests later confirmed that this screenshot training option is switched on by default. The good news is that voice-chat data isn't used for AI training unless you turn it on manually. If you want to stop your screenshots from being used, you can open the Xbox Game Bar, go to Gaming Copilot, and click on Settings → Privacy. There's a small toggle you can disable to prevent your screenshots from being uploaded or processed for AI model training. The bigger concern here is transparency. During installation, Gaming Copilot never tells users that their screenshots might be collected for training purposes. Under laws like the EU's GDPR, companies need clear consent before using personal data for AI training. Collecting text data from screenshots without explaining what's happening could be considered a breach of that rule. This has led some privacy experts to suggest Microsoft could face legal scrutiny in certain regions. Many players and professionals are calling for Microsoft to be more open about what data the Gaming Copilot collects and how it's used. Even a simple pop-up or setup screen would help users make an informed choice before joining any data-collection program. Until Microsoft comments on the issue or updates its privacy policy, users who want to keep their data private should manually disable the feature. The situation highlights the growing tension between AI development and user privacy -- especially in spaces like gaming, where sensitive or unreleased content can easily appear on screen. Source: Resetera, Techpowerup
[7]
Microsoft's Gaming Copilot watches you game and captures that data for 'model training'
TL;DR: Microsoft's Windows 11 Xbox App includes a Gaming Copilot AI assistant that captures and analyzes PC gaming via screenshots to train its AI models. Users should review and disable these data-sharing settings in the app's privacy options to protect their gaming information and maintain privacy. It's no secret that Microsoft is currently looking to inject AI tools and features into all areas of its Windows 11 operating system. This includes the PC gaming side of the OS and the Xbox App, which now features a Gaming Copilot chatbot and AI assistant that can be used for information, tips, and even feedback on what you're seeing on-screen. Still listed as being in Beta, Gaming Copilot is already a staple feature of the Xbox App on PC, with the tool popping up the moment you bring up the Xbox 'Game Bar' overlay. However, it seems that whether you're using it or not, Microsoft is actively recording, capturing, and analyzing screenshots of your PC gaming and sending all the text data to the company for training purposes. That is, Microsoft is reportedly training its Gaming Copilot AI tool with your data and screenshots of your PC gaming. This training option, which sends your data to Microsoft, is enabled by default, too. This was spotted by ResetEra user 'RedbullCola' (via Wccftech), who noticed that their network traffic was sending "everything I was doing to Microsoft," including data from an unreleased game they were playing that was under NDA at the time. The user alleges that Microsoft's Gaming Copilot takes screenshots, extracts text via OCR, and then sends it to the company. Opening up Gaming Copilot's 'Privacy Settings', we can confirm that 'Model training on text' is enabled by default, with an additional 'Personalization and memory' option also enabled by default, which basically says anything you do with Bing, MSN, Gaming Copilot, and 'inferred interests' will be used by Microsoft for training and to create a custom Gaming Copilot experience for you. Calling the option 'Model training on text' is a little misleading if Microsoft is actively screenshotting your PC gaming and scraping every piece of on-screen text for training its AI model. Without context, this could be interpreted as the text you enter into the Gaming Copilot prompt, which is a lot less concerning. Microsoft hasn't provided a detailed explanation of what 'Model training on text' does exactly, so hopefully, we get a proper explanation of how this side of Gaming Copilot works. The privacy settings also have an option for 'Model training on voice,' but thankfully, this isn't enabled by default. Basically, if the idea of Microsoft potentially capturing your PC gaming habits and using that data to train its AI models sounds like something you don't want, be sure to head to Gaming Copilot's settings and turn these "features" off.
[8]
Microsoft Comments on Gaming Copilot AI Controversy
Last week, a ResetEra user discovered that the new Gaming Copilot AI installed by Microsoft on all Windows 11 PCs (integrated directly into the Game Bar) was training itself by screenshotting every game played by the user and then sending everything back to Microsoft. Gaming Copilot is also enabled by default, so if you want to turn it off, you need to go to the Game Bar, and then to Settings and Privacy Settings, where you will find the option for Gaming Copilot to pull "Model training on text" or not. Needless to say, this discovery sparked a big controversy on what several users felt was a highly intrusive feature sneakily introduced by Microsoft. Following the news, Tom's Hardware was able to get a statement from the company about what the AI actually does: When you're actively using Gaming Copilot in Game Bar, it can use screenshots of your gameplay to get a better understanding of what's happening in your game and provide you with more helpful responses. These screenshots are not used to train AI models, and Gaming Copilot is an optional feature that only has access to gameplay when you're playing a game and actively using it. Separately, Gaming Copilot may use its text or voice conversations with players to help train and improve AI. Players can adjust Gaming Copilot's privacy settings by visiting 'Settings' in the Game Bar, followed by 'Privacy Settings. The AI was first tested earlier this year on mobile devices, though the global rollout only started last month on both PCs and the Xbox mobile app. Microsoft introduced Gaming Copilot as a sidekick specifically designed for gamers. Using AI, it recognizes which game is being played and understands the user's Xbox activity, allowing it to answer questions about games the user is interested in, provide links to further information when its response includes web sources, and answer various questions based on the user's account, play history, and achievements. Essentially, it is a guide to the game, should the player need it. Of course, it should be entirely optional, and its training feature should be disabled by default to comply with privacy laws.
[9]
Microsoft Is Training Its Gaming Copilot AI By Watching You Play Games, Unless You Turn It Off
A user on ResetEra spotted that as part of their network traffic, Microsoft's new Gaming Copilot AI, which is automatically installed on Windows 11 PCs, was sending screenshots and captures of everything they were playing back to Microsoft, so Microsoft could use that data to train its AI models further. The setting is on by default, which means that unless you turn it off, Microsoft is using your gaming time to train its AI. Wccftech can confirm that when you navigate to Game Bar, and then to Settings, and Privacy Settings, the option for Gaming Copilot to pull "Model training on text" is defaulted to being activated. I found the setting activated on my own laptop, before turning it off. There's also options for Gaming Copilot to train using any vocal conversations you have while playing games, though that was not defaulted to being 'on,' when we looked at our settings. It'll also capture personalization and memory data, and of course, keep track of any conversations you have with Gaming Copilot, if you were actually using the service. You can turn all of these settings off and/or ensure they're off by going into Game Bar, then to Gaming Copilot, then the Settings gear, which should be in the bottom left corner, and then lastly Privacy settings. There, you'll be able to turn off, or at least knowingly opt in to letting Gaming Copilot train on your gameplay, instead of it being on by default. In the past month or so, Microsoft has done nothing, it seems, but be a public disappointment for players. The price of the Xbox Series consoles went up in the US for the second time this year, followed by a price hike for Xbox development kits, meaning even game devs have to pay more for Xbox hardware. The price of Xbox Game Pass went up 50%, while at the same time, discounts and reward programs for Xbox software and services were shut down. And in the midst of all of that, we can probably expect a new version of Cloud Gaming with ads. Now, the latest is that Microsoft is training its AI with your gameplay, almost definitely without you strictly knowing about it. None of it exactly endears Xbox and Microsoft to players, but it does at least seem par for the course for a company that laid off 9,000+ people to bet more on AI.
Share
Share
Copy Link
Microsoft responds to controversy surrounding its new Gaming Copilot feature in Windows 11, addressing concerns about data collection and AI model training. The company clarifies its data usage policies while users debate the tool's impact on privacy and performance.
Microsoft's recent introduction of the Gaming Copilot feature in Windows 11 has sparked a heated debate about privacy and data collection. The controversy began when a user on the ResetEra forums claimed that the AI-powered assistant was automatically sending gameplay information, including screenshots, to Microsoft's servers
1
.
Source: TweakTown
In response to the growing concerns, Microsoft issued an official statement to clarify the functionality of Gaming Copilot:
2
.However, Microsoft did acknowledge that Gaming Copilot may use text or voice conversations with players to help train and improve AI
1
.
Source: XDA-Developers
Users can adjust Gaming Copilot's privacy settings through the Game Bar's 'Settings' and 'Privacy Settings' options
3
. The 'Model training on text' toggle is enabled by default, but users have the option to disable it. However, completely uninstalling Gaming Copilot is not straightforward, as it's built into the Game Bar4
.
Source: Guru3D.com
Related Stories
Beyond privacy issues, some users have reported a slight performance impact when using Gaming Copilot. Tests conducted on the 'Dead As Disco' demo on Steam showed a minor reduction in frame rates with the feature enabled
5
. This has led to discussions about the overall impact of Windows 11's features on gaming performance, especially for lower-end systems and handheld devices.The Gaming Copilot controversy highlights the ongoing tension between AI advancement and user privacy. As Microsoft and other tech giants continue to integrate AI-powered features into their products, the debate around data collection, user consent, and the balance between functionality and privacy is likely to intensify
2
.As the situation continues to evolve, users are encouraged to stay informed about their privacy settings and the data collection practices of AI-powered tools. Microsoft's response to this controversy may set a precedent for how tech companies address similar concerns in the future, potentially influencing industry standards for AI transparency and user privacy.
Summarized by
Navi
[2]
[4]