Microsoft Unveils Muse: A Groundbreaking AI Model for Game Development and Simulation
50 Sources
[1]
Xbox's new Muse generative AI may be compatible with user-created mods
TL;DR: Microsoft's new generative AI, Muse, aims to create customized gaming experiences by generating procedural gameplay from user inputs. It will be trained using first-party games, with developers having the option to opt out. Muse could integrate with user-created mods, enhancing game
[2]
Xbox's Muse AI Model Is A One-of-a-Kind Model That Can Generate Gameplay
It has long been speculated when the time would come for generative AI models to be widely used in game development to actually create gameplay, and it seems like that time is coming with Muse, an Xbox one-of-a-kind AI model that was unveiled today. Presented today on Nature, Muse is a generative
[3]
Microsoft's Muse AI Set to Transform Xbox Game Development
Microsoft is taking a bold step into the future of gaming. CEO Satya Nadella has confirmed that Xbox will soon have a catalog of games built with generative AI. The company's latest AI model, Muse, is set to transform how games are created and played, marking a major shift in the industry. Muse
[4]
Microsoft's new AI for game development called Muse can generate entire gameplay sequences
In brief: Despite the controversy surrounding generative AI, some game designers use the technology to brainstorm concepts during development. Microsoft's new open-source model aims to make this practice feasible for interactive content. It focuses on maintaining consistency across many frames
[5]
Microsoft: Our 'Muse' Generative AI Can Simulate Video Games
Microsoft researchers and Xbox staffers have created a generative AI model that can simulate a playable video game. The prototype program, called "Muse," can churn out the in-game visuals and corresponding actions based on the controller input. The 1.6 billion parameter Muse model was trained "on
[6]
Microsoft and Hellblade Developer Ninja Theory Built an AI Called Muse Designed to Generate Ideas for a Game's Design -- and It's Already Making 'Complex' Gameplay Sequences - IGN
Microsoft has announced a new generative AI model designed for gameplay ideation. The company detailed what it calls the first World and Human Action Model (WHAM). The WHAM, Katja Hofmann, Senior Principal Research Manager and lead of the Microsoft Research Game Intelligence team, said in a blog
[7]
Microsoft's Muse AI wants to change how games are made - but can it work?
Ninja Theory's generative AI can replicate gameplay and assets. Muse is Microsoft's new generative AI for game development that promises to be a gameplay concept tool - it will ideate playable ideas, building game visuals, controller inputs and more. It sounds groundbreaking but Muse feels like a
[8]
Microsoft's new 'breakthrough' generative AI model is designed to 'create consistent and diverse gameplay' and could be used to preserve classic games
Muse could also preserve classic games for future generation Microsoft has unveiled its new generative AI project called Muse which it says will be used to help studios create gameplay and preserve classic titles. In partnership with Xbox Game Studios' Ninja Theory and Microsoft Research, Muse
[9]
Microsoft's Muse AI Model Will Generate Gameplay Visuals and Actions
However, MS has clarified that the AI isn't meant to replace human development and instead supplement it. In a world where AI is practically everywhere, you would expect almost every industry to capitalize on it. The gaming industry seems to be following suit, but recent developments have made it
[10]
Xbox Will Have Catalogue of Games That Use Muse AI Model: Satya Nadella
Satya Nadella said games that utilise Muse will be playable soon Microsoft plans to have catalogue of games that utilise its recently revealed artificial intelligence (AI) model that can generate 3D gameplay environments, CEO Satya Nadella has said. The Xbox parent announced Muse, an AI model that
[11]
Microsoft Muse generative AI model for gaming unveiled
Microsoft on Wednesday introduced Muse, its first generative AI model for video game creation. Developed by the Microsoft Research Game Intelligence and Teachable AI Experiences (Tai X) teams with Xbox Games Studios' Ninja Theory, Muse introduces the World and Human Action Model (WHAM). This AI,
[12]
Microsoft reveals new gaming-focused generative AI model 'Muse' that could revive classic games
In a new blog post on Wednesday, Microsoft's research department debuted a new generative AI model called Muse that it describes as a "breakthrough" for gameplay ideation. Muse is a World and Human Action Model, or WHAM, built by the Microsoft Research Lab in Cambridge in conjunction with the
[13]
Microsoft's Xbox Unveils Generative AI Model for Gameplay
Microsoft is introducing a generative artificial-intelligence model for gameplay on the Xbox. The company said Wednesday on its Xbox blog that the model, called Muse, can create consistent and diverse gameplay rendered by AI. Microsoft is using Muse to develop a real-time playable AI model
[14]
Xbox's AI initiative with Muse is an attempt to read the tea leaves, not the room
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Earlier today, the heads of Microsoft's Xbox division revealed Muse, a generative AI model that intends to create both visuals and gameplay for games. The model, which
[15]
New open-source AI for game developers interprets footage and player input
In brief: Despite the controversy surrounding generative AI, some game designers use the technology to brainstorm concepts during development. Microsoft's new open-source model aims to make this practice feasible for interactive content. It focuses on maintaining consistency across many frames
[16]
Microsoft trained an AI to play (and maybe develop) games
Today, Microsoft announced its first World and Human Action Model, or WHAM, a generative AI capable of generating game visuals and controller actions. Nicknamed "Muse," this AI was built in collaboration with Microsoft Research Game Intelligence and Teachable AI Experiences alongside the game
[17]
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
"It's still early," but Microsoft has big ambitions for generative AI in game creation. "In nearly every corner of our lives, the buzz about AI is impossible to ignore," Microsoft said in today's announcement of its new generative AI model called Muse, and that is absolutely true. "It's destined
[18]
Microsoft's Muse AI can design video game worlds after watching you play
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Microsoft researchers have achieved what many in artificial intelligence considered a distant goal: teaching AI to understand and interact with three-dimensional spaces
[19]
Muse, Microsoft's new AI engine, can imagine gameplay of video games that don't exist
With just an image and a dream, Microsoft's Muse imagines up to two minutes of gameplay. This GIF version of a video shared by the researchers is taken from the original gameplay data, and an image of an additional character is edited into the image. The generated gameplay sequence shows how the
[20]
Microsoft Introduces Muse, a GenAI Model for Gameplay Ideation
Muse was trained on human gameplay data from Bleeding Edge, a 4v4 online game by Ninja Theory. Microsoft has introduced Muse, a generative AI model designed for gameplay ideation. The model, built on the World and Human Action Model (WHAM), can generate game visuals, controller actions, or
[21]
Microsoft used an Xbox game to train its new generative AI tools
TL;DR: Microsoft announced Muse, a generative AI toolset that was trained using player inputs from the Xbox game Bleeding Edge. Microsoft's new generative AI toolset, Muse, was trained using real-world player inputs from an Xbox game, the company today announced. Remember when Xbox announced its
[22]
Microsoft debuts generative AI that can create video game scenes
Microsoft unveiled artificial intelligence tools that can create video game scenes that would normally have to be programmed and animated by a human, a model it built using data collected from Xbox gamers and their controllers. Called Muse, the model is the first of its kind, according to
[23]
Microsoft Xbox showcases an incredibly impractical AI model for "gameplay ideation"
Microsoft's Muse AI being used to simulate inserting extra props and enemies into an existing scene from the game Bleeding Edge -- these soon become fully interactable as expected based on existing training data. (Image credit: Microsoft, Ninja Theory) Yesterday, Microsoft Xbox debuted Muse, "a
[24]
Muse is Xbox's generative AI model for gameplay ideation
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Microsoft Research unveiled Muse, the company's first generative AI model designed for gameplay ideation. Fatima Kardar, corporate vice president of gaming AI at
[25]
Microsoft will train its gaming AI on a "catalogue" of titles soon, Satya Nadella says, "and then start playing them"
Microsoft boss Satya Nadella has said the company plans to train its new gaming AI on a "catalogue of games" soon, so it can then "start playing them". Speaking on the Dwarkesh Patel podcast, Nadella described seeing Microsoft's gaming AI Muse generate gameplay videos that reflected a user's input
[26]
What to Expect from Muse: Microsoft's New AI for Video Games
Microsoft's Muse AI: Revolutionizing Video Game Development Microsoft presents its generative AI model Muse, which brings revolutionary changes to the video game development process. Museums can produce visual aspects for games and forecast how players interact with them, providing an innovative
[27]
Microsoft wants to use generative AI tool to help make video games
Using AI to produce footage of video games with a consistent world and rules could prove useful to game designers An artificial intelligence model from Microsoft can recreate realistic video game footage that the company says could help designers make games, but experts are unconvinced that the
[28]
Microsoft's Latest Muse AI Model Can Generate Game Environments
Muse was trained on human gameplay data from the Xbox game Bleeding Edge Microsoft researchers introduced a new artificial intelligence (AI) model on Wednesday that can generate 3D gameplay environments. Dubbed the World and Human Action Model (WHAM) or Muse, the new AI model was developed by the
[29]
Microsoft thinks Xbox's new generative AI could save classic games, future-proof game libraries
TL;DR: Microsoft believes its new generative AI tech could one day be used to future-proof games libraries and access classic tough-to-find games. Microsoft hopes to use its new AI technology to preserve older games, potentially future-proofing backwards compatibility. Microsoft is all-in on
[30]
Microsoft trained an AI model on a game no one played
World models -- AI algorithms capable of generating simulated environments -- represent one forefront of machine learning. Today, Microsoft published new research in the journal Nature detailing Muse, a model capable of generating game visuals and controller inputs. Unexpectedly, it was born out of
[31]
Microsoft Debuts Generative AI That Can Create Video-Game Scenes
Microsoft Corp. unveiled artificial intelligence tools that can create video-game scenes that would normally have to be programmed and animated by a human, a model it built using data collected from Xbox gamers and their controllers. Called Muse, the model is the first of its kind, according to
[32]
Satya Nadella on the use of AI in Xbox games: "Very soon they will start using these models"
It seems that lately all the talk inside and outside the tech world has to do with AI and its good or bad use, and what everyone interprets that to mean. There is a lot of discussion about whether the use of AI should be restricted to optimising mechanical processes that contribute nothing beyond
[33]
Microsoft's Plans to Make Games With AI Don't Sound Great
Microsoft CEO Satya Nadella has recently touted how great the company's recently introduced technology called Muse is. While this model is a big advancement, it's nowhere near as good as the company makes it seem. While speaking on the Dwarkesh Podcast, Nadella claimed that Microsoft would
[34]
Xbox first-party developers have a choice whether or not to use generative AI, Microsoft says
TL;DR: Microsoft emphasizes that AI will not replace traditional development and empowers creative leaders to decide its use. Ninja Theory opts not to use Muse, focusing on enhancing human creativity. Following heavy layoffs in the games industry, including its own video games division, Microsoft
[35]
Xbox has officially opened the generative AI floodgates, and Phil Spencer wants to use it for game preservation and save titles that "were maybe tied to unique pieces of hardware"
Xbox has unveiled its generative AI project Muse, a "generative AI model of a video game that can generate game visuals, controller actions, or both." The publisher is not being specific about this model's exact uses, but has outlined some potential applications in its announcement. One of those
[36]
Xbox Pushes Ahead With New Generative AI. Developers Say 'Nobody Will Want This'
One developer responds to the release of Muse: "We are implicitly empowering a class of people who own these tools and don't give a fuck about how they reshape our lives." Microsoft is wading deeper into generative artificial intelligence for gaming with Muse, a new AI model announced today. The
[37]
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
Microsoft's new AI-powered game generation platform Muse is akin to the impact that CGI had on the film industry. So, says CEO Satya Nadella in a wide ranging interview covering everything from AI and quantum computing, to the future of economic growth, while slightly ignoring the fact that
[38]
Microsoft wants to preserve your games for the future using AI
Allowing artificial intelligence to interfere with our games is usually a hot topic. Some fear that it will come at the expense of imagination and creativity because AI largely bases its work on what already exists. In addition, developers, voice actors and others are not super keen on losing their
[39]
Microsoft develops AI model for videogames
The model, called Muse, was made in collaboration with Ninja Theory, a developer under Xbox Game Studios - Microsoft's gaming division.Microsoft has developed an artificial intelligence model of a videogame which can help generate visuals and actions, the company announced on Wednesday. The model,
[40]
Gaming Data is to Microsoft What YouTube is to Google: Nadella
"It could serve as both a general action model and a world model." Microsoft recently launched Muse, a generative AI model for gameplay ideation. Built on the World and Human Action Model (WHAM), the model can generate game visuals, controller actions, or both. In a recent interview with Dwarkesh
[41]
Microsoft is replacing human gamers (and even games) with AI
AI is being used to predict how human gamers will react, in order to fine-tune how video games play and feel. In the future, Microsoft suggests, you may be playing AI. No, not on the battlefield, but on games that actually use AI to simulate the entire game itself. As a first step, Microsoft has
[42]
Microsoft develops AI model for videogames
(Reuters) - Microsoft has developed an artificial intelligence model of a videogame which can help generate visuals and actions, the company announced on Wednesday. The model, called Muse, was made in collaboration with Ninja Theory, a developer under Xbox Game Studios - Microsoft's gaming
[43]
Microsoft's generative AI model Muse isn't creating games - and it's certainly not going to solve game preservation, expert says
Last night, Microsoft trumpeted the announcement of Muse, a new "generative AI breakthrough" designed to aid "gameplay ideation". The company also published some grainy-looking gifs of AI-generated gameplay footage, based on Xbox studio Ninja Theory's multiplayer game Bleeding Edge. (The images
[44]
Microsoft builds AI that creates 'impressive' video-game worlds
Generative artificial intelligence (AI) tools have upended creative industries from music and film to scientific publishing. Now they're upending the world of video games, too. In a study published in Nature on 19 February, a team of researchers reveals a generative AI engine that can create
[45]
GRTV News - Xbox is using AI to preserve older games
Muse AI is here to help with game development and bring extra life to deceased or unavailable projects. "Hello everyone and welcome back to another episode of GRTV News. Today we're going to be talking a little bit about Microsoft again. Because yesterday they announced something that was really
[46]
GRTV News - Satya Nadella on the use of AI in Xbox games: "Very soon they will start using these models"
"Hello there, welcome back to GRTV News, I'm Alex as usual, going through the afternoons latest and greatest when it comes to gaming, technology, entertainment, whatever you like, whatever you love, we always have it here for you at GRTV News and in the wider Gamereactor network as a whole, so if
[47]
Why would I ever want to play a video game created by AI?
The generative AI craze has come for video games. While companies like Square Enix and Ubisoft have been casually experimenting with the tech for years, Microsoft jumped into the race this week. The company revealed its new AI model, nicknamed Muse, which it describes as "the first World and Human
[48]
Xbox wants to tackle video game preservation with AI - Softonic
Everyone thinks it's a terrible idea and Phil Spencer does what he does best: pretends not to notice Xbox has presented its new generative artificial intelligence project, called Muse, which has the potential to transform the way classic video games are preserved. According to the company, Muse is
[49]
GenAI tool promises jump forward for game devs
Researchers have produced a generative AI tool they say can create a three-dimensional game world to help developers design and tweak gameplay. A paper in Nature said a research team from Microsoft was able to demonstrate the model generating complex 3D video game sequences that were consistent
[50]
Microsoft shows progress toward real-time AI-generated game worlds
For a while now, many AI researchers have been working to integrate a so-called "world model" into their systems. Ideally, these models could infer a simulated understanding of how in-game objects and characters should behave based on video footage alone, then create fully interactive video that
Share
Copy Link
Microsoft introduces Muse, a generative AI model capable of simulating video game gameplay, potentially revolutionizing game development and preservation while raising concerns about its impact on the industry.
Microsoft Introduces Muse: A New Frontier in AI-Driven Game Development
Microsoft has unveiled Muse, a groundbreaking generative AI model designed to simulate video game gameplay, potentially revolutionizing the gaming industry. This innovative technology, described as a "World and Human Action Model," represents a significant leap forward in the application of artificial intelligence to game development
1
2
.How Muse Works
Muse is capable of generating game visuals and corresponding actions based on player input. Trained on over 1 billion images and controller actions from the multiplayer game Bleeding Edge, the 1.6 billion parameter model demonstrates a detailed understanding of 3D game worlds, including physics and player interactions
5
.The AI can predict up to 30 seconds of gameplay based on just one second of actual footage and nine seconds of player input. Unlike previous models, Muse maintains consistency across frames, remembering details such as terrain, characters, and game mechanics
4
.Current Capabilities and Limitations
At present, Muse can render gameplay sequences at a low resolution of 300x180 pixels over several minutes. While impressive, the generated gameplay isn't always accurate to player actions or the game it was trained on
5
. Microsoft acknowledges that Muse is still in early stages of development and will require further refinement before practical applications can be realized2
.Potential Applications in Game Development
Microsoft envisions several potential uses for Muse in the gaming industry:
- Prototyping: Developers could use Muse to rapidly generate and iterate game ideas
4
. - Game Preservation: The technology could potentially help revive classic games on modern hardware
4
5
. - Enhanced Creativity: Muse could serve as an extension of creative work, offering novel experiences
5
.
Industry Reactions and Concerns
The introduction of Muse has sparked both excitement and concern within the gaming community. While some see it as a breakthrough, others worry about its impact on traditional game development and industry jobs
3
.David Goldfarb, a veteran game developer, expressed dismissiveness towards the technology. Marc Burrage from Creative Assembly cautioned that using AI even in prototyping stages could deprive employees of valuable hands-on experience
4
.Related Stories
Microsoft's Stance on AI in Gaming
Microsoft emphasizes that Muse is not intended to replace human developers. Phil Spencer, CEO of Microsoft Gaming, stated that the company views AI as a tool to empower creators rather than replace them
2
5
. Microsoft has also given its creative leaders the autonomy to decide on the use of generative AI in their projects5
.Ethical Considerations and Data Usage
To address concerns about training data, Microsoft used games it already owns, such as Bleeding Edge, ensuring that users have consented to data usage through the game's EULA. This approach sidesteps some of the ethical issues facing other AI models trained on internet-scraped data
4
.The Future of AI in Gaming
As Microsoft continues to develop Muse and explore its applications, other companies like Netflix and EA are also embracing generative AI tools for game development
5
. The introduction of Muse marks a significant milestone in the integration of AI technology in the gaming industry, potentially shaping the future of how games are created, played, and preserved.References
Summarized by
Navi
[3]
[4]
[5]
Related Stories
Microsoft Unveils AI-Generated Quake II Demo: A Glimpse into the Future of Gaming AI
06 Apr 2025•Technology
Generative AI in Gaming: Developers and Industry Veterans Weigh In on Its Potential and Challenges
16 Oct 2024•Technology
Xbox Takes Measured Approach to AI: Spencer Emphasizes Developer Choice Over Corporate Mandates
24 Oct 2025•Technology
Recent Highlights
1
AI Hallucination Nearly Sparked US Military Confrontation With Chinese Ship in Middle East
Technology
2
Google Gemini Hacked Three Real Companies During Cybersecurity Testing, Raising AI Safety Concerns
Technology
3
OpenAI Claims AI Breakthrough on Navier-Stokes Problem, Sparking Math Community Crisis
Science and Research
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
