2 Sources
[1]
A new way to edit or generate images
AI image generation -- which relies on neural networks to create new images from a variety of inputs, including text prompts -- is projected to become a billion-dollar industry by the end of this decade. Even with today's technology, if you wanted to make a fanciful picture of, say, a friend
[2]
Image generation reimagined: Tokenizers and decoders enable editing and inpainting without generators
AI image generation -- which relies on neural networks to create new images from a variety of inputs, including text prompts -- is projected to become a billion-dollar industry by the end of this decade. Even with today's technology, if you wanted to make a fanciful picture of, say, a friend
Share
Copy Link
MIT researchers have developed a novel approach to AI image generation and editing using tokenizers and decoders, eliminating the need for traditional generators and potentially transforming the billion-dollar AI image industry.
Researchers from MIT have unveiled a groundbreaking approach to AI image generation that could potentially transform the rapidly growing industry, projected to reach billions of dollars by the end of the decade. The team, led by graduate student Lukas Lao Beyer and Associate Professor Kaiming He, presented their findings at the International Conference on Machine Learning (ICML 2025) in Vancouver
1
2
.Conventional AI image generators require extensive training on massive datasets, often consuming weeks or months of computational resources. These systems typically use neural networks to create new images from various inputs, including text prompts
1
2
.The MIT team's innovative method eliminates the need for a traditional generator, instead relying on a combination of a one-dimensional (1D) tokenizer and a detokenizer (decoder). This approach builds upon a June 2024 paper that introduced a new way of representing visual information using 1D tokenizers
1
2
.The 1D tokenizer can compress a 256x256-pixel image into just 32 tokens, each representing a 12-digit binary number. This creates a vocabulary of about 4,000 "words" in an abstract computer language. Lao Beyer's research revealed that manipulating individual tokens could affect specific image attributes such as resolution, background blurriness, brightness, and even object pose
1
2
.The team demonstrated that their system could perform various tasks without a traditional generator:
Image Editing: By modifying specific tokens, they could alter image characteristics in a controlled manner
1
2
.Image Transformation: Using the CLIP neural network for guidance, they successfully converted an image of a red panda into a tiger
1
2
.
Source: MIT
Image Creation from Scratch: Starting with random token values, they iteratively adjusted them to create entirely new images matching desired text prompts
1
2
.Inpainting: The system could fill in missing or blotted-out parts of images
1
2
.Related Stories
This research has significant implications for the AI image generation industry:
Reduced Computational Resources: By eliminating the need for extensive generator training, the new approach could significantly reduce the computational demands image tasks
1
2
.Faster Development: The streamlined process could accelerate the development of new image manipulation and generation tools
1
2
.Novel Applications: The ability to directly manipulate image attributes through tokens opens up new possibilities for precise image editing and creation
1
2
.As the AI image generation industry continues to grow, innovations like those presented by the MIT team could play a crucial role in shaping its future. By reimagining the fundamental processes behind image generation and manipulation, this research paves the way for more efficient, versatile, and powerful AI imaging tools
1
2
.Summarized by
Navi
1
Technology

2
Policy and Regulation

3
Technology
