ETRI Develops Hyper-Realistic AI Avatars from Single Photo for Enhanced Human-Machine Interaction

Breakthrough in AI Avatar Technology

The Electronics and Telecommunications Research Institute (ETRI) has made a significant advancement in artificial intelligence by developing hyper-realistic AI technology capable of creating lifelike avatars from a single portrait photo. This innovation is poised to revolutionize human-machine interactions, particularly in the realm of autonomous vehicles and beyond 1

1

2

Enhanced Human-Machine Interaction

Unlike traditional AI assistants that merely execute commands, ETRI's hyper-realistic avatars boast sophisticated facial expressions and mouth movements, enabling natural, human-like conversations. This technology represents a leap forward in creating more intuitive and engaging interfaces between humans and machines 1

1

2

Source: Tech Xplore

The potential applications are vast, ranging from in-vehicle AI drivers communicating with human passengers to AI avatars interacting with pedestrians. This human-centered approach to AI interaction is expected to make smart mobility services more accessible and user-friendly 1

1

2

Innovative Algorithm and Superior Performance

At the heart of this technology lies a unique algorithm that sets it apart from traditional generative AI. The system selectively learns and synthesizes facial features directly related to speech, such as lips and chin movements. This targeted approach reduces unnecessary information processing and allows for more nuanced facial expressions, including realistic mouth shapes, teeth visibility, and skin wrinkles 1

1

2

ETRI reports that their technology has demonstrated superior performance in terms of synthetic visual quality and lip synchronization accuracy. These achievements have been recognized at major international conferences such as CVPR and AAAI 1

1

2

Wide-Ranging Applications and Industry Impact

While the technology's primary focus is on enhancing human-machine interaction in autonomous vehicles, its potential extends far beyond. ETRI envisions applications in various sectors, including:

• Interactive kiosks
• Bank customer service
• News presentations
• Advertising and modeling
• General AI-based digital human industry 1

  1

  2

  2

The Mobility User Experience Research Section at ETRI is also developing complementary AI-based driver interface technologies that can analyze emotions, fatigue, and concentration levels of both drivers and pedestrians 1

1

2

Related Stories

Character.AI Unveils AvatarFX: A Groundbreaking AI Video Generation Model

The Rise of Personal AI Avatars: Creating Digital Twins

ByteDance's OmniHuman-1: Revolutionizing AI Video Generation with Single Image Input

Runway's Act-One: Revolutionizing AI Character Animation with Human Performance

Addressing Social Concerns and Future Developments

Daesub Yoon, Director of the Mobility User Experience Research Section, emphasized the technology's potential to bridge digital divides: "As mobility technology becomes more advanced, the elderly and socially disadvantaged may be marginalized. We hope that this AI avatar technology will contribute to improving digital literacy and make smart mobility services more accessible to all" 1

1

2

Senior Researcher Daewoong Choi outlined future aspirations for the technology: "We plan to further advance our generative AI technology so that AI avatars can naturally talk and move like real people. In the future, we're aiming for interactions that can replace some human labor for ordering, consulting, and more" 1

1

2

Commercialization and Technology Transfer

The technology, currently registered as "A Framework for Photorealistic Talking Face Generation" on the ETRI Technology Transfer site, is poised for commercialization. ETRI researchers are actively pursuing technology transfer and strategies to implement this innovation across various industries 1

1

2