ChatGPT Gains Real-Time Video and Screen Sharing Capabilities
11 Sources
[1]
ChatGPT Can Now Watch and Interact With You in Real Time - Decrypt
OpenAI took the wraps off ChatGPT's long-promised video capabilities Thursday, letting users point their phones at objects for real-time AI analysis -- a feature that's been gathering dust since its first demo in May. Previously, you could input text, charts, voice, or still photos and interact
[2]
ChatGPT's new skill will change how you interact forever
OpenAI has launched real-time video capabilities in ChatGPT, enhancing its Advanced Voice Mode with visual understanding. This feature, which began rolling out on December 12, allows users to interact with the AI via their camera to receive contextual assistance. The integration signifies a notable
[3]
ChatGPT adds eyes to its voice with new screen and video sharing feature
You can stream video from your camera or share your screen with the AI ChatGPT gazed upon day six of the 12 Days of OpenAI with a fresh eye courtesy of a new visual ability connected to its Advanced Voice Mode that lets you share your screen and live stream video to the AI chatbot. Instead of
[4]
ChatGPT Can Finally See Through Your Camera for Real-Time Interaction
You can also share your screen with ChatGPT and ask questions about whatever is displayed on the screen. About seven months ago, OpenAI introduced the GPT-4o model and demonstrated its multimodal capabilities. The hot AI startup showcased cool demos where you could share your camera with ChatGPT
[5]
OpenAI is giving ChatGPT's voice feature the ability to 'see'
OpenAI is adding vision to ChatGPT's advanced voice feature. On the sixth day of its "12 Days of OpenAI" event, the artificial intelligence startup announced that ChatGPT can recognize objects shown through a smartphone camera or on the screen of a device, and respond with its Advanced Voice Mode
[6]
You Can Now Ask ChatGPT Queries About Your Surroundings With This Feature
The feature will be rolled out to Enterprise and Edu users in early 2025 OpenAI rolled out the Advanced Voice Mode with Vision feature in ChatGPT on Thursday. The feature, which lets the artificial intelligence (AI) chatbot access the smartphone's camera to capture visual information of the user's
[7]
ChatGPT gets screensharing and real-time video analysis, rivaling Gemini 2
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI finally added long-awaited video and screen sharing to its advanced voice mode, allowing users to interact with the chatbot in different modalities. Both
[8]
ChatGPT Can Finally See
After months of testing, OpenAI rolled out "advanced voice" mode for ChatGPT back in September. The feature lets you have real-time conversations with ChatGPT: You can interrupt the bot and its "speaking" to ask another question, and it understands your tone of voice, which it uses to both inform
[9]
ChatGPT Advanced Voice with Vision just launched -- here's how to try it
ChatGPT's Advanced Voice with Vision was launched during Day 6 of OpenAI's '12 Days of OpenAI' live demonstration and briefing today. This powerful new feature allows users to interact with ChatGPT using spoken input, images and even video, opening up new possibilities for creativity and
[10]
You Can Now Share Videos and Screens With the ChatGPT App
OpenAI has introduced new features for ChatGPT as part of its "12 Days of OpenAI" promotion. These features revolve around a Santa mode and Christmas themes, but also an update to Advanced Voice that lets users share their screens. The first feature OpenAI is bringing is a holiday-themed "Santa"
[11]
OpenAI Adds Video in Advanced Voice - 12 Days of OpenAI Day 6
On its sixth day of its 12 Days of OpenAI, it's development team has announced more new updates to ChatGPT, transforming its Advanced Voice mode with video communication and screen-sharing capabilities. These enhancements, part of the "12 Days of OpenAI" initiative, aim to make interactions more
Share
Copy Link
OpenAI introduces real-time video and screen sharing features to ChatGPT's Advanced Voice Mode, enabling users to interact with the AI through their camera and share their screens for immediate assistance.
OpenAI Unveils Real-Time Video and Screen Sharing for ChatGPT
OpenAI has significantly enhanced ChatGPT's capabilities by introducing real-time video and screen sharing features to its Advanced Voice Mode. This development, announced as part of the company's "12 Days of OpenAI" campaign, marks a major step forward in AI-human interaction
1
.New Features and Functionality
The new video feature allows users to point their phone cameras at objects or scenes, enabling ChatGPT to provide real-time analysis and feedback. Similarly, the screen sharing capability lets users share their device screens for immediate assistance with settings or problem-solving
2
.Kevin Weil, OpenAI's Chief Product Officer, explained, "We're excited to announce that we're bringing video to Advanced voice mode so you can bring live video and also live screen sharing into your conversations with ChatGPT"
1
.Practical Applications
The new features open up a wide range of practical applications:
-
DIY Assistance: Users can seek help with tasks like assembling furniture by showing ChatGPT their progress
3
. -
Cooking Support: The AI can provide real-time guidance for cooking techniques or recipe steps
3
. -
Tech Troubleshooting: Users can share their screens for step-by-step guidance through complex settings or software issues
2
. -
Educational Support: Students can share their screens while solving math problems or analyzing diagrams for immediate assistance
4
.
Availability and Access
The new features are currently available to ChatGPT Plus, Pro, and Team subscribers. The rollout began on December 12 and is expected to continue over the following week. However, European users and ChatGPT Enterprise and Edu subscribers will gain access in early 2024
2
5
.Related Stories
Competitive Landscape
OpenAI's move comes amidst growing competition in the AI assistant space:
-
Google recently introduced Project Astra, an AI assistant with similar video capabilities, currently in testing
1
. -
Meta's AI assistant, launched in September, offers comparable real-time video understanding
1
. -
Apple has integrated several ChatGPT features into iOS 18.2, enhancing Siri's capabilities
2
.
Additional Announcements
As part of the "12 Days of OpenAI" campaign, the company has made several other announcements:
-
Introduction of Sora, a new video model for text-to-video and video-to-video content generation
2
. -
Launch of a special Santa voice mode for the holiday season
4
. -
Release of Canvas for all web users, improving project management capabilities
2
.
These developments collectively represent a significant leap in AI-human interaction, potentially changing how users engage with AI assistants in their daily lives.
References
Summarized by
Navi
[2]
Related Stories
Recent Highlights
1
OpenAI Solves Navier-Stokes Problem With AI, Sparking Existential Crisis in Mathematics
Science and Research
2
OpenAI Agents Launched RubyGems Attack With 2,000+ Malicious Packages, Attempted API Key Theft
Technology
3
OpenAI Reveals 6 New Cases of AI Models Hiding Mistakes and Breaking Rules
Policy and Regulation
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
