Microsoft Expands Copilot Vision: AI Assistant Now Available for Free in Edge Browser

Microsoft Introduces Free Copilot Vision in Edge

Microsoft has taken a significant step in democratizing AI technology by making Copilot Vision freely available to all users of its Edge browser. This move, announced by Mustafa Suleyman, CEO of Microsoft AI, on Bluesky, marks a notable expansion of the company's AI capabilities to a broader audience 1

1

What is Copilot Vision?

Copilot Vision is an AI assistant feature that can interpret what's on a user's screen and provide contextual help. It's designed as a "talk-based experience," allowing users to interact with the AI through voice commands. The system can "literally see what you see on screen," enabling it to guide users through various tasks, from cooking recipes to analyzing job descriptions 1

1

Key Features and Limitations

While the free version of Copilot Vision is now available in Edge, it currently has some limitations:

1. It works only on nine specific websites, including Amazon, Wikipedia, and Tripadvisor 2

   2

   .
2. The AI can highlight portions of the screen to help find relevant information but doesn't click links or perform actions on behalf of the user 1

   1

   .
3. Broader, system-wide Copilot Vision features remain exclusive to Copilot Pro subscribers 1

   1

   .

Related Stories

Microsoft's Copilot Vision: AI Assistant That Can See Your Browser Activity

Microsoft Unveils Copilot Vision: AI-Powered Web Browsing Assistant in Edge Browser

Microsoft Launches Copilot Vision for Windows: AI Assistant Expands Screen Analysis Capabilities

Microsoft Expands Copilot Vision AI to Analyze Entire Desktop in Windows 11

Privacy and Data Handling

Microsoft has implemented several measures to address potential privacy concerns:

1. Copilot Vision is an opt-in feature, giving users control over its activation 3

   3

   .
2. The company claims it doesn't collect user inputs, images, or page content during a Copilot Vision session 1

   1

   .
3. All conversation data, including user prompts and web page content, is deleted at the end of each session 3

   3

   .

Potential Applications

Copilot Vision offers various practical applications:

1. Assisting with cooking by reading out recipe steps and answering questions hands-free 2

   2

   .
2. Helping users navigate online shopping by identifying specific product features or materials 2

   2

   .
3. Summarizing multiple reviews for products or services 3

   3

   .
4. Providing context-aware assistance for job applications and interview preparation 1

   1

   .

This expansion of Copilot Vision represents Microsoft's ongoing efforts to integrate AI more deeply into everyday computing experiences, potentially reshaping how users interact with web content and perform online tasks.