Microsoft Unveils Major Copilot Upgrades: Web Actions, Vision, and Personalization

34 Sources

Share

Microsoft celebrates its 50th anniversary by introducing significant enhancements to its AI-powered Copilot, including web browsing capabilities, visual analysis, and personalized interactions.

News article

Microsoft Revolutionizes Copilot with Web Actions and Vision

In celebration of its 50th anniversary, Microsoft has unveiled a suite of groundbreaking updates to its AI-powered assistant, Copilot. These enhancements aim to transform Copilot from a mere chatbot into a personalized, action-oriented companion capable of interacting with the digital and physical world

1

.

Web Browsing and Task Completion

One of the most significant upgrades is Copilot's ability to browse the web and perform actions on "most websites." This new feature, dubbed "Copilot Actions," enables the AI to book tickets, make restaurant reservations, and complete various online tasks

1

. Microsoft has partnered with several major companies, including Booking.com, Expedia, and OpenTable, to ensure day-one compatibility

1

.

Visual Analysis Capabilities

Copilot Vision, previously limited to Edge webpages, is now expanding to Windows and mobile platforms. On Android and iOS devices, Copilot can analyze real-time video and photos from the camera or gallery, offering practical advice such as plant care tips or home decoration suggestions

5

. The Windows version will allow Copilot to interact with the entire desktop, potentially assisting users with complex software like Adobe Photoshop

5

.

Personalization and Memory

In a move towards creating a more personalized AI experience, Copilot now has the ability to remember user preferences and past interactions

2

. This feature aims to provide tailored solutions and proactive suggestions, although Microsoft emphasizes user control over what information is retained

1

.

Additional Features

Microsoft has introduced several other notable features:

  1. Podcast Generation: Copilot can create AI-generated podcasts on user-specified topics

    2

    .
  2. Deep Research: This function combines information from various online sources to answer complex queries

    1

    .
  3. Pages: A project-consolidating tool that organizes notes and research into a canvas

    1

    .
  4. Deal Tracking: Copilot can monitor online deals and notify users of price drops

    1

    .

Industry Context and Competition

These updates come at a time when Microsoft is reportedly considering a revamp of Copilot with more in-house technology, as it has historically relied on AI models from OpenAI

1

. The improvements are seen as a response to the rapid advancements made by competitors like OpenAI's ChatGPT and Google's Gemini

1

.

Privacy and Security Considerations

While these new features offer exciting possibilities, they also raise questions about privacy and security. Microsoft assures users that they have control over what information Copilot remembers and can opt out of personalization features entirely

2

. However, the extent of safeguards against potential misuse of desktop access or private file reading remains unclear

1

.

Future Outlook

Microsoft's vision for Copilot extends beyond being just an AI assistant. Mustafa Suleyman, Executive Vice President and CEO of Microsoft AI, describes it as "far richer, more dynamic, supportive and emergent than any software we've seen before"

2

. The company is even experimenting with giving Copilot customizable appearances, further personalizing the user experience

2

.

As these features roll out over the coming months, it remains to be seen how users will embrace this more integrated and personalized AI companion. The success of these updates could significantly impact Microsoft's position in the competitive AI landscape and potentially reshape how we interact with AI in our daily lives

2

.

TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2025 Triveous Technologies Private Limited
Instagram logo
LinkedIn logo