Microsoft Unveils Major Copilot Upgrades: Web Actions, Vision, and Personalization

Curated by THEOUTPOST

On Sat, 5 Apr, 12:05 AM UTC

34 Sources

Share

Microsoft celebrates its 50th anniversary by introducing significant enhancements to its AI-powered Copilot, including web browsing capabilities, visual analysis, and personalized interactions.

Microsoft Revolutionizes Copilot with Web Actions and Vision

In celebration of its 50th anniversary, Microsoft has unveiled a suite of groundbreaking updates to its AI-powered assistant, Copilot. These enhancements aim to transform Copilot from a mere chatbot into a personalized, action-oriented companion capable of interacting with the digital and physical world 1.

Web Browsing and Task Completion

One of the most significant upgrades is Copilot's ability to browse the web and perform actions on "most websites." This new feature, dubbed "Copilot Actions," enables the AI to book tickets, make restaurant reservations, and complete various online tasks 1. Microsoft has partnered with several major companies, including Booking.com, Expedia, and OpenTable, to ensure day-one compatibility 1.

Visual Analysis Capabilities

Copilot Vision, previously limited to Edge webpages, is now expanding to Windows and mobile platforms. On Android and iOS devices, Copilot can analyze real-time video and photos from the camera or gallery, offering practical advice such as plant care tips or home decoration suggestions 5. The Windows version will allow Copilot to interact with the entire desktop, potentially assisting users with complex software like Adobe Photoshop 5.

Personalization and Memory

In a move towards creating a more personalized AI experience, Copilot now has the ability to remember user preferences and past interactions 2. This feature aims to provide tailored solutions and proactive suggestions, although Microsoft emphasizes user control over what information is retained 1.

Additional Features

Microsoft has introduced several other notable features:

  1. Podcast Generation: Copilot can create AI-generated podcasts on user-specified topics 2.
  2. Deep Research: This function combines information from various online sources to answer complex queries 1.
  3. Pages: A project-consolidating tool that organizes notes and research into a canvas 1.
  4. Deal Tracking: Copilot can monitor online deals and notify users of price drops 1.

Industry Context and Competition

These updates come at a time when Microsoft is reportedly considering a revamp of Copilot with more in-house technology, as it has historically relied on AI models from OpenAI 1. The improvements are seen as a response to the rapid advancements made by competitors like OpenAI's ChatGPT and Google's Gemini 1.

Privacy and Security Considerations

While these new features offer exciting possibilities, they also raise questions about privacy and security. Microsoft assures users that they have control over what information Copilot remembers and can opt out of personalization features entirely 2. However, the extent of safeguards against potential misuse of desktop access or private file reading remains unclear 1.

Future Outlook

Microsoft's vision for Copilot extends beyond being just an AI assistant. Mustafa Suleyman, Executive Vice President and CEO of Microsoft AI, describes it as "far richer, more dynamic, supportive and emergent than any software we've seen before" 2. The company is even experimenting with giving Copilot customizable appearances, further personalizing the user experience 2.

As these features roll out over the coming months, it remains to be seen how users will embrace this more integrated and personalized AI companion. The success of these updates could significantly impact Microsoft's position in the competitive AI landscape and potentially reshape how we interact with AI in our daily lives 2.

Continue Reading
Microsoft Unveils Copilot Wave 2: AI Integration Across 365

Microsoft Unveils Copilot Wave 2: AI Integration Across 365 Suite

Microsoft announces the second wave of Copilot, expanding AI integration across its 365 product suite. The update introduces new features and capabilities aimed at enhancing productivity and creativity for businesses and individual users.

The Hindu logoThe Financial Express logoBeebom logoDigital Trends logo

24 Sources

The Hindu logoThe Financial Express logoBeebom logoDigital Trends logo

24 Sources

Microsoft 365 Copilot Gets Major Upgrade with AI-Powered

Microsoft 365 Copilot Gets Major Upgrade with AI-Powered Features for Business Users

Microsoft has announced significant updates to its 365 Copilot for business users, including AI-powered search, image generation capabilities, and new AI agents, enhancing productivity and collaboration in the enterprise space.

CNET logoZDNet logoThe Verge logotheregister.com logo

10 Sources

CNET logoZDNet logoThe Verge logotheregister.com logo

10 Sources

Microsoft Copilot Unveils Major AI Upgrades, Catching Up to

Microsoft Copilot Unveils Major AI Upgrades, Catching Up to Competitors

Microsoft introduces several new AI features to Copilot, including Deep Research, AI-generated podcasts, and improved shopping capabilities, bringing it closer to competitors like Google Gemini and ChatGPT.

XDA-Developers logoPCWorld logoDigital Trends logoLifehacker logo

6 Sources

XDA-Developers logoPCWorld logoDigital Trends logoLifehacker logo

6 Sources

Microsoft Copilot V2 Introduces Human-Like Voice

Microsoft Copilot V2 Introduces Human-Like Voice Capabilities, Challenging AI Competitors

Microsoft has released a significant update to Copilot V2, introducing advanced neural voice features that aim to provide a more natural and human-like interaction experience. This update positions Microsoft as a strong competitor in the AI voice technology market.

Geeky Gadgets logoLaptopMag logoTom's Guide logoMakeUseOf logo

20 Sources

Geeky Gadgets logoLaptopMag logoTom's Guide logoMakeUseOf logo

20 Sources

Microsoft Copilot Unveils Major Upgrades: Voice

Microsoft Copilot Unveils Major Upgrades: Voice Interactions, News Summaries, and More

Microsoft has announced significant enhancements to its Copilot AI assistant, including natural voice interactions, personalized news briefings, and improved integration across various platforms. These updates are set to roll out in October 2024, marking a new era in AI-assisted productivity and information access.

ZDNet logoSilicon Republic logoGeekWire logoXDA-Developers logo

19 Sources

ZDNet logoSilicon Republic logoGeekWire logoXDA-Developers logo

19 Sources

TheOutpost.ai

Your one-stop AI hub

The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.

© 2025 TheOutpost.AI All rights reserved