Microsoft Unveils Major Copilot Upgrades: Web Actions, Vision, and Personalization

34 Sources

Microsoft celebrates its 50th anniversary by introducing significant enhancements to its AI-powered Copilot, including web browsing capabilities, visual analysis, and personalized interactions.

News article

Microsoft Revolutionizes Copilot with Web Actions and Vision

In celebration of its 50th anniversary, Microsoft has unveiled a suite of groundbreaking updates to its AI-powered assistant, Copilot. These enhancements aim to transform Copilot from a mere chatbot into a personalized, action-oriented companion capable of interacting with the digital and physical world 1.

Web Browsing and Task Completion

One of the most significant upgrades is Copilot's ability to browse the web and perform actions on "most websites." This new feature, dubbed "Copilot Actions," enables the AI to book tickets, make restaurant reservations, and complete various online tasks 1. Microsoft has partnered with several major companies, including Booking.com, Expedia, and OpenTable, to ensure day-one compatibility 1.

Visual Analysis Capabilities

Copilot Vision, previously limited to Edge webpages, is now expanding to Windows and mobile platforms. On Android and iOS devices, Copilot can analyze real-time video and photos from the camera or gallery, offering practical advice such as plant care tips or home decoration suggestions 5. The Windows version will allow Copilot to interact with the entire desktop, potentially assisting users with complex software like Adobe Photoshop 5.

Personalization and Memory

In a move towards creating a more personalized AI experience, Copilot now has the ability to remember user preferences and past interactions 2. This feature aims to provide tailored solutions and proactive suggestions, although Microsoft emphasizes user control over what information is retained 1.

Additional Features

Microsoft has introduced several other notable features:

  1. Podcast Generation: Copilot can create AI-generated podcasts on user-specified topics 2.
  2. Deep Research: This function combines information from various online sources to answer complex queries 1.
  3. Pages: A project-consolidating tool that organizes notes and research into a canvas 1.
  4. Deal Tracking: Copilot can monitor online deals and notify users of price drops 1.

Industry Context and Competition

These updates come at a time when Microsoft is reportedly considering a revamp of Copilot with more in-house technology, as it has historically relied on AI models from OpenAI 1. The improvements are seen as a response to the rapid advancements made by competitors like OpenAI's ChatGPT and Google's Gemini 1.

Privacy and Security Considerations

While these new features offer exciting possibilities, they also raise questions about privacy and security. Microsoft assures users that they have control over what information Copilot remembers and can opt out of personalization features entirely 2. However, the extent of safeguards against potential misuse of desktop access or private file reading remains unclear 1.

Future Outlook

Microsoft's vision for Copilot extends beyond being just an AI assistant. Mustafa Suleyman, Executive Vice President and CEO of Microsoft AI, describes it as "far richer, more dynamic, supportive and emergent than any software we've seen before" 2. The company is even experimenting with giving Copilot customizable appearances, further personalizing the user experience 2.

As these features roll out over the coming months, it remains to be seen how users will embrace this more integrated and personalized AI companion. The success of these updates could significantly impact Microsoft's position in the competitive AI landscape and potentially reshape how we interact with AI in our daily lives 2.

Explore today's top stories

Apple Considers Partnering with OpenAI or Anthropic to Boost Siri's AI Capabilities

Apple is reportedly in talks with OpenAI and Anthropic to potentially use their AI models to power an updated version of Siri, marking a significant shift in the company's AI strategy.

TechCrunch logoThe Verge logoTom's Hardware logo

29 Sources

Technology

19 hrs ago

Apple Considers Partnering with OpenAI or Anthropic to

Cloudflare Launches Pay-Per-Crawl Feature to Monetize AI Bot Access

Cloudflare introduces a new tool allowing website owners to charge AI companies for content scraping, aiming to balance content creation and AI innovation.

Ars Technica logoTechCrunch logoMIT Technology Review logo

10 Sources

Technology

3 hrs ago

Cloudflare Launches Pay-Per-Crawl Feature to Monetize AI

Elon Musk's xAI Secures $10 Billion in Funding, Intensifying AI Competition

Elon Musk's AI company, xAI, has raised $10 billion in a combination of debt and equity financing, signaling a major expansion in AI infrastructure and development amid fierce industry competition.

TechCrunch logoReuters logoCNBC logo

5 Sources

Business and Economy

11 hrs ago

Elon Musk's xAI Secures $10 Billion in Funding,

Google Unveils Comprehensive AI Tools for Education with Gemini and NotebookLM

Google announces a major expansion of AI tools for education, including Gemini for Education and NotebookLM, aimed at enhancing learning experiences for students and supporting educators in classroom management.

TechCrunch logoThe Verge logoAndroid Police logo

8 Sources

Technology

19 hrs ago

Google Unveils Comprehensive AI Tools for Education with

NVIDIA's GB300 Blackwell Ultra AI Servers Set to Revolutionize AI Computing in Late 2025

NVIDIA's upcoming GB300 Blackwell Ultra AI servers, slated for release in the second half of 2025, are poised to become the most powerful AI servers globally. Major Taiwanese manufacturers are vying for production orders, with Foxconn securing the largest share.

TweakTown logoWccftech logo

2 Sources

Technology

11 hrs ago

NVIDIA's GB300 Blackwell Ultra AI Servers Set to
TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2025 Triveous Technologies Private Limited
Twitter logo
Instagram logo
LinkedIn logo