Microsoft Expands Copilot Vision to Windows and Mobile for Enhanced Real-World AI Assistance
â–¼ Summary
– Microsoft is expanding its Copilot Vision feature to Windows and mobile platforms, beyond its initial web-based use on Edge.
– The update allows Copilot Vision to analyze real-time video from mobile cameras, offering practical advice like plant care tips and home decoration ideas.
– The Copilot app for iOS and Android will include this feature starting today, with a Windows version to follow soon.
– Copilot Vision on Windows will integrate across the PC, helping with tasks such as navigating Adobe Photoshop and analyzing images and web content.
– Windows Insiders will access Copilot Vision next week, with a broader rollout after testing, and new capabilities like memory, personalization, and podcast creation are being added to Copilot.
Microsoft is expanding the reach of its Copilot Vision feature, bringing it beyond the confines of the web and into Windows and mobile platforms. Initially introduced as part of the Copilot redesign last year, Copilot Vision has so far been limited to aiding users on Edge webpages by providing insightful guides on what they are viewing.
With the latest update, Copilot Vision is set to analyze real-time video captured by mobile cameras, enabling the AI assistant to provide practical advice, such as tips for maintaining plant health or decorating your living space. Starting today, the Copilot app for both iOS and Android will include this feature, with a Windows version anticipated to follow shortly.
The Copilot app on Windows is also receiving enhancements to integrate Copilot Vision across the entire PC. This integration empowers Microsoft’s AI assistant to assist users with tasks like navigating Adobe Photoshop features or analyzing the images and web content displayed on their screens.
It is important to note that Copilot Vision operates differently from Microsoft’s Recall feature found on Copilot Plus PCs. While Recall automatically captures snapshots when activated, Copilot Vision functions more akin to a screen-sharing tool, offering real-time analysis similar to what users experience during a Microsoft Teams call.
Windows Insiders will gain access to Copilot Vision next week, with a broader rollout planned after thorough testing. Additionally, Microsoft is introducing a suite of new capabilities to Copilot today. The AI assistant now supports features such as memory, personalization, web-based actions, podcast creation, deep research, and more.
(Source: The Verge)
