Introduction to Copilot Vision
Microsoft is expanding its Copilot Vision feature beyond the web, making it available on Windows and mobile devices. Initially, Copilot Vision was limited to Edge webpages, providing guidance on what users were seeing. This expansion marks a significant step forward in the evolution of Microsoft’s AI assistant.
What is Copilot Vision?
Copilot Vision is an innovative feature that analyzes real-time video from a mobile camera, offering users tips and advice on various topics. For instance, it can provide guidance on keeping plants healthy or offer decorating advice for your home. This feature is now available in the Copilot app for both iOS and Android, with a similar feature set to launch on Windows soon.
Copilot Vision on Windows
The Copilot app on Windows is being updated to support Copilot Vision across the entire PC. This enables Microsoft’s AI assistant to perform tasks such as coaching users through Adobe Photoshop features or analyzing photos and webpages. This feature is distinct from Microsoft’s Recall feature on Copilot Plus PCs, which automatically takes snapshots when enabled. In contrast, Copilot Vision is more akin to screen sharing an app or the entire desktop in a Microsoft Teams call.
Availability and Updates
Copilot Vision on Windows will be available to Windows Insiders next week, with a broader rollout planned once testing is complete. In addition to Copilot Vision, Microsoft is updating its AI assistant with a range of new features. These include support for memory, personalization, web-based actions, podcast creation, and deep research, among others.
Conclusion
The expansion of Copilot Vision to Windows and mobile devices represents a significant enhancement to Microsoft’s AI assistant. With its ability to analyze real-time video and provide guidance on various topics, Copilot Vision has the potential to revolutionize the way users interact with their devices. As Microsoft continues to update and refine its AI assistant, it will be exciting to see the new features and capabilities that are introduced. With its commitment to innovation and user experience, Microsoft is poised to remain at the forefront of the AI assistant market.