Microsoft's Copilot AI Now Analyzes Your Entire Screen Content
Microsoft is introducing an update to Copilot Vision for Windows Insiders, enabling the AI tool to analyze everything displayed on your screen. Previously limited to viewing two applications simultaneously and connecting information between them, the tool can now examine your entire desktop or any specific browser or application window, according to Microsoft.
Unlike Recall, which automatically captures periodic snapshots of your computer screen, using Copilot Vision resembles screen sharing during a video call. You can activate the feature by clicking the glasses icon within the Copilot app and selecting the desktop you want it to observe.
Image: MicrosoftAccording to Microsoft, Copilot Vision can "help analyze content, deliver insights, and answer your questions, guiding you through the process verbally." The company adds, "Get advice for refining your creative projects, assistance with enhancing your resume, or support while navigating unfamiliar games."
Microsoft initially launched testing for Copilot Vision last year as a feature capable of interpreting content viewed in the Edge browser. The tool can also respond to questions about visual input captured through your mobile phone's camera.
Related article
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Google AI Overviews Gain Ground in Search Results
According to Similarweb’s 2026 Generative AI Landscape report, Google’s AI-generated summaries appeared in 43% of US searches, a significant rise from 15% recorded a year prior.While AI Overviews present generated summaries within standard search res
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
Related Special Topic Recommendations
Comments (3)
0/500
Wait, so Microsoft's Copilot can now watch everything on my screen? That's both impressive and mildly terrifying. 😅 I mean, sure, it could help with multitasking or finding info faster, but privacy-wise, this feels like a whole new level of surveillance. Hope they're transparent about what data gets stored or shared. Also, curious how well it handles messy desktop chaos – mine's a disaster zone.
¡Vaya, esto sí que es un cambio radical! 🤯 Microsoft parece decidido a que su IA lo vea TODO. Por un lado, es super útil para productividad (¡adiós al copiar y pegar entre apps!), pero por otro... ¿qué tan cómodo te sentirías sabiendo que un asistente analiza cada píxel de tu pantalla constantemente? Me pregunto sobre el procesamiento de datos privados o incluso sesiones bancarias.
Microsoft is introducing an update to Copilot Vision for Windows Insiders, enabling the AI tool to analyze everything displayed on your screen. Previously limited to viewing two applications simultaneously and connecting information between them, the tool can now examine your entire desktop or any specific browser or application window, according to Microsoft.
Unlike Recall, which automatically captures periodic snapshots of your computer screen, using Copilot Vision resembles screen sharing during a video call. You can activate the feature by clicking the glasses icon within the Copilot app and selecting the desktop you want it to observe.
Image: MicrosoftAccording to Microsoft, Copilot Vision can "help analyze content, deliver insights, and answer your questions, guiding you through the process verbally." The company adds, "Get advice for refining your creative projects, assistance with enhancing your resume, or support while navigating unfamiliar games."
Microsoft initially launched testing for Copilot Vision last year as a feature capable of interpreting content viewed in the Edge browser. The tool can also respond to questions about visual input captured through your mobile phone's camera.
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Google AI Overviews Gain Ground in Search Results
According to Similarweb’s 2026 Generative AI Landscape report, Google’s AI-generated summaries appeared in 43% of US searches, a significant rise from 15% recorded a year prior.While AI Overviews present generated summaries within standard search res
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
Wait, so Microsoft's Copilot can now watch everything on my screen? That's both impressive and mildly terrifying. 😅 I mean, sure, it could help with multitasking or finding info faster, but privacy-wise, this feels like a whole new level of surveillance. Hope they're transparent about what data gets stored or shared. Also, curious how well it handles messy desktop chaos – mine's a disaster zone.
¡Vaya, esto sí que es un cambio radical! 🤯 Microsoft parece decidido a que su IA lo vea TODO. Por un lado, es super útil para productividad (¡adiós al copiar y pegar entre apps!), pero por otro... ¿qué tan cómodo te sentirías sabiendo que un asistente analiza cada píxel de tu pantalla constantemente? Me pregunto sobre el procesamiento de datos privados o incluso sesiones bancarias.





Home






