Microsoft's Copilot Now Offers Real-Time Visual Interaction and Voice Communication

Microsoft's Copilot has been a formidable rival to ChatGPT, and although it's been lagging recently, a new update might just bring it back into the race. On Thursday, Microsoft introduced Copilot Vision, a feature now available in preview for Pro subscribers through Copilot Labs, which allows Copilot to analyze and understand your online activities in real-time, offering verbal assistance.
When you activate Copilot Vision, it can read alongside you, help troubleshoot browsing issues, analyze websites, and offer insights based on what it sees. Essentially, it's a dedicated assistant for your browsing needs, ready to help whenever you need it.
I got a firsthand look at this feature during a Microsoft Copilot and Windows Event in NYC in October. The demo showcased how Copilot Vision can be practically applied. For instance, a user asked for help selecting an outfit from Pinterest. Copilot Vision not only suggested an outfit but also provided encouragement when the user expressed doubts about pulling it off, all through a natural, verbal interaction.
Microsoft also highlighted other potential uses for Copilot Vision, such as assisting with holiday shopping by pinpointing products on a page that match user preferences, or helping plan a museum visit by pulling out key information for the trip.
The feature is integrated into Microsoft Edge, positioned at the browser's bottom. Initially, Copilot Vision is being rolled out to a select group of Copilot Pro subscribers in the U.S. via Copilot Labs, and it will only function on specific websites. As feedback is gathered, Microsoft plans to expand its availability.
For those worried about privacy, Microsoft assures that Copilot Vision is opt-in only, giving users complete control over whether they want their browsing to be monitored. Moreover, any data shared during a session, including verbal interactions and contextual information, is deleted afterward, as per the company's blog post.
The Copilot Pro subscription costs $20 per month and comes with additional benefits such as priority access to the latest models, enhanced access to Copilot Voice, and integration into Microsoft 365 apps like Word, Excel, PowerPoint, OneNote, and Outlook.
Related article
China Telecom Invests in Mianbi Intelligence, Raises Capital to 713,000 Yuan for LLM & Data Infra
The "national team" and the leading figure from Tsinghua University in the large model space are deepening their strategic alignment. On March 1, 2026, according to the latest business registration data from Qichacha, Beijing Mianbi Intelligent Techn
Taotian Group Accelerates AI-Native Restructuring, Grants Interns Free Token Quotas
TaoTian Group recently introduced the "AI Productivity Plan," designed to accelerate the integration of AI technology into e-commerce operations and R&D workflows through resource allocation and tool subsidies. The program is now available to all int
Glean targets enterprise AI infrastructure in land grab
The race to dominate enterprise AI is accelerating. Microsoft is embedding Copilot into Office, Google is integrating Gemini into Workspace, and both OpenAI and Anthropic are selling directly to corporations. Meanwhile, nearly every SaaS vendor now i
Related Special Topic Recommendations
Comments (7)
0/500
C'est dingue comment Microsoft rattrape son retard avec cette mise à jour ! 🤯 Les interactions visuelles en temps réel, c'est exactement ce qui manquait à l'IA. Mais je me demande si ça va vraiment concurrencer ChatGPT sur le long terme, ou si c'est juste un coup d'éclat temporaire...
Agora que eles melhoraram a comunicação por voz e visual, acho que vou testar a versão pro pra trabalhar. Mas será que isso não vai acabar ocupando ainda mais nosso tempo com telas? 🤔
¡El Copilot de Microsoft con interacción visual y de voz en tiempo real? ¡Cuenta conmigo! Es como tener un asistente personal que realmente puede ver y responder. Lo único es que todavía está en versión preliminar, así que hay algunos detalles por pulir. Pero oye, es un paso en la dirección correcta! 💪
O Copilot da Microsoft com interação visual e de voz em tempo real? Estou dentro! É como ter um assistente pessoal que realmente pode ver e responder. A única coisa é que ainda está em versão de prévia, então há alguns ajustes a serem feitos. Mas, ei, é um passo na direção certa! 💪
마이크로소프트의 Copilot에 실시간 비주얼과 음성 상호작용이 추가되다니, 정말 멋지네요! 마치 실제로 볼 수 있고 대화할 수 있는 개인 비서 같아요. 다만 아직 프리뷰 버전이라서 개선할 점이 있어요. 그래도 앞으로의 발전이 기대됩니다! 👀🎤

Microsoft's Copilot has been a formidable rival to ChatGPT, and although it's been lagging recently, a new update might just bring it back into the race. On Thursday, Microsoft introduced Copilot Vision, a feature now available in preview for Pro subscribers through Copilot Labs, which allows Copilot to analyze and understand your online activities in real-time, offering verbal assistance.
When you activate Copilot Vision, it can read alongside you, help troubleshoot browsing issues, analyze websites, and offer insights based on what it sees. Essentially, it's a dedicated assistant for your browsing needs, ready to help whenever you need it.
I got a firsthand look at this feature during a Microsoft Copilot and Windows Event in NYC in October. The demo showcased how Copilot Vision can be practically applied. For instance, a user asked for help selecting an outfit from Pinterest. Copilot Vision not only suggested an outfit but also provided encouragement when the user expressed doubts about pulling it off, all through a natural, verbal interaction.
Microsoft also highlighted other potential uses for Copilot Vision, such as assisting with holiday shopping by pinpointing products on a page that match user preferences, or helping plan a museum visit by pulling out key information for the trip.
The feature is integrated into Microsoft Edge, positioned at the browser's bottom. Initially, Copilot Vision is being rolled out to a select group of Copilot Pro subscribers in the U.S. via Copilot Labs, and it will only function on specific websites. As feedback is gathered, Microsoft plans to expand its availability.
For those worried about privacy, Microsoft assures that Copilot Vision is opt-in only, giving users complete control over whether they want their browsing to be monitored. Moreover, any data shared during a session, including verbal interactions and contextual information, is deleted afterward, as per the company's blog post.
The Copilot Pro subscription costs $20 per month and comes with additional benefits such as priority access to the latest models, enhanced access to Copilot Voice, and integration into Microsoft 365 apps like Word, Excel, PowerPoint, OneNote, and Outlook.
China Telecom Invests in Mianbi Intelligence, Raises Capital to 713,000 Yuan for LLM & Data Infra
The "national team" and the leading figure from Tsinghua University in the large model space are deepening their strategic alignment. On March 1, 2026, according to the latest business registration data from Qichacha, Beijing Mianbi Intelligent Techn
Taotian Group Accelerates AI-Native Restructuring, Grants Interns Free Token Quotas
TaoTian Group recently introduced the "AI Productivity Plan," designed to accelerate the integration of AI technology into e-commerce operations and R&D workflows through resource allocation and tool subsidies. The program is now available to all int
Glean targets enterprise AI infrastructure in land grab
The race to dominate enterprise AI is accelerating. Microsoft is embedding Copilot into Office, Google is integrating Gemini into Workspace, and both OpenAI and Anthropic are selling directly to corporations. Meanwhile, nearly every SaaS vendor now i
C'est dingue comment Microsoft rattrape son retard avec cette mise à jour ! 🤯 Les interactions visuelles en temps réel, c'est exactement ce qui manquait à l'IA. Mais je me demande si ça va vraiment concurrencer ChatGPT sur le long terme, ou si c'est juste un coup d'éclat temporaire...
Agora que eles melhoraram a comunicação por voz e visual, acho que vou testar a versão pro pra trabalhar. Mas será que isso não vai acabar ocupando ainda mais nosso tempo com telas? 🤔
¡El Copilot de Microsoft con interacción visual y de voz en tiempo real? ¡Cuenta conmigo! Es como tener un asistente personal que realmente puede ver y responder. Lo único es que todavía está en versión preliminar, así que hay algunos detalles por pulir. Pero oye, es un paso en la dirección correcta! 💪
O Copilot da Microsoft com interação visual e de voz em tempo real? Estou dentro! É como ter um assistente pessoal que realmente pode ver e responder. A única coisa é que ainda está em versão de prévia, então há alguns ajustes a serem feitos. Mas, ei, é um passo na direção certa! 💪
마이크로소프트의 Copilot에 실시간 비주얼과 음성 상호작용이 추가되다니, 정말 멋지네요! 마치 실제로 볼 수 있고 대화할 수 있는 개인 비서 같아요. 다만 아직 프리뷰 버전이라서 개선할 점이 있어요. 그래도 앞으로의 발전이 기대됩니다! 👀🎤





Home






