HomeMicrosoft's Copilot Now Offers Real-Time Visual Interaction and Voice Communication
Microsoft's Copilot has been a formidable rival to ChatGPT, and although it's been lagging recently, a new update might just bring it back into the race. On Thursday, Microsoft introduced Copilot Vision, a feature now available in preview for Pro subscribers through Copilot Labs, which allows Copilot to analyze and understand your online activities in real-time, offering verbal assistance.
When you activate Copilot Vision, it can read alongside you, help troubleshoot browsing issues, analyze websites, and offer insights based on what it sees. Essentially, it's a dedicated assistant for your browsing needs, ready to help whenever you need it.
I got a firsthand look at this feature during a Microsoft Copilot and Windows Event in NYC in October. The demo showcased how Copilot Vision can be practically applied. For instance, a user asked for help selecting an outfit from Pinterest. Copilot Vision not only suggested an outfit but also provided encouragement when the user expressed doubts about pulling it off, all through a natural, verbal interaction.
Microsoft also highlighted other potential uses for Copilot Vision, such as assisting with holiday shopping by pinpointing products on a page that match user preferences, or helping plan a museum visit by pulling out key information for the trip.
The feature is integrated into Microsoft Edge, positioned at the browser's bottom. Initially, Copilot Vision is being rolled out to a select group of Copilot Pro subscribers in the U.S. via Copilot Labs, and it will only function on specific websites. As feedback is gathered, Microsoft plans to expand its availability.
For those worried about privacy, Microsoft assures that Copilot Vision is opt-in only, giving users complete control over whether they want their browsing to be monitored. Moreover, any data shared during a session, including verbal interactions and contextual information, is deleted afterward, as per the company's blog post.
The Copilot Pro subscription costs $20 per month and comes with additional benefits such as priority access to the latest models, enhanced access to Copilot Voice, and integration into Microsoft 365 apps like Word, Excel, PowerPoint, OneNote, and Outlook.
Related article
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
How Recursive Intelligence Raised $335M at $4B Valuation in 4 Months
The co-founders of startup Ricursive Intelligence seemed destined to be co-founders.Anna Goldie, CEO, and Azalia Mirhoseini, CTO, are so well-known in the AI community that they were among those AI engineers who “got those weird emails from Zuckerber
Related Special Topic Recommendations
Design & Art
Top AI Illustration Tools: Create Editorial Scenes and Cover Art Faster
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
Education and Learning
Top AI Tutors for Exam Prep: Practice Math, Science, and English
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
Finance
AI Budget Planning Tools for Personal Money Management
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
Health & Wellness
AI Sleep Tracking Assistants: Improve Recovery with Better Bedtime Habits
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
Data Analysis
AI SQL Copilots for Product and Revenue Analytics
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
Education and Learning
Best AI Homework Helpers That Teach: Learn Concepts, Not Just Answers
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Comments (7)
0/500
![JuanAdams]()
C'est dingue comment Microsoft rattrape son retard avec cette mise à jour ! 🤯 Les interactions visuelles en temps réel, c'est exactement ce qui manquait à l'IA. Mais je me demande si ça va vraiment concurrencer ChatGPT sur le long terme, ou si c'est juste un coup d'éclat temporaire...
![CharlesLee]()
Agora que eles melhoraram a comunicação por voz e visual, acho que vou testar a versão pro pra trabalhar. Mas será que isso não vai acabar ocupando ainda mais nosso tempo com telas? 🤔
![BruceSmith]()
¡El Copilot de Microsoft con interacción visual y de voz en tiempo real? ¡Cuenta conmigo! Es como tener un asistente personal que realmente puede ver y responder. Lo único es que todavía está en versión preliminar, así que hay algunos detalles por pulir. Pero oye, es un paso en la dirección correcta! 💪
![JimmyGarcia]()
O Copilot da Microsoft com interação visual e de voz em tempo real? Estou dentro! É como ter um assistente pessoal que realmente pode ver e responder. A única coisa é que ainda está em versão de prévia, então há alguns ajustes a serem feitos. Mas, ei, é um passo na direção certa! 💪
![EricRoberts]()
마이크로소프트의 Copilot에 실시간 비주얼과 음성 상호작용이 추가되다니, 정말 멋지네요! 마치 실제로 볼 수 있고 대화할 수 있는 개인 비서 같아요. 다만 아직 프리뷰 버전이라서 개선할 점이 있어요. 그래도 앞으로의 발전이 기대됩니다! 👀🎤
![EdwardTaylor]()
マイクロソフトのCopilotにリアルタイムのビジュアルと音声インタラクションが追加されたのは素晴らしい！まるで本当に見て話せるパーソナルアシスタントがいるみたい。ただ、まだプレビュー版なので、改善の余地はありますね。それでも、これからの進化が楽しみです！👀🎤
Microsoft's Copilot has been a formidable rival to ChatGPT, and although it's been lagging recently, a new update might just bring it back into the race. On Thursday, Microsoft introduced Copilot Vision, a feature now available in preview for Pro subscribers through Copilot Labs, which allows Copilot to analyze and understand your online activities in real-time, offering verbal assistance.
When you activate Copilot Vision, it can read alongside you, help troubleshoot browsing issues, analyze websites, and offer insights based on what it sees. Essentially, it's a dedicated assistant for your browsing needs, ready to help whenever you need it.
I got a firsthand look at this feature during a Microsoft Copilot and Windows Event in NYC in October. The demo showcased how Copilot Vision can be practically applied. For instance, a user asked for help selecting an outfit from Pinterest. Copilot Vision not only suggested an outfit but also provided encouragement when the user expressed doubts about pulling it off, all through a natural, verbal interaction.
Microsoft also highlighted other potential uses for Copilot Vision, such as assisting with holiday shopping by pinpointing products on a page that match user preferences, or helping plan a museum visit by pulling out key information for the trip.
The feature is integrated into Microsoft Edge, positioned at the browser's bottom. Initially, Copilot Vision is being rolled out to a select group of Copilot Pro subscribers in the U.S. via Copilot Labs, and it will only function on specific websites. As feedback is gathered, Microsoft plans to expand its availability.
For those worried about privacy, Microsoft assures that Copilot Vision is opt-in only, giving users complete control over whether they want their browsing to be monitored. Moreover, any data shared during a session, including verbal interactions and contextual information, is deleted afterward, as per the company's blog post.
The Copilot Pro subscription costs $20 per month and comes with additional benefits such as priority access to the latest models, enhanced access to Copilot Voice, and integration into Microsoft 365 apps like Word, Excel, PowerPoint, OneNote, and Outlook.
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
How Recursive Intelligence Raised $335M at $4B Valuation in 4 Months
The co-founders of startup Ricursive Intelligence seemed destined to be co-founders.Anna Goldie, CEO, and Azalia Mirhoseini, CTO, are so well-known in the AI community that they were among those AI engineers who “got those weird emails from Zuckerber
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
C'est dingue comment Microsoft rattrape son retard avec cette mise à jour ! 🤯 Les interactions visuelles en temps réel, c'est exactement ce qui manquait à l'IA. Mais je me demande si ça va vraiment concurrencer ChatGPT sur le long terme, ou si c'est juste un coup d'éclat temporaire...
Agora que eles melhoraram a comunicação por voz e visual, acho que vou testar a versão pro pra trabalhar. Mas será que isso não vai acabar ocupando ainda mais nosso tempo com telas? 🤔
¡El Copilot de Microsoft con interacción visual y de voz en tiempo real? ¡Cuenta conmigo! Es como tener un asistente personal que realmente puede ver y responder. Lo único es que todavía está en versión preliminar, así que hay algunos detalles por pulir. Pero oye, es un paso en la dirección correcta! 💪
O Copilot da Microsoft com interação visual e de voz em tempo real? Estou dentro! É como ter um assistente pessoal que realmente pode ver e responder. A única coisa é que ainda está em versão de prévia, então há alguns ajustes a serem feitos. Mas, ei, é um passo na direção certa! 💪
마이크로소프트의 Copilot에 실시간 비주얼과 음성 상호작용이 추가되다니, 정말 멋지네요! 마치 실제로 볼 수 있고 대화할 수 있는 개인 비서 같아요. 다만 아직 프리뷰 버전이라서 개선할 점이 있어요. 그래도 앞으로의 발전이 기대됩니다! 👀🎤
マイクロソフトのCopilotにリアルタイムのビジュアルと音声インタラクションが追加されたのは素晴らしい！まるで本当に見て話せるパーソナルアシスタントがいるみたい。ただ、まだプレビュー版なので、改善の余地はありますね。それでも、これからの進化が楽しみです！👀🎤
