Home
AI Agents Gain New Ability to Navigate Websites and Apps with Copilot Studio's Latest Skill

Imagine an AI agent capable of not just surfing the web for research, but actually interacting with websites to get things done—all by itself. This is the vision behind Microsoft's latest innovation.
On Wednesday, Microsoft unveiled a new interactive skill for its Copilot Studio platform, which lets users create their own AI agents. This skill, dubbed "computer use," allows any agent you build to navigate and operate desktop applications or websites, performing tasks just as a human would.
This feature is rolling out through an early access research preview. With it, agents can click buttons, navigate menus, and fill out forms on screens, even if no API is available for the app or site. Microsoft put it succinctly: "If a person can use the app, the agent can too."
Your AI agents will be able to use popular browsers like Microsoft Edge, Chrome, and Firefox to carry out these tasks. The feature runs on Microsoft's backend, so you don't need to worry about setting up your own servers. All data generated stays on the Microsoft cloud and isn't used to train their AI models.
One of the coolest parts? These agents can adapt on the fly to changes in apps and websites. If a button or screen layout changes, your agent can still figure out what to do without needing manual updates from you. Plus, with the ability to "see" the screen, they can make decisions in real time, and they're equipped with reasoning capabilities to handle any hiccups without needing your help.
You don't need to know how to code to create an AI agent. Just use natural language to describe what you want the agent to do in Copilot Studio. You can test and tweak your instructions in a simulated mode, watching the steps play out before letting your agent loose. And you can review a detailed history of your agent's actions, complete with screenshots and reasoning steps.
Microsoft's blog post highlighted three scenarios where these AI agents could shine:
- Automated Data Entry: Need to input heaps of data from various sources into a central system? An AI agent can take this off your hands, saving you time and effort.
- Market Research: Marketing folks often need to gather data from multiple online sources. An AI agent could browse these sites and collect the necessary information autonomously.
- Invoice Processing: In finance, extracting data from invoices and entering it into an accounting system is common. An AI agent could do this automatically, ensuring the data gets where it needs to go.
While this all sounds promising, AI isn't perfect yet. Even simple AI bots can err, and with the added complexity of independent computer use, there's a risk your AI agent might make a wrong click or abandon its task.
The real test is in the doing. Microsoft is inviting Copilot Studio users to sign up for early access to this "computer use" feature. If you're not already using Copilot Studio, you can give it a try for free. Just use a work or school account to set it up, and you'll land on the main page where you can start describing the kind of agent you want to build.
Interested in more AI stories? Subscribe to our weekly newsletter, Innovation, for the latest updates.
Related article
Former OpenAI Chief Scientist Ilya’s SSI Unveils First Model
AI has achieved another major milestone. Following his departure from OpenAI, former chief scientist Ilya Sutskever established Safe Superintelligence Inc. (SSI), which has recently unveiled details regarding its inaugural model. Reports from oversea
Lovable Leads Atech's Seed Round as AI Ambient Coding Officially Enters the Hardware Field
On May 14, 2026, AI application development platform Lovable announced its participation in the $800,000 seed funding round for Danish hardware startup Atech. Led by Lovable, the round attracted top-tier venture capital firms including the a16z Scout
Anthropic Expands Claude AI Coding Tools to Japan in Push for Overseas Growth
Anthropic, a prominent U.S. artificial intelligence firm, is intensifying its global outreach. On Wednesday, the company hosted a major developer gathering, "Code with Claude," in Tokyo, drawing close to 500 software engineers. This initiative seeks
Related Special Topic Recommendations
Comments (8)
0/500
So basically we're giving AI the ability to click buttons... what could possibly go wrong? 😅 But seriously, this could be a game-changer for automating boring tasks. Though I wonder how it handles captchas or weird pop-ups.
Interessant! Klingt fast so, als ob wir bald nur noch zuschauen, während die KI unsere Arbeit erledigt. Hoffentlich denkt Microsoft auch an die Datenschutzfragen, wenn seine Agenten durch Websites surfen... 🤔
AI 에이전트가 웹사이트를 돌아다니면서 실제로 뭔가를 처리한다고? 🤯 진짜라면 일상생활에 정말 도움될 것 같은데... 개인정보 보안 문제는 어떻게 해결했을지 궁금해요. 사기꾼들이 악용할 수도 있지 않나 걱정되네요.
This AI navigating websites is wild! Imagine it booking my flights or shopping for me. But, uh, what if it clicks on sketchy ads? 😅 Needs some guardrails!

Imagine an AI agent capable of not just surfing the web for research, but actually interacting with websites to get things done—all by itself. This is the vision behind Microsoft's latest innovation.
On Wednesday, Microsoft unveiled a new interactive skill for its Copilot Studio platform, which lets users create their own AI agents. This skill, dubbed "computer use," allows any agent you build to navigate and operate desktop applications or websites, performing tasks just as a human would.
This feature is rolling out through an early access research preview. With it, agents can click buttons, navigate menus, and fill out forms on screens, even if no API is available for the app or site. Microsoft put it succinctly: "If a person can use the app, the agent can too."
Your AI agents will be able to use popular browsers like Microsoft Edge, Chrome, and Firefox to carry out these tasks. The feature runs on Microsoft's backend, so you don't need to worry about setting up your own servers. All data generated stays on the Microsoft cloud and isn't used to train their AI models.
One of the coolest parts? These agents can adapt on the fly to changes in apps and websites. If a button or screen layout changes, your agent can still figure out what to do without needing manual updates from you. Plus, with the ability to "see" the screen, they can make decisions in real time, and they're equipped with reasoning capabilities to handle any hiccups without needing your help.
You don't need to know how to code to create an AI agent. Just use natural language to describe what you want the agent to do in Copilot Studio. You can test and tweak your instructions in a simulated mode, watching the steps play out before letting your agent loose. And you can review a detailed history of your agent's actions, complete with screenshots and reasoning steps.
Microsoft's blog post highlighted three scenarios where these AI agents could shine:
- Automated Data Entry: Need to input heaps of data from various sources into a central system? An AI agent can take this off your hands, saving you time and effort.
- Market Research: Marketing folks often need to gather data from multiple online sources. An AI agent could browse these sites and collect the necessary information autonomously.
- Invoice Processing: In finance, extracting data from invoices and entering it into an accounting system is common. An AI agent could do this automatically, ensuring the data gets where it needs to go.
While this all sounds promising, AI isn't perfect yet. Even simple AI bots can err, and with the added complexity of independent computer use, there's a risk your AI agent might make a wrong click or abandon its task.
The real test is in the doing. Microsoft is inviting Copilot Studio users to sign up for early access to this "computer use" feature. If you're not already using Copilot Studio, you can give it a try for free. Just use a work or school account to set it up, and you'll land on the main page where you can start describing the kind of agent you want to build.
Interested in more AI stories? Subscribe to our weekly newsletter, Innovation, for the latest updates.
Former OpenAI Chief Scientist Ilya’s SSI Unveils First Model
AI has achieved another major milestone. Following his departure from OpenAI, former chief scientist Ilya Sutskever established Safe Superintelligence Inc. (SSI), which has recently unveiled details regarding its inaugural model. Reports from oversea
Lovable Leads Atech's Seed Round as AI Ambient Coding Officially Enters the Hardware Field
On May 14, 2026, AI application development platform Lovable announced its participation in the $800,000 seed funding round for Danish hardware startup Atech. Led by Lovable, the round attracted top-tier venture capital firms including the a16z Scout
Anthropic Expands Claude AI Coding Tools to Japan in Push for Overseas Growth
Anthropic, a prominent U.S. artificial intelligence firm, is intensifying its global outreach. On Wednesday, the company hosted a major developer gathering, "Code with Claude," in Tokyo, drawing close to 500 software engineers. This initiative seeks
So basically we're giving AI the ability to click buttons... what could possibly go wrong? 😅 But seriously, this could be a game-changer for automating boring tasks. Though I wonder how it handles captchas or weird pop-ups.
Interessant! Klingt fast so, als ob wir bald nur noch zuschauen, während die KI unsere Arbeit erledigt. Hoffentlich denkt Microsoft auch an die Datenschutzfragen, wenn seine Agenten durch Websites surfen... 🤔
AI 에이전트가 웹사이트를 돌아다니면서 실제로 뭔가를 처리한다고? 🤯 진짜라면 일상생활에 정말 도움될 것 같은데... 개인정보 보안 문제는 어떻게 해결했을지 궁금해요. 사기꾼들이 악용할 수도 있지 않나 걱정되네요.
This AI navigating websites is wild! Imagine it booking my flights or shopping for me. But, uh, what if it clicks on sketchy ads? 😅 Needs some guardrails!











