Microsoft Allows Copilot Studio to Operate Computer Independently

This week, Microsoft rolled out an exciting new feature for Copilot Studio called "computer use," which allows AI agents to interact with websites and desktop applications in a way that feels almost human. Think of it as giving your AI a pair of digital hands to click buttons, navigate menus, and type into fields on the screen. It's a game-changer, especially for businesses looking to automate tasks without the need for direct API connections.

Charles Lamanna, the corporate vice president of Microsoft's business & industry Copilot, put it this way: "Computer use enables agents to interact with websites and desktop apps by clicking buttons, selecting menus, and typing into fields on the screen. This allows agents to handle tasks even when there is no API available to connect to the system directly. If a person can use the app, the agent can too." It's like giving your AI a license to operate any software tool you use daily.

With this new capability, Copilot Studio can craft AI agents that take on a variety of tasks, from data entry to market research, and even invoice processing. What's more, these AI agents are smart enough to adapt when apps or websites update their interfaces. They won't just stop working because a button moved or a screen changed; they'll keep going, ensuring your automation stays on track.

Microsoft isn't stopping there. Earlier this month, they introduced a similar feature called Actions for their consumer Copilot. These Actions can run in the background, freeing you up to focus on other tasks while Copilot books your restaurant reservations, snags event tickets, or shops online for you. However, the Actions feature is currently limited to a select group of partners. On the other hand, Copilot Studio's "computer use" feature seems poised to play nicely with a broader range of websites and apps, offering more flexibility for businesses.