Microsoft lets Copilot Studio use a computer on its own

by

Microsoft has its own ‘ computer use ‘ feature for AI agents to instantly use websites and apps.

Microsoft has its own ‘ computer use ‘ feature for AI agents to instantly use websites and apps.

STK259_MICROSOFT_COPILOT_3__B
STK259_MICROSOFT_COPILOT_3__B
Tom Warren
is a senior writer and author of Notepad, who has been covering all things Microsoft, PC, and it for over 20 years.
Microsoft has enabled a new” system use” feature for Copilot Artist this week that lets AI agents interact with websites and desktop applications. Much like OpenAI’s Operator or Claude’s perfectly named” system use” function, businesses will be able to use Copilot Studio to develop AI agents that treat websites and desktop apps as if they’re tools for automated tasks.

” Computer use enables agents to interact with websites and desktop applications by clicking buttons, selecting recipes, and typing into areas on the camera”, explains Charles Lamanna, business vice president of Microsoft’s business &amp, business Navigator. ” This allows agents to handle tasks even when there is no API available to connect to the system directly. If a person can use the app, the agent can too”.

Copilot Studio will be able to create AI agents that can automate data entry, perform market research, or even process invoices. This new tool will even detect when buttons and screens change in apps or websites and continue working without failing or breaking, according to Microsoft.

Microsoft added a similar feature, dubbed Actions, to its . Actions can be performed in the background while you work on other tasks. Copilot can now do things like book restaurant reservations, event tickets, and purchase items from online stores. The Actions experience is limited to a number of partners though, and it sounds like Copilot Studio will be free to work with more websites and apps.

Most Popular

Leave a Comment