![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio--scaled.png\")
Business documents such as purchase orders, invoices, reports, and shipping documents often contain valuable information in tabular format. In many organizations, this information is still copied manually into spreadsheets or business applications, which takes time and increases the possibility of errors.<\/p>\n
Microsoft Copilot Studio includes Computer Use, a capability that enables an agent to interact with applications through their user interface. Instead of depending on APIs or custom integrations, the agent can automatically open applications, navigate through screens, identify information, and complete tasks based on what it sees on the screen.<\/p>\n
In this blog, we’ll build a practical solution that uses Computer Use to open a PDF document, identify the primary table, and extract its contents into a structured JSON format. The extracted data is then passed to a Power Automate flow, which converts it into a CSV file and sends it as an email attachment. This demonstrates how AI-driven UI automation can simplify document processing while reducing manual effort.<\/p>\n
Let\u2019s consider a potential use case:<\/p>\n
Many organizations store business documents such as purchase orders, invoices, and reports in SharePoint document libraries for centralized access and collaboration. These documents often contain important tabular information that needs to be extracted and shared with other teams or business applications. Performing this task manually requires users to open each PDF, identify the required table, and copy the data into a structured format, making the process repetitive and prone to errors.<\/p>\n
In this scenario, a purchase order PDF is stored in a SharePoint document library. A Copilot Studio agent uses Computer Use to open the PDF directly from SharePoint, identify the primary table containing the line-item details, and extract the data into a structured JSON format. The extracted data is then passed to a Power Automate flow, which converts it into a CSV file and sends it as an email attachment. This approach reduces manual effort and provides a simple way to automate document processing using AI-driven UI automation.<\/p>\n
By the end of this article, you’ll know how to:<\/p>\n
Let’s go through the end-to-end implementation of this solution.<\/p>\n
Before we get started, ensure you have the following:<\/p>\n
Step 1<\/strong>:<\/p>\n Sign in to Microsoft Copilot Studio<\/strong> by navigating to https:\/\/copilotstudio.microsoft.com\/<\/strong><\/a>. Once you’re signed in, open your agent and select Tools<\/strong> from the left navigation menu. Click Add tool<\/strong>, select New tool<\/strong>, and then choose Computer use<\/strong> to create a new Computer Use tool.<\/p>\n Click Add and configure<\/strong> to create the Computer Use tool. This opens the configuration page where you can define the execution environment, authentication settings, and instructions for the agent. For now, keep the default configuration, as we will add the instructions for the Computer Use agent in a later step.<\/p>\n Step 3:<\/strong><\/p>\n The Computer Use tool configuration page will open. Enter an appropriate Name<\/strong> and Description<\/strong> for the tool. Under the Model<\/strong> section, select Claude Sonnet 4.5<\/strong>, as it provides the capabilities required for performing Computer Use tasks. Once the basic configuration is complete, click Save<\/strong> to proceed.<\/p>\n Step 4: Add the Computer Use Instructions Copy and paste the following instructions into the Instructions section of the Computer Use tool.<\/p>\n You are an intelligent document extraction assistant. Wait until the PDF is fully loaded. Preserve the original column names from the table header. Return ONLY a valid JSON array. Step 5: Configure the Execution Settings Next, under Stored credentials<\/strong>, click Add and configure the credentials that the agent will use to sign in to the SharePoint site. Store the username and password for the Microsoft sign-in page (for example, login.microsoftonline.com). During execution, the Computer Use agent automatically uses these stored credentials to authenticate. If additional verification, such as Multi-Factor Authentication (MFA), is required, the assigned reviewer can respond to the agent’s request and allow the execution to continue.<\/p>\n Step 7:<\/strong> Provide an appropriate name for the flow and click Create<\/strong> to continue.<\/p>\n Step 8:<\/strong> Next, add a Parse JSON<\/strong> action and set the Content<\/strong> field to the ExtractedJson<\/strong> input. Generate the schema using a sample of the JSON returned by the Computer Use agent. This enables Power Automate to interpret the extracted data and make each property available for subsequent actions.<\/p>\n After parsing the JSON, add the Create CSV table<\/strong> action. Set the From<\/strong> field to the Body<\/strong> output of the Parse JSON<\/strong> action. This converts the extracted table data into a CSV format that can be used in downstream actions, such as sending it as an email attachment.<\/p>\n This step prepares the extracted PDF data for further processing within the flow.<\/p>\n Step 9:<\/strong> Next, add a Get file content<\/strong> action and set the File<\/strong> field to the Id<\/strong> returned by the Create file<\/strong> action. This retrieves the contents of the generated CSV file, allowing it to be used in subsequent actions, such as sending it as an email attachment.<\/p>\n Step 10:<\/strong> Finally, add the Respond to Copilot<\/strong> action. Return a success response indicating that the flow completed successfully. For example, you can return the following JSON:<\/p>\n {<\/p>\n “Status”: “Success”,<\/p>\n “Message”: “CSV generated and emailed successfully.”<\/p>\n } Step 11:<\/strong> For example, you can use instructions similar to the following: After saving the instructions, publish the agent. The agent is now configured to use the Computer Use tool for PDF table extraction and the Power Automate flow for generating and emailing the CSV output.<\/p>\n Test Results: During execution, the agent performs the following actions:<\/p>\n Conclusion<\/strong>: In this blog, we built an end-to-end solution using Microsoft Copilot Studio Computer Use<\/strong> and Power Automate<\/strong> to automate the extraction of tabular data from a PDF stored in SharePoint. The Computer Use tool interacted with the PDF through its user interface, extracted the required table into a structured JSON format, and passed the data to a Power Automate flow. The flow then converted the extracted data into a CSV file and emailed it to the intended recipient.<\/p>\n 1. What is Computer Use in Microsoft Copilot Studio?<\/strong><\/p>\n Computer Use is a capability in Microsoft Copilot Studio that enables agents to interact with applications through their graphical user interface (GUI). Instead of relying on APIs, the agent can open applications, navigate screens, extract information, and perform tasks based on what it sees.<\/p>\n 2. Can Copilot Studio extract data from PDF files?<\/strong><\/p>\n Yes. By using the Computer Use capability, a Copilot Studio agent can open PDF documents, identify tables or other relevant information, and extract the data into a structured format such as JSON for further processing.<\/p>\n <\/p>\n","protected":false},"excerpt":{"rendered":" Business documents such as purchase orders, invoices, reports, and shipping documents often contain valuable information in tabular format. In many organizations, this information is still copied manually into spreadsheets or business applications, which takes time and increases the possibility of errors. Microsoft Copilot Studio includes Computer Use, a capability that enables an agent to interact\u2026 Read More: Automating PDF Data Extraction Using Computer Use within Copilot Studio »<\/a><\/span><\/p>\n","protected":false},"author":15,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3313,2361],"tags":[3403],"class_list":["post-45612","post","type-post","status-publish","format-standard","hentry","category-microsoft-copilot-studio","category-technical","tag-pdf-data-extraction"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-1.jpg\")
<\/strong><\/p>\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-2.jpg\")
\nStep 2<\/strong>:<\/p>\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-3.jpg\")
<\/p>\n
\n<\/strong>The next step is to provide instructions that guide the Computer Use tool on how to interact with the PDF. These instructions tell the agent where the PDF is located, how to handle authentication, identify the required table, and return the extracted data in a structured JSON format.<\/p>\n
\nYour task is to extract the primary tabular data from a PDF document.
\nOpen Microsoft Edge.
\nNavigate to: Please paste the sharepoint document folder link
\nIf authentication is required:
\n– Use the stored username.
\n– Use the stored password.
\n– If Multi-Factor Authentication (MFA) is requested, pause and wait for the user to approve it.
\n– Continue automatically after authentication succeeds.<\/p>\n
\nExamine the document to identify the main table containing business data.
\nIgnore logos, headers, addresses, titles, summaries, footers, and terms & conditions.
\nFocus on the largest table containing rows of business records or line items.
\nIf the table spans multiple pages:
\n– Scroll through the document.
\n– Continue extracting rows until the complete table has been captured.
\n– Do not stop after the first page.<\/p>\n
\nExtract every row exactly as displayed.
\nUse the following data types consistently:
\n– Line: String
\n– Qty: String
\n– Item Code: String
\n– Description: String
\n– UOM: String
\n– Unit Price: String
\n– Amount: String<\/p>\n
\nEach JSON object should represent one row.
\nUse the actual column names from the PDF as the JSON property names.
\nDo not include explanations, markdown, summaries, or additional text.
\nReturn only valid JSON.
\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-4.jpg\")
<\/p>\n
\n<\/strong>Next, configure the execution settings for the Computer Use tool. Set the Outputs type to Text, as the agent will return the extracted table data in JSON format. Under Machine, select Hosted Browser to execute the automation in a Microsoft-hosted browser session. Finally, set Credentials to use to End user credentials so the agent can authenticate using the credentials configured for the end user.
\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-5.jpg\")
\nStep 6:
\n<\/strong>Under Human supervision, assign a reviewer who can receive and respond to requests from the Computer Use agent. Human supervision<\/strong> allows the agent to contact a designated reviewer for confirmation or to request additional information whenever manual intervention is required during execution. These notifications are sent through Outlook. Set the Response time limit<\/strong> to 1 Hour.<\/p>\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-6.jpg\")
<\/p>\n
\nSign in to Power Automate<\/strong> by navigating to https:\/\/powerautomate.microsoft.com\/<\/strong><\/a>. From the left navigation pane, select Create<\/strong>, choose Instant cloud flow<\/strong>, and then select the When an agent calls the flow<\/strong> trigger. This trigger enables the flow to be invoked directly from a Copilot Studio agent, allowing it to process the data extracted by the Computer Use tool.<\/p>\n
\nIn the When an agent calls the flow<\/strong> trigger, add a Text<\/strong> input named ExtractedJson<\/strong>. This input will receive the JSON data returned by the Computer Use tool.<\/p>\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-7.jpg\")
<\/p>\n
\nAfter generating the CSV data, add a Create file<\/strong> action (OneDrive for Business) to save the CSV file temporarily. Specify the destination folder, provide a meaningful file name (for example, PurchaseOrder_<timestamp>.csv), and set the File Content<\/strong> to the Output<\/strong> from the Create CSV table<\/strong> action.<\/p>\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-8.jpg\")
<\/p>\n
\nAdd a Send an email (V2)<\/strong> action to the flow. Configure the recipient’s email address, provide an appropriate subject, and compose the email body. Under Attachments<\/strong>, use the file content obtained from the Get file content<\/strong> action and specify the CSV file name. This sends the generated CSV file as an email attachment to the intended recipient.<\/p>\n
\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-9.jpg\")
<\/p>\n
\nSave and enable the Power Automate flow. Return to your Copilot Studio agent and edit the agent instructions to orchestrate the complete process. The instructions should direct the agent to invoke the Computer Use tool to extract the table data from the PDF and then pass the extracted JSON to the Power Automate flow for further processing.<\/p>\n
\nWhenever a PDF is added or updated in the specified SharePoint document library, invoke the Computer Use tool to extract the primary table from the PDF. Once the extraction is complete, pass the returned JSON to the Power Automate flow to generate a CSV file and email it to the configured recipient.<\/p>\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-10.jpg\")
<\/p>\n
\n<\/strong>After publishing the Copilot Studio agent, invoke it by providing a prompt to extract the table from the Purchase Order PDF stored in the SharePoint document library.<\/p>\n\n
![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-11.jpg\")
<\/p>\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-12.jpg\")
<\/p>\n![\"Automating](\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/08\/Automating-PDF-Data-Extraction-Using-Computer-Use-within-Copilot-Studio-13.jpg\")
<\/p>\nFrequently Asked Questions (FAQs)<\/strong><\/h3>\n