{"id":44865,"date":"2026-06-09T12:23:59","date_gmt":"2026-06-09T06:53:59","guid":{"rendered":"https:\/\/www.inogic.com\/blog\/?p=44865"},"modified":"2026-06-09T12:23:59","modified_gmt":"2026-06-09T06:53:59","slug":"how-integrate-application-insights-with-copilot-studio-for-better-ai-monitoring","status":"publish","type":"post","link":"https:\/\/www.inogic.com\/blog\/2026\/06\/how-integrate-application-insights-with-copilot-studio-for-better-ai-monitoring\/","title":{"rendered":"How to Integrate Application Insights with Copilot Studio for Better AI Monitoring"},"content":{"rendered":"<p><img decoding=\"async\" class=\"alignnone size-full wp-image-44873\" style=\"border: 1px solid #000000; padding: 1px; margin: 1px;\" src=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/How-to-Integrate-Application-Insights-with-Copilot-Studio-for-Better-AI-Monitoring.png\" alt=\"Copilot Studio \" width=\"2100\" height=\"1200\" srcset=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/How-to-Integrate-Application-Insights-with-Copilot-Studio-for-Better-AI-Monitoring.png 2100w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/How-to-Integrate-Application-Insights-with-Copilot-Studio-for-Better-AI-Monitoring-300x171.png 300w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/How-to-Integrate-Application-Insights-with-Copilot-Studio-for-Better-AI-Monitoring-1024x585.png 1024w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/How-to-Integrate-Application-Insights-with-Copilot-Studio-for-Better-AI-Monitoring-768x439.png 768w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/How-to-Integrate-Application-Insights-with-Copilot-Studio-for-Better-AI-Monitoring-1536x878.png 1536w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/How-to-Integrate-Application-Insights-with-Copilot-Studio-for-Better-AI-Monitoring-2048x1170.png 2048w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/How-to-Integrate-Application-Insights-with-Copilot-Studio-for-Better-AI-Monitoring-660x377.png 660w\" sizes=\"(max-width: 2100px) 100vw, 2100px\" \/>AI agents built using Microsoft Copilot Studio are now widely used for customer support, employee self-service, and IT automation. While building an AI agent is easy, monitoring and optimizing it in production is the real challenge.<\/p>\n<p>Organizations frequently need answers to important operational questions such as why conversations are failing, which topics are leading to escalations, why users are abandoning conversations midway, or whether backend APIs are causing delays. Without proper monitoring and diagnostics, the AI agent eventually becomes a black box with very limited visibility into its real-world performance.<\/p>\n<p>This is where integrating Azure Application Insights with Copilot Studio becomes valuable. It provides telemetry, diagnostics, performance monitoring, and operational visibility for enterprise AI agents, helping organizations better understand how their agents behave in production environments.<\/p>\n<p>Once integrated with Copilot Studio, Application Insights can capture valuable telemetry such as conversation start and end events, triggered topics, node execution paths, fallback scenarios, response latency, API performance, errors, exceptions, and dependency tracking for external systems. These insights help organizations proactively monitor, troubleshoot, and optimize their AI agents more effectively.<\/p>\n<p>To better understand how telemetry improves AI operations, consider the following real-world scenario.<\/p>\n<h3>Real Business Use Case: AI-Powered Telecom Customer Support<\/h3>\n<p>Consider a telecom organization that deploys a Copilot Studio agent to handle customer operations such as SIM activation, recharge assistance, and bill payment support. Initially, the AI agent reduces support workload by automating repetitive customer interactions.<\/p>\n<p>However, after moving to production, the support team begins noticing several operational challenges. This included increase in escalations to human agents, users abandoning conversations midway, and slower response times during specific support journeys.<\/p>\n<h3><strong>How Application Insights Helped<\/strong><\/h3>\n<p>Application Insights provided detailed telemetry and operational visibility into the AI agent.<\/p>\n<p>The organization was able to identify:<\/p>\n<ol>\n<li>The exact conversation flow where users were dropping off<\/li>\n<li>Topics generating the highest escalation volume<\/li>\n<li>Backend APIs impacting response performance<\/li>\n<li>Repeated fallback scenarios affecting customer experience<\/li>\n<\/ol>\n<p>This improves:<\/p>\n<ul>\n<li>Customer satisfaction<\/li>\n<li>Operational efficiency<\/li>\n<li>AI containment rate<\/li>\n<li>Support cost reduction<\/li>\n<\/ul>\n<h3>Step-by-Step Integration<\/h3>\n<p><strong>Step 1 \u2013 Create Application Insights<\/strong><\/p>\n<p>To create an Application Insights resource, refer to the Microsoft documentation below:<\/p>\n<p><a href=\"https:\/\/learn.microsoft.com\/en-us\/azure\/azure-monitor\/app\/create-workspace-resource?tabs=portal\" target=\"_blank\" rel=\"noopener\">Microsoft Documentation \u2013 Create Application Insights Resource<\/a><\/p>\n<p>Once the Application Insights resource is created:<\/p>\n<ol>\n<li>Open the Application Insights resource<\/li>\n<li>Navigate to <strong>Overview<\/strong><\/li>\n<li>Copy the <strong>Connection String using Copy to clipboard button.<\/strong><\/li>\n<\/ol>\n<p>This connection string will be used in Copilot Studio configuration.<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-44866\" style=\"border: 1px solid #000000; padding: 1px; margin: 1px;\" src=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-1-1.jpg\" alt=\"Copilot Studio \" width=\"1377\" height=\"589\" srcset=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-1-1.jpg 1377w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-1-1-300x128.jpg 300w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-1-1-1024x438.jpg 1024w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-1-1-768x329.jpg 768w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-1-1-660x282.jpg 660w\" sizes=\"(max-width: 1377px) 100vw, 1377px\" \/><\/p>\n<p><strong>Step 2 \u2013 Configure in Copilot Studio<\/strong><\/p>\n<p><strong>A.<\/strong> Open your agent in Copilot Studio and click the Settings button in the top-right corner.<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-44867\" style=\"border: 1px solid #000000; padding: 1px; margin: 1px;\" src=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-2-1.jpg\" alt=\"Copilot Studio \" width=\"1378\" height=\"581\" srcset=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-2-1.jpg 1378w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-2-1-300x126.jpg 300w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-2-1-1024x432.jpg 1024w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-2-1-768x324.jpg 768w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-2-1-660x278.jpg 660w\" sizes=\"(max-width: 1378px) 100vw, 1378px\" \/><\/p>\n<p><strong>B.<\/strong> From the Settings page, navigate to the Advanced section available in the left navigation panel. Under Advanced, locate the Application Insights section, where you can configure the Connection String along with additional logging and telemetry options.<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-44868\" style=\"border: 1px solid #000000; padding: 1px; margin: 1px;\" src=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-3-1.jpg\" alt=\"Copilot Studio \" width=\"1377\" height=\"588\" srcset=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-3-1.jpg 1377w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-3-1-300x128.jpg 300w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-3-1-1024x437.jpg 1024w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-3-1-768x328.jpg 768w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-3-1-660x282.jpg 660w\" sizes=\"(max-width: 1377px) 100vw, 1377px\" \/><\/p>\n<p><strong>C.<\/strong> Save the configuration.<\/p>\n<p><strong>Step 3 \u2013 Publish and Test<\/strong><\/p>\n<p>Publish the agent and trigger conversations to generate telemetry.<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-44869\" style=\"border: 1px solid #000000; padding: 1px; margin: 1px;\" src=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-4-1.jpg\" alt=\"Copilot Studio \" width=\"1906\" height=\"816\" srcset=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-4-1.jpg 1906w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-4-1-300x128.jpg 300w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-4-1-1024x438.jpg 1024w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-4-1-768x329.jpg 768w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-4-1-1536x658.jpg 1536w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-4-1-660x283.jpg 660w\" sizes=\"(max-width: 1906px) 100vw, 1906px\" \/><\/p>\n<p><strong>Step 4 \u2013 Verify flow in Application Insights<\/strong><\/p>\n<ol>\n<li>Return to the Application Insights resource in the Azure portal and navigate to <strong>Monitoring \u2192 Metrics<\/strong>.<\/li>\n<li>Select <strong>Users<\/strong> as the metric and choose <strong>Unique<\/strong> as the aggregation type. After running a few test conversations, you should be able to see at least one unique user reflected in the metrics data.<\/li>\n<\/ol>\n<p style=\"padding-left: 40px;\"><img decoding=\"async\" class=\"alignnone size-full wp-image-44870\" style=\"border: 1px solid #000000; padding: 1px; margin: 1px;\" src=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-5.jpg\" alt=\"Copilot Studio \" width=\"1381\" height=\"592\" srcset=\"https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-5.jpg 1381w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-5-300x129.jpg 300w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-5-1024x439.jpg 1024w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-5-768x329.jpg 768w, https:\/\/www.inogic.com\/blog\/wp-content\/uploads\/2026\/06\/Copilot-Studio-5-660x283.jpg 660w\" sizes=\"(max-width: 1381px) 100vw, 1381px\" \/><\/p>\n<h3>Query Telemetry Data with KQL<\/h3>\n<p>One of the most powerful capabilities of Application Insights is the ability to analyze telemetry data using Kusto Query Language (KQL).<\/p>\n<p>After telemetry data begins flowing into Application Insights, administrators can use KQL to analyze conversation behavior, performance trends, user interactions, and AI agent activity in greater detail.<\/p>\n<p>To explore the conversation telemetry:<\/p>\n<ol>\n<li>Open your Application Insights resource in the Azure portal<\/li>\n<li>Navigate to <strong>Monitoring \u2192 Logs<\/strong><\/li>\n<li>Enter the following KQL query to retrieve conversation details from the test pane, including message-level telemetry:<\/li>\n<\/ol>\n<p style=\"padding-left: 40px;\">customEvents<br \/>\n| extend text = customDimensions[&#8216;text&#8217;],<br \/>\nfromName = customDimensions[&#8216;fromName&#8217;],<br \/>\ndesignMode = customDimensions[&#8216;DesignMode&#8217;]\n| where designMode == &#8220;True&#8221;<br \/>\n| project timestamp, name, text, fromName<br \/>\n| order by timestamp asc<\/p>\n<p>The query results provide detailed visibility into the complete conversation lifecycle between the user and the Copilot Studio agent.<\/p>\n<p><strong>A.<\/strong>\u00a0 BotMessageReceived: Indicates that the user\u2019s message was received by the agent<br \/>\n<strong>B.<\/strong>\u00a0 TopicStart: Represents the start of a triggered topic<br \/>\n<strong>C.<\/strong>\u00a0 TopicAction: Captures actions being executed within the topic flow<br \/>\n<strong>D.<\/strong>\u00a0 GenerativeAnswers: Shows AI-generated responses created by the agent<br \/>\n<strong>E.<\/strong>\u00a0 BotMessageSend: Indicates that the response was sent back to the user<br \/>\n<strong>F.<\/strong>\u00a0 TopicEnd: Marks the completion of the topic execution flow<\/p>\n<h3>Below are some useful KQL Queries you can use:<\/h3>\n<p><strong>1. Show only production data:<\/strong><\/p>\n<p>customEvents<br \/>\n| extend isDesignMode = customDimensions[&#8216;DesignMode&#8217;]\n| where isDesignMode == &#8220;False&#8221;<\/p>\n<p><strong>2.Count of unique user per day for last 14 days<\/strong><\/p>\n<p>let queryStartDate = ago(14d);<br \/>\nlet queryEndDate = now();<br \/>\nlet groupByInterval = 1d;<br \/>\ncustomEvents<br \/>\n| where timestamp &gt; queryStartDate<br \/>\n| where timestamp &lt; queryEndDate<br \/>\n| summarize uc=dcount(user_Id) by bin(timestamp, groupByInterval)<br \/>\n| render timechart<\/p>\n<p><strong>3. View generative answer events with sources:<\/strong><\/p>\n<p>customEvents<br \/>\n| where name == &#8220;GenerativeAnswers&#8221;<br \/>\n| extend cd = todynamic(customDimensions)<br \/>\n| project timestamp, Sources = cd[&#8216;Sources&#8217;], Result = cd[&#8216;Result&#8217;]\n| order by timestamp desc<\/p>\n<h3>Conclusion<\/h3>\n<p>Copilot Studio helps organizations build AI agents quickly, but Application Insights provides the monitoring layer required to run them successfully in production. With proper telemetry, organizations can monitor failures, optimize conversations, improve performance, and build enterprise-grade AI solutions.<\/p>\n<h3><strong>FAQs<\/strong><\/h3>\n<p><strong>How do I integrate Application Insights with Copilot Studio?<\/strong><\/p>\n<p>Create an Application Insights resource in Azure, copy the connection string, and configure it within the Application Insights settings under the Advanced section in Copilot Studio. After saving the configuration, publish the agent to begin collecting telemetry data.<\/p>\n<p><strong>What telemetry does Application Insights capture for Copilot Studio agents?<\/strong><\/p>\n<p>Application Insights can capture conversation events, topic execution details, user interactions, fallback scenarios, response latency, API performance metrics, exceptions, and dependency tracking information.<\/p>\n<p><strong>Can Application Insights monitor Copilot Studio conversations?<\/strong><\/p>\n<p>Yes. Application Insights provides visibility into conversation lifecycles, including user messages, topic triggers, AI-generated responses, conversation completion events, and escalation patterns.<\/p>\n<p><strong>What is Kusto Query Language (KQL) in Application Insights?<\/strong><\/p>\n<p>KQL is a query language used in Azure Monitor and Application Insights to analyze telemetry data, investigate issues, identify trends, and create operational reports.<\/p>\n<p><strong>Why should I use Application Insights with Copilot Studio?<\/strong><\/p>\n<p>The integration helps organizations monitor AI agent performance, identify failures, analyze user behavior, troubleshoot issues faster, and continuously improve conversational experiences.<\/p>\n<p><strong>Can I track Generative AI responses in Copilot Studio using Application Insights?<\/strong><\/p>\n<p>Yes. Application Insights captures GenerativeAnswers events, allowing administrators to analyze AI-generated responses, review sources, and evaluate answer quality.<br \/>\n<script type=\"application\/ld+json\">\n{\n  \"@context\": \"https:\/\/schema.org\",\n  \"@type\": \"FAQPage\",\n  \"mainEntity\": [{\n    \"@type\": \"Question\",\n    \"name\": \"How do I integrate Application Insights with Copilot Studio?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Create an Application Insights resource in Azure, copy the connection string, and configure it within the Application Insights settings under the Advanced section in Copilot Studio. After saving the configuration, publish the agent to begin collecting telemetry data.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"What telemetry does Application Insights capture for Copilot Studio agents?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Application Insights can capture conversation events, topic execution details, user interactions, fallback scenarios, response latency, API performance metrics, exceptions, and dependency tracking information.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"Can Application Insights monitor Copilot Studio conversations?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Yes. Application Insights provides visibility into conversation lifecycles, including user messages, topic triggers, AI-generated responses, conversation completion events, and escalation patterns.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"What is Kusto Query Language (KQL) in Application Insights?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"KQL is a query language used in Azure Monitor and Application Insights to analyze telemetry data, investigate issues, identify trends, and create operational reports.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"Why should I use Application Insights with Copilot Studio?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"The integration helps organizations monitor AI agent performance, identify failures, analyze user behavior, troubleshoot issues faster, and continuously improve conversational experiences.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"Can I track Generative AI responses in Copilot Studio using Application Insights?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Yes. Application Insights captures GenerativeAnswers events, allowing administrators to analyze AI-generated responses, review sources, and evaluate answer quality.\"\n    }\n  }]\n}\n<\/script><\/p>\n","protected":false},"excerpt":{"rendered":"<p>AI agents built using Microsoft Copilot Studio are now widely used for customer support, employee self-service, and IT automation. While building an AI agent is easy, monitoring and optimizing it in production is the real challenge. Organizations frequently need answers to important operational questions such as why conversations are failing, which topics are leading to\u2026 <span class=\"read-more\"><a href=\"https:\/\/www.inogic.com\/blog\/2026\/06\/how-integrate-application-insights-with-copilot-studio-for-better-ai-monitoring\/\">Read More &raquo;<\/a><\/span><\/p>\n","protected":false},"author":15,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3313,2361],"tags":[3371],"class_list":["post-44865","post","type-post","status-publish","format-standard","hentry","category-microsoft-copilot-studio","category-technical","tag-ai-monitoring"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/posts\/44865","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/comments?post=44865"}],"version-history":[{"count":3,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/posts\/44865\/revisions"}],"predecessor-version":[{"id":44874,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/posts\/44865\/revisions\/44874"}],"wp:attachment":[{"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/media?parent=44865"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/categories?post=44865"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/tags?post=44865"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}