{"id":20330,"date":"2019-08-23T12:27:39","date_gmt":"2019-08-23T12:27:39","guid":{"rendered":"https:\/\/www.inogic.com\/blog\/?p=20330"},"modified":"2022-07-21T12:13:30","modified_gmt":"2022-07-21T06:43:30","slug":"execute-multiple-fetchxml-and-odata-queries-using-batch-request","status":"publish","type":"post","link":"https:\/\/www.inogic.com\/blog\/2019\/08\/execute-multiple-fetchxml-and-odata-queries-using-batch-request\/","title":{"rendered":"Execute multiple FetchXML and OData queries using Batch request"},"content":{"rendered":"

We have developed an application to fulfill one of our clients\u2019 requirement. In that application we have perform multiple retrieval operation from CRM (around 10) either using FetchXML or OData of different entities. So, when we retrieve records from Dynamics 365 CRM of different entities for each retrieve operation it takes around 300 milliseconds and thus our application takes time to load and users have to wait for application to load. For this, our clients reported that the application is slow and taking time to load and operate, so ultimately it takes time in displaying result to the users. As it is, quick turnaround time is essential for a business. Therefore, to improve the performance, we worked on it and found that most of the time it was taking was to retrieve records from Dynamics CRM as we perform multiple retrieval operation. To reduce this retrieval time, we have used Batch request and retrieved multiple records using single request instead of multiple requests thereby reducing significant amount of time.<\/p>\n

Below is the JavaScript code used for same.<\/p>\n

We have created this function to execute four retrieval requests in single instance to retrieve records from Dynamics CRM instead of four different requests.<\/p>\n

\/\/This function is used to read batch records from CRM<\/p>\n

var readRecordsUsingBatchRequest = function (entityType, webresourceName) {<\/p>\n

var functionName = “readRecordsUsingBatchRequest “;<\/p>\n

var batchReq = [];<\/p>\n

var team = “Sales”;<\/p>\n

var userId = “”;<\/p>\n

var languagecode = “1033”;<\/p>\n

try {<\/p>\n

\/\/get the userid<\/p>\n

userId = getUserId().replace(“{“, “”).replace(“}”, “”);<\/p>\n

\/\/Read system user\u00a0\u00a0\u00a0\u00a0 <\/strong><\/p>\n

fetchXml = “<fetch version=’1.0′ output-format=’xml-platform’ mapping=’logical’ distinct=’true’>” +<\/p>\n

“<entity name=’systemuser’>” +<\/p>\n

“<attribute name=’fullname’ \/>” +<\/p>\n

“<attribute name=’businessunitid’ \/>” +<\/p>\n

“<attribute name=’systemuserid’ \/>” +<\/p>\n

“<link-entity name=’teammembership’ from=’systemuserid’ to=’systemuserid’ visible=’false’ intersect=’true’>” +<\/p>\n

“<link-entity name=’team’ from=’teamid’ to=’teamid’ alias=’team’>” +<\/p>\n

“<attribute name=’name’ \/>” +<\/p>\n

“<attribute name=’teamid’ \/>” +<\/p>\n

“<filter type=’and’>” +<\/p>\n

“<condition attribute=’name’ operator=’eq’ value='” + team.toLowerCase() + “‘ \/>” +<\/p>\n

“<\/filter>” +<\/p>\n

“<\/link-entity>” +<\/p>\n

“<\/link-entity>” +<\/p>\n

“<\/entity>” +<\/p>\n

“<\/fetch>”;<\/p>\n

var req = {};<\/p>\n

req.Query = fetchXml;<\/p>\n

req.IsFetchxml = true;<\/p>\n

req.EntitysetName = “systemusers”;<\/p>\n

batchReq.push(req);<\/p>\n

\/\/Read Language webresource <\/strong><\/p>\n

var req = {};<\/p>\n

webresourceName = “new_LanguageLables_” + languagecode + “.xml”;<\/p>\n

req.Query = “?$select=webresourceid,content&$filter=name eq ‘” + webresourceName + “‘ “;<\/p>\n

req.EntitysetName = “webresourceset”;<\/p>\n

batchReq.push(req);<\/p>\n

\/\/Read usage (custom entity) records<\/strong><\/p>\n

fetchxml = “<fetch version=’1.0′ output-format=’xml-platform’ mapping=’logical’ distinct=’false’>” +<\/p>\n

“<entity name=’new_usage’>” +<\/p>\n

“<attribute name=’new_usageid’ \/>” +<\/p>\n

“<attribute name=’new_currentcount’ \/>” +<\/p>\n

“<attribute name=’new_allowedlimit’ \/>” +<\/p>\n

“<filter type=’and’>” +<\/p>\n

“<condition attribute=’statecode’ operator=’eq’ value=’0′ \/>” +<\/p>\n

“<\/filter>” +<\/p>\n

“<\/entity>” +<\/p>\n

“<\/fetch>”;<\/p>\n

var req = {};<\/p>\n

req.Query = fetchxml;<\/p>\n

req.IsFetchxml = true;<\/p>\n

req.EntitysetName = “new_usages”;<\/p>\n

batchReq.push(req);<\/p>\n

\/\/Read System views<\/strong><\/p>\n

var req = {};<\/p>\n

req.Query = “?$select=name,fetchxml,savedqueryid,layoutxml&$filter=querytype eq 0 and isquickfindquery eq false and statecode eq 0 and returnedtypecode eq\u00a0 ‘” + entityType + “‘”;<\/p>\n

req.EntitysetName = “savedqueries”;<\/p>\n

batchReq.push(req);<\/p>\n

\/\/retrieve using batch request<\/p>\n

WebApiLib.batchRequestRetrieve(batchReq, function (results) {<\/p>\n

readRecordsUsingBatchRequestCallback(result)<\/p>\n

}, readRecordsUsingBatchRequestErrorCallBack);<\/p>\n

} catch (e) {<\/p>\n

showError(functionName + ” ” + e.message);<\/p>\n

}<\/p>\n

}<\/p>\n

var readRecordsUsingBatchRequestCallback = function (error) {<\/p>\n

var functionName = “readRecordsUsingBatchRequestCallback “;<\/p>\n

try {<\/p>\n

\/\/Perform the required logic<\/p>\n

} catch (e) {<\/p>\n

showError(functionName + ” ” + e.message);<\/p>\n

}<\/p>\n

}<\/p>\n

var readRecordsUsingBatchRequestErrorCallBack = function (error) {<\/p>\n

var functionName = “readRecordsUsingBatchRequestCallback “;<\/p>\n

try {<\/p>\n

showError(functionName + ” ” + e.message);<\/p>\n

} catch (e) {<\/p>\n

}<\/p>\n

}<\/p>\n

In WebApi library we have written below function to execute all the above queries to retrieve records using Ajax request. When we execute the request then it gives results in following format.<\/p>\n

\"Execute<\/p>\n

Now, our next challenge is to parse above response and get the results in JSON format.<\/p>\n

To parse the above response first we split this result using \u201cbatch\u201d word and slice it as shown in below.<\/p>\n

data.split(<\/em>“–batch”<\/em>).slice(1, reqCount + 1);<\/em><\/p>\n

Once we split, we get the array then looping through that array get the result of individual using<\/p>\n

result = value.substring(value.indexOf(<\/em>‘{‘<\/em>), value.lastIndexOf(<\/em>‘}’<\/em>) + 1);<\/em><\/p>\n

And finally parse that result to get it JSON format using following line of code.<\/p>\n

\u00a0<\/em>JSON.parse(result)<\/em><\/p>\n

\/\/Retrieval function in web api library<\/strong><\/p>\n

batchRequestRetrieve: function (requests, batchRequestRetrieveSuccess, batchRequestRetrieveError) {<\/p>\n

var reqColl = [];<\/p>\n

var reqCount = 0;<\/p>\n

try {<\/p>\n

reqCount = requests.length;<\/p>\n

\/\/encode the fetchxml<\/p>\n

$.each(requests, function (index, req) {<\/p>\n

reqColl.push(‘–batch_fetch’);<\/p>\n

reqColl.push(‘Content-Type: application\/http’);<\/p>\n

reqColl.push(‘Content-Transfer-Encoding: binary’);<\/p>\n

reqColl.push(”);<\/p>\n

if (req.IsFetchxml != undefined && req.IsFetchxml == true) {<\/p>\n

reqColl.push(‘GET ‘ + getWebAPIPath() + req.EntitysetName + ‘?fetchXml=’ + req.Query + ‘ HTTP\/1.1’);<\/p>\n

}<\/p>\n

else if (req.FunctionName != undefined) {<\/p>\n

reqColl.push(‘GET ‘ + getWebAPIPath() + req.FunctionName + ‘ HTTP\/1.1’);<\/p>\n

}<\/p>\n

else {<\/p>\n

reqColl.push(‘GET ‘ + getWebAPIPath() + req.EntitysetName + req.Query + ‘ HTTP\/1.1’);<\/p>\n

}<\/p>\n

reqColl.push(‘Content-Type: application\/json’);<\/p>\n

reqColl.push(‘OData-Version: 4.0’);<\/p>\n

reqColl.push(‘OData-MaxVersion: 4.0’);<\/p>\n

reqColl.push(‘Prefer: odata.include-annotations=*’);<\/p>\n

reqColl.push(”);<\/p>\n

reqColl.push(‘{}’);<\/p>\n

});<\/p>\n

reqColl.push(‘–batch_fetch–‘);<\/p>\n

var mainReq = reqColl.join(‘\\r\\n’);<\/p>\n

\/\/create AJAX request<\/p>\n

$.ajax({<\/p>\n

type: “POST”,<\/p>\n

contentType: “application\/json; charset=utf-8”,<\/p>\n

datatype: “json”,<\/p>\n

async: true,<\/p>\n

url: this.getWebAPIPath() + “$batch”,<\/p>\n

data: mainReq,<\/p>\n

beforeSend: function (xhr) {<\/p>\n

\/\/Specifying this header ensures that the results will be returned as JSON.<\/p>\n

xhr.setRequestHeader(“Accept”, “application\/json”);<\/p>\n

xhr.setRequestHeader(“OData-MaxVersion”, “4.0”);<\/p>\n

xhr.setRequestHeader(“OData-Version”, “4.0”);<\/p>\n

xhr.setRequestHeader(“Prefer”, “odata.include-annotations=*”);<\/p>\n

xhr.setRequestHeader(“Content-Type”, “multipart\/mixed;boundary=batch_fetch”);<\/p>\n

},<\/p>\n

success: function (data, textStatus, xhr) {<\/p>\n

var results = data.split(“–batch”).slice(1, reqCount + 1);<\/p>\n

var recCollection = [];<\/p>\n

$.each(results, function (index, data) {<\/p>\n

var result = getFormattedData(data);<\/p>\n

if (JSON.parse(result).value != undefined) {<\/p>\n

recCollection.push(JSON.parse(result).value);<\/p>\n

}<\/p>\n

else {<\/p>\n

recCollection.push(JSON.parse(result));<\/p>\n

}<\/p>\n

});<\/p>\n

batchRequestRetrieveSuccess(recCollection);<\/p>\n

},<\/p>\n

error: function (xhr, textStatus, errorThrown) {<\/p>\n

batchRequestRetrieveError(xhr);<\/p>\n

}<\/p>\n

});<\/p>\n

} catch (e) {<\/p>\n

throw new Error(e);<\/p>\n

}<\/p>\n

}<\/p>\n

getWebAPIPath: function () {<\/p>\n

return this.getClientUrl() + “\/api\/data\/v9.1\/”;<\/p>\n

}<\/p>\n

getFormattedData: function (value) {<\/p>\n

return value.substring(value.indexOf(‘{‘), value.lastIndexOf(‘}’) + 1);<\/p>\n

}<\/p>\n

Conclusion<\/strong><\/h2>\n

With the help of Batch request we can execute multiple Fetch and OData queries to get the results. This increases the performance and reduces the retrieval time.<\/p>\n

70% of global 2000 companies apply gamification to improve productivity and returns!<\/div><\/div><\/h2>\n

Gamifics365<\/a> <\/strong>\u2013 Spin the magic of games within Microsoft Dynamics 365 CRM to improve user adoption, enhance productivity, and achieve company goals!<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

We have developed an application to fulfill one of our clients\u2019 requirement. In that application we have perform multiple retrieval operation from CRM (around 10) either using FetchXML or OData of different entities. So, when we retrieve records from Dynamics 365 CRM of different entities for each retrieve operation it takes around 300 milliseconds and\u2026 Read More »<\/a><\/span><\/p>\n","protected":false},"author":13,"featured_media":20331,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13,15],"tags":[795],"class_list":["post-20330","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-customizations","category-development","tag-fetchxml"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/posts\/20330","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/comments?post=20330"}],"version-history":[{"count":0,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/posts\/20330\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/media\/20331"}],"wp:attachment":[{"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/media?parent=20330"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/categories?post=20330"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.inogic.com\/blog\/wp-json\/wp\/v2\/tags?post=20330"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}