Normal Datapoints: Allow JSON reponses to dynamically populate Name and Post Processor values.

Question

While working on optimizing Powershell scripts for Logic Monitor, we found out that Active Discovery was great for some applications.&nbsp;However, when it came Powershell invoking commands(running scripts on servers), we found that Active Discovery has the&nbsp;potential to generate too many connections to servers. The answer we arrived at was doing everything in one script and returning it all in a JSON response. This worked significantly better than the dynamic Active Discovery, but had one draw back. The data points had to be manually entered.&nbsp;

My suggestion is that Logic Monitor modify the data points&nbsp; to allow reference to the JSON responses. Meaning, that we would set one instance of a Data Point with a Name field that indicates the JSON path to an array with all of the Instances&nbsp;and the Post Process could be pointed to the corresponding JSON path for the Value of each instance.

JSON&nbsp;Example:

[
	&nbsp;&nbsp; &nbsp;{
	&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;"Title":"Name of an Instance",
	&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;"Value":1 &nbsp; &nbsp;
	&nbsp;&nbsp; &nbsp;},
	&nbsp;&nbsp; &nbsp;{
	&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;"Title":"Name of another Instance",
	&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;"Value": 2000 &nbsp; &nbsp;
	&nbsp;&nbsp; &nbsp;}
	]

DataPoint would look something like this:

Name&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Metric Type&nbsp; &nbsp; &nbsp; &nbsp; Raw Metric&nbsp; &nbsp; &nbsp; &nbsp; Post Processor&nbsp; &nbsp; &nbsp; &nbsp; Alert Threshold

&nbsp;json(Title)&nbsp; &nbsp; &nbsp; &nbsp; guage&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; output&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;json(Value)&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;!= 1

&nbsp;

Results would create instances like this on a graph as you would if you type them out normal:

"Name of an Instance": 1

"Name of another Instance": 2000

&nbsp;

I believe this would be more efficient and allow us to be still dynamic.
	Thanks,

Jason Wainwright&nbsp;

&nbsp;

mosh · Answer

Hi Jason,

Re "we found that Active Discovery has the&nbsp;potential to generate too many connections to servers", may I ask what is it that you're discovering (the instances)? &nbsp;Are they things that need to be discovered in one go, or could they be discovered one by one or in batches?

jwainwright · Answer

Hi Mosh,

We were using Active Discovery&nbsp; with PowerShell to discover MSMQ queues on each server. This in itself was not an issue, but the way to check each queue requires each Queue found in the discovery would need a connection to the server and a check on whatever we were looking for(ie, Age of oldest message, or subscription verifications). With only a few queues, this may not be much of an issue, but with our 125+ queues on a server and each request requiring an open connection from the logic monitor collector we found that this could overwhelm the CPU resources on a server, fairly quickly(given&nbsp;the right scenario).&nbsp;The solution was pretty simple. We removed the active discovery script and combined it in Collector script("Embedded PowerShell Script") but returned the data in JSON. This allowed for all 125+ queues to return information with 1 connection&nbsp;in under 2 seconds, where as before, each of the 125+ queues would have to fire a script that connected to the server and would take less than a second each, but have 125+ connections spawned over the duration of the 5 minute monitor.

mosh · Answer

Ah I understand now, thanks for the explanation. &nbsp;So in your collection script you are doing the same also, grabbing all the data in one connection, and then looping through the data to generate the output using ##WILDVALUE##.

jwainwright · Answer

Correct, except we do not use ##WILDVALUE##, we build a JSON response and return that. Then, once&nbsp;we created the datapoints, we would reference the JSON object. Currently, our JSON looks something like this:

{
	&nbsp;&nbsp; &nbsp;"Name of some queue we want to know age of oldest message":44, &nbsp;&nbsp;
	&nbsp;&nbsp; &nbsp;"Name of some other queue we want to know age of oldest message":0
	}

&nbsp;

example from exported XML
	&nbsp; &nbsp; &nbsp; &lt;datapoint&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;name&gt;Name of some queue we want to know age of oldest message&lt;/name&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;dataType&gt;7&lt;/dataType&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;type&gt;2&lt;/type&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;postprocessormethod&gt;json&lt;/postprocessormethod&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;postprocessorparam&gt;Name of some queue we want to know age of oldest message&lt;/postprocessorparam&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;usevalue&gt;output&lt;/usevalue&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;alertexpr&gt;!= 0 0 0&lt;/alertexpr&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;alertmissing&gt;1&lt;/alertmissing&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;alertsubject&gt;&lt;/alertsubject&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;alertbody&gt;&lt;/alertbody&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;description&gt;&lt;/description&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;maxvalue&gt;&lt;/maxvalue&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;minvalue&gt;&lt;/minvalue&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;userparam1&gt;&lt;/userparam1&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;userparam2&gt;&lt;/userparam2&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;userparam3&gt;&lt;/userparam3&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;iscomposite&gt;false&lt;/iscomposite&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;rpn&gt;&lt;/rpn&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;alertTransitionIval&gt;0&lt;/alertTransitionIval&gt;
	&nbsp; &nbsp; &nbsp; &nbsp; &lt;alertClearTransitionIval&gt;0&lt;/alertClearTransitionIval&gt;
	&nbsp; &nbsp; &nbsp; &lt;/datapoint&gt;

Forum Discussion

Normal Datapoints: Allow JSON reponses to dynamically populate Name and Post Processor values.

Related Content

Complex DataPoint.

Extracting datapoints via API

Complex datapoint expression syntax

Dynamic Device Groups - constrain membership to parent folder

Dynamic groups formatting question

Recent Discussions

Dashboard Sharing – An Inline Framing Method

2021-12-15 US Office Hours

Live Training - Tuning Datapoints and Alerts - 15th JUNE 2022 - APAC

Live Training - Introduction to Dashboards - 18th MAY 2022 - APAC

2022-05-11- APAC Product Overview -Collectors, Resources/Groups, Dashboards