Selenium on Linux Collector to execute synthetic webchecks

Question

You can use this&nbsp;bash script to install and configure all the necessary components in order to execute synthetic webchecks on a Linux (Debian/Ubuntu) Collector.&nbsp; This script will install Chrome, Chromedriver, and Selenium to the Collector's host (be&nbsp;sure the Collector is&nbsp;installed prior to executing the bash script).

Once this is done, you can execute selenium commands from within LogicMonitor DataSources (sample DataSources can be found with&nbsp;in the LM-Exchange: "Synthetics Check Template"&nbsp;and "LogicMonitor Login Selenium").&nbsp;

The easiest approach I've found to getting a synthetics recording into LM&nbsp;is to use the Selenium IDE Chrome extension to record and then export the recording as a java file. From here, simply copy-paste the&nbsp;driver.&nbsp;commands from this exported file into the DataSource.&nbsp; For simplicity and clarity, I've always applied the synthetics DataSource to the Collector itself.&nbsp; Inherent in this approach is that you can have multiple synthetics DataSources applied to a single Collector.

The final result can look something like this:&nbsp;

Though it is not depicted here in this example, you can insert timestamps into the DataSource groovy script to measure the duration of each step in your webcheck.

For more info on uploading other custom jars to the Collector, check out this Support Page.&nbsp;

teijo_forsell · Answer

Thanks Jake. Your post was quite timely with my intentions to try Selenium with LogicMonitor and very much helped get me started (although I used CentOS collector machine, but still the bash-script gave the right direction of course!&nbsp;?&nbsp;

Those DataSources seemed to be private, so I could not load them, so I created one myself (included below; possibly very bad version, but it works ?&nbsp;).

In order to check textFields in the target web site, I also added two more libraries in addition to the selenium-server-standalone.jar:

wrapper.java.classpath.115=../custom/selenium-server-standalone.jar
	wrapper.java.classpath.116=../custom/hamcrest-2.2.jar&nbsp; &nbsp;
	wrapper.java.classpath.117=../custom/junit-4.13.jar
	&nbsp;

And here is my example Groovy-script just to help others (maybe):

import com.santaba.agent.groovyapi.expect.Expect;
	import com.santaba.agent.groovyapi.snmp.Snmp;
	import com.santaba.agent.groovyapi.http.*;
	import com.santaba.agent.groovyapi.jmx.*;
	import org.xbill.DNS.*;
	import static org.junit.Assert.*;
	import static org.hamcrest.CoreMatchers.is;
	import static org.hamcrest.core.IsNot.not;
	import org.openqa.selenium.By;
	import org.openqa.selenium.WebDriver;
	//import org.openqa.selenium.firefox.FirefoxDriver;
	import org.openqa.selenium.chrome.ChromeDriver;
	import org.openqa.selenium.chrome.ChromeOptions;
	import org.openqa.selenium.remote.RemoteWebDriver;
	import org.openqa.selenium.remote.DesiredCapabilities;
	import org.openqa.selenium.Dimension;
	import org.openqa.selenium.WebElement;
	import org.openqa.selenium.interactions.Actions;
	import org.openqa.selenium.support.ui.ExpectedConditions;
	import org.openqa.selenium.support.ui.WebDriverWait;
	import org.openqa.selenium.JavascriptExecutor;
	import org.openqa.selenium.Alert;
	import org.openqa.selenium.Keys;
	import java.util.*;
	import java.net.MalformedURLException;
	import java.net.URL;
	ChromeOptions chromeOptions = new ChromeOptions();
	chromeOptions.addArguments("--no-sandbox");
	//chromeOptions.addArguments("--remote-debugging-port=9222");
	//chromeOptions.addArguments("--disable-dev-shm-usage");
	//chromeOptions.addArguments("--disable-gpu");
	chromeOptions.addArguments("--headless");
	&nbsp; &nbsp; WebDriver driver = new ChromeDriver(options=chromeOptions);
	&nbsp; &nbsp; driver.get("http://juhani.exdecfinland.org/~tforsell/home.html");
	// &nbsp; &nbsp;driver.manage().window().setSize(new Dimension(1321, 916));
	&nbsp; &nbsp; driver.findElement(By.cssSelector("a:nth-child(4) &gt; img")).click();
	&nbsp; &nbsp; assertThat(driver.findElement(By.cssSelector("h2:nth-child(56)")).getText(), is("Saksan reissu -Germany trip 2005"));
	&nbsp; &nbsp; driver.close();
	&nbsp; &nbsp; driver.quit();
	println("TeijoScriptStatus=Success");

jake_cohen · Answer

Glad to hear you found this helpful @Teijo Forsell! I have just confirmed that the LM-Exchange DataSources posted above should now be public.&nbsp; Thanks for sharing your DataSource template as well!

teijo_forsell · Answer

Thanks for the datasources; they confirmed what I was doing!

And then, just to finalize this, as my previous script was indeed a very crude and hastily comprised. I had to abandon all Asserts (including softAsserts),&nbsp;so a better generalized version below having two datapoints: FailedStep and GeneralSuccess (not really needed, but just for clarity). Two graphs as well having the same ones where FailedStep has vertical label description as "ZeroIsGood" and GeneralSuccess has "OneIsGood". Of course alert thresholds&nbsp;set respectively. This quite probably fits my needs nicely when cloning and amending to multiple different tests. (One development step would still be to get rid of the "--no-sandbox" as it is a security risk to run chromedriver as root.)

import&nbsp;org.openqa.selenium.By;

import&nbsp;org.openqa.selenium.WebDriver;

import&nbsp;org.openqa.selenium.chrome.ChromeDriver;

import&nbsp;org.openqa.selenium.chrome.ChromeOptions;

import&nbsp;org.openqa.selenium.WebElement;

import&nbsp;java.util.*;

import&nbsp;java.net.MalformedURLException;

import&nbsp;java.net.URL;

ChromeOptions&nbsp;chromeOptions&nbsp;=&nbsp;new&nbsp;ChromeOptions();

chromeOptions.addArguments("--no-sandbox");

chromeOptions.addArguments("--headless");

WebDriver&nbsp;driver&nbsp;=&nbsp;new&nbsp;ChromeDriver(options=chromeOptions);

///////&nbsp;STEP&nbsp;1

try&nbsp;{

&nbsp;&nbsp;&nbsp;&nbsp;driver.get("http://juhani.exdecfinland.org/~tforsell/home.html");

&nbsp;&nbsp;&nbsp;&nbsp;if&nbsp;(&nbsp;driver.getTitle().contains("404")&nbsp;)&nbsp;&nbsp;&nbsp;//Only&nbsp;way&nbsp;to&nbsp;catch&nbsp;page&nbsp;not&nbsp;found&nbsp;(https://stackoverflow.com/questions/17657037/catching-a-404-error-with-selenium)

&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;println&nbsp;"GeneralSuccess=0";&nbsp;println&nbsp;"FailedStep=1";&nbsp;driver.quit();&nbsp;return&nbsp;0;&nbsp;}

&nbsp;&nbsp;&nbsp;&nbsp;}&nbsp;catch&nbsp;(Exception&nbsp;ex)&nbsp;{&nbsp;println&nbsp;"GeneralSuccess=0";&nbsp;println&nbsp;"FailedStep=1";&nbsp;driver.quit();&nbsp;return&nbsp;0;&nbsp;}
	
	&nbsp;

///////&nbsp;STEP&nbsp;2

try&nbsp;{

&nbsp;&nbsp;&nbsp;&nbsp;driver.findElement(By.cssSelector("a:nth-child(4)&nbsp;&gt;&nbsp;img")).click();&nbsp;//Click&nbsp;the&nbsp;motorbike&nbsp;image&nbsp;in&nbsp;the&nbsp;right frame

&nbsp;&nbsp;&nbsp;&nbsp;if&nbsp;(&nbsp;driver.getTitle().contains("404")&nbsp;)&nbsp;&nbsp;&nbsp;//Only&nbsp;way&nbsp;to&nbsp;catch&nbsp;page&nbsp;not&nbsp;found&nbsp;(https://stackoverflow.com/questions/17657037/catching-a-404-error-with-selenium)

&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;println&nbsp;"GeneralSuccess=0";&nbsp;println&nbsp;"FailedStep=2";&nbsp;driver.quit();&nbsp;return&nbsp;0;&nbsp;}

&nbsp;&nbsp;&nbsp;&nbsp;}&nbsp;catch&nbsp;(Exception&nbsp;ex)&nbsp;{&nbsp;println&nbsp;"GeneralSuccess=0";&nbsp;println&nbsp;"FailedStep=2";&nbsp;driver.quit();&nbsp;return&nbsp;0;&nbsp;}
	
	&nbsp;

///////&nbsp;STEP&nbsp;3

try&nbsp;{

&nbsp;&nbsp;&nbsp;&nbsp;if&nbsp;(&nbsp;!driver.findElement(By.cssSelector("h2:nth-child(56)")).getText().contains("Saksan&nbsp;reissu&nbsp;-Germany&nbsp;trip&nbsp;2005")&nbsp;)

&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;println&nbsp;"GeneralSuccess=0";&nbsp;println&nbsp;"FailedStep=3";&nbsp;driver.quit();&nbsp;return&nbsp;0;&nbsp;}

&nbsp;&nbsp;&nbsp;&nbsp;}&nbsp;catch&nbsp;(Exception&nbsp;ex)&nbsp;{&nbsp;println&nbsp;"GeneralSuccess=0";&nbsp;println&nbsp;"FailedStep=3";&nbsp;driver.quit();&nbsp;return&nbsp;0;&nbsp;}
	
	&nbsp;

println&nbsp;"GeneralSuccess=1";&nbsp;println&nbsp;"FailedStep=0";&nbsp;driver.quit();&nbsp;return&nbsp;0;

rakzskull · Answer

@Jake Cohen&nbsp;@Teijo Forsell&nbsp;Can I use these data sources on Windows collectors?

anonymous · Answer

LM has made some serious advances with selenium and synthetic web checks. I'd reach out to your CSM to get in touch with the product managers about it.&nbsp;

Forum Discussion

Selenium on Linux Collector to execute synthetic webchecks

Related Content

Collectors: Open Telemetry vs. LM Collector

LM Synthetics

Collector Debug - removed?

Event Sources SNMP and Windows collectors?

Auto Balanced Collector Group vs Failover?

Recent Discussions

Elasticsearch and OpenSearch

Devops metrics monitoring in Lm

LM APM - Traces - HTTP Post from Powershell Scripts

SNMP Traps - Baseline for alerting

Module Toolbox AppliesTo IDE