Python SDK and creating multiple customProperties in one go

I’m trying to be able to supply a script to add some CustomProperties and I was wondering so that I don’t have to reinvent the wheel, if anyone has a quick method to building what is required to set in the BODY of the post.

Let’s say I have some different custom properties I want to add:

corp.building = “Some Building Name”

corp.department = “Some Department Name”

corp.role = “Some Role”

Can I wrap all these up into a single array/dictionary to pass into the “customProperties” attribute in the “body” of the post?

The idea could be I feed a CSV file into the script and the amount of customProperties can be 1 or 10 for any given line being processed.

Thanks and let me know if I need to shed more light on what I’m expecting to happen.

Jeff_W_

Posted 3 years ago·Last reply 3 years ago

6 comments

LM User

·3 years ago

It’s not actually a Python problem It’s an LM problem. LM is the one that decided to use a list of dictionaries instead of a dictionary.

Jeff_W_

OP3 years ago

This should be helpful for me. Once I set up my customProps as a list of dictionaries it worked like a charm (this is where my python lacks, coming more from a PHP background). I was close, just slightly off ;)

Thanks for the tips and snippets.

LM User

·3 years ago

FWIW, I wouldn’t use argparse to pull in the csv data. I’d actually use the built in CSV handling capabilities of Python:

def read_csv(filename):<br/>    import csv<br/>    result = []<br/>    with open(filename, mode='r') as csv_file:<br/>        csv_reader = csv.DictReader(csv_file)<br/>        result = [<br/>            {"name":row["name"], "department":row["department"], "bday":row["birthday month"]}<br/>            for row<br/>            in csv_reader<br/>        ]<br/>    return result

Given the following CSV file called “example.csv” in the current working directory:

name,department,birthday month<br/>John Smith,Accounting,November<br/>Erica Meyers,IT,March

The usage would look like this:

>>> from pprint import pprint<br/>>>> def read_csv(filename):<br/>...     import csv<br/>...     result = []<br/>...     with open(filename, mode='r') as csv_file:<br/>...         csv_reader = csv.DictReader(csv_file)<br/>...         result = [<br/>...             {"name":row["name"], "department":row["department"], "bday":row["birthday month"]}<br/>...             for row<br/>...             in csv_reader<br/>...         ]<br/>...     return result<br/>...<br/>>>> data = read_csv("example.csv")<br/>>>> pprint(data)<br/>[{'bday': 'November', 'department': 'Accounting', 'name': 'John Smith'},<br/> {'bday': 'March', 'department': 'IT', 'name': 'Erica Meyers'}]<br/>>>>

LM User

·3 years ago

Yep, I do something very similar, except that I’ve started using environment variables for the credentials (see input_method below). This function should facilitate creating your groups. Actually, it’s idempotent, so if you call it once, it’ll create the group. The second time you call it, it should just update the existing one:

import logicmonitor_sdk, argparse, os<br/>from datetime import datetime<br/><br/>input_method = "envs"<br/><br/>if input_method == "args":<br/>    parser = argparse.ArgumentParser()<br/>    for arg,help in {<br/>            "id":"LM API Access ID",<br/>            "key": "LM API Access Key",<br/>            "company": "LM API Company",<br/>    }.items():<br/>        parser.add_argument(arg, help=help)<br/>    args = parser.parse_args()<br/><br/>    lm_creds = {<br/>        "AccessId": args.id,<br/>        "AccessKey": args.key,<br/>        "Company": args.company<br/>    }<br/>elif input_method == "envs":<br/>    lm_creds = {<br/>        "AccessId": os.environ['accessid'],<br/>        "AccessKey": os.environ['accesskey'],<br/>        "Company": os.environ['company']<br/>    }<br/>else:<br/>    print(f"Invalid input method chosen: {input_method}")<br/>    quit()<br/><br/>configuration = logicmonitor_sdk.Configuration()<br/>configuration.access_id = lm_creds['AccessId']<br/>configuration.access_key = lm_creds['AccessKey']<br/>configuration.company = lm_creds['Company']<br/>lm = logicmonitor_sdk.LMApi(logicmonitor_sdk.ApiClient(configuration))<br/><br/>debug = False<br/>info = False<br/><br/>def log_msg(msg, severity="INFO", end="\n"):<br/>  if (severity == "DEBUG" and debug) or (severity == "INFO" and info) or severity not in ("DEBUG", "INFO"):<br/>    print(f"{datetime.now().strftime('[%Y-%m-%d %H:%M:%S]')} {severity}: {msg}", end=end)<br/><br/>def create_group(name,parent,customProperties={},appliesTo=""): # shortcut function to the sdk that creates device groups with less fuss<br/>    parsedProperties = [{"name": k, "value": v} for k,v in customProperties.items()]<br/>    device_groups = []<br/>    end_found = False<br/>    offset = 0<br/>    size = 1000<br/>    while not end_found:<br/>        current = lm.get_device_group_list(size=size,offset=offset,filter=f"parentId:\"{parent}\",name:\"{name}\"").items<br/>        device_groups += current<br/>        offset += len(current)<br/>        end_found = len(current) != size<br/>    if len(device_groups) == 0:<br/>        try:<br/>            result = lm.add_device_group({"name":name, "parentId":parent, "customProperties":parsedProperties, "appliesTo":appliesTo})<br/>            log_msg(f"  Created resource group {result.full_path} ({result.id})", "API SDK POST")<br/>            return result<br/>        except lm.ApiException as e:<br/>            log_msg("Exception when calling LMApi->addDeviceGroup: %s\n" % e)<br/>    else:<br/>        existing_group = device_groups[0]<br/>        mismatches = 0<br/>        log_msg(f"  Group {name} exists in LM ({existing_group.id}), checking if attributes match...", "DEBUG")<br/>        existing_properties = {x.name:x.value for x in existing_group.custom_properties}<br/>        for k,v in customProperties.items(): #check each of the custom attributes we want to pass in to see if they match<br/>            if k in existing_properties.keys() and v==existing_properties.get(k,None):<br/>                log_msg(f"    Property {k} matches attribute already in LM", "DEBUG")<br/>            else:<br/>                log_msg(f"    Property {k} doesn't match attribute already in LM")<br/>                mismatches += 1<br/>            log_msg(f"    {'='*80}", "DEBUG")<br/>            log_msg(f"    {k}: {v}", "DEBUG")<br/>            log_msg(f"    {k}: {existing_properties.get(k)}", "DEBUG")<br/>            log_msg(f"    {'='*80}", "DEBUG")<br/>        if len(appliesTo) > 0:<br/>            if appliesTo == existing_group.applies_to:<br/>                log_msg(f"    AppliesTo we want to patch in matches the AppliesTo already on the device", "DEBUG")<br/>            else:<br/>                log_msg(f"    AppliesTo we want to patch in doesn't match the AppliesTo already on the device")<br/>                mismatches += 1<br/>            log_msg(f"      {'='*80}", "DEBUG")<br/>            formatted_appliesTo = appliesTo.replace('\n','\n      ')<br/>            log_msg(f"      {formatted_appliesTo}", "DEBUG")<br/>            log_msg(f"      {'='*80}", "DEBUG")<br/>            formatted_appliesTo = existing_group.applies_to.replace('\n','\n      ')<br/>            log_msg(f"      {formatted_appliesTo}", "DEBUG")<br/>            log_msg(f"      {'='*80}", "DEBUG")<br/>        else:<br/>            log_msg(f"    There is no AppliesTo that we want to patch in.", "DEBUG")<br/>        if mismatches > 0:<br/>            log_msg(f"    Number of attribute mismatches: {mismatches}")<br/>            existing_group.applies_to = appliesTo<br/>            existing_properties.update(customProperties)<br/>            existing_group.custom_properties = [{"name":k,"value":v} for k,v in existing_properties.items()]<br/>            result = lm.patch_device_group_by_id(id=existing_group.id, body=existing_group) # , op_type="replace")<br/>            log_msg(f"    Patched device group {existing_group.name}", "API SDK PATCH")<br/>        else:<br/>            log_msg(f"    {existing_group.full_path} already exists in LM with all the correct properties, moving on...", "SUMMARY")<br/>            result = existing_group<br/>    log_msg(f"    {result.id}: {result.full_path}: {result.custom_properties}", "DEBUG")<br/>    return result

Example usage:

>>> response = create_group("SDK Test",812,{"prop1":"1","prop2":"2"})<br/>[2023-02-21 16:30:11] API SDK POST:   Created resource group Customers/Longhorn Smokers/SDK Test (854)<br/>>>> response = create_group("SDK Test",812,{"prop1":"1","prop2":"2"})<br/>[2023-02-21 16:33:06] SUMMARY:     Customers/Longhorn Smokers/SDK Test already exists in LM with all the correct properties, moving on...<br/>>>> response = create_group("SDK Test",812,{"prop1":"1","prop2":"2"})<br/>[2023-02-21 16:33:43] API SDK PATCH:     Patched device group SDK Test<br/>>>> debug = True<br/>>>> info = True<br/>>>> response = create_group("SDK Test",812,{"prop1":"1","prop2":"2"})<br/>[2023-02-21 16:35:57] DEBUG:   Group SDK Test exists in LM (854), checking if attributes match...<br/>[2023-02-21 16:35:57] DEBUG:     Property prop1 matches attribute already in LM<br/>[2023-02-21 16:35:57] DEBUG:     ================================================================================<br/>[2023-02-21 16:35:57] DEBUG:     prop1: 1<br/>[2023-02-21 16:35:57] DEBUG:     prop1: 1<br/>[2023-02-21 16:35:57] DEBUG:     ================================================================================<br/>[2023-02-21 16:35:57] DEBUG:     Property prop2 matches attribute already in LM<br/>[2023-02-21 16:35:57] DEBUG:     ================================================================================<br/>[2023-02-21 16:35:57] DEBUG:     prop2: 2<br/>[2023-02-21 16:35:57] DEBUG:     prop2: 2<br/>[2023-02-21 16:35:57] DEBUG:     ================================================================================<br/>[2023-02-21 16:35:57] DEBUG:     There is no AppliesTo that we want to patch in.<br/>[2023-02-21 16:35:57] SUMMARY:     Customers/Longhorn Smokers/SDK Test already exists in LM with all the correct properties, moving on...<br/>[2023-02-21 16:35:57] DEBUG:     854: Customers/Longhorn Smokers/SDK Test: [{'name': 'prop2', 'value': '2'}, {'name': 'prop1', 'value': '1'}]<br/>>>>

Jeff_W_

OP3 years ago

Thanks Stuart. One of the libraries I was using is “argparse” from the CLI.

My test script right now looks something like:

./script.py --primary ”Folder Name” --location ”123 somewhere ln, here, there 11111” --custom “building:Some Building” --custom “department:Some Department” --custom “role:Some Role”

When I push via the SDK to the api.add_device_group() function, I would basically take the --location and all the --custom ones set via the CLI and “build” the customProperties that I want to POST in the body of the api call (along with some more common , one off variables I scrape).

I’ll mess with the listofDicts as you illustrated and go from there.

Thanks for your help.

LM User

·3 years ago

You’d have a couple different things going on. I suggest trying to break down your code into separate functions.

Bring the data into a dictionary from your input CSV - several examples on the internet. Reply here if your google-fu turns up nothing useful
Convert the dictionary to a list of dictionaries - example below
POST/PUT/PATCH the object in LM using the SDK (I only mention that because it’s in the title of this post) - Documentation here.

Example to translate properties into something that can be patched in:

myDictionary = {"corp.building":"Some Building Name","corp.department":"Some Department Name","corp.role":"Some Role"}<br/>myListofDicts = [{"name":k,"value":v} for k,v in myDictionary.items()]<br/>pprint(myListofDicts)<br/>[{'name': 'corp.building', 'value': 'Some Building Name'},<br/> {'name': 'corp.department', 'value': 'Some Department Name'},<br/> {'name': 'corp.role', 'value': 'Some Role'}]

1	SUYASH GAIKWAD
2	NA Nazmeen Ali
3	DK Deepak Kumar
4	PG Phillip Green
5	SS Sean Staats
6	AH Arno haverlach