Issue in capturing historical data

You first retrieve all instance IDs, then in your code loop through each. Making a separate call for each instance. This is why mass data exportation is not feasible in the current method.

# Define start time in seconds
start_timestamp = int(time.mktime(time.strptime("2024-01-01", "%Y-%m-%d")))

# Get the current time in seconds
current_timestamp = int(time.time())

Shall I ChatGPT that for you?

from datetime import datetime, timedelta
end_time = int(datetime.utcnow().timestamp())
start_time = int((datetime.utcnow() - timedelta(minutes=30)).timestamp())

Mass data exportation is not feasible at all via LogicMonitor. This was a sticking point for us awhile back when we did a mass move to the platform from another.

#!/bin/env python

import requests
import json
import hashlib
import base64
import time
import hmac
import pandas as pd

# Account Info
AccessId = 
AccessKey = 
Company = 

# Define start time 
start_timestamp = int(time.mktime(time.strptime("2024-01-01", "%Y-%m-%d"))) * 1000

# Get the current time in milliseconds
current_timestamp = int(time.time() * 1000)



# Request Info
httpVerb = 'GET'
resourcePath = '/device/devices/659/devicedatasources/77499/instances/64341678/data'
queryParams = f'?start={start_timestamp}&end={current_timestamp}'
data = ''

# Construct URL
url = 'https://' + Company + '.logicmonitor.com/santaba/rest' + resourcePath + queryParams

# Get current time in milliseconds
epoch = str(int(time.time() * 1000))

# Concatenate Request details
requestVars = httpVerb + epoch + data + resourcePath

# Construct signature
hmac1 = hmac.new(AccessKey.encode(), msg=requestVars.encode(), digestmod=hashlib.sha256).hexdigest()
signature = base64.b64encode(hmac1.encode())

# Construct headers
auth = 'LMv1 ' + AccessId + ':' + signature.decode() + ':' + epoch
headers = {'Content-Type': 'application/json', 'Authorization': auth}

# Make request
response = requests.get(url, data=data, headers=headers)

# Print status and body of response
print('Response Status:', response.status_code)
print('Response Body:', response.content)

# Convert response content to JSON
json_response = json.loads(response.content)

# Check if "data" field exists in the JSON response
if "data" in json_response:
    data_field = json_response["data"]

    # Check if "values" field exists
    if data_field and "values" in data_field:
        # Extract the "values" field and create a Pandas DataFrame
        df = pd.DataFrame(data_field["values"], columns=data_field["dataPoints"])

        # Access the "time" field and add it as a new column
        df["time"] = pd.to_datetime(data_field["time"], unit="ms")

        # Print the Pandas DataFrame
        print(df)
    else:
        print("No 'values' field found in the 'data' section of the JSON response.")
else:
    print("No 'data' field found in the JSON response. Error message:", json_response.get("errmsg", "N/A"))

i want to capture Data from 1st January 2024 to till date. Any one Please look into this 

Ok . What if I want my start_time should be 30 before for my current_time stamp 

# Define start time in seconds

start_timestamp = ?

# Get the current time in seconds current_timestamp = int(time.time())

In my code above i have 

resourcePath = '/device/devices/659/devicedatasources/77499/instances/64341678/data'.

in the above Scenario I am capturing the data for one instance i.e. for 64341678. in the same code if i want to capture the data for another instance then how should we define multiple Resource path considering another instance is 64341782

@Joe Williams is there any other method for mass data exportation? Could you Please Help? Thanks

Reports: run and download them via the API.

i am using the below

current_timestamp = int(datetime.utcnow().timestamp()) 
print(current_timestamp)

start_timestamp = int((datetime.utcnow() - timedelta(days=30)).timestamp())

yesterday_timestamp = int((datetime.utcnow() - timedelta(days=1)).timestamp())

queryParams = f'?start={start_timestamp}&end={yesterday_timestamp}&size=1000'

My intention here is to capture data from: past 30 days from  yesterday

when i try this iam getting empty rows. Any Help?