Merge branch 'andrew/add-power-metric-scripts' into 'master'

Add power metric verification scripts

 

See merge request dfinity-lab/public/ic!12582

Author: andrewbattat

ic-os/scripts/README.adoc

@@ -1,3 +1,4 @@
 = Scripts
 
-This folder contains build and utility scripts for HostOS, which are intended to be consolidated with `ic-os/guestos/scripts` and `ic-os/generic-guestos/scripts`. This unified system will serve as a common build process for any Docker-based images.
+This folder contains build and utility scripts for the IC-OS. 
+

ic-os/scripts/power-metric-verification/README.adoc

@@ -0,0 +1,12 @@
+= Power Metric Verification
+
+This directory contains the scripts needed to perform power metric verification on a node. 
+
+* `collect_voltage_readings.sh`: collects voltage readings during alternating cycles of stress tests and rest periods. 
+* `parse_voltage_readings.py`: invoked by collect_voltage_readings.sh, parses the collected voltage readings and generates a CSV file containing the instantaneous voltage readings.
+
+After running these scripts, the resulting data can be cross-verified with the readings from an on-site power distribution unit. This comparison helps validate the readings acquired by the `ipmitool`.
+
+Note: for the scripts to work, you must install `stress-ng` and `ipmitool`
+
+    $ sudo apt-get install -y ipmitool stress-ng

ic-os/scripts/power-metric-verification/collect_voltage_readings.sh

@@ -0,0 +1,29 @@
+#!/bin/bash
+
+output_file="voltage_readings.txt"
+sudo rm "$output_file"
+
+collect_voltage_readings() {
+    duration_in_minutes=$1
+    end_time=$(($(date +%s) + duration_in_minutes * 60))
+
+    while [ $(date +%s) -lt $end_time ]; do
+        sudo ipmitool dcmi power reading >>$output_file
+        sleep 10s
+    done
+}
+
+# duration_in_minutes is the maximum amount of time to collect voltage readings
+duration_in_minutes=120
+collect_voltage_readings $duration_in_minutes &
+voltage_readings_pid=$!
+
+# alternating cycles of stress tests and rest periods in order to get voltage readings under different conditions.
+for i in 10 5 10 5 10; do
+    timeout "${i}m" stress-ng --sequential "$(nproc)"
+    sleep "${i}m"
+done
+
+sudo kill $voltage_readings_pid
+
+python3 parse_voltage_readings.py voltage_readings.txt

ic-os/scripts/power-metric-verification/parse_voltage_readings.py

@@ -0,0 +1,20 @@
+import csv
+import re
+import sys
+
+voltage_readings = sys.argv[1]
+
+with open(voltage_readings, 'r') as in_file, open('voltage_readings.csv', 'w', newline='') as out_file:
+    writer = csv.writer(out_file)
+    writer.writerow(['Time', 'Instantaneous voltage reading'])
+
+    lines = in_file.readlines()
+
+    for line in lines:
+        if line.startswith('    Instantaneous power reading:'):
+            voltage_reading = re.search(r'\d+', line).group()
+
+        elif line.startswith('    IPMI timestamp:'):
+            time = re.search(r'\d{2}:\d{2}:\d{2}', line).group()
+
+            writer.writerow([time, voltage_reading])