v3.5 Metrics Output

Contents

1. Load Average
   1.1. Console
   1.2. File
   
2. Step Summary
   2.1. Console
   2.2. File
   
3. I/O Traces
   3.1. Console
   3.2. File
   
4. Threshold
   4.1. Console
   4.2. File
   

1. Load Average

1.1. Console

1. Step Name The configured step name. Timestamp value is used if not configured obviously. Note that only last 12 characters are displayed in the table.
2. Timestamp The datetime of the record output.
3. Operation Type

May be N (Noop), C (Create), R (Read), U (Update) or D (Delete). Colored for readability.

4. Concurrency x Drivers

The configured concurrency level and the count of the storage drivers used to perform a load. The effective concurrency level is a product of configured concurrency and the drivers count.

5. Count/Success

The count of the items processed sucessfully.

6. Count/Failed

The count of the items processed with a failure.

7. Step Time [s]

The test step elapsed time in seconds. Note that the step elapsing more than 11.574 days will cause the cell overflow as far as only 6 characters are available for the output.

8. Last Rate/[op/s]

The moving average operations per second rate for the last 10 seconds period.

9. Last Rate/[MB/s]

The moving average megabytes per second rate for the last 10 seconds period.

10. Mean Latency [us]

The last mean latency measured in the microseconds.

11. Mean Duration [us]

The last mean operation duration measured in the microseconds.

1.2. Files

Average metrics data is written to a CSV file metrics.csv with dynamic path.

Field Name	Description
DateTimeISO8601	Timestamp in the ISO8601 format
TypeLoad	Load type (CREATE/READ/...)
Concurrency	The concurrency level
DriverCount	Count of the storage drivers used (may be more than 1 in the distributed mode)
CountSucc	Total successful I/O tasks count
CountFail	Total failed I/O tasks count
Size	Total transferred byte count
JobDuration[s]	Total step duration
DurationSum[s]	Total sum of the I/O tasks durations
TPAvg[op/s]	Total average throughput
TPLast[op/s]	Last final moving average throughput
BWAvg[MB/s]	Total average bandwidth
BWLast[MB/s]	Last final moving average bandwidth
DurationAvg[us]	Total average I/O tasks duration
DurationMin[us]	Minimum I/O task duration
DurationLoQ[us]	Low quartile of the I/O tasks duration distribution
DurationMed[us]	Median of the I/O tasks duration distribution
DurationHiQ[us]	High quartile of the I/O tasks duration distribution
DurationMax[us]	Maximum I/O task duration
LatencyAvg[us]	Total average I/O tasks latency
LatencyMin[us]	Minimum I/O task latency
LatencyLoQ[us]	Low quartile of the I/O tasks latency distribution
LatencyMed[us]	Median of the I/O tasks latency distribution
LatencyHiQ[us]	High quartile of the I/O tasks latency distribution
LatencyMax[us]	Maximum I/O task latency

2. Step Summary

2.1. Console

2.2. Files

3. I/O Traces

The metrics for each load operation (request either file operation).

3.1. Console

The console output is absent.

3.2. Files

The file output is disabled by default. To enable the file output, set the output-metrics-trace-persist configuration parameter to "true". Output file: io.trace.csv with dynamic path.

Available fields

Field Name	Description
StorageDriver	The address/hostname of the storage driver executed the operation
StorageNode	The target storage node address/hostname
ItemPath	The resulting item path
IoTypeCode	The I/O operation type code
StatusCode	The I/O operation resulting status code
ReqTimeStart	The I/O operation start timestamp in microseconds
Duration	The I/O operation total duration in microseconds
RespLatency	The I/O operation response latency in microseconds
DataLatency	The I/O operation response data latency ("1st byte" of the response content) in microseconds
TransferSize	The count of the bytes transferred within the I/O operation

IoTypeCode

Code	I/O Type
0	NOOP
1	CREATE
2	READ
3	UPDATE
4	DELETE

StatusCode

Code	Description	HTTP response codes
O	Pending (internal)
1	Active (internal)
2	Interrupted
3	Unknown failure	all other codes
4	Success	2xx
5	I/O Failure
6	Timeout	504
7	Unrecognized storage response
8	Client failure or invalid request	100, 400, 405, 409, 411, 414, 416
9	Internal storage failure	413, 415, 429, 500, 501, 502, 503, 505
10	Item not found on the storage	404
11	Authentication/access failure	401, 403
12	Data item corrupted	2xx
13	Not enough space on the storage	507

4. Threshold

4.1. Console

4.2. Files