Bump datadog-serverless-trace-mini-agent to 0.12.0

[duncanpharvey]

What does this PR do?

Bumps datadog-serverless-trace-mini-agent version to 0.12.0.

Motivation

Upcoming release

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.55%. Comparing base (305b434) to head (89c2cb9).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #873      +/-   ##
==========================================
- Coverage   71.61%   71.55%   -0.07%     
==========================================
  Files         328      328              
  Lines       48262    48262              
==========================================
- Hits        34564    34532      -32     
- Misses      13698    13730      +32     

Components	Coverage Δ
crashtracker	42.87% <ø> (ø)
crashtracker-ffi	6.25% <ø> (ø)
datadog-alloc	98.73% <ø> (ø)
data-pipeline	92.01% <ø> (ø)
data-pipeline-ffi	90.39% <ø> (ø)
ddcommon	80.08% <ø> (ø)
ddcommon-ffi	61.05% <ø> (ø)
ddtelemetry	61.74% <ø> (ø)
ddtelemetry-ffi	22.46% <ø> (ø)
dogstatsd	90.01% <ø> (ø)
dogstatsd-client	79.77% <ø> (ø)
ipc	82.68% <ø> (ø)
profiling	79.41% <ø> (-0.64%)	⬇️
profiling-ffi	70.68% <ø> (ø)
serverless	0.00% <ø> (ø)
sidecar	40.57% <ø> (ø)
sidecar-ffi	2.05% <ø> (ø)
spawn-worker	54.37% <ø> (ø)
tinybytes	92.00% <ø> (ø)
trace-mini-agent	72.48% <ø> (ø)
trace-normalization	98.23% <ø> (ø)
trace-obfuscation	95.96% <ø> (ø)
trace-protobuf	77.67% <ø> (ø)
trace-utils	93.22% <ø> (ø)

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2025-02-18 15:25:08

Comparing candidate commit 89c2cb9 in PR branch duncan-harvey/mini-agent-v0.12.0 with baseline commit 305b434 in branch main.

Found 0 performance improvements and 4 performance regressions! Performance is the same for 48 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/378282246310005

• 🟥 execution_time [+9.387µs; +9.664µs] or [+12.302%; +12.664%]
• 🟥 throughput [-1472859.914op/s; -1433875.874op/s] or [-11.239%; -10.941%]

scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて

• 🟥 execution_time [+19.083µs; +19.225µs] or [+4.208%; +4.239%]
• 🟥 throughput [-89689.758op/s; -89021.305op/s] or [-4.068%; -4.037%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.332µs	2.376µs ± 0.017µs	2.374µs ± 0.010µs	2.385µs	2.412µs	2.423µs	2.424µs	2.14%	0.310	0.803	0.72%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.374µs; 2.379µs] or [-0.099%; +0.099%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	244.654ns	253.984ns ± 11.663ns	248.671ns ± 2.660ns	254.196ns	279.790ns	288.958ns	295.268ns	18.74%	1.628	1.633	4.58%	0.825ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[252.368ns; 255.600ns] or [-0.636%; +0.636%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	53.616ms	53.966ms ± 0.201ms	53.927ms ± 0.084ms	54.008ms	54.391ms	54.712ms	54.865ms	1.74%	1.827	4.078	0.37%	0.014ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[53.938ms; 53.993ms] or [-0.052%; +0.052%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.900µs	3.914µs ± 0.003µs	3.914µs ± 0.001µs	3.915µs	3.918µs	3.920µs	3.921µs	0.19%	-0.538	3.222	0.07%	0.000µs	1	200
credit_card/is_card_number/	throughput	255023870.434op/s	255499454.451op/s ± 170758.687op/s	255498185.963op/s ± 97230.453op/s	255590248.925op/s	255764158.349op/s	255885446.795op/s	256379226.921op/s	0.34%	0.548	3.257	0.07%	12074.463op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	81.417µs	83.177µs ± 0.738µs	83.158µs ± 0.480µs	83.627µs	84.234µs	84.560µs	88.455µs	6.37%	1.795	11.502	0.89%	0.052µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	11305222.508op/s	12023498.785op/s ± 105168.297op/s	12025258.272op/s ± 69778.548op/s	12094804.992op/s	12173178.962op/s	12191931.673op/s	12282458.376op/s	2.14%	-1.542	9.386	0.87%	7436.522op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	78.257µs	79.417µs ± 0.510µs	79.378µs ± 0.304µs	79.715µs	80.084µs	80.400µs	83.589µs	5.31%	2.596	20.933	0.64%	0.036µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	11963227.864op/s	12592316.460op/s ± 79644.373op/s	12598010.917op/s ± 48418.812op/s	12639846.675op/s	12703791.192op/s	12763259.244op/s	12778428.885op/s	1.43%	-2.301	18.091	0.63%	5631.708op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.898µs	3.914µs ± 0.005µs	3.914µs ± 0.001µs	3.916µs	3.918µs	3.921µs	3.969µs	1.40%	6.423	67.510	0.13%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	251945651.527op/s	255463663.917op/s ± 328664.546op/s	255474516.418op/s ± 94080.980op/s	255568294.247op/s	255796876.702op/s	255981658.686op/s	256565851.517op/s	0.43%	-6.313	66.085	0.13%	23240.093op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	83.923µs	85.833µs ± 0.918µs	85.773µs ± 0.600µs	86.363µs	87.424µs	88.479µs	88.723µs	3.44%	0.629	0.480	1.07%	0.065µs	1	200
credit_card/is_card_number/378282246310005	throughput	11271024.796op/s	11651799.376op/s ± 123817.702op/s	11658669.441op/s ± 81784.764op/s	11742193.678op/s	11829659.464op/s	11899667.721op/s	11915741.652op/s	2.20%	-0.564	0.356	1.06%	8755.234op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	51.350µs	51.448µs ± 0.034µs	51.447µs ± 0.021µs	51.470µs	51.503µs	51.522µs	51.544µs	0.19%	-0.139	0.420	0.07%	0.002µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	19400996.714op/s	19437057.241op/s ± 12840.131op/s	19437657.601op/s ± 7979.897op/s	19444198.553op/s	19458069.261op/s	19469637.383op/s	19474227.807op/s	0.19%	0.144	0.423	0.07%	907.934op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	6.027µs	6.039µs ± 0.006µs	6.039µs ± 0.002µs	6.041µs	6.044µs	6.048µs	6.110µs	1.18%	7.812	89.166	0.10%	0.000µs	1	200
credit_card/is_card_number/x371413321323331	throughput	163663938.770op/s	165595345.033op/s ± 166979.290op/s	165600093.465op/s ± 59166.417op/s	165669649.322op/s	165760358.419op/s	165850760.165op/s	165907284.561op/s	0.19%	-7.720	87.793	0.10%	11807.219op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.897µs	3.914µs ± 0.003µs	3.914µs ± 0.002µs	3.915µs	3.917µs	3.919µs	3.920µs	0.16%	-1.336	5.586	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	255090605.088op/s	255525764.709op/s ± 178984.659op/s	255500357.703op/s ± 101614.710op/s	255614796.613op/s	255865070.853op/s	255944563.939op/s	256596488.113op/s	0.43%	1.348	5.663	0.07%	12656.127op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	65.868µs	66.291µs ± 0.181µs	66.265µs ± 0.115µs	66.398µs	66.614µs	66.768µs	66.894µs	0.95%	0.593	0.443	0.27%	0.013µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	14949091.907op/s	15085112.700op/s ± 41082.172op/s	15090827.041op/s ± 26224.338op/s	15113427.903op/s	15142551.971op/s	15162574.340op/s	15181881.962op/s	0.60%	-0.576	0.412	0.27%	2904.948op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	59.414µs	59.698µs ± 0.108µs	59.712µs ± 0.080µs	59.776µs	59.852µs	59.922µs	59.977µs	0.44%	-0.150	-0.512	0.18%	0.008µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	16673003.400op/s	16751158.272op/s ± 30339.373op/s	16746930.653op/s ± 22557.400op/s	16774274.136op/s	16803375.715op/s	16820394.124op/s	16831149.408op/s	0.50%	0.158	-0.510	0.18%	2145.318op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.893µs	3.914µs ± 0.003µs	3.914µs ± 0.002µs	3.915µs	3.918µs	3.920µs	3.930µs	0.42%	-0.750	8.884	0.09%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	254438792.240op/s	255516270.376op/s ± 220312.115op/s	255507774.478op/s ± 113889.592op/s	255621881.235op/s	255882402.055op/s	255961749.986op/s	256893587.661op/s	0.54%	0.777	8.967	0.09%	15578.419op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	56.248µs	56.849µs ± 0.212µs	56.857µs ± 0.160µs	57.032µs	57.141µs	57.196µs	57.219µs	0.64%	-0.393	-0.547	0.37%	0.015µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	17476660.218op/s	17590734.050op/s ± 65706.293op/s	17588003.223op/s ± 49559.006op/s	17632861.515op/s	17705145.573op/s	17737810.527op/s	17778377.574op/s	1.08%	0.408	-0.526	0.37%	4646.137op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	51.341µs	51.428µs ± 0.039µs	51.430µs ± 0.023µs	51.452µs	51.477µs	51.519µs	51.648µs	0.42%	0.708	4.518	0.08%	0.003µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	19361730.140op/s	19444657.927op/s ± 14646.999op/s	19443848.111op/s ± 8821.349op/s	19454033.038op/s	19472206.930op/s	19474517.127op/s	19477762.239op/s	0.17%	-0.694	4.448	0.08%	1035.699op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	6.026µs	6.038µs ± 0.006µs	6.038µs ± 0.002µs	6.040µs	6.045µs	6.049µs	6.106µs	1.13%	6.068	63.373	0.11%	0.000µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	163780707.523op/s	165623120.517op/s ± 173344.249op/s	165628595.781op/s ± 64191.666op/s	165689198.781op/s	165835555.324op/s	165888744.996op/s	165937533.537op/s	0.19%	-5.978	62.145	0.10%	12257.289op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.914µs; 3.914µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/	throughput	[255475788.940op/s; 255523119.963op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[83.075µs; 83.279µs] or [-0.123%; +0.123%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[12008923.471op/s; 12038074.100op/s] or [-0.121%; +0.121%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[79.346µs; 79.487µs] or [-0.089%; +0.089%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[12581278.516op/s; 12603354.404op/s] or [-0.088%; +0.088%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.914µs; 3.915µs] or [-0.018%; +0.018%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[255418114.172op/s; 255509213.662op/s] or [-0.018%; +0.018%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[85.706µs; 85.961µs] or [-0.148%; +0.148%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[11634639.434op/s; 11668959.319op/s] or [-0.147%; +0.147%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[51.443µs; 51.453µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[19435277.723op/s; 19438836.760op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[6.038µs; 6.040µs] or [-0.014%; +0.014%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[165572203.309op/s; 165618486.756op/s] or [-0.014%; +0.014%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.913µs; 3.914µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[255500959.156op/s; 255550570.261op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[66.266µs; 66.316µs] or [-0.038%; +0.038%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[15079419.106op/s; 15090806.294op/s] or [-0.038%; +0.038%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[59.683µs; 59.713µs] or [-0.025%; +0.025%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[16746953.527op/s; 16755363.018op/s] or [-0.025%; +0.025%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.913µs; 3.914µs] or [-0.012%; +0.012%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[255485737.236op/s; 255546803.516op/s] or [-0.012%; +0.012%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[56.820µs; 56.878µs] or [-0.052%; +0.052%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[17581627.789op/s; 17599840.310op/s] or [-0.052%; +0.052%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[51.423µs; 51.433µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[19442627.993op/s; 19446687.860op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[6.037µs; 6.039µs] or [-0.015%; +0.015%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[165599096.672op/s; 165647144.363op/s] or [-0.015%; +0.015%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	65.197µs	65.492µs ± 0.285µs	65.395µs ± 0.079µs	65.621µs	65.870µs	66.132µs	68.024µs	4.02%	4.541	33.486	0.43%	0.020µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[65.452µs; 65.531µs] or [-0.060%; +0.060%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	150.968µs	151.703µs ± 0.428µs	151.612µs ± 0.262µs	151.943µs	152.401µs	153.152µs	153.974µs	1.56%	1.582	4.783	0.28%	0.030µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[151.644µs; 151.762µs] or [-0.039%; +0.039%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	32.758µs	33.557µs ± 1.341µs	32.918µs ± 0.062µs	33.122µs	36.427µs	36.463µs	37.798µs	14.82%	1.713	1.042	3.99%	0.095µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[33.371µs; 33.743µs] or [-0.554%; +0.554%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.658µs	25.575µs ± 11.050µs	17.993µs ± 0.119µs	34.762µs	43.256µs	55.642µs	98.303µs	446.35%	2.132	8.872	43.10%	0.781µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[24.043µs; 27.106µs] or [-5.988%; +5.988%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.215µs	3.167µs ± 1.496µs	2.966µs ± 0.026µs	2.992µs	3.594µs	13.758µs	16.774µs	465.52%	7.610	59.348	47.13%	0.106µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[2.959µs; 3.374µs] or [-6.548%; +6.548%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	5.931ms	5.944ms ± 0.008ms	5.943ms ± 0.003ms	5.946ms	5.953ms	5.966ms	6.026ms	1.41%	5.938	53.168	0.14%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[5.943ms; 5.945ms] or [-0.019%; +0.019%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	208.574µs	209.117µs ± 0.161µs	209.125µs ± 0.110µs	209.229µs	209.379µs	209.427µs	209.535µs	0.20%	-0.218	-0.082	0.08%	0.011µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	4772483.135op/s	4782008.419op/s ± 3673.023op/s	4781839.212op/s ± 2513.302op/s	4784582.164op/s	4788046.260op/s	4789790.738op/s	4794457.607op/s	0.26%	0.222	-0.077	0.08%	259.722op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	18.269µs	18.359µs ± 0.053µs	18.373µs ± 0.028µs	18.390µs	18.425µs	18.446µs	18.627µs	1.38%	0.217	2.126	0.29%	0.004µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	53686091.558op/s	54470983.114op/s ± 155766.880op/s	54428526.768op/s ± 83232.172op/s	54584026.246op/s	54729119.031op/s	54734183.027op/s	54738263.702op/s	0.57%	-0.183	1.962	0.29%	11014.382op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	10.651µs	10.708µs ± 0.027µs	10.704µs ± 0.017µs	10.725µs	10.753µs	10.774µs	10.801µs	0.91%	0.458	0.342	0.25%	0.002µs	1	200
normalization/normalize_name/normalize_name/good	throughput	92581382.596op/s	93389826.018op/s ± 233914.426op/s	93419696.252op/s ± 144524.813op/s	93543097.734op/s	93762909.330op/s	93870164.896op/s	93888236.887op/s	0.50%	-0.442	0.319	0.25%	16540.248op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[209.095µs; 209.140µs] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[4781499.374op/s; 4782517.465op/s] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[18.351µs; 18.366µs] or [-0.040%; +0.040%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[54449395.323op/s; 54492570.906op/s] or [-0.040%; +0.040%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[10.704µs; 10.712µs] or [-0.035%; +0.035%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[93357407.728op/s; 93422244.308op/s] or [-0.035%; +0.035%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	504.647µs	505.719µs ± 0.562µs	505.705µs ± 0.277µs	505.941µs	506.346µs	506.732µs	511.054µs	1.06%	4.292	38.992	0.11%	0.040µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1956741.022op/s	1977383.535op/s ± 2187.042op/s	1977437.982op/s ± 1082.692op/s	1978568.802op/s	1980145.325op/s	1981038.935op/s	1981583.821op/s	0.21%	-4.218	38.090	0.11%	154.647op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	471.782µs	472.666µs ± 0.333µs	472.653µs ± 0.203µs	472.871µs	473.226µs	473.446µs	473.695µs	0.22%	0.065	0.339	0.07%	0.024µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2111061.853op/s	2115658.704op/s ± 1491.156op/s	2115716.320op/s ± 908.054op/s	2116494.886op/s	2118206.373op/s	2119051.175op/s	2119620.918op/s	0.18%	-0.060	0.337	0.07%	105.441op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	175.176µs	176.352µs ± 0.321µs	176.384µs ± 0.184µs	176.566µs	176.803µs	176.904µs	177.104µs	0.41%	-0.899	1.471	0.18%	0.023µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5646409.187op/s	5670495.604op/s ± 10322.732op/s	5669435.541op/s ± 5909.230op/s	5675640.340op/s	5690568.358op/s	5703932.599op/s	5708560.446op/s	0.69%	0.913	1.507	0.18%	729.927op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	37.533µs	37.633µs ± 0.041µs	37.628µs ± 0.025µs	37.659µs	37.704µs	37.721µs	37.823µs	0.52%	0.495	1.566	0.11%	0.003µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	26439040.872op/s	26572606.270op/s ± 29045.846op/s	26575871.952op/s ± 17814.960op/s	26590434.571op/s	26614976.874op/s	26639622.498op/s	26643018.406op/s	0.25%	-0.484	1.534	0.11%	2053.851op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	48.212µs	48.332µs ± 0.042µs	48.329µs ± 0.027µs	48.361µs	48.402µs	48.442µs	48.468µs	0.29%	0.308	0.274	0.09%	0.003µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	20632174.516op/s	20690174.578op/s ± 18149.370op/s	20691687.855op/s ± 11763.671op/s	20702285.027op/s	20715916.168op/s	20730122.988op/s	20741758.274op/s	0.24%	-0.303	0.269	0.09%	1283.354op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[505.642µs; 505.797µs] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1977080.432op/s; 1977686.638op/s] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[472.620µs; 472.712µs] or [-0.010%; +0.010%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2115452.044op/s; 2115865.364op/s] or [-0.010%; +0.010%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[176.308µs; 176.396µs] or [-0.025%; +0.025%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5669064.973op/s; 5671926.236op/s] or [-0.025%; +0.025%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[37.627µs; 37.638µs] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[26568580.795op/s; 26576631.745op/s] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[48.326µs; 48.338µs] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[20687659.250op/s; 20692689.906op/s] or [-0.012%; +0.012%]	None	None	None

Group 13

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	89c2cb9	1739891617	duncan-harvey/mini-agent-v0.12.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
ip_address/quantize_peer_ip_address_benchmark	execution_time	4.990µs	5.069µs ± 0.046µs	5.077µs ± 0.037µs	5.099µs	5.142µs	5.147µs	5.151µs	1.45%	-0.018	-1.217	0.90%	0.003µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark	execution_time	[5.063µs; 5.075µs] or [-0.125%; +0.125%]	None	None	None

Baseline

Omitted due to size.