Skip to content

Add torchao kernels to llama runner #24490

Add torchao kernels to llama runner

Add torchao kernels to llama runner #24490

Job Run time
11s
2m 28s
2m 26s
2m 17s
2m 19s
2m 17s
2m 20s
2m 25s
2m 26s
2m 28s
2m 31s
2m 17s
2m 16s
2m 19s
2m 29s
2m 18s
2m 26s
2m 16s
2m 25s
2m 23s
2m 24s
2m 25s
2m 16s
2m 24s
2m 10s
1m 55s
1m 58s
1m 56s
2m 2s
1m 56s
1m 57s
1h 8m 40s