Skip to content

Commit 7d110da

Browse files
Update leaderboard.md
1 parent 8785b9d commit 7d110da

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

neurips23/leaderboard.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,8 @@ The recall of the baselines at this QPS threshold is listed [above](#measuring_y
66
For tasks "Filter", "Out-of-Distribution" and "Sparse" tracks, algorithms were ranked on the QPS they achieve on the track dataset, as long as the recall@10 is at least 90%.
77
These results files for [Azure D8lds_v5](Azure_D8lds_v5_table.md) and [AWS EC2 c6i.2xlarge](ec2_c6i.2xlarge_table.md) list the maximum QPS measured for each algorihtm with at least 90% recall@10.
88

9-
For the Streaming track, algorithms will be ranked on recall@10, as long as each algorithm completes the runbook within the alloted 1 hour.
10-
The [result file](streaming/res_final_runbook_AzureD8lds_v5.csv) lists measurements on Azure D8lds_v5.
9+
For the Streaming track, algorithms were ranked on recall@10, as long as each algorithm completes the runbook within the alloted 1 hour. The leading entry had a recall of 0.9849.
10+
The [result file](streaming/res_final_runbook_AzureD8lds_v5.csv) lists measurements for all streaming algorithms on Azure D8lds_v5.
1111

1212
QPS vs recall@10 plots for tracks based on public queries on Azure D8lds_v5:
1313
**Filter track**
@@ -18,3 +18,5 @@ QPS vs recall@10 plots for tracks based on public queries on Azure D8lds_v5:
1818

1919
**Sparse track**
2020
![sparse-full](sparse/plot_public_queries_AzureD8lds_v5.png)
21+
22+
More plots to follow.

0 commit comments

Comments
 (0)