My rust implementation for 1 Billion Row Challenge. [https://1brc.dev]
The objective is to write a program that retrieves temperature measurement values from a text file and calculates the min, mean, and max temperature per weather station. The file has 1,000,000,000 rows! That's more than 10 GB of data.
While the official challenge - which was for Java implementations - ended in Jan 2024, this implementation is an effort to go deeper with rust toolkit to get the best (min) execution time possible. Secondary objectve would be to use minimum memory.
Execution time and Memory usage for each implementation will be recorded here in this file.
The input data file can be generated by calling function, included in the code, that takes data/weather_stations.csv as seed, and mirrors the original Java implementation.
Implementation Approach | Execution Time | Memory |
---|---|---|
Naive Hash Counter | ||
SIMD | -- | -- |
Paralel Processing of Data chunks | -- | -- |