Improve dictionary null handling in hashing and expand aggregate test coverage for nulls#16466

Open

kosiew wants to merge 49 commits intoapache:mainfrom

kosiew:fuzz-16266b

Commits on Jun 17, 2025

fuzz: include dict with null values
kosiew
committed

Commits on Jun 19, 2025

feat: enhance error reporting in AggregationFuzzTestTask with dataset rows and sort keys
kosiew
committed

Commits on Jun 20, 2025

Fix typo in expect message
kosiew
committed
feat: add tests for GROUP BY with MAX aggregations, including handling of null values
kosiew
committed
feat: add tests for GROUP BY with MAX aggregations on dictionary arrays handling null keys and values
kosiew
committed
feat: enhance GROUP BY tests with detailed assertions for dictionary columns handling nulls
kosiew
committed
feat: enhance GROUP BY MAX tests with comprehensive assertions for null handling in dictionary columns
kosiew
committed
feat: update test assertions for GROUP BY MAX with nulls and dictionary handling
kosiew
committed
feat: add tests for COUNT, SUM, MIN, MEDIAN, and FIRST/LAST_VALUE handling of null values
kosiew
committed
feat: add comprehensive tests for GROUP BY with dictionary columns handling null keys and values
kosiew
committed
fix: correct median value assertions in GROUP BY tests for dictionary columns
kosiew
committed
feat: remove redundant GROUP BY tests for MAX aggregations and enhance null handling in dictionary columns
kosiew
committed
feat: enhance COUNT, SUM, MIN, and MEDIAN tests for null handling with GROUP BY on dictionary columns
kosiew
committed
feat: enhance COUNT, SUM, MIN, and MEDIAN tests for null handling with GROUP BY on dictionary columns, including null keys and values
kosiew
committed
feat: enhance COUNT, SUM, MIN, and MEDIAN tests for null handling with GROUP BY on dictionary columns, including single and multiple partition scenarios
kosiew
committed
feat: add helper functions and test data structures for handling nulls in dictionary columns across various aggregate functions
kosiew
committed
Merge branch 'main' into fuzz-16266a
kosiew
committed
refactor: improve batch splitting logic in setup_test_contexts
kosiew
committed
refactor: add num_partitions variable, streamline setup_test_contexts by consolidating batch creation logic
kosiew
committed
refactor: simplify setup_test_contexts by introducing create_context_with_partitions function
kosiew
committed
refactor: consolidate dictionary creation functions in aggregate tests
kosiew
committed
refactor: introduce string_dict_type function to simplify dictionary field creation
kosiew
committed
refactor: move create_context_with_partitions function to improve test context setup
kosiew
committed
add more first_value, last_value tests
kosiew
committed
test: add fuzz tests for MAX with dictionary columns containing null keys and values
kosiew
committed
test: add fuzz tests for MIN aggregation with timestamp and dictionary columns containing nulls
kosiew
committed
test: add COUNT and COUNT DISTINCT tests for fuzz table with dictionary columns containing nulls
kosiew
committed
test: add median and median distinct tests for fuzz table with numeric types and dictionary columns containing nulls
kosiew
committed
test: fix first and last value null handling in aggregate tests
kosiew
committed
test: update expected values in count distinct test for dictionary columns with nulls
kosiew
committed
test: update expected values in aggregate tests for dictionary columns with nulls
kosiew
committed
fix: improve null handling in dictionary hash calculations
kosiew
committed
test: enable generation of null values in record batch generator
kosiew
committed
fix: remove dataset rows and sort keys from error report in AggregationFuzzTestTask
kosiew
committed
test: remove overlapping tests
kosiew
committed
fix: correct formatting in AggregationFuzzTestTask output
kosiew
committed
Merge branch 'main' into fuzz-16266a
kosiew
committed
fix: rename variables for clarity in hash_dictionary function
kosiew
committed
fix: refactor hash_dictionary to use helper function for updating dictionary key hashes
kosiew
committed
fix: add debug assertion for null percentage in RecordBatchGenerator
kosiew
committed
fix: introduce create_test_dict helper function for improved dictionary creation
kosiew
committed
refactor: remove legacy create_dict function in favor of create_test_dict
kosiew
committed
refactor: enhance test helper functions for improved readability and consistency
kosiew
committed
feat: add fuzz timestamp test data structure and related setup functions
kosiew
committed
refactor: simplify run_snapshot_test function by removing unused parameter
kosiew
committed
Merge branch 'main' into fuzz-16266b
kosiew
committed
fix clippy errors
kosiew
committed
Merge branch 'main' into fuzz-16266b
kosiew
committed

Commits on Jun 23, 2025

Merge branch 'main' into fuzz-16266b
kosiew
committed