You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[SPARK-52233][SQL][FOLLOW-UP] Fix 0.0 and -0.0 issues in map_zip_with
### What changes were proposed in this pull request?
This PR introduces normalization of floating point numbers before being inserted into java map of map_zip_with implementation.
### Why are the changes needed?
Scala maps have problems with NaNs, but Java maps have problems with 0.0 and -0.0. We need to make sure our implementation works properly for all inputs.
### Does this PR introduce _any_ user-facing change?
No, scala implementation did not have this problem and java fix was not released yet.
### How was this patch tested?
Golden file test added.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closesapache#51052 from mihailom-db/mapZipWith-followup.
Authored-by: Mihailo Milosevic <mihailo.milosevic@databricks.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
0 commit comments