[SPARK-52277] Upgrade Docker tags to 4.0.0 instead of 4.0.0-preview2

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to use Spark docker image tag 4.0.0 instead of 4.0.0-preview2.

Why are the changes needed?

To use the official one instead of the preview.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manual review.

Was this patch authored or co-authored using generative AI tooling?

No.

[dongjoon-hyun]

This PR will be ready after the release manager publish the docker image.

[dongjoon-hyun]

This PR is ready.

• https://hub.docker.com/r/apache/spark/tags?name=4.0.0

$ docker run -it --rm apache/spark:4.0.0 /opt/spark/bin/spark-shell --version
WARNING: Using incubator modules: jdk.incubator.vector
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 4.0.0
      /_/

Using Scala version 2.13.16, OpenJDK 64-Bit Server VM, 17.0.15
Branch HEAD
Compiled by user wenchen on 2025-05-19T07:58:03Z
Revision fa33ea000a0bda9e5a3fa1af98e8e85b8cc5e4d4
Url https://github.com/apache/spark
Type --help for more information.

[dongjoon-hyun]

Thank you, @viirya . Merged to main.