[SPARK-53923][CORE] Rename spark.executor.(log -> logs).redirectConsoleOutputs

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to rename spark.executor.log.redirectConsoleOutputs to spark.executor.logs.redirectConsoleOutputs to be consistent with the existing executor log configurations like the following.

spark.executor.logs.rolling.strategy
spark.executor.logs.rolling.time.interval
spark.executor.logs.rolling.maxSize
spark.executor.logs.rolling.maxRetainedFiles
spark.executor.logs.rolling.enableCompression
spark.executor.logs.redirectConsoleOutputs

Why are the changes needed?

Although SPARK-52426 introduced two configurations consistently in the PR, Apache Spark has different namespaces for Driver and Executor which are spark.driver.log.* and spark.executor.logs.* respectively. Instead of introducing a new config namespace, spark.executor.log, for this single new configuration, we had better follow the existing naming rule.

• [SPARK-52426][CORE] Support redirecting stdout/stderr to logging system #51130

spark.driver.log.redirectConsoleOutputs
spark.executor.log.redirectConsoleOutputs

Does this PR introduce any user-facing change?

No this is not released yet.

How was this patch tested?

Pass the CIs. Manual review.

Was this patch authored or co-authored using generative AI tooling?

No.

[dongjoon-hyun]

cc @pan3793 , @yaooqinn , @peter-toth

[dongjoon-hyun]

Thank you, @peter-toth .

[pan3793]

LGTM, I haven't noticed the existing spark.executor.logs config namespace, the change makes the config names more consistent.

[dongjoon-hyun]

Thank you, @pan3793 .

[dongjoon-hyun]

Merged to master for Apache Spark 4.1.0-preview3.