Skip to content

Commit d1d29f9

Browse files
wForgetdongjoon-hyun
authored andcommitted
[SPARK-52560][BUILD] Bump ap-loader 4.0(v10) to support for async-profiler 4.0
### What changes were proposed in this pull request? Bump ap-loader 4.0-10 ### Why are the changes needed? ap-loader 4.0 (v10) has already been released, which supports for async-profier 4.0. The release guide refers to [Loader for 4.0 (v10): Heatmaps and Native memory profiling](https://github.com/jvm-profiling-tools/ap-loader/releases/tag/4.0-10) ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? ### Was this patch authored or co-authored using generative AI tooling? No Closes #51257 from wForget/SPARK-52560. Authored-by: wforget <643348094@qq.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
1 parent 00a8adb commit d1d29f9

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

connector/profiler/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ or
1616

1717
## Executor Code Profiling
1818

19-
The spark profiler module enables code profiling of executors in cluster mode based on the [async profiler](https://github.com/async-profiler/async-profiler/blob/v3.0/README.md), a low overhead sampling profiler. This allows a Spark application to capture CPU and memory profiles for application running on a cluster which can later be analyzed for performance issues. The profiler captures [Java Flight Recorder (jfr)](https://access.redhat.com/documentation/es-es/red_hat_build_of_openjdk/17/html/using_jdk_flight_recorder_with_red_hat_build_of_openjdk/openjdk-flight-recorded-overview) files for each executor; these can be read by many tools including Java Mission Control and Intellij.
19+
The spark profiler module enables code profiling of executors in cluster mode based on the [async profiler](https://github.com/async-profiler/async-profiler/blob/v4.0/README.md), a low overhead sampling profiler. This allows a Spark application to capture CPU and memory profiles for application running on a cluster which can later be analyzed for performance issues. The profiler captures [Java Flight Recorder (jfr)](https://access.redhat.com/documentation/es-es/red_hat_build_of_openjdk/17/html/using_jdk_flight_recorder_with_red_hat_build_of_openjdk/openjdk-flight-recorded-overview) files for each executor; these can be read by many tools including Java Mission Control and Intellij.
2020

2121
The profiler writes the jfr files to the executor's working directory in the executor's local file system and the files can grow to be large, so it is advisable that the executor machines have adequate storage. The profiler can be configured to copy the jfr files to a hdfs location before the executor shuts down.
2222

@@ -95,7 +95,7 @@ Then enable the profiling in the configuration.
9595
<td>event=wall,interval=10ms,alloc=2m,lock=10ms,chunktime=300s</td>
9696
<td>
9797
Arguments to pass to the Async Profiler. Detailed options are documented in the comments here:
98-
<a href="https://github.com/async-profiler/async-profiler/blob/v3.0/src/arguments.cpp#L44">Profiler arguments</a>.
98+
<a href="https://github.com/async-profiler/async-profiler/blob/v4.0/docs/ProfilerOptions.md">Profiler options</a>.
9999
Note that the arguments to start, stop, specify output format, and output file do not have to be specified.
100100
</td>
101101
<td>4.0.0</td>

pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -308,7 +308,7 @@
308308
<tomcat.annotations.api.version>6.0.53</tomcat.annotations.api.version>
309309

310310
<!-- Version used in Profiler -->
311-
<ap-loader.version>3.0-9</ap-loader.version>
311+
<ap-loader.version>4.0-10</ap-loader.version>
312312

313313
<CodeCacheSize>128m</CodeCacheSize>
314314
<!-- Needed for consistent times -->

0 commit comments

Comments
 (0)