Skip to content

Commit 97b27fe

Browse files
authored
[data] deflake test_streaming_backpressure_e2e (#51999)
## Why are these changes needed? Explicitly set RAY_object_spilling_threshold to 1 for this test. So Ray Core only starts to spill when the object store utilization reaches 100%. Signed-off-by: Hao Chen <chenh1024@gmail.com>
1 parent e8906c4 commit 97b27fe

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

python/ray/data/tests/test_backpressure_e2e.py

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -287,9 +287,15 @@ def range_(i):
287287
assert launched <= 10, launched
288288

289289

290-
def test_streaming_backpressure_e2e(restore_data_context): # noqa: F811
290+
def test_streaming_backpressure_e2e(
291+
shutdown_only, monkeypatch, restore_data_context # noqa: F811
292+
):
291293
# This test case is particularly challenging since there is a large input->output
292294
# increase in data size: https://github.com/ray-project/ray/issues/34041
295+
296+
# Increase the Ray Core spilling threshold to 100% to avoid flakiness.
297+
monkeypatch.setenv("RAY_object_spilling_threshold", "1")
298+
293299
class TestSlow:
294300
def __call__(self, df: np.ndarray):
295301
time.sleep(2)

0 commit comments

Comments
 (0)