Recover tests after migration to 6.12 #865
Description
tempesta-tech/tempesta#2506 , which is just removing code under #ifdef DEBUG caused these tests to fail:
-
http2_general.test_h2_frame.TestPostponedFrames.test_headershttp2_general.test_h2_frame.TestPostponedFramesdon't work on CI #862 - t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_cached
- t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_not_cached_for_authenticated_user
-
frang.test_request_rate_burst.TestFrangRapidDDoSH2.test_request_burst_with_only_headers_frameFixed by remove old Rapid Reset tests #867 - t_leaks.test_leak.TestLeakH2.test_used_memory
- t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_cached
- t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_not_cached_for_authenticated_user
- t_leaks.test_leak.TestLeakH2.test_used_memory
- t_stress.test_stress.TlsWrkStressDocker.test_concurrent_connections
The tests also failed for my local master build (as of 5a4f1c7ae61c00490c14e0b89738e0b96d3b415d). The full traces from the CI, local tests:
======================================================================
ERROR: t_stress.test_stress.TlsWrkStressDocker.test_concurrent_connections
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/test_suite/tester.py", line 498, in cleanup_check_memory_leaks
raise error.MemoryConsumptionException(
helpers.error.MemoryConsumptionException:
Used memory before test: 1964080;
Used memory after test: 2165192;
Delta for memory consumption: 201112.
Used memory >= memory_leak_threshold (201112 KB >= 131072 KB)
======================================================================
FAIL: http2_general.test_h2_frame.TestPostponedFrames.test_headers
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/venv/lib/python3.10/site-packages/parameterized/parameterized.py", line 620, in standalone_func
return func(*(a + p.args), **p.kwargs, **kw)
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/helpers/networker.py", line 122, in wrapper
test(self, *args, **kwargs)
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/http2_general/test_h2_frame.py", line 953, in test
self.run_test_tso_gro_gso_disabled(client, server, self._test, 100)
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/helpers/networker.py", line 226, in run_test_tso_gro_gso_disabled
self.__run_test_tso_gro_gso(client, server, test, mtu, False, False, False)
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/helpers/networker.py", line 214, in __run_test_tso_gro_gso
test(client, server)
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/http2_general/test_h2_frame.py", line 906, in _test
self.assertTrue(client.wait_for_ping_frames(ping_count))
AssertionError: False is not true
======================================================================
FAIL: t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_cached [Get blog post] (i=1, expect_cached=False)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 275, in test_blog_post_cached
self.assertEqual(response.status, 200)
AssertionError: 503 != 200
======================================================================
FAIL: t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_cached [Get blog post] (i=2, expect_cached=True)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 275, in test_blog_post_cached
self.assertEqual(response.status, 200)
AssertionError: 503 != 200
======================================================================
FAIL: t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_cached [Get blog post] (i=3, expect_cached=True)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 275, in test_blog_post_cached
self.assertEqual(response.status, 200)
AssertionError: 503 != 200
======================================================================
FAIL: t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_not_cached_for_authenticated_user
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 288, in test_blog_post_not_cached_for_authenticated_user
self.login()
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 175, in login
self.assertEqual(response.status, 302)
AssertionError: 503 != 302
----------------------------------------------------------------------
Ran 2302 tests in 6353.924s
FAILED (failures=5, errors=1, skipped=33, expected failures=81)
16:11:57 CRITICAL
16:11:57
.
717 | test | | ----------------------------------------------------------------------------
d=890356;
2mrun_tests.py
:
d=371763;file:///home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/run_tests.py#148
2m148
">file:///home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/run_tests.py
2mrun_tests.py
:
d=371763;file:///home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/run_tests.py#148
2m148
Check memory leaks for test suite:
Before: used memory:
1616640;
Before: python memory:
99616;
After: used memory:
1853996;
After: python memory:
355688;
Delta:
-18716 KB
----------------------------------------------------------------------------
remote tests:
======================================================================
FAIL: t_frang.test_request_rate_burst.TestFrangRapidDDoSH2.test_request_burst_with_only_headers_frame
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/venv/lib/python3.10/site-packages/parameterized/parameterized.py", line 620, in standalone_func
return func(*(a + p.args), **p.kwargs, **kw)
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/test_suite/marks.py", line 63, in wrapper
test(self, *args, **kwargs)
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_frang/test_request_rate_burst.py", line 398, in test_request
self.assertFrangWarning(warning=warning, expected=range(1, 15))
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_frang/frang_test_case.py", line 160, in assertFrangWarning
self.assertTrue(
AssertionError: False is not true : Amount of 'Warning: frang: requests burst exceeded' warnings in dmesg is less then 1: 0
======================================================================
FAIL: t_leaks.test_leak.TestLeakH2.test_used_memory
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_leaks/test_leak.py", line 232, in test_used_memory
self.assertLess(used, self.memory_leak_threshold)
AssertionError: 250812 not less than 131072
======================================================================
FAIL: t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_cached [Get blog post] (i=1, expect_cached=False)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 275, in test_blog_post_cached
self.assertEqual(response.status, 200)
AssertionError: 503 != 200
======================================================================
FAIL: t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_cached [Get blog post] (i=2, expect_cached=True)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 275, in test_blog_post_cached
self.assertEqual(response.status, 200)
AssertionError: 503 != 200
======================================================================
FAIL: t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_cached [Get blog post] (i=3, expect_cached=True)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 275, in test_blog_post_cached
self.assertEqual(response.status, 200)
AssertionError: 503 != 200
======================================================================
FAIL: t_sites.test_tempesta_tech.TestTempestaTechSite.test_blog_post_not_cached_for_authenticated_user
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 288, in test_blog_post_not_cached_for_authenticated_user
self.login()
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_sites/test_tempesta_tech.py", line 175, in login
self.assertEqual(response.status, 302)
AssertionError: 503 != 302
----------------------------------------------------------------------
Ran 2054 tests in 7262.872s
FAILED (failures=6, skipped=32, expected failures=81)
t_frang.test_request_rate_burst.TestFrangRapidDDoSH2.test_request_burst_with_only_headers_frame ... ok
t_leaks.test_leak.TestLeakH2.test_used_memory ...
----------------------------------------------------------------------
Run failed tests again ...
----------------------------------------------------------------------
FAIL
======================================================================
FAIL: t_leaks.test_leak.TestLeakH2.test_used_memory
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/t_leaks/test_leak.py", line 232, in test_used_memory
self.assertLess(used, self.memory_leak_threshold)
AssertionError: 186900 not less than 131072
----------------------------------------------------------------------
Ran 2 tests in 22.463s
FAILED (failures=1)
19:37:30 CRITICAL
19:37:30
.
203 | test | | ----------------------------------------------------------------------------
d=632285;
2mrun_tests.py
:
d=683671;file:///home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/run_tests.py#148
2m148
">file:///home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/run_tests.py
2mrun_tests.py
:
d=683671;file:///home/jenkins/workspace/_PR_tempesta_PR-2506/tempesta-test/run_tests.py#148
2m148
Check memory leaks for test suite:
Before: used memory:
1579228;
Before: python memory:
101576;
After: used memory:
1757612;
After: python memory:
406340;
Delta:
-126380 KB