pytest gets out of tests suits if one test is over timeout

[hmfkzh]

Hi,
I am using following command to run my tests:
pytest --timeout=30 test_methods.py --forked --timeout_method=thread
I have one test which is hanging, but as soon as that test is timed out, the whole test suit gets out. Here is my plugins:

platform linux -- Python 3.6.13, pytest-6.2.4, py-1.11.0, pluggy-0.13.1
rootdir: /mytest/tests, configfile: pytest.ini
plugins: html-3.1.1, metadata-1.11.0, xdist-2.5.0, timeout-1.4.2, forked-1.4.0
timeout: 30.0s
timeout method: thread
timeout func_only: False
collected 7 items

test_methods.py ....
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

  File "/root/miniconda3/envs/py39/bin/pytest", line 11, in <module>
    sys.exit(console_main())
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/_pytest/config/__init__.py", line 185, in console_main
    code = main()
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/_pytest/config/__init__.py", line 163, in main
    config=config
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/hooks.py", line 286, in __call__
    return self._hookexec(self, self.get_hookimpls(), kwargs)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/manager.py", line 93, in _hookexec
    return self._inner_hookexec(hook, methods, kwargs)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/manager.py", line 87, in <lambda>
    firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/callers.py", line 187, in _multicall
    res = hook_impl.function(*args)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/_pytest/main.py", line 316, in pytest_cmdline_main
    return wrap_session(config, _main)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/_pytest/main.py", line 269, in wrap_session
    session.exitstatus = doit(config, session) or 0
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/_pytest/main.py", line 323, in _main
    config.hook.pytest_runtestloop(session=session)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/hooks.py", line 286, in __call__
    return self._hookexec(self, self.get_hookimpls(), kwargs)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/manager.py", line 93, in _hookexec
    return self._inner_hookexec(hook, methods, kwargs)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/manager.py", line 87, in <lambda>
    firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/callers.py", line 187, in _multicall
    res = hook_impl.function(*args)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/_pytest/main.py", line 348, in pytest_runtestloop
    item.config.hook.pytest_runtest_protocol(item=item, nextitem=nextitem)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/hooks.py", line 286, in __call__
    return self._hookexec(self, self.get_hookimpls(), kwargs)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/manager.py", line 93, in _hookexec
    return self._inner_hookexec(hook, methods, kwargs)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/manager.py", line 87, in <lambda>
    firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pluggy/callers.py", line 187, in _multicall
    res = hook_impl.function(*args)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pytest_forked/__init__.py", line 51, in pytest_runtest_protocol
    reports = forked_run_report(item)
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/pytest_forked/__init__.py", line 74, in forked_run_report
    result = ff.waitfinish()
  File "/root/miniconda3/envs/py39/lib/python3.6/site-packages/py/_process/forkedfunc.py", line 82, in waitfinish
    pid, systemstatus = waiter(self.pid, 0)

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
```

As you can see it detects 7 tests, but as soon as one test fails, it is aborted with only 4 successful tests. 

[RonnyPfannschmidt]

as per the readme of the timeout plugin that is to be expected
see https://pypi.org/project/pytest-timeout/

it seems the timeout plugin is not integrated with the forked plugin

[hmfkzh]

Thanks for your reply, now I have another question, is it possible to run each test separately on a different thread and using a timeout methodology.
because when I run my tests without a forked options, my test suits is hanging in the test number 4. I have used both timeout_method (s) (thread and signal)
pytest --timeout=30 test_methods.py --timeout_method=thread

platform linux -- Python 3.6.13, pytest-6.2.4, py-1.11.0, pluggy-0.13.1
rootdir: /my_tests/tests, configfile: pytest.ini
plugins: html-3.1.1, metadata-1.11.0, xdist-2.5.0, timeout-1.4.2, forked-1.4.0
timeout: 30.0s
timeout method: thread
timeout func_only: False
collected 7 items

test_methods.py ....