Testing and tox.ini environment improvements #1256
Description
The tox.ini file and environments do not match the documents, and should also align with the .github/workflow/main.yml file. Ideally, the main.yml file should use the tox.ini file with minimal or no changes to the build config, so that the tests run are consistent on GitHub and the desktop.
Pull request #1255 addresses some of the issues without major changes.
Improvements suggested:
- Remove the platform independent environments, and have these built into the different environments using platform environments.
- Split out the selenium, selenium-remote and other tests correctly so the correct environments are used. If doing tox -e tests -- tests/ then errors will be raised in the tests as the environment setup is incorrect (missing: extras = selenium).
- Align main.yml with the tox configuration.
- Add selenium remote and installation of java and the .jar file to run properly.
- Fix the pytest -n 4 option as the workers use the same port and thus do not seem to work.
- Add missing tests/test_webdriver_edge_chromium.py
- Ensure tests are running all browsers on all platforms.
- Fix some test failures from tests as listed below.
- Fix warnings.
- The Development Environment Setup looks like it needs a review as tox is now used rather than virtual environments, plus other items.
I propose to make Pull requests with the proposed changes, addressing the above items individually, or in sensible parts.
Failed tests:
FAILED tests/test_webdriver_chrome.py::ChromeBrowserTest::test_click_element_by_css_selector - AssertionError: 'BAR!' not found in '<html><head></head><body></body></html>'
FAILED tests/test_webdriver_chrome.py::ChromeBrowserTest::test_click_links - AssertionError: 'BAR!' not found in '<html><head></head><body></body></html>'
FAILED tests/test_webdriver_chrome.py::ChromeBrowserTest::test_is_text_present_and_should_wait_time - AssertionError: False is not true
FAILED tests/test_webdriver_chrome.py::ChromeBrowserFullscreenTest::test_click_element_by_css_selector - AssertionError: 'BAR!' not found in '<html><head></head><body></body></html>'
FAILED tests/test_webdriver_chrome.py::ChromeBrowserFullscreenTest::test_click_links - AssertionError: 'BAR!' not found in '<html><head></head><body></body></html>'
FAILED tests/test_webdriver_chrome.py::ChromeBrowserFullscreenTest::test_is_text_present_and_should_wait_time - AssertionError: False is not true
FAILED tests/test_webdriver_edge_chromium.py::EdgeChromiumBrowserTest::test_click_element_by_css_selector - AssertionError: 'BAR!' not found in '<html><head></head><body></body></html>'
FAILED tests/test_webdriver_edge_chromium.py::EdgeChromiumBrowserTest::test_click_links - AssertionError: 'BAR!' not found in '<html><head></head><body></body></html>'
FAILED tests/test_webdriver_edge_chromium.py::EdgeChromiumBrowserTest::test_is_text_present_and_should_wait_time - AssertionError: False is not true
FAILED tests/test_webdriver_edge_chromium.py::EdgeChromiumBrowserFullscreenTest::test_click_element_by_css_selector - AssertionError: 'BAR!' not found in '<html><head></head><body></body></html>'
FAILED tests/test_webdriver_edge_chromium.py::EdgeChromiumBrowserFullscreenTest::test_click_links - AssertionError: 'BAR!' not found in '<html><head></head><body></body></html>'
FAILED tests/test_webdriver_edge_chromium.py::EdgeChromiumBrowserFullscreenTest::test_is_text_present_and_should_wait_time - AssertionError: False is not true
FAILED tests/test_zopetestbrowser.py::ZopeTestBrowserDriverTest::test_click_element_by_css_selector - zope.testbrowser.browser.RobotExclusionError: HTTP Error 403: request disallowed by robots.txt
FAILED tests/test_zopetestbrowser.py::ZopeTestBrowserDriverTest::test_click_links - zope.testbrowser.browser.RobotExclusionError: HTTP Error 403: request disallowed by robots.txt
FAILED tests/test_zopetestbrowser.py::ZopeTestBrowserDriverTest::test_is_text_not_present_and_should_wait_time - zope.testbrowser.browser.RobotExclusionError: HTTP Error 403: request disallowed by robots.txt
FAILED tests/test_zopetestbrowser.py::ZopeTestBrowserDriverTest::test_is_text_present_and_should_wait_time - zope.testbrowser.browser.RobotExclusionError: HTTP Error 403: request disallowed by robots.txt