E2E testing does not work correctly

[ptbrowne]

This issue is mainly not to forget.

There are E2E tests for services and emails but there are a bit hard to launch and are a bit flaky if my memory serves well.

There is documentation in docs/dev.md > "End to end tests".

• Understand correctly what's not working and what is
• Make a plan on how to fix
• Discuss