Potential bug during test execution

[GomesGokuBR]

Hi,

I have a problem with the test execution. Here is the test in question:

import Database from "@ioc:Adonis/Lucid/Database";
import { test } from "@japa/runner";

test.group('Users', (group) => {

  group.setup(async () => {
    await Database.beginGlobalTransaction();

    return async () => Database.rollbackGlobalTransaction();
  });

  test('it should create an user', async ({ assert, client }) => {
    const body = {
      email: 'dev@test.fr',
      username: 'test',
      password: 'test',
      avatar: 'http://images.com/img/1'
    };

    const response = await client
      .post('/users/store')
      .json(body)
      .send();


    assert.exists(response.body().user);
    assert.exists(response.body().user.id);
    assert.equal(response.body().user.email, body.email);
    assert.equal(response.body().user.username, body.username);
    assert.notExists(response.body().user.password, 'Password defined');
    assert.equal(response.body().user.avatar, body.avatar);
    assert.equal(response.status(), 201);
  }).waitForDone();

  test('It should return 409 when email is already in use 1', async ({ assert, client }) => {
    const response = await client
      .post('/users/store')
      .json({
        email: 'dev@test.fr',
        username: 'tests',
        password: 'tests',
      })
      .send();

    assert.equal(response.status(), 409);
  });
});

The problem is that only the last test is executed.

Even if I just run an assert.equal(2, 2); in both tests, the problem persists.

I also have another strange behavior, I run the tests with the node command with:

node ace test --watch
or
node ace test

when I do Crtl+s several times, the behavior often happens, that is, the last test is executed, not the first. Then sometimes both.

This is a very fresh project, below I share my package.json

{
"devDependencies": {
    "@adonisjs/assembler": "^5.8.0",
    "@japa/preset-adonis": "^1.1.0",
    "@japa/runner": "^2.0.9",
    "adonis-preset-ts": "^2.1.0",
    "eslint": "^8.17.0",
    "eslint-config-prettier": "^8.5.0",
    "eslint-plugin-adonis": "^2.1.0",
    "eslint-plugin-prettier": "^4.0.0",
    "pino-pretty": "^8.0.0",
    "prettier": "^2.7.1",
    "typescript": "~4.7",
    "youch": "^3.2.0",
    "youch-terminal": "^2.1.4"
  },
  "dependencies": {
    "@adonisjs/core": "^5.8.3",
    "@adonisjs/lucid": "^18.0.1",
    "@adonisjs/repl": "^3.1.11",
    "luxon": "^2.4.0",
    "pg": "^8.7.3",
    "phc-argon2": "^1.1.3",
    "proxy-addr": "^2.0.7",
    "reflect-metadata": "^0.1.13",
    "source-map-support": "^0.5.21",
    "sqlite3": "^5.0.8"
  }
}

Additional information

Node 18.3.0
OS Linux

Can you help me?

Thank you in advance.

[ProjektGopher]

Have you tried commenting out runFailedTests(), in the plugins prop of tests/bootstrap.ts?

[GomesGokuBR]

Oww

I understood, why I had this behavior, as indicated in Japa's doc, https://japa.dev/filtering-tests#run-failed-tests. In my case, the first test was necessary for the second to pass. I commented as you indicated and it seems to work. I'll reread the japa doc, to remember these little settings.

I thank you, I wish you a good day.

[ProjektGopher]

No problem, friend. Happy building 😄