Run a single test multiple times in parallel #help

Answer

Sure, you can run the same tests multiple times in parallel with Playwright. Here's how:

Single Worker

You can set workers: 1 in the config file or use --workers=1 in the command line. This runs tests sequentially, with only one worker active at a time.

// playwright.config.ts
module.exports = {
  workers: 1
};

Parallel Tests

For independent tests in a single file, use test.describe.configure(). Set mode: 'parallel' to run all tests in the suite in separate worker processes.

test.describe.configure({ mode: 'parallel' })('my suite', () => {
  // Your tests here
});

Fully-Parallel Mode

In playwright.config.ts, set fullyParallel: true for all test files or specific projects. Be mindful of inter-dependent tests that need to run serially. Annotate these as "serial". If a serial test fails, all subsequent tests are skipped.

// playwright.config.ts
module.exports = {
  projects: [
    {
      name: 'Project 1',
      fullyParallel: true
    },
    {
      name: 'Project 2',
      fullyParallel: false
    }
  ]
};

Control Test Execution Order

When not using parallelism, Playwright runs test files alphabetically. You can control the order by prefixing filenames with numbers. Alternatively, define tests in helper functions across multiple files. Call these functions in a specific order to control execution. However, this method is discouraged and supported as a best-effort only.

For more details, check out Maximizing Test Efficiency with Parallelism in Playwright.