Rayrun
BlogAsk AIToolsVideosQA WikiDiscord
← Back to Discord Forum

deflake --runs_per_test=100 - bazel

leblancmenesesposted in #help-playwright
Open in Discord
leblancmeneses

Is there any project that helps deflake playwright tests? I want to make my tests to be verified not flaky before they are submitted and part of our CI pipeline.

bazel test has a parameter --runs_per_test=100 to help deflake e2e tests.
I was thinking of attempting this with mcr.microsoft.com/playwright:v1.35.0-jammy and https://bazel.build/remote/sandbox

However, what is the community using for deflaking?

This thread is trying to answer question "What is the community using for deflaking playwright tests?"

6 replies
lucgagan
lucgagan

You can do --repeat-each 100. It is a good starting point.

lucgagan
lucgagan

I am midway of writing an article about the best ways to detect flaky tests automatically, and will be releasing a small package to help with that too.

lucgagan
lucgagan

Will share in this thread when it is out

leblancmeneses

for hermetic setup will you be utilizing docker compose or kubernetes?

lucgagan
lucgagan

docker is good enough

p01___
p01___

Make sure to scope the --repeat-each=100 with the path of tests touched in the PR so you only repeat those 100x, and the others run normally.

Open in Discord
BlogAsk AIToolsVideosQA WikiDiscord
TwitterGitHubLinkedIn
AboutQuestionsDiscord ForumBrowser ExtensionTagsQA Jobs

Rayrun is a community for QA engineers. I am constantly looking for new ways to add value to people learning Playwright and other browser automation frameworks. If you have feedback, email [email protected].