Horrible time getting Playwright to pass tests in Azure Devops pipeline
As the title, saids, I am having a horrible time getting playwright (and playwrite test) to run in Azure pipeline running Ubuntu (Image: ubuntu-20.04). While my tests run and pass locally with the same exact setup (using webserver, same npm script command) my tests pass on my local. But in a PR with the same code base the tests will fail. I tried adjusting timeouts both in config and webserver, retries to 2, and slomo but to no success. Finally, I just placed skip on all my describes so no tests run... and I still get another error!
Error: Timed out waiting 480000ms from config.webServer.
I don't get this on my local (ubuntu linux) with the same tests having skip! I mean the same exact test run on my local will just skip and finish. I don't get this since it is all Mircosoft, Azure should be Playwright friendly.
At the very least, why can't I skip all the tests on and not have that webserver timeout error? Again, same thing runs on my local with no errors.
This thread is trying to answer question "How can the user get Playwright tests to pass in an Azure Devops pipeline running Ubuntu?"
I set the stdout to pipe and got the below. From docs, stderr alrerady goes to pipe
[WebServer]
** Angular Live Development Server is listening on localhost:8080, open your browser on http://localhost:8080/ **
[WebServer]
✔ Compiled successfully.
[WebServer] ✔ Browser application bundle generation complete.
[WebServer]
Initial Chunk Files | Names | Raw Size
runtime.js | runtime | 13.00 kB |
5 unchanged chunks
Build at: 2023-06-15T17:45:37.386Z - Hash: 86736805c660f512 - Time: 4532ms
[WebServer]
✔ Compiled successfully.
Error: Timed out waiting 480000ms from config.webServer.
Rayrun is a community for QA engineers. I am constantly looking for new ways to add value to people learning Playwright and other browser automation frameworks. If you have feedback, email [email protected].