Running Playwright tests using Azure Test Plans
- I've been running Playwright tests that are linked to Azure Test Plans UI using a third-party library. When I run these tests locally, the status of the test-case updates automatically in the Azure Test Plans UI.
- However, I'm encountering issues when trying to run these tests in a release pipeline on Azure DevOps. The tests are failing and causing errors.
- According to the logs, the test run is being aborted, which is causing the task to fail. The error message I'm seeing is "System.Exception: The test run was aborted, failing the task."
- Interestingly, my build pipeline completes successfully and all tests pass. This leads me to believe that the issue might be with the release pipeline or its interaction with Azure Test Plans.
- I've shared my
playwright.config.tsandazure-pipelines-pw.ymlfiles for reference. These files contain the configurations for the Playwright tests and the Azure Pipelines build respectively.
For more details, you can check out my original post: https://stackoverflow.com/questions/76396854/is-there-any-way-to-run-a-test-using-the-azure-test-plans-if-the-test-runner-is
This thread is trying to answer question "Why are Playwright tests that are linked to Azure Test Plans UI failing when run in a release pipeline on Azure DevOps, and how can this issue be resolved?"
@ntodorov99 as you already know, with Playwright we have to use https://www.npmjs.com/package/@alex_neo/playwright-azure-reporter to update the test case status.. so we no need to use VS Test tasks as its not meant for this framework.
Rayrun is a community for QA engineers. I am constantly looking for new ways to add value to people learning Playwright and other browser automation frameworks. If you have feedback, email [email protected].