I've heard that it has been done and I've found one project which may be useful to look into: https://github.com/MozillaFoundation/ci-image-diff
I'm trying to see if I can combine Playwrights navigation with occasionally navigate based on visual inputs. I.e. analyse the screenshots live to determine where to click next. Based on colors perhaps also template matching. Does anyone have an idea of how to achieve this or know of someone who has done so?
This thread is trying to answer question "Is it possible to combine OpenCV with Playwright to navigate based on visual inputs?"
Rayrun is a community for QA engineers. I am constantly looking for new ways to add value to people learning Playwright and other browser automation frameworks. If you have feedback, email firstname.lastname@example.org.