Tests runs locally but fails in Azure DevOps Pipeline

[SebastianKoch27]

The Problem:

We wrote a simple test which only fills a textfield, clicks on a button and checks for redirect. On our local machines the test runs without any problems. In the pipeline the test fills the textfield and says that he has clicked the button, but nothing happens and the next condition fails.

Our Pipeline steps:

• npm install
• gatsby build
• gatsby serve -p 8000 & npx cypress run --record --key <KEY> --config video=false --e2e

Specs:

• Cypress: 12.0.1

• React: 18.2.0

• Gatsby 4.24.0

• Azure Pipeline running on Ubuntu 20.04

Our Test:

cy.get('#search-field').should('be.visible').clear().type(searchText);

cy.get('#submit-search-button').click({ force: true });

cy.get('#search-results').children().its('length').should('be.gte', 3);

What we tried:

• Increasing Buildagent CPUs and Storage
• Using different browsers (Chrome, Electron)
• Disabling Video generation
• Creating a new Pipeline (Windows)
• Running all steps from the pipeline on our local machines