Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experimental Flake Detection Features are not working #5594

Open
1 of 6 tasks
e-fedosser opened this issue Jan 4, 2024 · 2 comments
Open
1 of 6 tasks

Experimental Flake Detection Features are not working #5594

e-fedosser opened this issue Jan 4, 2024 · 2 comments

Comments

@e-fedosser
Copy link

e-fedosser commented Jan 4, 2024

Description

When I tried to use Experimental Test Retries feature accroding documentation then I'm getting an error below:
Expected retries to be a positive number or null or an object with keys "openMode" and "runMode" with values of numbers or nulls.

Documentation to experimental feature:
https://docs.cypress.io/guides/references/experiments#Experimental-Retries

Steps to replicate

Cypress version: 13.4.0; 13.5.1; 13.6.1;

  1. Go to cypress.config file
  2. Set the experimental retries feature according documentation:
 retries: {
    experimentalStrategy: 'detect-flake-and-pass-on-threshold',
    experimentalOptions: {
      maxRetries: 2,
      passesRequired: 2,
    },
    openMode: true,
    runMode: true,
  },

https://docs.cypress.io/guides/references/experiments#Experimental-Retries

Error:
Actual_result

Browser

No response

Device

  • PC
  • Mac
  • iPhone
  • iPad
  • Android Phone
  • Android Tablet

Additional Information

No response

@e-fedosser
Copy link
Author

According documentation it must working:
documentation

@e-fedosser e-fedosser changed the title Experimental Flake Detection Features Experimental Flake Detection Features is not working Jan 4, 2024
@e-fedosser e-fedosser changed the title Experimental Flake Detection Features is not working Experimental Flake Detection Features are not working Jan 4, 2024
@ryanpei
Copy link
Contributor

ryanpei commented Jan 5, 2024

@e-fedosser can you please verify if the Cypress version is updated? This error is the coincidentally the same error you would see with this configuration if you were on an older version than Cypress 13.4.0.

If you are using cypress run, you can see the Cypress version at the start of the run:
Screenshot 2024-01-04 at 9 07 33 PM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants