Integration test flakiness

[henrybear327]

Bug report criteria

• This bug report is not security related, security issues should be disclosed privately via netbox operator maintainers.
• Existing open issues have been checked and this is not a duplicate.

What happened?

The current integration tests are very flaky thus the integration test CI pipeline can't be enabled

What did you expect to happen?

The integration tests pass consistently when the CI pipeline is enabled

How can we reproduce it (as minimally and precisely as possible)?

Run the integration test with make integration-test

Netbox operator version

Commit 798a3082fc8b6703614da52b613ef89933a8f649

Netbox operator configuration (command line flags or environment variables)

paste your configuration here

Relevant log output

No response

Anything else we need to know?

No response

[henrybear327]

There are still failures @bruelea @jstudler @alexandernorth that we need to look into, but most of the runs can pass

• https://github.com/netbox-community/netbox-operator/actions/runs/10737742627/job/29779850679?pr=46
• https://github.com/netbox-community/netbox-operator/actions/runs/10737742089/job/29779849307?pr=45
• https://github.com/netbox-community/netbox-operator/actions/runs/10739191128/job/29784375850?pr=52
• https://github.com/netbox-community/netbox-operator/actions/runs/10770198427/job/29863060005?pr=31

[henrybear327]

Let's close this ticket for now and only reopen it if we see flaky tests still! :)

[henrybear327]

https://github.com/netbox-community/netbox-operator/actions/runs/11017312163/job/30594896657?pr=74

[henrybear327]

The integration tests are still very flaky. I have to manually trigger retest for almost 1/3 of the commits merged into main, let along the ones that I triggered for PRs.