Investigate if and how we can extract the integration tests into suites

[carlspring]

Task Description

At the moment, the integration tests are executed as separate tests using the maven-failsafe-plugin. We need to re-work this so that they are executed as a suite. This needs to be done so that we could be able to re-run the same integration tests against different environments. For example, the default profile for integration tests should be against a real Amazon S3. However, if we re-work these to be executed as a suite, we could then add another suite with the same tests, but for MinIO instead.

What we can do is:

• Have all the integration tests that are connecting to S3 tagged using the @Tag("integration-test-s3") annotation.
• Create separate test suites that have an @IncludeTags("integration-test-s3") annotation
• Create an AmazonS3ITTestSuite.
• Eventually, create additional test suites such as, for example, MinIOITTestSuite.
• Make the maven-failsafe-plugin only execute the *ITSuite classes.

Tasks

The following tasks will need to be carried out:

• Investigate whether it's possible to enable/trigger profiles for JUnit tests at a suite level.
• Create a test suite for all the integration tests.
• Make the maven-failsafe-plugin only execute *ITSuite-s.

Task Relationships

This task:

• Relates to: Implement support for MinIO #103
• Depends on:
  • Introduce support for declarative test suites junit-team/junit5#744 (supposed to be fixed via Introduce junit-platform-suite-engine junit-team/junit5#2416)
  • JUnit5 tests annotated with @Tag are not executed in suite that has @IncludeTags, unless combined with @SelectPackages junit-team/junit5#2503

Stackoverflow Questions

• How to get JUnit tests annotated with @Tag to be executed in suite that has @IncludeTags?

Help

• Our chat channel
• Points of contact:
  • @carlspring
  • @ptirador
  • @steve-todorov
  • @sbespalov

[carlspring]

We'll have to re-visit this topic once junit-team/junit5#744 (supposed to be fixed via junit-team/junit5#2416) have been impemented, so that we could drop the JUnit4 dependencies.

[carlspring]

Eventually, when #60 and #103 have been implemented, we'll create a new suite for MinIO.