Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

run-multiple execution creates output sub folders with alphanumeric value instead of browser names #4265

Open
AugustineAutoGit opened this issue Mar 22, 2024 · 10 comments
Labels

Comments

@AugustineAutoGit
Copy link

What are you trying to achieve?

For run-multiple execution with multiple browsers like Chrome, Safari, Firefox and Edge, the subfolder in the output folder should have a name like parallel_Chrome_1, parallel_Safari_2, parallel_Firefox_3 etc

What do you get instead?

While executing using run-multiple the subfolder in the output folder should have name like the following:
parallel_0096a0c740a073d21e23267bf167f711a9826c9d84addc417bc5b320df11e0bd_1
parallel_f7899c9a407a947a824a4955416619aef2c53bd0fbb18965b53d0a3fb4c207d6_2

instead of browser/channel name some alphanumeric value is present in the folder name.

image

This makes it difficult to do many validations. For eg:
Validating the file download using handleDownloads and FileSystem helper, like using methods I.amInPath('output/folderName');
where folderName is parallel_0096a0c740a073d21e23267bf167f711a9826c9d84addc417bc5b320df11e0bd_1.
This is only 1 example

Provide console output if related. Use --verbose mode for more details.

# paste output here

Provide test source code if related

// paste test

Details

  • CodeceptJS version: 3.5.15
  • NodeJS Version: 20
  • Operating System: Mac OS
  • Playwright (if related)
  • Configuration file:
# paste config here
@kobenguyent
Copy link
Collaborator

I think that's supposed to be like that when you don't explicitly define the outputName
Screenshot 2024-03-22 at 10 37 29

To overcome your issue, try this approach #1722 (comment)

"multiple": {
        "dev": {
            "browsers": [
                {
                    browser: "chrome",
                    outputName: "chrome"
                },
                {
                    browser: "firefox",
                    outputName: "firefox"
                }
            ]
        }
}

@AugustineAutoGit
Copy link
Author

Thanks @kobenguyent this fixed my issue of random hash value
For the case of:
Validating the file download using handleDownloads and FileSystem helper, like using methods I.amInPath('output/folderName');
for folderName how should we give?
say now output folders are like parallel_output_1, the runId is dynamic
I tried this way but not working:
I.amInPath('output/parallel_output_*');

@AugustineAutoGit
Copy link
Author

Sure

@AugustineAutoGit
Copy link
Author

@kobenguyent
1 doubt / suggestion
Is appending runId to the outputDir mandatory, like can we avoid it?
Instead can we append the browser
Since run-mutiple itslef is for parallel testing in multiple browsers can we something like:
outputDir = runName + outputName + browser

For eg: for Playwright browser can be :

  • chromium(this can have different channel names like chrome, msedge etc)
  • webkit
  • firefox

Hence my doubt / suggestion is the possibility of removing runId append and instead adding browser and channel name if any. Like:
outputDir = runName + outputName + browser + channel(only for chromium)

@kobenguyent
Copy link
Collaborator

@AugustineAutoGit I think run-multiple command is kinda obsolete and there would be not really active maintenance. It is encouraged to use run-workers command.

@AugustineAutoGit
Copy link
Author

@kobenguyent I am using codeceptjs-resemblehelper for visual testing.
This helper won't work with run-workers due to inability to execute in multiple threads.
Sad to know that run-multiple command is kinda obsolete :(
run-multiple was very helpful for me as it is preferred as mentioned in CodeceptJS site for mutliple browser executions.
Our paralle execution requirement is for multiple browsers. Also due to budget constraints not able to use codeceptjs-applitoolshelper

@kobenguyent
Copy link
Collaborator

Well @AugustineAutoGit you could raise a PR if you have time to fix it.

@AugustineAutoGit
Copy link
Author

AugustineAutoGit commented Apr 4, 2024

@kobenguyent sure will give a try from my side.
Will you provide access or do I need to do a fork
or
if it run-multiple command is kinda obsolete do we need to consider this

Will proceed as per your suggestion

Copy link

github-actions bot commented Jul 4, 2024

This issue is stale because it has been open for 90 days with no activity.

@github-actions github-actions bot added the stale label Jul 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants