BuildCanary test workflows for Azure Actions

[kaverma]

We have GitHub Actions for Azure which take dependency on hosted runner infra.For example Azure Powershell action and azure/arm-deploy action.

We are looking at a test strategy of having canary test workflows for these Actions which can be run before updating the hosted image. The aim of these tests will be to ensure the tasks do not break with new changes in hosted image.

For example, we recently had an issue in azure/arm-deploy action - Azure/arm-deploy#48 which caused this action to fail with the release of Azure CLI Version 2.24.1 as the new CLI version had a bug. Here is the RCA for this bug for reference - Azure/arm-deploy#69.

So for such Actions to avoid such breaks we are looking at having canary tests.

We want to understand on how we can have this test infra and the process to maintain the infra and process for the teams adding tests to the canary runs.

[github-actions]

This issue is idle because it has been open for 14 days with no activity.

[raiyanalam]

@kaverma - Can you update the latest status here?

[kaverma]

We are planning to take this up in this this quarter Q4 2022.