From 671a16f99c63566eda6d1794ed1a2caab561c1c2 Mon Sep 17 00:00:00 2001 From: Anton Tayanovskyy Date: Mon, 12 Feb 2024 16:22:49 -0500 Subject: [PATCH] Run one benchmark at a time (#1585) Before the change, benchmarks ran in parallel. We are observing very high variance no the benchmarks, part of the problem could be resource contention for network bandwidth across benchmarks. This change will give the entire runner's worth of resources to each benchmark individually, and hopefully reduce variance at the cost of using more CI runner time. Will observe for 1 week and evaluate. --- .github/workflows/performance_metrics_cron.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.github/workflows/performance_metrics_cron.yml b/.github/workflows/performance_metrics_cron.yml index bdf483400..1593114db 100644 --- a/.github/workflows/performance_metrics_cron.yml +++ b/.github/workflows/performance_metrics_cron.yml @@ -90,7 +90,7 @@ jobs: shell: bash run: | set -euo pipefail - cd misc/test && go test . --timeout 4h -count=1 -json -short -parallel 40 --tags=Performance 2>&1 | tee /tmp/gotest.log | gotestfmt + cd misc/test && go test . --timeout 4h -count=1 -json -short -parallel 1 --tags=Performance 2>&1 | tee /tmp/gotest.log | gotestfmt - name: Upload traces GHA artifact uses: actions/upload-artifact@v3 with: