Add script to upload fio results to bigquery #18
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
anushka567
reviewed
May 22, 2025
perf-benchmarking-for-releases/upload-fio-output-to-bigquery.py
Outdated
Show resolved
Hide resolved
anushka567
reviewed
May 22, 2025
perf-benchmarking-for-releases/upload-fio-output-to-bigquery.py
Outdated
Show resolved
Hide resolved
vipnydav
force-pushed
the
fio-to-bigquery
branch
2 times, most recently
from
ade921b to
570e476
Compare
vipnydav
force-pushed
the
fio-to-bigquery
branch
9 times, most recently
from
ca7578a to
b72c280
Compare
vipnydav
force-pushed
the
fio-to-bigquery
branch
4 times, most recently
from
7f723c3 to
b0d2794
Compare
vipnydav
force-pushed
the
fio-to-bigquery
branch
2 times, most recently
from
4990357 to
ffd2ec3
Compare
vipnydav
force-pushed
the
fio-to-bigquery
branch
2 times, most recently
from
43d8a1c to
7cfa947
Compare
vipnydav
force-pushed
the
fio-to-bigquery
branch
from
7cfa947 to
82395b4
Compare
vipnydav
force-pushed
the
fio-to-bigquery
branch
from
82395b4 to
b6e2293
Compare
Tulsishah
reviewed
Jul 21, 2025
Tulsishah
reviewed
Jul 21, 2025
vipnydav
force-pushed
the
fio-to-bigquery
branch
from
c244cbf to
e82c5de
Compare
vipnydav
force-pushed
the
fio-to-bigquery
branch
2 times, most recently
from
2512749 to
57961ea
Compare
vipnydav
force-pushed
the
fio-to-bigquery
branch
from
57961ea to
c26bd68
Compare
Tulsishah
approved these changes
Jul 28, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR adds a new Python script to automate uploading FIO benchmark results to BigQuery and integrates the script with
starter-script.shto upload output to bigquery table.Note : For testing, the workflow is temporarily configured as follows:
fio-to-bigquerybranch ofgcsfuse-tools. This will be updated tomainafter the merge.gcs-fuse-test-ml.gke_test_tool_outputs.vipinydv_fio_outputs) to avoid disrupting the production table. This will be pointed to the final table (gcs-fuse-test-ml.gke_test_tool_outputs.fio_outputs) upon merging.Link to the issue in case of a bug fix
https://b.corp.google.com/issues/418882954
Testing details