Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove estimated GPU duration from qualification output #1412

Merged
merged 4 commits into from
Nov 5, 2024

Conversation

amahussein
Copy link
Collaborator

Signed-off-by: Ahmed Hussein [email protected]

Fixes #1411

Removes two columns from the core qualification's output Estimated GPU Duration and Estimated GPU Time Saved from 2 files rapids_4_spark_qualification_output.csv and rapids_4_spark_qualification_output_persql.csv

  • This PR also removes the unused fields in EstimatedAppInfo since it is becoming dead code.
  • Updated the unit tests

Signed-off-by: Ahmed Hussein <[email protected]>

Fixes NVIDIA#1411

Removes two columns from the core qualification's output
`Estimated GPU Duration` and `Estimated GPU Time Saved` from 2 files `rapids_4_spark_qualification_output.csv` and `rapids_4_spark_qualification_output_persql.csv`
@amahussein amahussein added core_tools Scope the core module (scala) affect-output A change that modifies the output (add/remove/rename files, add/remove/rename columns) labels Nov 5, 2024
@amahussein amahussein self-assigned this Nov 5, 2024
@amahussein
Copy link
Collaborator Author

Found that I mistakenly removed the quotes from the CSV files

@amahussein amahussein marked this pull request as draft November 5, 2024 17:10
@amahussein amahussein marked this pull request as ready for review November 5, 2024 17:25
Signed-off-by: Ahmed Hussein <[email protected]>
Copy link
Collaborator

@parthosa parthosa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @amahussein. QQ: How do we update the expectation files beside running the tools for each of them? Do we have a script to update the expectation files?

Signed-off-by: Ahmed Hussein <[email protected]>
parthosa
parthosa previously approved these changes Nov 5, 2024
Copy link
Collaborator

@parthosa parthosa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @amahussein. LGTME.

@amahussein
Copy link
Collaborator Author

Thanks @amahussein. QQ: How do we update the expectation files beside running the tools for each of them? Do we have a script to update the expectation files?

Thanks @parthosa
Yes, I wrote a script some time ago
core/src/test/resources/dev/generate-qualification-test-results.sh.
I did not use it this time because I could do the fixes manually.

@amahussein amahussein merged commit 8eaeaa9 into NVIDIA:dev Nov 5, 2024
14 checks passed
@amahussein amahussein deleted the rapids-tools-1411 branch November 5, 2024 22:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affect-output A change that modifies the output (add/remove/rename files, add/remove/rename columns) core_tools Scope the core module (scala)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove estimated GPU duration from qualification output
2 participants