Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: create exit log #10107

Draft
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

michal-shalev
Copy link
Contributor

@michal-shalev michal-shalev commented Aug 28, 2024

What?

Improves reporting across multiple CI scripts to provide clear information on the CI environment and the details required for reproducing issues.

Why?

Locating Docker info, identifying the machine, and gathering CI details is time-consuming, requiring repeated searches through logs.
This change consolidates all relevant information into a single log section on script exit, simplifying and speeding up debugging, making it easier to replicate the CI environment for troubleshooting.

How?

  • Added a log_info_on_exit function triggered by trap "log_info_on_exit" EXIT in various CI scripts.
  • Collects and displays the information that is listed below.

Information printed in log_info_on_exit

  1. Script Information:
    Script name
    Current working directory
    User running the script
  2. Machine Information:
    Whether it's running inside a container
    Container hostname
    Container image details
    Docker-specific environment variables
    Host machine name (if not in a container)
    Operating system and version
    Kernel version and details
    System architecture
  3. UCX Environment Variables
  4. UCX Info:
    Detailed output from ucx_info if available
  5. Modules Loaded
  6. CPU Affinity
  7. Ulimit Information
  8. System resource limits (ulimit settings)
  9. Disk Usage
  10. Current disk usage information

@michal-shalev michal-shalev added the WIP-DNM Work in progress / Do not review label Aug 28, 2024
@michal-shalev michal-shalev marked this pull request as draft August 28, 2024 22:05
@michal-shalev michal-shalev force-pushed the improve-ci-logs branch 11 times, most recently from 1c5b1dd to f533f48 Compare September 5, 2024 11:00
@michal-shalev michal-shalev force-pushed the improve-ci-logs branch 5 times, most recently from 5f068ef to a97ad53 Compare September 16, 2024 15:19
@openucx openucx deleted a comment from azure-pipelines bot Sep 16, 2024
@michal-shalev michal-shalev force-pushed the improve-ci-logs branch 3 times, most recently from 8a77425 to 9aa22bb Compare September 16, 2024 19:41
@michal-shalev michal-shalev changed the title CI: Improve debug logs CI: add exit log Sep 17, 2024
@michal-shalev michal-shalev removed the WIP-DNM Work in progress / Do not review label Sep 17, 2024
@michal-shalev michal-shalev marked this pull request as ready for review September 17, 2024 18:47
@michal-shalev michal-shalev changed the title CI: add exit log CI: create exit log Sep 17, 2024
@michal-shalev
Copy link
Contributor Author

/azp run UCX PR

Copy link

Pull request contains merge conflicts.

@michal-shalev michal-shalev force-pushed the improve-ci-logs branch 9 times, most recently from a918f50 to 3610177 Compare October 20, 2024 06:55
@michal-shalev michal-shalev added WIP-DNM Work in progress / Do not review and removed Ready for Review labels Oct 22, 2024
@michal-shalev michal-shalev marked this pull request as draft October 22, 2024 20:34
@michal-shalev michal-shalev force-pushed the improve-ci-logs branch 6 times, most recently from 19e802e to e4a5fb3 Compare October 27, 2024 08:37
@michal-shalev michal-shalev force-pushed the improve-ci-logs branch 4 times, most recently from 1b87135 to 9f3608a Compare November 11, 2024 09:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
WIP-DNM Work in progress / Do not review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants