Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JMX Scraper - YAML config and integration test for HBase #1538

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

robsunday
Copy link
Contributor

@robsunday robsunday commented Nov 12, 2024

  • Created YAML config for connecting JMX Insight to HBase created based on jmx-metrics groovy script
  • Updated jmx-metrics units to match semconv rules

"Hadoop:service=HBase,name=Master,sub=AssignmentManager" metrics are defined as updowncounter, while in my opinion it should be just gauges. I kept updowncounters to minimize incompatibilities.
We may consider if updownocunters should be converted to gauges in this or the following PR

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[for reviewer] Some small improvements to report meaningful errors for few failed assertions

@robsunday robsunday changed the title YAML config andf integration test for HBase YAML config and integration test for HBase Nov 14, 2024
@robsunday robsunday changed the title YAML config and integration test for HBase JMX Scraper - YAML config and integration test for HBase Nov 14, 2024
metric: region.count
unit: "{region}"
desc: The number of regions hosted by the region server.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[minor] the spacing between blocks is intentional to keep things a bit readable here, maybe adding an explicit "header comment" with for example the metric name/prefix/suffix would help to understand this is intentional and needs to be preserved when maintaining this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comments added

Comment on lines +166 to +180
Append_99th_percentile:
metric: operation.append.latency.p99
desc: Append operation 99th Percentile latency.
Append_max:
metric: operation.append.latency.max
desc: Append operation max latency.
Append_min:
metric: operation.append.latency.min
desc: Append operation minimum latency.
Append_mean:
metric: operation.append.latency.mean
desc: Append operation mean latency.
Append_median:
metric: operation.append.latency.median
desc: Append operation median latency.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not related to this PR, but I am pretty sure those are metrics created with dropwizard, we need to make sure those are mapped consistently for every supported system where they are used. The downside of those here is that there is no way for us to translate that easily to an otel histogram as we don't have access to the individual samples.

@@ -7,6 +7,7 @@ rules:
unit: "{server}"
type: updowncounter
mapping:
# Group of properties to build hbase.master.region_server.count metric
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# Group of properties to build hbase.master.region_server.count metric
# hbase.master.region_server.count

[nitpicking] Maybe simplify this even further as everything here is a metric (and do the same with others that match Group of properties to build .* metric regex)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants