Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Sort] Add new source metrics for sort-connector-mongodb-cdc-v1.15 #11355

Closed
2 tasks done
PeterZh6 opened this issue Oct 14, 2024 · 0 comments · Fixed by #11356
Closed
2 tasks done

[Feature][Sort] Add new source metrics for sort-connector-mongodb-cdc-v1.15 #11355

PeterZh6 opened this issue Oct 14, 2024 · 0 comments · Fixed by #11356
Milestone

Comments

@PeterZh6
Copy link
Contributor

PeterZh6 commented Oct 14, 2024

Description

Parent Issue: #10961
Add source metrics in the same way as PostgreSQL-connector [Feature][Sort] Enhanced source metric instrumentation for InLong Sort Flink Connector #11129 for mongodb-cdc-v1.15

Key Metric Categories:

  1. Serialization/Deserialization Metrics:

    • Success/Error Counters: Track successful and failed deserialization attempts (numDeserializeSuccess, numDeserializeError).
    • Latency Gauges: Measure the time taken for both serialization and deserialization (deserializeTimeLag, serializeTimeLag).
  2. SnapshotState Metrics:

    • Creation/Error Counters: Monitor the number of snapshots created and errors encountered during snapshot operations (numSnapshotCreate, numSnapshotError).
  3. NotifyComplete Metrics:

    • Completed Snapshots Counter: Track the number of completed checkpoints (numCompletedSnapshots).
    • Snapshot-to-Checkpoint Latency: Record the time between snapshot creation and checkpoint completion (snapshotToCheckpointTimeLag).

Use case

No response

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants