Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[observability] Grafana and Loki as log monitoring stack #295

Open
2 tasks done
michaelkoepf opened this issue Dec 31, 2024 · 1 comment · May be fixed by #308
Open
2 tasks done

[observability] Grafana and Loki as log monitoring stack #295

michaelkoepf opened this issue Dec 31, 2024 · 1 comment · May be fixed by #308
Labels
feature New feature or request

Comments

@michaelkoepf
Copy link
Contributor

michaelkoepf commented Dec 31, 2024 •
edited
Loading

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

In addition to the already existing metrics monitoring capabilities with Prometheus and Grafana, log monitoring with Grafana and Loki would further enhance application observability and allow users to analyze all cluster logs in a single place.

Solution

  • Group the Metric Reporters, Monitor Metrics, and Logging doc pages under a new heading in the docs menu (Maintenance > Observability)
  • Add an additional Observability with Prometheus, Grafana, and Loki sub-page under the Observability heading
  • Move the existing metrics monitoring guide ([observability] Prometheus and Grafana as metrics monitoring stack #257) to the new sub-page
  • Extend the metrics monitoring guide and show how to use Loki for log monitoring

Anything else?

No response

Willingness to contribute

  • I'm willing to submit a PR!
@michaelkoepf michaelkoepf added the feature New feature or request label Dec 31, 2024
michaelkoepf added a commit to michaelkoepf/fluss that referenced this issue Jan 3, 2025
@michaelkoepf
[observability] Add Grafana and Loki as log monitoring stack
56321f4 
- Group logging, metrics, and monitoring into common sidebar menu group ("observability")
- Move monitoring quickstart guide (Prometheus + Grafana) to separate page ("observability quickstart guides")
- Extend monitoring quickstart guide (log monitoring with Loki) + provide new quickstart configuration ZIP archive
- Minor changes and fixes in Flink quickstart guide
- Add version hint for logback in doc

Issue alibaba#295, alibaba#304
@michaelkoepf michaelkoepf linked a pull request Jan 3, 2025 that will close this issue
Open
michaelkoepf added a commit to michaelkoepf/fluss that referenced this issue Jan 3, 2025
@michaelkoepf
[observability] Add Grafana and Loki as log monitoring stack
d5a497b 
- Group logging, metrics, and monitoring into common sidebar menu group ("observability")
- Move monitoring quickstart guide (Prometheus + Grafana) to separate page ("observability quickstart guides")
- Extend monitoring quickstart guide (log monitoring with Loki) + provide new quickstart configuration ZIP archive
- Minor changes and fixes in Flink quickstart guide
- Add version hint for logback in doc

Issue alibaba#295, alibaba#304
@michaelkoepf
Copy link
Contributor Author

@polyzos this is also ready, see #308. it is an extension of #257 (which you reviewed) that adds log monitoring capabilities. looks like this in grafana.

Screenshot from 2025-01-03 19-29-38

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[observability] Add Grafana and Loki as log monitoring stack michaelkoepf/fluss
1 participant
@michaelkoepf