Added Prometheus and Grafana monitoring #84

davidbyoung · 2025-01-28T01:55:09Z

Get metrics working for the database, website, and API
Simulate a pod crash and ensure alerts are triggered
Get labels to populate on alert summaries
Configure Grafana dashboards
Determine how to send alerts (eg email?)
Configure sending of alerts
Secure Grafana password

github-actions · 2025-01-28T01:55:56Z

Terraform Plan Output

digitalocean_spaces_bucket.aphiria_com_infrastructure: Refreshing state... [id=aphiria-com-infrastructure]
module.kubernetes.digitalocean_kubernetes_cluster.aphiria_com_cluster: Refreshing state... [id=c0bc903e-71c8-421d-8bce-0a2092731e0f]
module.monitoring.digitalocean_uptime_check.api: Refreshing state... [id=d4daa623-1532-4113-b1ef-0cf9ab308a79]
module.monitoring.digitalocean_uptime_check.web: Refreshing state... [id=f14cf1b0-0af3-445e-95e5-048571bcd563]
module.networking.digitalocean_domain.default: Refreshing state... [id=aphiria.com]
module.networking.data.kubernetes_service.load_balancer: Reading...
module.networking.digitalocean_record.www_cname: Refreshing state... [id=1744933304]
module.networking.digitalocean_record.mx_2: Refreshing state... [id=1744933305]
module.networking.digitalocean_record.mx_3: Refreshing state... [id=1744933309]
module.networking.digitalocean_record.ns_3: Refreshing state... [id=1744933312]
module.networking.digitalocean_record.mx_4: Refreshing state... [id=1744933302]
module.networking.digitalocean_record.ns_2: Refreshing state... [id=1744933311]
module.networking.digitalocean_record.mx_default: Refreshing state... [id=1744933308]
module.networking.digitalocean_record.ns_1: Refreshing state... [id=1744933303]
module.networking.digitalocean_record.mx_1: Refreshing state... [id=1744933310]
module.networking.data.kubernetes_service.load_balancer: Read complete after 0s [id=nginx-gateway/nginx-gateway-nginx-gateway-fabric]
module.networking.digitalocean_record.a: Refreshing state... [id=1744933307]
module.networking.digitalocean_record.api_a: Refreshing state... [id=1744933306]

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

github-actions · 2025-01-29T02:20:43Z

Terraform Plan Output

digitalocean_spaces_bucket.aphiria_com_infrastructure: Refreshing state... [id=aphiria-com-infrastructure]
module.kubernetes.digitalocean_kubernetes_cluster.aphiria_com_cluster: Refreshing state... [id=c0bc903e-71c8-421d-8bce-0a2092731e0f]
module.networking.digitalocean_domain.default: Refreshing state... [id=aphiria.com]
module.monitoring.digitalocean_uptime_check.web: Refreshing state... [id=f14cf1b0-0af3-445e-95e5-048571bcd563]
module.monitoring.digitalocean_uptime_check.api: Refreshing state... [id=d4daa623-1532-4113-b1ef-0cf9ab308a79]
module.networking.data.kubernetes_service.load_balancer: Reading...
module.networking.digitalocean_record.mx_2: Refreshing state... [id=1744933305]
module.networking.digitalocean_record.mx_1: Refreshing state... [id=1744933310]
module.networking.digitalocean_record.mx_4: Refreshing state... [id=1744933302]
module.networking.digitalocean_record.ns_1: Refreshing state... [id=1744933303]
module.networking.digitalocean_record.www_cname: Refreshing state... [id=1744933304]
module.networking.digitalocean_record.mx_default: Refreshing state... [id=1744933308]
module.networking.digitalocean_record.ns_3: Refreshing state... [id=1744933312]
module.networking.digitalocean_record.mx_3: Refreshing state... [id=1744933309]
module.networking.digitalocean_record.ns_2: Refreshing state... [id=1744933311]
module.networking.data.kubernetes_service.load_balancer: Read complete after 1s [id=nginx-gateway/nginx-gateway-nginx-gateway-fabric]
module.networking.digitalocean_record.a: Refreshing state... [id=1744933307]
module.networking.digitalocean_record.api_a: Refreshing state... [id=1744933306]

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

…rts, still have checked in a container command that will keep the API deployment from succeeding

github-actions · 2025-01-29T02:32:58Z

Terraform Plan Output

digitalocean_spaces_bucket.aphiria_com_infrastructure: Refreshing state... [id=aphiria-com-infrastructure]
module.kubernetes.digitalocean_kubernetes_cluster.aphiria_com_cluster: Refreshing state... [id=c0bc903e-71c8-421d-8bce-0a2092731e0f]
module.monitoring.digitalocean_uptime_check.api: Refreshing state... [id=d4daa623-1532-4113-b1ef-0cf9ab308a79]
module.networking.digitalocean_domain.default: Refreshing state... [id=aphiria.com]
module.monitoring.digitalocean_uptime_check.web: Refreshing state... [id=f14cf1b0-0af3-445e-95e5-048571bcd563]
module.networking.data.kubernetes_service.load_balancer: Reading...
module.networking.digitalocean_record.ns_1: Refreshing state... [id=1744933303]
module.networking.digitalocean_record.ns_2: Refreshing state... [id=1744933311]
module.networking.digitalocean_record.www_cname: Refreshing state... [id=1744933304]
module.networking.digitalocean_record.mx_3: Refreshing state... [id=1744933309]
module.networking.digitalocean_record.mx_default: Refreshing state... [id=1744933308]
module.networking.digitalocean_record.mx_2: Refreshing state... [id=1744933305]
module.networking.digitalocean_record.mx_4: Refreshing state... [id=1744933302]
module.networking.digitalocean_record.mx_1: Refreshing state... [id=1744933310]
module.networking.digitalocean_record.ns_3: Refreshing state... [id=1744933312]
module.networking.data.kubernetes_service.load_balancer: Read complete after 0s [id=nginx-gateway/nginx-gateway-nginx-gateway-fabric]
module.networking.digitalocean_record.a: Refreshing state... [id=1744933307]
module.networking.digitalocean_record.api_a: Refreshing state... [id=1744933306]

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

github-actions · 2025-02-01T01:38:11Z

Terraform Plan Output

digitalocean_spaces_bucket.aphiria_com_infrastructure: Refreshing state... [id=aphiria-com-infrastructure]
module.kubernetes.digitalocean_kubernetes_cluster.aphiria_com_cluster: Refreshing state... [id=c0bc903e-71c8-421d-8bce-0a2092731e0f]
module.monitoring.digitalocean_uptime_check.web: Refreshing state... [id=f14cf1b0-0af3-445e-95e5-048571bcd563]
module.monitoring.digitalocean_uptime_check.api: Refreshing state... [id=d4daa623-1532-4113-b1ef-0cf9ab308a79]
module.networking.digitalocean_domain.default: Refreshing state... [id=aphiria.com]
module.networking.data.kubernetes_service.load_balancer: Reading...
module.networking.digitalocean_record.mx_1: Refreshing state... [id=1744933310]
module.networking.digitalocean_record.ns_2: Refreshing state... [id=1744933311]
module.networking.digitalocean_record.mx_default: Refreshing state... [id=1744933308]
module.networking.digitalocean_record.ns_3: Refreshing state... [id=1744933312]
module.networking.digitalocean_record.ns_1: Refreshing state... [id=1744933303]
module.networking.digitalocean_record.www_cname: Refreshing state... [id=1744933304]
module.networking.digitalocean_record.mx_3: Refreshing state... [id=1744933309]
module.networking.digitalocean_record.mx_4: Refreshing state... [id=1744933302]
module.networking.digitalocean_record.mx_2: Refreshing state... [id=1744933305]
module.networking.data.kubernetes_service.load_balancer: Read complete after 1s [id=nginx-gateway/nginx-gateway-nginx-gateway-fabric]
module.networking.digitalocean_record.a: Refreshing state... [id=1744933307]
module.networking.digitalocean_record.api_a: Refreshing state... [id=1744933306]

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

github-actions · 2025-02-01T02:03:50Z

Terraform Plan Output

digitalocean_spaces_bucket.aphiria_com_infrastructure: Refreshing state... [id=aphiria-com-infrastructure]
module.kubernetes.digitalocean_kubernetes_cluster.aphiria_com_cluster: Refreshing state... [id=c0bc903e-71c8-421d-8bce-0a2092731e0f]
module.networking.digitalocean_domain.default: Refreshing state... [id=aphiria.com]
module.monitoring.digitalocean_uptime_check.api: Refreshing state... [id=d4daa623-1532-4113-b1ef-0cf9ab308a79]
module.monitoring.digitalocean_uptime_check.web: Refreshing state... [id=f14cf1b0-0af3-445e-95e5-048571bcd563]
module.networking.data.kubernetes_service.load_balancer: Reading...
module.networking.digitalocean_record.mx_4: Refreshing state... [id=1744933302]
module.networking.digitalocean_record.mx_2: Refreshing state... [id=1744933305]
module.networking.digitalocean_record.ns_3: Refreshing state... [id=1744933312]
module.networking.digitalocean_record.mx_3: Refreshing state... [id=1744933309]
module.networking.digitalocean_record.ns_2: Refreshing state... [id=1744933311]
module.networking.digitalocean_record.mx_1: Refreshing state... [id=1744933310]
module.networking.digitalocean_record.www_cname: Refreshing state... [id=1744933304]
module.networking.digitalocean_record.ns_1: Refreshing state... [id=1744933303]
module.networking.digitalocean_record.mx_default: Refreshing state... [id=1744933308]
module.networking.data.kubernetes_service.load_balancer: Read complete after 0s [id=nginx-gateway/nginx-gateway-nginx-gateway-fabric]
module.networking.digitalocean_record.a: Refreshing state... [id=1744933307]
module.networking.digitalocean_record.api_a: Refreshing state... [id=1744933306]

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

# Conflicts: # README.md

github-actions · 2025-02-01T18:58:21Z

Terraform Plan Output

digitalocean_spaces_bucket.aphiria_com_infrastructure: Refreshing state... [id=aphiria-com-infrastructure]
module.kubernetes.digitalocean_kubernetes_cluster.aphiria_com_cluster: Refreshing state... [id=c0bc903e-71c8-421d-8bce-0a2092731e0f]
module.networking.digitalocean_domain.default: Refreshing state... [id=aphiria.com]
module.monitoring.digitalocean_uptime_check.web: Refreshing state... [id=f14cf1b0-0af3-445e-95e5-048571bcd563]
module.monitoring.digitalocean_uptime_check.api: Refreshing state... [id=d4daa623-1532-4113-b1ef-0cf9ab308a79]
module.networking.data.kubernetes_service.load_balancer: Reading...
module.networking.digitalocean_record.ns_2: Refreshing state... [id=1744933311]
module.networking.digitalocean_record.mx_1: Refreshing state... [id=1744933310]
module.networking.digitalocean_record.ns_1: Refreshing state... [id=1744933303]
module.networking.digitalocean_record.ns_3: Refreshing state... [id=1744933312]
module.networking.digitalocean_record.www_cname: Refreshing state... [id=1744933304]
module.networking.digitalocean_record.mx_2: Refreshing state... [id=1744933305]
module.networking.digitalocean_record.mx_default: Refreshing state... [id=1744933308]
module.networking.digitalocean_record.mx_4: Refreshing state... [id=1744933302]
module.networking.digitalocean_record.mx_3: Refreshing state... [id=1744933309]
module.networking.data.kubernetes_service.load_balancer: Read complete after 1s [id=nginx-gateway/nginx-gateway-nginx-gateway-fabric]
module.networking.digitalocean_record.a: Refreshing state... [id=1744933307]
module.networking.digitalocean_record.api_a: Refreshing state... [id=1744933306]

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

github-actions · 2025-02-01T19:16:20Z

Terraform Plan Output

digitalocean_spaces_bucket.aphiria_com_infrastructure: Refreshing state... [id=aphiria-com-infrastructure]
module.kubernetes.digitalocean_kubernetes_cluster.aphiria_com_cluster: Refreshing state... [id=c0bc903e-71c8-421d-8bce-0a2092731e0f]
module.monitoring.digitalocean_uptime_check.web: Refreshing state... [id=f14cf1b0-0af3-445e-95e5-048571bcd563]
module.monitoring.digitalocean_uptime_check.api: Refreshing state... [id=d4daa623-1532-4113-b1ef-0cf9ab308a79]
module.networking.digitalocean_domain.default: Refreshing state... [id=aphiria.com]
module.networking.data.kubernetes_service.load_balancer: Reading...
module.networking.digitalocean_record.mx_2: Refreshing state... [id=1744933305]
module.networking.digitalocean_record.mx_3: Refreshing state... [id=1744933309]
module.networking.digitalocean_record.ns_1: Refreshing state... [id=1744933303]
module.networking.digitalocean_record.ns_2: Refreshing state... [id=1744933311]
module.networking.digitalocean_record.www_cname: Refreshing state... [id=1744933304]
module.networking.digitalocean_record.mx_4: Refreshing state... [id=1744933302]
module.networking.digitalocean_record.mx_1: Refreshing state... [id=1744933310]
module.networking.digitalocean_record.mx_default: Refreshing state... [id=1744933308]
module.networking.digitalocean_record.ns_3: Refreshing state... [id=1744933312]
module.networking.data.kubernetes_service.load_balancer: Read complete after 0s [id=nginx-gateway/nginx-gateway-nginx-gateway-fabric]
module.networking.digitalocean_record.api_a: Refreshing state... [id=1744933306]
module.networking.digitalocean_record.a: Refreshing state... [id=1744933307]

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

github-actions · 2025-02-01T19:30:27Z

Terraform Plan Output

digitalocean_spaces_bucket.aphiria_com_infrastructure: Refreshing state... [id=aphiria-com-infrastructure]
module.kubernetes.digitalocean_kubernetes_cluster.aphiria_com_cluster: Refreshing state... [id=c0bc903e-71c8-421d-8bce-0a2092731e0f]
module.monitoring.digitalocean_uptime_check.web: Refreshing state... [id=f14cf1b0-0af3-445e-95e5-048571bcd563]
module.networking.digitalocean_domain.default: Refreshing state... [id=aphiria.com]
module.monitoring.digitalocean_uptime_check.api: Refreshing state... [id=d4daa623-1532-4113-b1ef-0cf9ab308a79]
module.networking.data.kubernetes_service.load_balancer: Reading...
module.networking.data.kubernetes_service.load_balancer: Read complete after 0s [id=nginx-gateway/nginx-gateway-nginx-gateway-fabric]
module.networking.digitalocean_record.www_cname: Refreshing state... [id=1744933304]
module.networking.digitalocean_record.mx_3: Refreshing state... [id=1744933309]
module.networking.digitalocean_record.a: Refreshing state... [id=1744933307]
module.networking.digitalocean_record.api_a: Refreshing state... [id=1744933306]
module.networking.digitalocean_record.mx_1: Refreshing state... [id=1744933310]
module.networking.digitalocean_record.ns_3: Refreshing state... [id=1744933312]
module.networking.digitalocean_record.mx_default: Refreshing state... [id=1744933308]
module.networking.digitalocean_record.mx_2: Refreshing state... [id=1744933305]
module.networking.digitalocean_record.ns_1: Refreshing state... [id=1744933303]
module.networking.digitalocean_record.ns_2: Refreshing state... [id=1744933311]
module.networking.digitalocean_record.mx_4: Refreshing state... [id=1744933302]

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

davidbyoung added 4 commits January 26, 2025 14:32

Fixed localhost path

c93c8b5

Merge branch 'master' into prometheus

5e567cb

Merge branch 'master' into prometheus

6ae3688

Got Prometheus working, along with alerts, but they're always failing.

6447ba0

Got alerts working, still need to get labels to populate on alerts

9e0c56d

Removed code that I do not think was working to fill in labels on ale…

c0f60b8

…rts, still have checked in a container command that will keep the API deployment from succeeding

Started adding Grafana (WIP)

4668592

Merge branch 'master' into prometheus

be71d60

davidbyoung added 2 commits February 1, 2025 12:57

Merge branch 'master' into prometheus

6082121

# Conflicts: # README.md

Merged master

df8fde8

Merge branch 'master' into prometheus

43fb8e5

Merge branch 'master' into prometheus

2cfe1b6

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Added Prometheus and Grafana monitoring #84

Added Prometheus and Grafana monitoring #84

davidbyoung commented Jan 28, 2025 •

edited

Loading

github-actions bot commented Jan 28, 2025

github-actions bot commented Jan 29, 2025

github-actions bot commented Jan 29, 2025

github-actions bot commented Feb 1, 2025

github-actions bot commented Feb 1, 2025

github-actions bot commented Feb 1, 2025

github-actions bot commented Feb 1, 2025

github-actions bot commented Feb 1, 2025

Added Prometheus and Grafana monitoring #84

Are you sure you want to change the base?

Added Prometheus and Grafana monitoring #84

Conversation

davidbyoung commented Jan 28, 2025 • edited Loading

github-actions bot commented Jan 28, 2025

Terraform Plan Output

github-actions bot commented Jan 29, 2025

Terraform Plan Output

github-actions bot commented Jan 29, 2025

Terraform Plan Output

github-actions bot commented Feb 1, 2025

Terraform Plan Output

github-actions bot commented Feb 1, 2025

Terraform Plan Output

github-actions bot commented Feb 1, 2025

Terraform Plan Output

github-actions bot commented Feb 1, 2025

Terraform Plan Output

github-actions bot commented Feb 1, 2025

Terraform Plan Output

davidbyoung commented Jan 28, 2025 •

edited

Loading