Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(storage): GCS backend using thanos.io/objstore #11132

Merged
merged 54 commits into from
Oct 18, 2024
Merged

feat(storage): GCS backend using thanos.io/objstore #11132

merged 54 commits into from
Oct 18, 2024

Commits on Nov 14, 2023

  1. GCP implementation using thanos.io/objstore

    @JoaoBraveCoding
    JoaoBraveCoding committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    326d994 View commit details
    Browse the repository at this point in the history

  2. Implemented all ObjectClient methods

    @JoaoBraveCoding
    JoaoBraveCoding committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    5960741 View commit details
    Browse the repository at this point in the history

  3. Cleaned up code

    @JoaoBraveCoding
    JoaoBraveCoding committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    9878c97 View commit details
    Browse the repository at this point in the history

  4. Change Iter options to be more standard

    @JoaoBraveCoding
    JoaoBraveCoding committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    f6ea86d View commit details
    Browse the repository at this point in the history

  5. Allow support for ruler to use thanos/obj storage 

    Signed-off-by: Joao Marcal <[email protected]>
    @JoaoBraveCoding
    JoaoBraveCoding committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    0c88216 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. Add thanos/objstore to common configuration

    @JoaoBraveCoding
    JoaoBraveCoding committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    184ea74 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2023

  1. Fix metric registration by solving the "component" label conflict

    @JoaoBraveCoding
    JoaoBraveCoding committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    e816a3c View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    1af852e View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    19f610c View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    80333a4 View commit details
    Browse the repository at this point in the history

  2. feat(storage): implements hedging for thanos gcs client

    @JoaoBraveCoding
    JoaoBraveCoding committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    32a9e4c View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    1bf07cd View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    1a0da8b View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    6728e2f View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. Revert func signature of NewObjectClient and introduce NewObjectClientV2

    @JoaoBraveCoding
    JoaoBraveCoding committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    3a2fe9e View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. Merge branch 'main' into log-4550-gcp

    @kavirajk
    kavirajk authored Jul 12, 2024
    Configuration menu
    Copy the full SHA
    17ee4ec View commit details
    Browse the repository at this point in the history

  2. fix the putObject api arguments 

    Signed-off-by: Kaviraj <[email protected]>
    @kavirajk
    kavirajk committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    4451f23 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Merge branch 'main' into log-4550-gcp

    @kavirajk
    kavirajk committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    919d04f View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. vendor thanos with chunk-size patch 

    Signed-off-by: Kaviraj Kanagaraj <[email protected]>
    @kavirajk
    kavirajk committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    f051abf View commit details
    Browse the repository at this point in the history

  2. support chunk-buffer-size 

    Signed-off-by: Kaviraj Kanagaraj <[email protected]>
    @kavirajk
    kavirajk committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    ea17fc5 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. Merge branch 'main' into log-4550-gcp

    @kavirajk
    kavirajk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    3e5e772 View commit details
    Browse the repository at this point in the history

  2. implement GetRange to satisfy the interface 

    Signed-off-by: Kaviraj Kanagaraj <[email protected]>
    @kavirajk
    kavirajk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    e0d5a93 View commit details
    Browse the repository at this point in the history

  3. make doc add new chunk-buffer-size to thanos GCS 

    Signed-off-by: Kaviraj Kanagaraj <[email protected]>
    @kavirajk
    kavirajk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    2074894 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into log-4550-gcp

    @kavirajk
    kavirajk authored Jul 30, 2024
    Configuration menu
    Copy the full SHA
    b86c4d7 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    1060422 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Start using objstore.WrapWith to avoid duplicate metric registration

    @JoaoBraveCoding
    JoaoBraveCoding committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    e0dc5aa View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    a3b367c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    3fef0bf View commit details
    Browse the repository at this point in the history

  3. chore: add ObjectExistsWithSize to respect the interface 

    new method was added in grafana#14268
    @JoaoBraveCoding
    JoaoBraveCoding committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    6e98e22 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. Merge branch 'main' into log-4550-gcp

    @JoaoBraveCoding
    JoaoBraveCoding committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    e4fd02d View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. fix: update interface to GetAttributes

    @JoaoBraveCoding
    JoaoBraveCoding committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    e908566 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. use global thanos metrics and other changes (#1) 

        use a global thanos metric.
    remove ruler changes, will be added in a separate pr
    rename configs
    @ashwanthgoli
    ashwanthgoli authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    ca835ad View commit details
    Browse the repository at this point in the history

  2. use existing NewObjectClient method

    @ashwanthgoli
    ashwanthgoli committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    36de56f View commit details
    Browse the repository at this point in the history

  3. fixup! use existing NewObjectClient method

    @ashwanthgoli
    ashwanthgoli committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    b057471 View commit details
    Browse the repository at this point in the history

  4. fix tests

    @ashwanthgoli
    ashwanthgoli committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    f120df2 View commit details
    Browse the repository at this point in the history

  5. wire http conf + transport for gcs correctly

    @ashwanthgoli
    ashwanthgoli committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    225866f View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. remove backend field, loki supports multiple backends (per period)

    @ashwanthgoli
    ashwanthgoli committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    7ba4c3b View commit details
    Browse the repository at this point in the history

  2. fixup! remove backend field, loki supports multiple backends (per per… 

    …iod)

Signed-off-by: Ashwanth Goli <[email protected]>
    @ashwanthgoli
    ashwanthgoli committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    9977d5b View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. update docs + config cleanup

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    0baea5a View commit details
    Browse the repository at this point in the history

  2. move storage backend to root block

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    df50926 View commit details
    Browse the repository at this point in the history

  3. fixup! move storage backend to root block

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    0aa6c3c View commit details
    Browse the repository at this point in the history

  4. metric reg cleanup

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    5a1d2e5 View commit details
    Browse the repository at this point in the history

  5. remove sse limits, add back in s3 pr

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    a0478d0 View commit details
    Browse the repository at this point in the history

  6. use objstore.TryToGetSize

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    529f1d6 View commit details
    Browse the repository at this point in the history

  7. nits

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    5788eec View commit details
    Browse the repository at this point in the history

  8. fix compile + update docs

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    f473928 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' into log-4550-gcp

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    3da88e5 View commit details
    Browse the repository at this point in the history

  10. go mod tidy & vendor

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    1e6c079 View commit details
    Browse the repository at this point in the history

  11. fixup! go mod tidy & vendor

    @ashwanthgoli
    ashwanthgoli committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    66dc091 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. fix lint

    @ashwanthgoli
    ashwanthgoli committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    db57fca View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. add tests

    @ashwanthgoli
    ashwanthgoli committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    6050e0b View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. update docs and comments

    @ashwanthgoli
    ashwanthgoli committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    45d33c3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into log-4550-gcp

    @ashwanthgoli
    ashwanthgoli committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    d7d0243 View commit details
    Browse the repository at this point in the history

  3. add back after fixing doc-gen

    @ashwanthgoli
    ashwanthgoli committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    ef26a40 View commit details
    Browse the repository at this point in the history