Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(chunkv5): Chunk V5 structure, encoding and decoding #14674

Draft
wants to merge 50 commits into
base: main
Choose a base branch
from
Draft

feat(chunkv5): Chunk V5 structure, encoding and decoding #14674

wants to merge 50 commits into from

Commits on Nov 13, 2024

  1. Add a new chunk and block format

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1c1e6f8 View commit details
    Browse the repository at this point in the history

  2. Refactor to fetch CompressedBlock from source

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    b436be9 View commit details
    Browse the repository at this point in the history

  3. Add implementation for organised head format

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    9ad2d51 View commit details
    Browse the repository at this point in the history

  4. Add iterator placeholders

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    d2b8993 View commit details
    Browse the repository at this point in the history

  5. implement sample and entry iterators

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    4c5dee6 View commit details
    Browse the repository at this point in the history

  6. Fix read timestamps

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    402da98 View commit details
    Browse the repository at this point in the history

  7. Fix test block

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    278d2ea View commit details
    Browse the repository at this point in the history

  8. Fix writing and reading chunks with the new block format

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ad5cdff View commit details
    Browse the repository at this point in the history

  9. Add temporary skip for corrupt chunk test

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    0b99c97 View commit details
    Browse the repository at this point in the history

  10. Skip failing test for now

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    dffc234 View commit details
    Browse the repository at this point in the history

  11. format

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    14fbae3 View commit details
    Browse the repository at this point in the history

  12. Skip failing checkpointing test for now

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    865fe99 View commit details
    Browse the repository at this point in the history

  13. Add an evaluator mode to skip lines

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    33b3f19 View commit details
    Browse the repository at this point in the history

  14. Fix existing tests

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1582785 View commit details
    Browse the repository at this point in the history

  15. Support both v4 and v5 chunk formats in storage hack (data gen)

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    bc2c21d View commit details
    Browse the repository at this point in the history

  16. Add missing schema entries

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    6428e9a View commit details
    Browse the repository at this point in the history

  17. A bit of additional optimization

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    8ba5765 View commit details
    Browse the repository at this point in the history

  18. Add a new chunk and block format

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    43986b3 View commit details
    Browse the repository at this point in the history

  19. Refactor to fetch CompressedBlock from source

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    840e0fb View commit details
    Browse the repository at this point in the history

  20. Add implementation for organised head format

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    3aa3d48 View commit details
    Browse the repository at this point in the history

  21. Add iterator placeholders

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    93f6b39 View commit details
    Browse the repository at this point in the history

  22. implement sample and entry iterators

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    0159953 View commit details
    Browse the repository at this point in the history

  23. Fix read timestamps

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    e76c2d1 View commit details
    Browse the repository at this point in the history

  24. Fix test block

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    6bf6c34 View commit details
    Browse the repository at this point in the history

  25. Fix writing and reading chunks with the new block format

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    d51082a View commit details
    Browse the repository at this point in the history

  26. Add temporary skip for corrupt chunk test

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    e7b1d0e View commit details
    Browse the repository at this point in the history

  27. Skip failing test for now

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    a552edd View commit details
    Browse the repository at this point in the history

  28. format

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    2249c44 View commit details
    Browse the repository at this point in the history

  29. Skip failing checkpointing test for now

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ceebc86 View commit details
    Browse the repository at this point in the history

  30. Fix lint

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    e2c57c8 View commit details
    Browse the repository at this point in the history

  31. Add documentation

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    897d899 View commit details
    Browse the repository at this point in the history

  32. Merge branch 'chunkv5-query' into chunkv5

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    02e651d View commit details
    Browse the repository at this point in the history

  33. Populate stats while decoding

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    21b4826 View commit details
    Browse the repository at this point in the history

  34. Add test to benchmark storage

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    7459ab0 View commit details
    Browse the repository at this point in the history

  35. Fix documentation

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    0e97be3 View commit details
    Browse the repository at this point in the history

  36. Add initial benchmark results to doc

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    8309fff View commit details
    Browse the repository at this point in the history

  37. Improve doc

    @shantanualsi
    shantanualsi committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    c3ee869 View commit details
    Browse the repository at this point in the history

  38. Merge branch 'main' into chunkv5

    @shantanualsi
    shantanualsi authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    955e67c View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Add a micro benchmark

    @cyriltovena
    cyriltovena committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    a7d36c5 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2024

  1. Merge branch 'main' into chunkv5

    @shantanualsi
    shantanualsi committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    a72455a View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2024

  1. Merge branch 'main' into chunkv5

    @shantanualsi
    shantanualsi committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    42f33d8 View commit details
    Browse the repository at this point in the history

  2. Use no compression for structured metadata and timestamps

    @shantanualsi
    shantanualsi committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    eae46c0 View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2024

  1. Merge branch 'main' into chunkv5

    @shantanualsi
    shantanualsi committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    487691c View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2024

  1. Simplify buffer usage in chunk v5

    @shantanualsi
    shantanualsi committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    a7ce939 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into chunkv5

    @shantanualsi
    shantanualsi committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    bcf3608 View commit details
    Browse the repository at this point in the history

  3. Fix failing querier test

    @shantanualsi
    shantanualsi committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    4da2348 View commit details
    Browse the repository at this point in the history

  4. Move logic to query metrics to extractor

    @shantanualsi
    shantanualsi committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    b4f438d View commit details
    Browse the repository at this point in the history

  5. Remove unused functions

    @shantanualsi
    shantanualsi committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    97af5f0 View commit details
    Browse the repository at this point in the history

  6. Fix tests

    @shantanualsi
    shantanualsi committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    45764fd View commit details
    Browse the repository at this point in the history

  7. Simplify serializing block

    @shantanualsi
    shantanualsi committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    5c14ef0 View commit details
    Browse the repository at this point in the history