Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New Concurrency Model #2634

Draft
wants to merge 62 commits into
base: main
Choose a base branch
from
Draft

New Concurrency Model #2634

wants to merge 62 commits into from

Commits on Sep 12, 2023

  1. Added initial stub deeplog objects

    @nvoxland
    nvoxland committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    7cc8205 View commit details
    Browse the repository at this point in the history

  2. Added initial stub deeplog objects

    @nvoxland
    nvoxland committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    0e3eb9b View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. create_tensor action + load new meta

    @FayazRahman
    FayazRahman committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    53b1b13 View commit details
    Browse the repository at this point in the history

  2. Fixed type hints

    @nvoxland
    nvoxland committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    53c546a View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Working on getting load to load

    @nvoxland
    nvoxland committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    c0e0f68 View commit details
    Browse the repository at this point in the history

  2. Load passes

    @nvoxland
    nvoxland committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    c48c35e View commit details
    Browse the repository at this point in the history

  3. Don't create tiles/encoder dirs

    @nvoxland
    nvoxland committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    fc58849 View commit details
    Browse the repository at this point in the history

  4. Fixing reading data with fake deeplog

    @nvoxland
    nvoxland committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    7ea3881 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. upds

    @FayazRahman
    FayazRahman committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    c283aab View commit details
    Browse the repository at this point in the history

  2. update deeplog from storages

    @FayazRahman
    FayazRahman committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    f79fbc2 View commit details
    Browse the repository at this point in the history

  3. Brought over existing deeplog code

    @nvoxland
    nvoxland committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    4397f48 View commit details
    Browse the repository at this point in the history

  4. add tensor action

    @FayazRahman
    FayazRahman committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    df015b5 View commit details
    Browse the repository at this point in the history

  5. initial cmake changes

    @levongh
    levongh committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    9a24821 View commit details
    Browse the repository at this point in the history

  6. add cmake file for google tests

    @levongh
    levongh committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    c9f8343 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2023

  1. Able to bind and call deeplog sample class from python

    @nvoxland
    nvoxland committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    733ee00 View commit details
    Browse the repository at this point in the history

  2. Moved test location and naming pattern

    @nvoxland
    nvoxland committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    1ca0e8a View commit details
    Browse the repository at this point in the history

  3. Binded real deeplog class as DeepLogCpp for now

    @nvoxland
    nvoxland committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    dad16c6 View commit details
    Browse the repository at this point in the history

  4. add CMakeLists for deeplog subfolder

    @levongh
    levongh committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    1cb3615 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/main' into deeplog_cpp

    @nvoxland
    nvoxland committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    4e58396 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. Merge branch 'deeplog_cmake_configure' into deeplog_cpp

    @nvoxland
    nvoxland committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    9347898 View commit details
    Browse the repository at this point in the history

  2. Improving cmake config

    @nvoxland
    nvoxland committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    8a823d4 View commit details
    Browse the repository at this point in the history

  3. Renamed deeplake namespace to deeplog

    @nvoxland
    nvoxland committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    1ffb6ce View commit details
    Browse the repository at this point in the history

  4. Improving cmake config

    @nvoxland
    nvoxland committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    0be111c View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. Working on binding deeplog to python

    @nvoxland
    nvoxland committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    21ae80f View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Created snapshot and transaction objects

    @nvoxland
    nvoxland committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    fe93119 View commit details
    Browse the repository at this point in the history

  2. Switched action fields to be public vs. behind a reader method

    @nvoxland
    nvoxland committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    d8ea9f9 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Merge branch 'deeplog_cpp' into deeplog 

    # Conflicts:
#	deeplake/core/dataset/dataset.py
#	deeplake/core/tensor.py
#	deeplake/deeplog/actions.py
#	deeplake/deeplog/deeplog.py
#	deeplake/util/version_control.py
    @nvoxland
    nvoxland committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    86d4b78 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into deeplog

    @nvoxland
    nvoxland committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    0c7210e View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Merge remote-tracking branch 'origin/main' into deeplog

    @nvoxland
    nvoxland committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    55b27c2 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2023

  1. update cmake build

    @FayazRahman
    FayazRahman committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    9f3a77a View commit details
    Browse the repository at this point in the history

  2. move to _deeplake subpackage

    @FayazRahman
    FayazRahman committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    09334a2 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2023

  1. create tensor almost

    @FayazRahman
    FayazRahman committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    484dd1a View commit details
    Browse the repository at this point in the history

  2. use snapshot for metadata + bug fix

    @FayazRahman
    FayazRahman committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    b6544be View commit details
    Browse the repository at this point in the history

  3. Shifting to more arrow-native data handling

    @nvoxland
    nvoxland committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    de0d351 View commit details
    Browse the repository at this point in the history

  4. Shifting to more arrow-native data handling

    @nvoxland
    nvoxland committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    63c3267 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. Finishing up move of action-selection logic to snapshots not deeplog

    @nvoxland
    nvoxland committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    e44317e View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. Improving serialization logic

    @nvoxland
    nvoxland committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    e945b79 View commit details
    Browse the repository at this point in the history

  2. Added "log_format" argument to dataset creation

    @nvoxland
    nvoxland committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    51dd630 View commit details
    Browse the repository at this point in the history

  3. Include tensors in the list of actions in the schema

    @nvoxland
    nvoxland committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    7a7a5b2 View commit details
    Browse the repository at this point in the history

  4. Added log library 

    Fixed action filtering
    @nvoxland
    nvoxland committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    4d76973 View commit details
    Browse the repository at this point in the history

  5. Working on tensor creation from python

    @nvoxland
    nvoxland committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    19cbf87 View commit details
    Browse the repository at this point in the history

  6. create tensor working

    @FayazRahman
    FayazRahman committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    16ee744 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'deeplog' of https://github.com/activeloopai/deeplake in… 

    …to deeplog
    @FayazRahman
    FayazRahman committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    e93650b View commit details
    Browse the repository at this point in the history

  8. smol

    @FayazRahman
    FayazRahman committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    160e1e7 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2023

  1. Merge branch 'main' into deeplog

    @nvoxland
    nvoxland committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    791af76 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/deeplog' into deeplog

    @nvoxland
    nvoxland committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    333289c View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Created storage module and wrapper for python version

    @nvoxland
    nvoxland committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    d26f312 View commit details
    Browse the repository at this point in the history

  2. Fixed checkpoint logic to collapse actions

    @nvoxland
    nvoxland committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    4bd1dd9 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. fixes + adding basic samples

    @FayazRahman
    FayazRahman committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    58c8795 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'deeplog' of https://github.com/activeloopai/deeplake in… 

    …to deeplog
    @FayazRahman
    FayazRahman committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    9001252 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. - Moved metadata commits to a seprate _meta directory 

    - Defined version 0 as "no data" (so no 000.json file)
- Main branch is a random-generated id like any other branch
- Collapsed methods into metadata_snapshot->find_branch()
    @nvoxland
    nvoxland committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    67fb090 View commit details
    Browse the repository at this point in the history

  2. write and read working

    @FayazRahman
    FayazRahman committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    7051d63 View commit details
    Browse the repository at this point in the history

  3. merge confl

    @FayazRahman
    FayazRahman committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    ad2ce3e View commit details
    Browse the repository at this point in the history

  4. fix test

    @FayazRahman
    FayazRahman committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    97c426c View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into deeplog

    @nvoxland
    nvoxland committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9fa7823 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. Correctly store create_tensor_action.link()

    @nvoxland
    nvoxland committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    1c94192 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into deeplog

    @nvoxland
    nvoxland committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    61649a5 View commit details
    Browse the repository at this point in the history

  3. Ensure correct versions are committed

    @nvoxland
    nvoxland committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    51128b5 View commit details
    Browse the repository at this point in the history

  4. Ensure correct versions are committed

    @nvoxland
    nvoxland committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    434aa9a View commit details
    Browse the repository at this point in the history

  5. Added base_test class

    @nvoxland
    nvoxland committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    f36451f View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. Fixing tensor_link handling

    @nvoxland
    nvoxland committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    0c9c7a8 View commit details
    Browse the repository at this point in the history

  2. Fixing tensor_link handling

    @nvoxland
    nvoxland committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    f5dd723 View commit details
    Browse the repository at this point in the history