Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deduplication #12

Merged
merged 8 commits into from
Jul 17, 2023
Merged

Deduplication #12

merged 8 commits into from
Jul 17, 2023

Commits on Jul 17, 2023

  1. Add minhashdedup

    @alexchapeaux
    alexchapeaux committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    3ac9132 View commit details
    Browse the repository at this point in the history

  2. Add minhash skeleton

    @alexchapeaux
    alexchapeaux committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    59115ab View commit details
    Browse the repository at this point in the history

  3. Remove dedup folder outside pipeline

    @alexchapeaux
    alexchapeaux committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    529c8bf View commit details
    Browse the repository at this point in the history

  4. 🚧 Add C4 dedup structure

    @alexchapeaux
    alexchapeaux committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    f89185b View commit details
    Browse the repository at this point in the history

  5. 🚧 Add first working version of C4

    @alexchapeaux
    alexchapeaux committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    50ab614 View commit details
    Browse the repository at this point in the history

  6. changes to support the new IO refactoring

    @guipenedo @alexchapeaux
    guipenedo authored and alexchapeaux committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    b9ceca5 View commit details
    Browse the repository at this point in the history

  7. 🎨 Improve structure

    @alexchapeaux
    alexchapeaux committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    bed1310 View commit details
    Browse the repository at this point in the history

  8. 📝 Add sentence-deduplication example

    @alexchapeaux
    alexchapeaux committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    4fa0562 View commit details
    Browse the repository at this point in the history