Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DRAFT] Webhook example with record completed #5477

Closed
wants to merge 90 commits into from
Closed

[DRAFT] Webhook example with record completed #5477

wants to merge 90 commits into from

Commits on Aug 1, 2024

  1. feat: add rq as dependency

    @jfcalvo
    jfcalvo committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    0bdd174 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. feat: add rq support and first job to update dataset records status

    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    879e18c View commit details
    Browse the repository at this point in the history

  2. feat: add Redis and rq workers to argilla-hf-spaces Dockerfile

    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    68dad75 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into feat/add-rq

    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    65ae689 View commit details
    Browse the repository at this point in the history

  4. feat: add Redis as service dependency to GitHub argilla-server workflow

    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    24733c2 View commit details
    Browse the repository at this point in the history

  5. feat: fix some problems with argilla-hf-spaces Dockerfile adding redis

    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    684c025 View commit details
    Browse the repository at this point in the history

  6. feat: change docker-compose.yaml example file to use Redis and a rq w… 

    …orker
    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    abac3c6 View commit details
    Browse the repository at this point in the history

  7. feat: add ping redis function at application startup

    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    27b349c View commit details
    Browse the repository at this point in the history

  8. feat: add documentation about background jobs to argilla server READM… 

    …E.md
    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    4c30308 View commit details
    Browse the repository at this point in the history

  9. feat: add Redis as dependency to developer docs

    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    f671597 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'develop' into feat/add-rq

    @jfcalvo
    jfcalvo authored Aug 27, 2024
    Configuration menu
    Copy the full SHA
    f47cb0c View commit details
    Browse the repository at this point in the history

  11. chore: update CHANGELOG.md

    @jfcalvo
    jfcalvo committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    0755c96 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. feat: remove useless conditional

    @jfcalvo
    jfcalvo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    7c939d2 View commit details
    Browse the repository at this point in the history

  2. feat: add new job to update one single record status

    @jfcalvo
    jfcalvo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a7ca9ae View commit details
    Browse the repository at this point in the history

  3. feat: update records status outside main job transaction

    @jfcalvo
    jfcalvo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    689bc12 View commit details
    Browse the repository at this point in the history

  4. feat: small refactors

    @jfcalvo
    jfcalvo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a8b17bd View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. feat: disable job timeout for default queue

    @jfcalvo
    jfcalvo committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    275d6df View commit details
    Browse the repository at this point in the history

  2. feat: move timeout definition outside of the queue

    @jfcalvo
    jfcalvo committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    9cd7ee1 View commit details
    Browse the repository at this point in the history

  3. feat: add environment variable to define the number of background wor… 

    …kers to use on HF docker image
    @jfcalvo
    jfcalvo committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    a6ed2cb View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. feat: increase default value of BACKGROUND_JOB_WORKERS environment va… 

    …riable from 1 to 2 workers
    @jfcalvo
    jfcalvo committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    67c34c6 View commit details
    Browse the repository at this point in the history

  2. feat: improve how number of workers is specified on docker compose an… 

    …d rename environment variable
    @jfcalvo
    jfcalvo committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    9be4f6d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into feat/add-rq

    @jfcalvo
    jfcalvo authored Aug 30, 2024
    Configuration menu
    Copy the full SHA
    fc228fc View commit details
    Browse the repository at this point in the history

  4. feat: first proof of concept for webhooks using standard-webhooks

    @jfcalvo
    jfcalvo committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    cfa5219 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. feat: add webhooks table and API endpoints to support webhooks CRUD

    @jfcalvo
    jfcalvo committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    2ed5c34 View commit details
    Browse the repository at this point in the history

  2. feat: improve notify events using database Webhooks

    @jfcalvo
    jfcalvo committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    7df6309 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. feat: add new endpoint to ping a webhook

    @jfcalvo
    jfcalvo committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    6268389 View commit details
    Browse the repository at this point in the history

  2. feat: add enabled and description to webhooks table

    @jfcalvo
    jfcalvo committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    c484c99 View commit details
    Browse the repository at this point in the history

  3. feat: remove uniqueness for url and secret columns

    @jfcalvo
    jfcalvo committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    9ccfb58 View commit details
    Browse the repository at this point in the history

  4. feat: add a limit to the number of webhooks that can be created

    @jfcalvo
    jfcalvo committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    fe228f3 View commit details
    Browse the repository at this point in the history

  5. feat: small refactor

    @jfcalvo
    jfcalvo committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    fcbd310 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'develop' into feat/add-webhooks

    @jfcalvo
    jfcalvo committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    aa678d1 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Merge branch 'develop' into feat/add-rq

    @jfcalvo
    jfcalvo committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    c0adb56 View commit details
    Browse the repository at this point in the history

  2. ✨ Invalidate progress cache

    @damianpumar
    damianpumar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    e9f664b View commit details
    Browse the repository at this point in the history

  3. chore: add missing file

    @jfcalvo
    jfcalvo committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    2a5089c View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feat/add-rq' into feat/add-webhooks-with-background-jobs

    @jfcalvo
    jfcalvo committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    e9d54cf View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Merge branch 'develop' into feat/add-rq

    @jfcalvo
    jfcalvo committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    977f1a3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/add-rq' into feat/add-webhooks-with-background-jobs

    @jfcalvo
    jfcalvo committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    a6a930d View commit details
    Browse the repository at this point in the history

  3. feat: add webhook integration with background jobs

    @jfcalvo
    jfcalvo committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    12471a1 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Merge branch 'develop' into feat/add-webhooks

    @frascuchon
    frascuchon authored Sep 9, 2024
    Configuration menu
    Copy the full SHA
    1acb668 View commit details
    Browse the repository at this point in the history

  2. feat: remove admin as role that can use webhooks API

    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    2be0e13 View commit details
    Browse the repository at this point in the history

  3. feat: use pydantic_v1 package to get HttpUrl class

    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    1645f6a View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feat/add-webhooks' into feat/add-webhooks-with-backgrou… 

    …nd-jobs
    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    c44422d View commit details
    Browse the repository at this point in the history

  5. chore: update CHANGELOG.md

    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    9d17339 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'feat/add-webhooks' into feat/add-webhooks-with-backgrou… 

    …nd-jobs
    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    37c8a5a View commit details
    Browse the repository at this point in the history

  7. feat: add explicit timeout for webhooks notify event function

    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    cbe5823 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'feat/add-webhooks' into feat/add-webhooks-with-backgrou… 

    …nd-jobs
    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    bfb0294 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'feat/add-webhooks-feature-branch' into feat/add-webhook… 

    …s-with-background-jobs
    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    e2f671a View commit details
    Browse the repository at this point in the history

  10. chore: update CHANGELOG.md

    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    f9b2350 View commit details
    Browse the repository at this point in the history

  11. feat: add low queue to RQ

    @jfcalvo
    jfcalvo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    906dc0d View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. feat: move jsonable encoding of data to enqueue_notify_events function

    @jfcalvo
    jfcalvo committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    4a7c185 View commit details
    Browse the repository at this point in the history

  2. feat: add some more example of invalid urls for webhooks

    @jfcalvo
    jfcalvo committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    0e424bb View commit details
    Browse the repository at this point in the history

  3. feat: retry webhooks event notifications jobs when the response statu… 

    …s code is different from 2XX
    @jfcalvo
    jfcalvo committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    9b790e9 View commit details
    Browse the repository at this point in the history

  4. feat: force jobs to return None so we don't polute Redis with useless… 

    … results
    @jfcalvo
    jfcalvo committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    ddc5a9b View commit details
    Browse the repository at this point in the history

  5. feat: use raise_for_status instead of manually checking for not success

    @jfcalvo
    jfcalvo committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    c8cfd75 View commit details
    Browse the repository at this point in the history

  6. feat: add dataset created, updated, deleted and published webhook events

    @jfcalvo
    jfcalvo committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    71f0ffb View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. chore: update CHANGELOG.md

    @jfcalvo
    jfcalvo committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    d876682 View commit details
    Browse the repository at this point in the history

  2. feat: add support for response.upserted webhook events

    @jfcalvo
    jfcalvo committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    3ff2c07 View commit details
    Browse the repository at this point in the history

  3. chore: webhook example code

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    d23894d View commit details
    Browse the repository at this point in the history

  4. add required env variable to avoid worker priviledges errors

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    3a3e278 View commit details
    Browse the repository at this point in the history

  5. fix: Prevent None values for vectors and add dataset_id attribute

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    00a4164 View commit details
    Browse the repository at this point in the history

  6. expose WebhooksAPI in client.api

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    7944148 View commit details
    Browse the repository at this point in the history

  7. add record.completed event

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    5aaf551 View commit details
    Browse the repository at this point in the history

  8. send record event with record responses and suggestions

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    027ba82 View commit details
    Browse the repository at this point in the history

  9. add server notify record event module

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    598bfe6 View commit details
    Browse the repository at this point in the history

  10. prevent errors on None vector, suggestions or responses

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    fbaa728 View commit details
    Browse the repository at this point in the history

  11. Update README.md

    @frascuchon
    frascuchon authored Sep 11, 2024
    Configuration menu
    Copy the full SHA
    962f340 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'feat/add-webhooks-feature-branch' into feat/webhook-exa… 

    …mple-with-record-completed
    @frascuchon
    frascuchon authored Sep 11, 2024
    Configuration menu
    Copy the full SHA
    9a981fc View commit details
    Browse the repository at this point in the history

  13. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    9c735e2 View commit details
    Browse the repository at this point in the history

  14. Remove dockerfile

    @frascuchon
    frascuchon committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    9a50db5 View commit details
    Browse the repository at this point in the history

  15. feat: add expanded events for webhooks

    @jfcalvo
    jfcalvo committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    f1b584b View commit details
    Browse the repository at this point in the history

  16. feat: use awaitable_attrs to don't replace the current state of the r… 

    …esource
    @jfcalvo
    jfcalvo committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    2c56e7a View commit details
    Browse the repository at this point in the history

  17. feat: add missing note comment

    @jfcalvo
    jfcalvo committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    fbf8511 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. feat: add additional resources to Webhooks DatasetEventSchema

    @jfcalvo
    jfcalvo committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e22879e View commit details
    Browse the repository at this point in the history

  2. chore: add comment

    @jfcalvo
    jfcalvo committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    767127c View commit details
    Browse the repository at this point in the history

  3. chore: add comment

    @jfcalvo
    jfcalvo committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    2ee36a6 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Merge branch 'feat/add-webhook-expanded-events' into feat/webhook-exa… 

    …mple-with-record-completed
    @frascuchon
    frascuchon authored Sep 13, 2024
    Configuration menu
    Copy the full SHA
    10c5983 View commit details
    Browse the repository at this point in the history

  2. feat: use database query with selectinload to load resources needed b… 

    …y webhook schema events
    @jfcalvo
    jfcalvo committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    0d352b5 View commit details
    Browse the repository at this point in the history

  3. feat: using a different Redis database for testing

    @jfcalvo
    jfcalvo committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    443d563 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Merge branch 'feat/add-webhook-expanded-events' into feat/webhook-exa… 

    …mple-with-record-completed
    @frascuchon
    frascuchon authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    35dbdc9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/add-webhooks-feature-branch' into feat/webhook-exa… 

    …mple-with-record-completed
    @frascuchon
    frascuchon authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c7874f3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feat/add-webhooks-feature-branch' into feat/webhook-exa… 

    …mple-with-record-completed
    @frascuchon
    frascuchon authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    b5608fb View commit details
    Browse the repository at this point in the history

  4. create record-related events

    @frascuchon
    frascuchon committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    039efce View commit details
    Browse the repository at this point in the history

  5. create record.is_completed method

    @frascuchon
    frascuchon committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    841555a View commit details
    Browse the repository at this point in the history

  6. feat: Notify record events

    @frascuchon
    frascuchon committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    ee3704b View commit details
    Browse the repository at this point in the history

  7. feat: Notify record events

    @frascuchon
    frascuchon committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    3475e21 View commit details
    Browse the repository at this point in the history

  8. chore: Update changelog

    @frascuchon
    frascuchon committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    aaaa214 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'feat/add-record-related-webhook-events' into feat/webho… 

    …ok-example-with-record-completed
    @frascuchon
    frascuchon authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    6ec297d View commit details
    Browse the repository at this point in the history

  10. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    d2ffa45 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'feat/add-webhooks-feature-branch' into feat/webhook-exa… 

    …mple-with-record-completed
    @frascuchon
    frascuchon committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    45cb194 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'feat/add-webhooks-feature-branch' into feat/webhook-exa… 

    …mple-with-record-completed
    @frascuchon
    frascuchon authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    aca87e8 View commit details
    Browse the repository at this point in the history