Shanbady/qdrant docs

[shanbady]

What are the relevant tickets?

Closes https://github.com/mitodl/hq/issues/6352

Description (What does it do?)

This PR consolidates some useful information (scattered through existing PRs) regarding embeddings.

How can this be tested?

Give it a read through. Note if there are mistakes or if anything needs clarity.

[ChristopherChudzicki]

👍 Docs look good.

Question: Reading "Embeddings are automatically generated for new conetnt by a periodic celery task." made me look at the code a little, where I saw:

@app.task(bind=True)
def embed_new_learning_resources(self):
    # ...
    new_learning_resources = LearningResource.objects.filter(
        published=True,
        created_on__gt=since,
    ).exclude(resource_type=CONTENT_FILE_TYPE)

Do we need to update the embeddings when resources are updated? (not created)

[shanbady]

👍 Docs look good.

Question: Reading "Embeddings are automatically generated for new conetnt by a periodic celery task." made me look at the code a little, where I saw:

@app.task(bind=True)
def embed_new_learning_resources(self):
    # ...
    new_learning_resources = LearningResource.objects.filter(
        published=True,
        created_on__gt=since,
    ).exclude(resource_type=CONTENT_FILE_TYPE)

Do we need to update the embeddings when resources are updated? (not created)

We will. There is still some work left around detecting both contentfile and resource embedding changes so it will probably get covered there.