Code

OpenSearch integration improvements#139

Code

Open

filipecosta90 wants to merge 22 commits intoqdrant:masterqdrant/vector-db-benchmark:masterfrom redis-performance:opensearch.improvementsredis-performance/vector-db-benchmark:opensearch.improvementsCopy head branch name to clipboard

+235-66

Commits

Commits on May 16, 2024

• opensearch improvements

  filipecosta90

  committed
  4964b7b

  Copy full SHA for 4964b7b

• Fixes per PR linter

  filipecosta90

  committed
  fbe689e

  Copy full SHA for fbe689e

• Fixes per ruff linter

  filipecosta90

  committed
  91d3dd0

  Copy full SHA for 91d3dd0

Commits on May 17, 2024

• Increase the vector limit to 16K given the latest docs

  filipecosta90

  committed
  acb11f1

  Copy full SHA for acb11f1

• Removed the dotproduct incompatibility error given opensearch now supports it (supported for Lucene in OpenSearch version 2.13 and later)

  filipecosta90

  committed
  e05c145

  Copy full SHA for e05c145

• Added source for IncompatibilityError on vector size

  filipecosta90

  committed
  c82c5e9

  Copy full SHA for c82c5e9

• Only using basic_auth when we have opensearch login data (this allows for anonymous_auth feature of opensearch)

  filipecosta90

  committed
  d98196d

  Copy full SHA for d98196d

• Only using basic_auth when we have opensearch login data (this allows for anonymous_auth feature of opensearch)

  filipecosta90

  committed
  3fb15b9

  Copy full SHA for 3fb15b9

• Detecting ssl features from url on opensearch client

  filipecosta90

  committed
  0555aa4

  Copy full SHA for 0555aa4

• Fixed OpenSearch connection setup

  filipecosta90

  committed
  fa3eb76

  Copy full SHA for fa3eb76

• Waiting for yellow status at least on opensearch post upload stage

  filipecosta90

  committed
  8ea777a

  Copy full SHA for 8ea777a

• Fixes per PR pre-commit: isort

  filipecosta90

  committed
  aec4967

  Copy full SHA for aec4967

• Fixed forcemerge api usage on opensearch

  filipecosta90

  committed
  e8b5764

  Copy full SHA for e8b5764

• Renamed references to ES

  filipecosta90

  committed
  e500000

  Copy full SHA for e500000

• Added backoff strategy for search_one method on opensearch client

  filipecosta90

  committed
  4f5937a

  Copy full SHA for 4f5937a

• Fixes per PR pre-commit: isort

  filipecosta90

  committed
  f83bc75

  Copy full SHA for f83bc75

• Added backoff strategy for search_one method on opensearch client

  filipecosta90

  committed
  abd8637

  Copy full SHA for abd8637

Commits on May 19, 2024

• Improved index and search performance based uppon docs recommendation

  filipecosta90

  committed
  ae5b620

  Copy full SHA for ae5b620

• Collecting index stats at end of ingestion

  filipecosta90

  committed
  5679a19

  Copy full SHA for 5679a19

• Using backoff on opensearch ingestion

  filipecosta90

  committed
  276892c

  Copy full SHA for 276892c

Commits on May 20, 2024

• Included single shard experiment for opensearch. Added backoff to post upload stage

  filipecosta90

  committed
  2c54762

  Copy full SHA for 2c54762

• Fixes per PR pre-commit: isort

  filipecosta90

  committed
  7292e92

  Copy full SHA for 7292e92