[Enhancement] Remove multiple vectors references during flush #2207
Labels
Enhancements
Increases software capabilities beyond original client specifications
good first issue
Good for newcomers
v2.19.0
Description
With upgrade to Lucene 9.12, Lucene started exposing the FlatVectorsFormat as KnnVectorsFormat. With this FlatFieldVectorsWriter now exposes
DocsWithFieldSet
andvectors
which are added in the FlatFieldVectorsWriter during flush.Now NativeEngineFieldVectorsWriter and FlatFieldVectorsWriter stores the same reference of vectors and docIds, which is not required. We can completely get rid of reference of vectors and docIds from
NativeEngineFieldVectorsWriter
and just useFlatFieldVectorsWriter
during flush. This will simplify the code and will also free up some resources from heap.The text was updated successfully, but these errors were encountered: