Skip to content

v0.16.1

Latest
Compare
Choose a tag to compare
@github-actions github-actions released this 12 Dec 15:09
· 19 commits to main since this release

Changed

  • pw.io.s3.read now monitors object deletions and modifications in the S3 source, when ran in streaming mode. When an object is deleted in S3, it is also removed from the engine. Similarly, if an object is modified in S3, the engine updates its state to reflect those changes.
  • pw.io.s3.read now supports with_metadata flag, which makes it possible to attach the metadata of the source object to the table entries.

Fixed

  • pw.xpacks.llm.document_store.DocumentStore no longer requires _metadata column in the input table.