Skip to content

[FEATURE] Quarantine transformation #35

@mikita-sakalouski

Description

@mikita-sakalouski

Is your feature request related to a problem? Please describe.

Quarantine transformation can be used to split your incoming data based on custom logic and write "bad" part to different table, while propagating good part to the next koheesio Step.

Describe the solution you'd like

Should be pretty simple, but customizable pyspark transformation with splitting logic.

Describe alternatives you've considered

We should Delta Live Tables feature for the same issue, which is providing more functionality (metrics, stats and etc.)

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

Status

No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions