Make kafka output store offset for successfully delivered events#516

Draft

ppcad wants to merge 9 commits intomainfrom dev-ensure-kafka-input-offsets

+597-47

Commits on Feb 1, 2024

Make kafka output store offset for successfully delivered events
ppcad
committed

Commits on Feb 23, 2024

Add metadata preprocessor and make kafka set/use metadata for offsets
ppcad
committed

Commits on Feb 26, 2024

Commits on Jun 21, 2024

Add fixes, more tests and add scheduled flush to kafka output
ppcad
committed