Code

snowpipe: exactly once semantics#3060

Code

Open

rockwotj wants to merge 29 commits intomainredpanda-data/connect:mainfrom snow-onceredpanda-data/connect:snow-onceCopy head branch name to clipboard

+1,715-458

Commits

Commits on Dec 17, 2024

• snowflake: add a test about reopening a channel invalidates old channels

  rockwotj

  committed
  71533b7

• snowpipe: add lint rules for build options

  rockwotj

  committed
  b2f95a2

• snowpipe: rename capped package to pool

  rockwotj

  committed
  3d603fb

• snowpipe: add indexed pool utility

  rockwotj

  committed
  c9b765e

• snowpipe: plumb offset_token around in snowpipe streaming api

  Show description for ba903e8
  rockwotj

  committed
  ba903e8

• snowpipe: support exactly once

  Show description for 4f5e401
  rockwotj

  committed
  4f5e401

• snowpipe: extract out schema evolution to seperate struct

  Show description for 781a8a0
  rockwotj

  committed
  781a8a0

• snowpipe: fix linter errors

  rockwotj

  committed
  4f07d36

• snowpipe: update docs

  rockwotj

  committed
  0aca1f4

• snowpipe: cleanup integration test

  rockwotj

  committed
  7681b5f

• snowpipe: fix pool tests

  rockwotj

  committed
  b0730d6

• snowpipe: extract exactly once processing

  Show description for 6efde47
  rockwotj

  committed
  6efde47

• snowpipe: move schema migration locking to one place

  Show description for 2c2566d
  rockwotj

  committed
  2c2566d

• snowpipe: extract metrics to another file

  rockwotj

  committed
  ebec700

• snowpipe: split snowpipe output responsibility

  Show description for 3cb41a4
  rockwotj

  committed
  3cb41a4

• snowpipe: do some basic normalization for table names

  Show description for 2bf1822
  rockwotj

  committed
  2bf1822

• snowpipe: support explicitly specifying the channel name

  Show description for cb164ea
  rockwotj

  committed
  cb164ea

• snowflake: move id generation into pool

  Show description for 99aeb62
  rockwotj

  committed
  99aeb62

• chore: fmt

  rockwotj

  committed
  07841e1

• snowpipe: prevent races with Close/Connect

  Show description for be70504
  rockwotj

  committed
  be70504

• snowpipe: fix cleanup

  rockwotj

  committed
  cbe3f8a

• snowflake: clarify docs

  rockwotj

  committed
  e5548c7

• snowflake: add some totally wicked examples

  rockwotj

  committed
  b62051e

• snowpipe: remove application query param which does nothing

  rockwotj

  committed
  ec62d88

• snowpipe: add metadata for SNOWPIPE_STREAMING_CLIENT_HISTORY

  Show description for 790ab20
  rockwotj

  committed
  790ab20

• snowpipe: support interpolated tables

  rockwotj

  committed
  afe38a5

• update changelog

  rockwotj

  committed
  af10166

• snowpipe: fix table creation for dynamic tables

  rockwotj

  committed
  b212668

Commits on Dec 18, 2024

• snowpipe: remove SQL query from startup

  Show description for 98b547f
  rockwotj

  committed
  98b547f