Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Connector capability matrix

Sinks

SinkExactly-once (atomic watermark)Upsert / deleteSchema evolution
bigquery✓✓✓
elasticsearch✓✓
iceberg✓✓
kafka✓
mongodb✓✓
mssql✓✓✓
mysql✓✓✓
postgres✓✓✓
redis✓
snowflake✓
spanner✓✓✓
sqlite✓✓✓

Sources

SourceExactly-once replayDataset discovery
bigquery✓
elasticsearch✓
gcs✓
kafka✓
mongodb✓
mongodb-cdc✓
mssql✓
mssql-cdc✓
mysql✓
mysql-cdc✓
postgres✓
postgres-cdc✓
s3✓
snowflake✓
spanner✓
sqlite✓

Exactly-once delivery (source × sink)

A delivery: exactly_once pipeline needs a replayable source and an atomic-watermark sink. Every ✓ pair below composes; any other pairing must use the keyed-upsert alternative (write_mode: upsert + key).

source ↓ / sink →bigqueryicebergkafkamongodbmssqlmysqlpostgresredissnowflakespannersqlite
kafka✓✓✓✓✓✓✓✓✓✓✓
mongodb-cdc✓✓✓✓✓✓✓✓✓✓✓
mssql-cdc✓✓✓✓✓✓✓✓✓✓✓
mysql-cdc✓✓✓✓✓✓✓✓✓✓✓
postgres-cdc✓✓✓✓✓✓✓✓✓✓✓