Changelog
What's new in faucet-stream
One entry per release, across the faucet CLI and every crate. Each crate
versions independently; the chips show which ones moved and to what.
- faucet-cli 1.12.0 and 6 more crates
Features
- faucet-cli 1.11.0 and 91 more crates
Features
- Meltano-migration connector gaps — REST pagination/records, graphql/sql/auth/transform features, overwrite fan-out fix (#547–#558) #563
- Config-driven parity — REST headers/async-url, XML decode/paging, flow-auth sign/capture (#539–#544) #545
- Rest partitions fan-out + repeated query params, cross_join transform, ClickHouse staged load (#535/#536/#534/#528) #537
- Datetime window slicing, tree_flatten, staged-load foundation, persistent run logs, chained discovery (#527–#531) #532
- transforms Inbuilt reshape transforms — json_encode, unpivot, lookup #520
- source-rest Add response_format json|csv|excel for authed file bodies #508
- MTLS, ES overwrite, OAuth1, and completeness reconciliation #506
- Response-decode + async-job (rest), scoped overwrite, run/lineage metadata columns #526
- source Composable auth flows, OData mode + $metadata discovery, server-side incremental push-down #524
- rest, auth Enterprise HTTP auth & POST-search pagination gaps #505
- sinks Add write_mode: overwrite (full-refresh) across data-storage sinks #493
- cli Discovery-driven request matrix (discover + for_each cross-product) #509
Fixes
- transforms Drop dangling transform-unpivot cfg from CdcUnwrap match arms #522
92 crates released
faucet-auth 1.1.0faucet-cli 1.11.0faucet-common-azure 1.0.5faucet-common-bigquery 1.0.11faucet-common-clickhouse 1.0.5faucet-common-delta 1.0.6faucet-common-elasticsearch 1.0.11faucet-common-gcs 1.0.11faucet-common-kafka 1.0.11faucet-common-kinesis 1.0.6faucet-common-mssql 1.0.12faucet-common-nats 1.0.5faucet-common-pubsub 1.0.5faucet-common-redshift 1.0.5faucet-common-sftp 1.0.5faucet-common-snowflake 1.0.11faucet-common-spanner 1.0.6faucet-common-sqs 1.0.5faucet-conformance 1.3.3faucet-core 1.11.0faucet-lineage 2.1.0faucet-sink-azure-blob 1.0.5faucet-sink-bigquery 1.6.0faucet-sink-clickhouse 1.1.0faucet-sink-csv 1.2.1faucet-sink-delta 1.1.5faucet-sink-duckdb 1.0.5faucet-sink-elasticsearch 1.5.0faucet-sink-gcs 1.3.1faucet-sink-http 1.3.1faucet-sink-iceberg 1.4.0faucet-sink-jsonl 1.3.6faucet-sink-kafka 1.4.1faucet-sink-kinesis 1.0.6faucet-sink-mongodb 1.6.0faucet-sink-mssql 1.5.0faucet-sink-mysql 1.7.0faucet-sink-nats 1.0.5faucet-sink-parquet 1.2.1faucet-sink-postgres 1.7.0faucet-sink-pubsub 1.0.5faucet-sink-redis 1.3.1faucet-sink-redshift 1.1.0faucet-sink-s3 1.4.1faucet-sink-sftp 1.0.5faucet-sink-snowflake 1.5.0faucet-sink-spanner 1.1.2faucet-sink-sqlite 1.7.0faucet-sink-sqs 1.0.5faucet-sink-stdout 1.3.1faucet-source-azure-blob 1.0.5faucet-source-bigquery 1.4.3faucet-source-clickhouse 1.0.5faucet-source-csv 1.4.1faucet-source-databricks 1.1.5faucet-source-delta 1.1.5faucet-source-duckdb 1.1.1faucet-source-elasticsearch 1.4.1faucet-source-gcs 1.6.1faucet-source-graphql 1.4.0faucet-source-grpc 1.3.1faucet-source-kafka 1.3.7faucet-source-kinesis 1.0.6faucet-source-mongodb 1.5.1faucet-source-mongodb-cdc 1.2.7faucet-source-mssql 1.4.3faucet-source-mssql-cdc 1.0.5faucet-source-mysql 1.6.1faucet-source-mysql-cdc 1.2.7faucet-source-nats 1.0.5faucet-source-parquet 1.3.1faucet-source-postgres 1.7.1faucet-source-postgres-cdc 1.3.7faucet-source-pubsub 1.0.5faucet-source-redis 1.3.1faucet-source-redshift 1.0.5faucet-source-rest 1.5.0faucet-source-s3 1.8.1faucet-source-sftp 1.1.1faucet-source-singer 1.1.6faucet-source-snowflake 1.3.3faucet-source-spanner 1.1.3faucet-source-sqlite 1.6.1faucet-source-sqs 1.0.5faucet-source-webhook 1.1.10faucet-source-websocket 1.1.10faucet-source-xml 1.5.0faucet-state-postgres 1.2.6faucet-state-redis 1.0.12faucet-stream 1.8.0faucet-transform-sql 1.2.0faucet-transform-wasm 1.0.5 - faucet-cli 1.10.0 and 91 more crates
Features
92 crates released
faucet-auth 1.0.10faucet-cli 1.10.0faucet-common-azure 1.0.4faucet-common-bigquery 1.0.10faucet-common-clickhouse 1.0.4faucet-common-delta 1.0.5faucet-common-elasticsearch 1.0.10faucet-common-gcs 1.0.10faucet-common-kafka 1.0.10faucet-common-kinesis 1.0.5faucet-common-mssql 1.0.11faucet-common-nats 1.0.4faucet-common-pubsub 1.0.4faucet-common-redshift 1.0.4faucet-common-sftp 1.0.4faucet-common-snowflake 1.0.10faucet-common-spanner 1.0.5faucet-common-sqs 1.0.4faucet-conformance 1.3.2faucet-core 1.10.0faucet-lineage 2.0.2faucet-sink-azure-blob 1.0.4faucet-sink-bigquery 1.5.1faucet-sink-clickhouse 1.0.4faucet-sink-csv 1.2.0faucet-sink-delta 1.1.4faucet-sink-duckdb 1.0.4faucet-sink-elasticsearch 1.4.1faucet-sink-gcs 1.3.0faucet-sink-http 1.3.0faucet-sink-iceberg 1.3.4faucet-sink-jsonl 1.3.5faucet-sink-kafka 1.4.0faucet-sink-kinesis 1.0.5faucet-sink-mongodb 1.5.0faucet-sink-mssql 1.4.1faucet-sink-mysql 1.6.0faucet-sink-nats 1.0.4faucet-sink-parquet 1.2.0faucet-sink-postgres 1.6.0faucet-sink-pubsub 1.0.4faucet-sink-redis 1.3.0faucet-sink-redshift 1.0.4faucet-sink-s3 1.4.0faucet-sink-sftp 1.0.4faucet-sink-snowflake 1.4.0faucet-sink-spanner 1.1.1faucet-sink-sqlite 1.6.0faucet-sink-sqs 1.0.4faucet-sink-stdout 1.3.0faucet-source-azure-blob 1.0.4faucet-source-bigquery 1.4.2faucet-source-clickhouse 1.0.4faucet-source-csv 1.4.0faucet-source-databricks 1.1.4faucet-source-delta 1.1.4faucet-source-duckdb 1.1.0faucet-source-elasticsearch 1.4.0faucet-source-gcs 1.6.0faucet-source-graphql 1.3.0faucet-source-grpc 1.3.0faucet-source-kafka 1.3.6faucet-source-kinesis 1.0.5faucet-source-mongodb 1.5.0faucet-source-mongodb-cdc 1.2.6faucet-source-mssql 1.4.2faucet-source-mssql-cdc 1.0.4faucet-source-mysql 1.6.0faucet-source-mysql-cdc 1.2.6faucet-source-nats 1.0.4faucet-source-parquet 1.3.0faucet-source-postgres 1.7.0faucet-source-postgres-cdc 1.3.6faucet-source-pubsub 1.0.4faucet-source-redis 1.3.0faucet-source-redshift 1.0.4faucet-source-rest 1.4.4faucet-source-s3 1.8.0faucet-source-sftp 1.1.0faucet-source-singer 1.1.5faucet-source-snowflake 1.3.2faucet-source-spanner 1.1.2faucet-source-sqlite 1.6.0faucet-source-sqs 1.0.4faucet-source-webhook 1.1.9faucet-source-websocket 1.1.9faucet-source-xml 1.4.0faucet-state-postgres 1.2.5faucet-state-redis 1.0.11faucet-stream 1.7.5faucet-transform-sql 1.1.4faucet-transform-wasm 1.0.4 - faucet-cli 1.9.0 and 91 more crates
Features
Testing
- sinks Integration coverage for the scoped-cleanup delete paths #488
92 crates released
faucet-auth 1.0.9faucet-cli 1.9.0faucet-common-azure 1.0.3faucet-common-bigquery 1.0.9faucet-common-clickhouse 1.0.3faucet-common-delta 1.0.4faucet-common-elasticsearch 1.0.9faucet-common-gcs 1.0.9faucet-common-kafka 1.0.9faucet-common-kinesis 1.0.4faucet-common-mssql 1.0.10faucet-common-nats 1.0.3faucet-common-pubsub 1.0.3faucet-common-redshift 1.0.3faucet-common-sftp 1.0.3faucet-common-snowflake 1.0.9faucet-common-spanner 1.0.4faucet-common-sqs 1.0.3faucet-conformance 1.3.1faucet-core 1.9.0faucet-lineage 2.0.1faucet-sink-azure-blob 1.0.3faucet-sink-bigquery 1.5.0faucet-sink-clickhouse 1.0.3faucet-sink-csv 1.1.8faucet-sink-delta 1.1.3faucet-sink-duckdb 1.0.3faucet-sink-elasticsearch 1.4.0faucet-sink-gcs 1.2.4faucet-sink-http 1.2.5faucet-sink-iceberg 1.3.3faucet-sink-jsonl 1.3.4faucet-sink-kafka 1.3.5faucet-sink-kinesis 1.0.4faucet-sink-mongodb 1.4.0faucet-sink-mssql 1.4.0faucet-sink-mysql 1.5.0faucet-sink-nats 1.0.3faucet-sink-parquet 1.1.8faucet-sink-postgres 1.5.0faucet-sink-pubsub 1.0.3faucet-sink-redis 1.2.5faucet-sink-redshift 1.0.3faucet-sink-s3 1.3.4faucet-sink-sftp 1.0.3faucet-sink-snowflake 1.3.3faucet-sink-spanner 1.1.0faucet-sink-sqlite 1.5.0faucet-sink-sqs 1.0.3faucet-sink-stdout 1.2.3faucet-source-azure-blob 1.0.3faucet-source-bigquery 1.4.1faucet-source-clickhouse 1.0.3faucet-source-csv 1.3.4faucet-source-databricks 1.1.3faucet-source-delta 1.1.3faucet-source-duckdb 1.0.3faucet-source-elasticsearch 1.3.1faucet-source-gcs 1.5.1faucet-source-graphql 1.2.7faucet-source-grpc 1.2.5faucet-source-kafka 1.3.5faucet-source-kinesis 1.0.4faucet-source-mongodb 1.4.1faucet-source-mongodb-cdc 1.2.5faucet-source-mssql 1.4.1faucet-source-mssql-cdc 1.0.3faucet-source-mysql 1.5.1faucet-source-mysql-cdc 1.2.5faucet-source-nats 1.0.3faucet-source-parquet 1.2.6faucet-source-postgres 1.6.1faucet-source-postgres-cdc 1.3.5faucet-source-pubsub 1.0.3faucet-source-redis 1.2.5faucet-source-redshift 1.0.3faucet-source-rest 1.4.3faucet-source-s3 1.7.1faucet-source-sftp 1.0.3faucet-source-singer 1.1.4faucet-source-snowflake 1.3.1faucet-source-spanner 1.1.1faucet-source-sqlite 1.5.1faucet-source-sqs 1.0.3faucet-source-webhook 1.1.8faucet-source-websocket 1.1.8faucet-source-xml 1.3.1faucet-state-postgres 1.2.4faucet-state-redis 1.0.10faucet-stream 1.7.4faucet-transform-sql 1.1.3faucet-transform-wasm 1.0.3 - faucet-cli 1.8.1 and 15 more crates
Features
- conformance Add discover-roundtrip and cancellation-flush integration checks #472
16 crates released
faucet-cli 1.8.1faucet-conformance 1.3.0faucet-sink-gcs 1.2.3faucet-sink-s3 1.3.3faucet-source-bigquery 1.4.0faucet-source-elasticsearch 1.3.0faucet-source-gcs 1.5.0faucet-source-mongodb 1.4.0faucet-source-mssql 1.4.0faucet-source-mysql 1.5.0faucet-source-postgres 1.6.0faucet-source-s3 1.7.0faucet-source-snowflake 1.3.0faucet-source-spanner 1.1.0faucet-source-sqlite 1.5.0faucet-stream 1.7.3 - faucet-cli 1.8.0 and 91 more crates
Features
- conformance, xml Registry-allowlist parity + capability matrix (#465), soap: ergonomics block (#468) #469
- topology Exactly-once delivery + per-node SLA/notify/lineage/catalog #464
- templates Release lifecycle (launch/rollback/deprecate) + console versions page #455
- serve Pipeline template registry + parameterized trigger API #452
Fixes
- Resolve the fourth hardening audit — topology governance bypass, SQS at-most-once, control-plane secret leaks (#456) #457
- Second-pass audit — wide-integer corruption in the Arrow/SQL shim and SQL binds, backfill DST windows (#460, #461, #462) #463
- Resolve third-pass audit findings (contract DLQ index, GraphQL cycle guard, redshift null-row, spanner NUMERIC cursor) #467
Testing
- conformance Adopt the new capability checks across all connectors #470
92 crates released
faucet-auth 1.0.8faucet-cli 1.8.0faucet-common-azure 1.0.2faucet-common-bigquery 1.0.8faucet-common-clickhouse 1.0.2faucet-common-delta 1.0.3faucet-common-elasticsearch 1.0.8faucet-common-gcs 1.0.8faucet-common-kafka 1.0.8faucet-common-kinesis 1.0.3faucet-common-mssql 1.0.9faucet-common-nats 1.0.2faucet-common-pubsub 1.0.2faucet-common-redshift 1.0.2faucet-common-sftp 1.0.2faucet-common-snowflake 1.0.8faucet-common-spanner 1.0.3faucet-common-sqs 1.0.2faucet-conformance 1.2.0faucet-core 1.8.0faucet-lineage 2.0.0faucet-sink-azure-blob 1.0.2faucet-sink-bigquery 1.4.2faucet-sink-clickhouse 1.0.2faucet-sink-csv 1.1.7faucet-sink-delta 1.1.2faucet-sink-duckdb 1.0.2faucet-sink-elasticsearch 1.3.4faucet-sink-gcs 1.2.2faucet-sink-http 1.2.4faucet-sink-iceberg 1.3.2faucet-sink-jsonl 1.3.3faucet-sink-kafka 1.3.4faucet-sink-kinesis 1.0.3faucet-sink-mongodb 1.3.3faucet-sink-mssql 1.3.4faucet-sink-mysql 1.4.3faucet-sink-nats 1.0.2faucet-sink-parquet 1.1.7faucet-sink-postgres 1.4.3faucet-sink-pubsub 1.0.2faucet-sink-redis 1.2.4faucet-sink-redshift 1.0.2faucet-sink-s3 1.3.2faucet-sink-sftp 1.0.2faucet-sink-snowflake 1.3.2faucet-sink-spanner 1.0.3faucet-sink-sqlite 1.4.3faucet-sink-sqs 1.0.2faucet-sink-stdout 1.2.2faucet-source-azure-blob 1.0.2faucet-source-bigquery 1.3.2faucet-source-clickhouse 1.0.2faucet-source-csv 1.3.3faucet-source-databricks 1.1.2faucet-source-delta 1.1.2faucet-source-duckdb 1.0.2faucet-source-elasticsearch 1.2.3faucet-source-gcs 1.4.2faucet-source-graphql 1.2.6faucet-source-grpc 1.2.4faucet-source-kafka 1.3.4faucet-source-kinesis 1.0.3faucet-source-mongodb 1.3.3faucet-source-mongodb-cdc 1.2.4faucet-source-mssql 1.3.3faucet-source-mssql-cdc 1.0.2faucet-source-mysql 1.4.3faucet-source-mysql-cdc 1.2.4faucet-source-nats 1.0.2faucet-source-parquet 1.2.5faucet-source-postgres 1.5.3faucet-source-postgres-cdc 1.3.4faucet-source-pubsub 1.0.2faucet-source-redis 1.2.4faucet-source-redshift 1.0.2faucet-source-rest 1.4.2faucet-source-s3 1.6.2faucet-source-sftp 1.0.2faucet-source-singer 1.1.3faucet-source-snowflake 1.2.3faucet-source-spanner 1.0.3faucet-source-sqlite 1.4.3faucet-source-sqs 1.0.2faucet-source-webhook 1.1.7faucet-source-websocket 1.1.7faucet-source-xml 1.3.0faucet-state-postgres 1.2.3faucet-state-redis 1.0.9faucet-stream 1.7.2faucet-transform-sql 1.1.2faucet-transform-wasm 1.0.2 -
Other
- Cargo:
cargo install faucet-cli - Docker:
docker pull ghcr.io/faucet-hq/faucet-stream:1.7.1 - Helm:
helm install faucet oci://ghcr.io/faucet-hq/charts/faucet-stream --version 1.7.1
1 crate released
- Cargo:
-
Features
- deploy Dockerfile + Helm chart for container/Kubernetes deployment #439
1 crate released
- faucet-cli 1.7.0 and 17 more crates
Features
- transform-wasm Add WebAssembly (wasmtime) per-record transform (#124) #426
- transforms [breaking] Hash / json_parse / coalesce / split / join, value_case title+capitalize, keys_case dot, stdout csv (#403–#409) — faucet-core 2.0.0 #418
- connectors Add DuckDB, SQS, NATS, SFTP connector pairs + Airtable REST recipe
- Initial release: AWS SQS source — long-polls
ReceiveMessage, buffers to - Initial release: SFTP source connector — lists a remote directory (or reads a
- Initial release: NATS source — subscribes to a subject (core NATS with
- Initial release: DuckDB query source — opens a DuckDB file or in-memory
- Initial release: AWS SQS sink — batched
SendMessageBatchwrites (≤10 entries - Initial release: SFTP sink connector — writes records to an SFTP server as
- Initial release: NATS sink — publishes each record as a JSON message to a
- iceberg Additive schema evolution via iceberg-rust 0.10.0 (#255); fix(cli): run summary → stderr (#424) #425
- Initial release: DuckDB sink — writes JSON records to a DuckDB table via a
- cli Topology mode — fan-out (tee), fan-in (merge), and cross-source join (#71, #72) #421
- Initial release: shared
SqsCredentialsauth enum +build_clienthelper for - Initial release: shared SFTP connection config (
SftpConnectionConfig, - Initial release: shared NATS configuration types for the source and sink
- cli MCP server — agent-operable control plane (#420) #422
Fixes
- Keep transform additions a minor release — pin touched crates to 1.x
Documentation
- Single source of truth for connector/crate counts
- gtm Elevate Singer on-ramp, fix conformance + connector-count drift
- readme Keep downloads badge link on faucet-stream
- readme Point downloads badge at faucet-core
Testing
- conformance Wire the battery into delta/clickhouse/pubsub/azure-blob; fix databricks tier (#396, #397)
- cli Whitelist SFTP_PASSWORD + AIRTABLE_* env for example-validate test
18 crates released
faucet-cli 1.7.0faucet-common-nats 1.0.0faucet-common-sftp 1.0.0faucet-common-sqs 1.0.0faucet-core 1.7.0faucet-sink-duckdb 1.0.0faucet-sink-iceberg 1.3.0faucet-sink-nats 1.0.0faucet-sink-sftp 1.0.0faucet-sink-sqs 1.0.0faucet-sink-stdout 1.2.0faucet-source-duckdb 1.0.0faucet-source-nats 1.0.0faucet-source-rest 1.4.0faucet-source-sftp 1.0.0faucet-source-sqs 1.0.0faucet-stream 1.6.0faucet-transform-wasm 1.0.0 - faucet-cli 1.6.0 and 43 more crates
Features
- Live
runprogress + Arrow BigQuery & Snowflake paths (#385, #380, #381) #395 - Arrow columnar path for S3, GCS, and Databricks — RFC 0002 Phase 4 (#375) #382
- cli Config-change preview —
faucet plan --diff(#374) #378 - connectors Redshift, Pub/Sub, ClickHouse, Azure Blob, and SQL Server CDC #362
- cli Tier-3 commands — fmt, explain, history, run --output json (#387,#389,#390,#391) #394
- cli
faucet migrate+doctor --offlineconfig linter (#388, #392) #393 - cli Shell tab-completion —
faucet completions+ dynamic (registry/config-aware) completion (#383) #384 - cli Runtime matrix-row selection model (#370, #371, #376, #377) #379
- cli Surface connector conformance maturity tiers (#330) #367
Documentation
- Architecture-review follow-ups — ADRs, SDK streaming docs, build_pipeline refactor, Arrow benchmark (#324) #373
- WS-11 — Airflow/Dagster+dbt orchestration recipe & evergreen posts (#314) #361
- Reconcile counts, annotate benchmark, per-page SEO (closes #335, #336, #337) #339
- Upgrade Mermaid diagrams to V2 role-coded style #340
- Brand all GitHub-viewed Mermaid diagrams with the faucet teal theme #338
- Brand the docs site with the faucet-stream teal (#14B8A6) #332
- Architecture learning path, interactive docs site, platform/governance repositioning (+ release-plz retry fix) #326
44 crates released
faucet-cli 1.6.0faucet-sink-azure-blob 1.0.0faucet-sink-bigquery 1.4.0faucet-sink-clickhouse 1.0.0faucet-sink-csv 1.1.5faucet-sink-delta 1.1.0faucet-sink-elasticsearch 1.3.2faucet-sink-gcs 1.2.0faucet-sink-http 1.2.2faucet-sink-iceberg 1.2.2faucet-sink-jsonl 1.3.1faucet-sink-kafka 1.3.2faucet-sink-kinesis 1.0.1faucet-sink-mongodb 1.3.1faucet-sink-mssql 1.3.2faucet-sink-mysql 1.4.1faucet-sink-parquet 1.1.5faucet-sink-postgres 1.4.1faucet-sink-pubsub 1.0.0faucet-sink-redis 1.2.2faucet-sink-redshift 1.0.0faucet-sink-s3 1.3.0faucet-sink-snowflake 1.3.0faucet-sink-spanner 1.0.1faucet-sink-sqlite 1.4.1faucet-sink-stdout 1.1.5faucet-source-azure-blob 1.0.0faucet-source-bigquery 1.3.0faucet-source-clickhouse 1.0.0faucet-source-csv 1.3.1faucet-source-databricks 1.1.0faucet-source-delta 1.1.0faucet-source-elasticsearch 1.2.1faucet-source-parquet 1.2.3faucet-source-postgres-cdc 1.3.2faucet-source-redis 1.2.2faucet-source-snowflake 1.2.1faucet-source-spanner 1.0.1faucet-source-sqlite 1.4.1faucet-source-webhook 1.1.5faucet-source-websocket 1.1.5faucet-state-postgres 1.2.1faucet-state-redis 1.0.7faucet-stream 1.5.0 - Live
- faucet-core 1.6.0 and 35 more crates
Features
Fixes
- ci Unblock main — ignore heavy mssql-cdc Docker tests, un-ignore tracked CI scripts #368
Documentation
36 crates released
faucet-auth 1.0.6faucet-common-azure 1.0.0faucet-common-bigquery 1.0.6faucet-common-clickhouse 1.0.0faucet-common-delta 1.0.1faucet-common-elasticsearch 1.0.6faucet-common-gcs 1.0.6faucet-common-kafka 1.0.6faucet-common-kinesis 1.0.1faucet-common-mssql 1.0.7faucet-common-pubsub 1.0.0faucet-common-redshift 1.0.0faucet-common-snowflake 1.0.6faucet-common-spanner 1.0.1faucet-conformance 1.1.1faucet-core 1.6.0faucet-lineage 1.2.2faucet-source-gcs 1.4.0faucet-source-graphql 1.2.4faucet-source-grpc 1.2.2faucet-source-kafka 1.3.2faucet-source-kinesis 1.0.1faucet-source-mongodb 1.3.1faucet-source-mongodb-cdc 1.2.2faucet-source-mssql 1.3.1faucet-source-mssql-cdc 1.0.0faucet-source-mysql 1.4.1faucet-source-mysql-cdc 1.2.2faucet-source-postgres 1.5.1faucet-source-pubsub 1.0.0faucet-source-redshift 1.0.0faucet-source-rest 1.3.1faucet-source-s3 1.6.0faucet-source-singer 1.1.1faucet-source-xml 1.2.4faucet-transform-sql 1.1.0 - faucet-stream 1.4.0 and 65 more crates
Features
- databricks Databricks SQL query source via Statement Execution API #320
- delta Apache Delta Lake source + sink via delta-rs #319
- Encryption at rest for state/DLQ + live TUI for faucet run #315
- Google Cloud Spanner source + sink connectors #312
- Connector conformance battery + tiers, FCP spec, sink-bound benchmark, sink config fixes #307
- cli Plugin loading, schema config, connector scaffolding + registry, plan/dev, hot reload #306
- AWS Kinesis source + sink connectors and shipped Grafana dashboards / Prometheus alerts
- Faucet discover (live source introspection) + faucet backfill (resumable historical replay)
- sink-postgres COPY bulk-load fast-path (write_method: copy) #313
Fixes
Testing
66 crates released
faucet-auth 1.0.5faucet-common-bigquery 1.0.5faucet-common-delta 1.0.0faucet-common-elasticsearch 1.0.5faucet-common-gcs 1.0.5faucet-common-kafka 1.0.5faucet-common-kinesis 1.0.0faucet-common-mssql 1.0.6faucet-common-snowflake 1.0.5faucet-common-spanner 1.0.0faucet-conformance 1.1.0faucet-core 1.5.0faucet-lineage 1.2.1faucet-sink-bigquery 1.3.1faucet-sink-csv 1.1.4faucet-sink-delta 1.0.0faucet-sink-elasticsearch 1.3.1faucet-sink-gcs 1.1.4faucet-sink-http 1.2.1faucet-sink-iceberg 1.2.1faucet-sink-jsonl 1.3.0faucet-sink-kafka 1.3.1faucet-sink-kinesis 1.0.0faucet-sink-mongodb 1.3.0faucet-sink-mssql 1.3.1faucet-sink-mysql 1.4.0faucet-sink-parquet 1.1.4faucet-sink-postgres 1.4.0faucet-sink-redis 1.2.1faucet-sink-s3 1.2.1faucet-sink-snowflake 1.2.1faucet-sink-spanner 1.0.0faucet-sink-sqlite 1.4.0faucet-sink-stdout 1.1.4faucet-source-bigquery 1.2.0faucet-source-csv 1.3.0faucet-source-databricks 1.0.0faucet-source-delta 1.0.0faucet-source-elasticsearch 1.2.0faucet-source-gcs 1.3.0faucet-source-graphql 1.2.3faucet-source-grpc 1.2.1faucet-source-kafka 1.3.1faucet-source-kinesis 1.0.0faucet-source-mongodb 1.3.0faucet-source-mongodb-cdc 1.2.1faucet-source-mssql 1.3.0faucet-source-mysql 1.4.0faucet-source-mysql-cdc 1.2.1faucet-source-parquet 1.2.2faucet-source-postgres 1.5.0faucet-source-postgres-cdc 1.3.1faucet-source-redis 1.2.1faucet-source-rest 1.3.0faucet-source-s3 1.5.0faucet-source-singer 1.1.0faucet-source-snowflake 1.2.0faucet-source-spanner 1.0.0faucet-source-sqlite 1.4.0faucet-source-webhook 1.1.4faucet-source-websocket 1.1.4faucet-source-xml 1.2.3faucet-state-postgres 1.2.0faucet-state-redis 1.0.6faucet-stream 1.4.0faucet-transform-sql 1.0.4 - faucet-cli 1.4.0 and 56 more crates
Features
Miscellaneous
- dist Homebrew tap homebrew-faucet-stream, formula faucet-cli #295
57 crates released
faucet-auth 1.0.4faucet-cli 1.4.0faucet-common-bigquery 1.0.4faucet-common-elasticsearch 1.0.4faucet-common-gcs 1.0.4faucet-common-kafka 1.0.4faucet-common-mssql 1.0.5faucet-common-snowflake 1.0.4faucet-conformance 1.0.0faucet-core 1.4.0faucet-lineage 1.2.0faucet-sink-bigquery 1.3.0faucet-sink-csv 1.1.3faucet-sink-elasticsearch 1.3.0faucet-sink-gcs 1.1.3faucet-sink-http 1.2.0faucet-sink-iceberg 1.2.0faucet-sink-jsonl 1.2.0faucet-sink-kafka 1.3.0faucet-sink-mongodb 1.2.0faucet-sink-mssql 1.3.0faucet-sink-mysql 1.3.0faucet-sink-parquet 1.1.3faucet-sink-postgres 1.3.0faucet-sink-redis 1.2.0faucet-sink-s3 1.2.0faucet-sink-snowflake 1.2.0faucet-sink-sqlite 1.3.0faucet-sink-stdout 1.1.3faucet-source-bigquery 1.1.3faucet-source-csv 1.2.0faucet-source-elasticsearch 1.1.3faucet-source-gcs 1.2.1faucet-source-graphql 1.2.2faucet-source-grpc 1.2.0faucet-source-kafka 1.3.0faucet-source-mongodb 1.2.0faucet-source-mongodb-cdc 1.2.0faucet-source-mssql 1.2.1faucet-source-mysql 1.3.0faucet-source-mysql-cdc 1.2.0faucet-source-parquet 1.2.1faucet-source-postgres 1.4.0faucet-source-postgres-cdc 1.3.0faucet-source-redis 1.2.0faucet-source-rest 1.2.2faucet-source-s3 1.4.0faucet-source-singer 1.0.0faucet-source-snowflake 1.1.3faucet-source-sqlite 1.3.0faucet-source-webhook 1.1.3faucet-source-websocket 1.1.3faucet-source-xml 1.2.2faucet-state-postgres 1.1.0faucet-state-redis 1.0.5faucet-stream 1.3.0faucet-transform-sql 1.0.3 - faucet-cli 1.3.0 and 54 more crates
Features
- masking PII detection + column-level masking policies #206
- cli Depends_on — completion ordering between matrix rows #276
- cli Data-freshness & volume SLA monitoring with anomaly alerts #275
- cli Faucet test — fixture-based offline pipeline testing #273
- core Data contracts — versioned output schema/constraints enforced per page #272
- Extend cluster Mode B sharding to mysql, mssql, sqlite, gcs, and parquet sources #271
- source-kafka Cluster Mode B sharding via native consumer-group assignment #274
- Persistent Data Movement Catalog — datasets, schema timelines & lineage graph #286
- cli DLQ replay & management — faucet dlq inspect / replay / discard (#281) #285
- cli Notification & incident routing — Slack / PagerDuty / webhook (#280) #284
- serve RBAC + audit log for the control plane (#205) #277
Fixes
- sink-kafka Bound exactly-once commit-token reader to O(1) memory #269
Documentation
- Ship interactive local demo (try-local.sh) + quickstart & console screenshots #288
55 crates released
faucet-auth 1.0.3faucet-cli 1.3.0faucet-common-bigquery 1.0.3faucet-common-elasticsearch 1.0.3faucet-common-gcs 1.0.3faucet-common-kafka 1.0.3faucet-common-mssql 1.0.4faucet-common-snowflake 1.0.3faucet-core 1.3.0faucet-lineage 1.1.0faucet-sink-bigquery 1.2.1faucet-sink-csv 1.1.2faucet-sink-elasticsearch 1.2.1faucet-sink-gcs 1.1.2faucet-sink-http 1.1.2faucet-sink-iceberg 1.1.1faucet-sink-jsonl 1.1.2faucet-sink-kafka 1.2.1faucet-sink-mongodb 1.1.2faucet-sink-mssql 1.2.1faucet-sink-mysql 1.2.1faucet-sink-parquet 1.1.2faucet-sink-postgres 1.2.1faucet-sink-redis 1.1.2faucet-sink-s3 1.1.2faucet-sink-snowflake 1.1.2faucet-sink-sqlite 1.2.1faucet-sink-stdout 1.1.2faucet-source-bigquery 1.1.2faucet-source-csv 1.1.2faucet-source-elasticsearch 1.1.2faucet-source-gcs 1.2.0faucet-source-graphql 1.2.1faucet-source-grpc 1.1.2faucet-source-kafka 1.2.0faucet-source-mongodb 1.1.2faucet-source-mongodb-cdc 1.1.1faucet-source-mssql 1.2.0faucet-source-mysql 1.2.0faucet-source-mysql-cdc 1.1.1faucet-source-parquet 1.2.0faucet-source-postgres 1.3.0faucet-source-postgres-cdc 1.2.1faucet-source-redis 1.1.2faucet-source-rest 1.2.1faucet-source-s3 1.3.0faucet-source-snowflake 1.1.2faucet-source-sqlite 1.2.0faucet-source-webhook 1.1.2faucet-source-websocket 1.1.2faucet-source-xml 1.2.1faucet-state-postgres 1.0.4faucet-state-redis 1.0.4faucet-stream 1.2.0faucet-transform-sql 1.0.2 - faucet-cli 1.2.0 and 54 more crates
Features
- Unified resilience policy (retry / circuit-breaker / poison-pill) #252
- Serve cluster Mode B — source-shard distribution across workers (#230) #263
- Consistent snapshot → CDC replication handoff — faucet replicate #189
- Schema-drift handling policy (warn/evolve/ignore/quarantine/fail) #194
- sink-kafka Exactly-once delivery via transactional producer (#216) #253
- sink-iceberg Opt-in orphan cleanup on definitive commit failure (#193) #260
- sink-bigquery Write_mode upsert/delete via in-place MERGE #245
- observability OpenTelemetry (OTLP) trace + metric export (#201) #259
- cli Add execution schema output #244
Fixes
- Resolve all 20 Medium reliability/data-integrity findings (F20–F39, #264) #266
- Resolve all Critical & High reliability/data-integrity findings (#264) #265
- s3, gcs Verify object read integrity — length + opt-in checksum (#161) #257
- Resolve all 18 Low reliability/data-integrity findings (F40–F57, #264) #267
- mysql-cdc Support MySQL 8.4+ current-position capture (#242) #247
- triggers Reject unknown fields in --triggers config (#232) #246
Documentation
55 crates released
faucet-auth 1.0.2faucet-cli 1.2.0faucet-common-bigquery 1.0.2faucet-common-elasticsearch 1.0.2faucet-common-gcs 1.0.2faucet-common-kafka 1.0.2faucet-common-mssql 1.0.3faucet-common-snowflake 1.0.2faucet-core 1.2.0faucet-lineage 1.0.1faucet-sink-bigquery 1.2.0faucet-sink-csv 1.1.1faucet-sink-elasticsearch 1.2.0faucet-sink-gcs 1.1.1faucet-sink-http 1.1.1faucet-sink-iceberg 1.1.0faucet-sink-jsonl 1.1.1faucet-sink-kafka 1.2.0faucet-sink-mongodb 1.1.1faucet-sink-mssql 1.2.0faucet-sink-mysql 1.2.0faucet-sink-parquet 1.1.1faucet-sink-postgres 1.2.0faucet-sink-redis 1.1.1faucet-sink-s3 1.1.1faucet-sink-snowflake 1.1.1faucet-sink-sqlite 1.2.0faucet-sink-stdout 1.1.1faucet-source-bigquery 1.1.1faucet-source-csv 1.1.1faucet-source-elasticsearch 1.1.1faucet-source-gcs 1.1.1faucet-source-graphql 1.2.0faucet-source-grpc 1.1.1faucet-source-kafka 1.1.1faucet-source-mongodb 1.1.1faucet-source-mongodb-cdc 1.1.0faucet-source-mssql 1.1.1faucet-source-mysql 1.1.1faucet-source-mysql-cdc 1.1.0faucet-source-parquet 1.1.1faucet-source-postgres 1.2.0faucet-source-postgres-cdc 1.2.0faucet-source-redis 1.1.1faucet-source-rest 1.2.0faucet-source-s3 1.2.0faucet-source-snowflake 1.1.1faucet-source-sqlite 1.1.1faucet-source-webhook 1.1.1faucet-source-websocket 1.1.1faucet-source-xml 1.2.0faucet-state-postgres 1.0.3faucet-state-redis 1.0.3faucet-stream 1.1.1faucet-transform-sql 1.0.1 - faucet-cli 1.1.0 and 54 more crates
Fixes
- Fix security issues, error semantics, and code quality across workspace
- Fix CI: install libcurl-dev for rdkafka-sys build
- Fix release.toml: remove invalid publish-delay key
- Fix release workflow: publish in waves to respect crates.io rate limit
Miscellaneous
- Bump version to 0.1.4
- Set faucet-stream version to 0.1.0
Other
- Add Auth::TokenEndpoint with ResponseValidator for fetching credentials from APIs
- Restructure into multi-crate workspace with source/sink categories and add comprehensive test coverage
- Add Pipeline orchestration for source-to-sink data transfer
- Add 6 new connectors: GraphQL, XML, gRPC sources and Postgres, JSONL, Snowflake sinks
- Extract shared utilities into faucet-core::util module
- Add 18 new connectors: 9 sources + 9 sinks
- Remove Kafka source+sink (rdkafka C dependency too heavy for CI)
- Add SQLite source connector (faucet-source-sqlite)
- Improve third-party connector developer experience
- Optimize all connectors for throughput
- Add config loading from JSON files and env vars
- Add config_schema() to Source and Sink traits via schemars
- Update README with config loading, schema introspection, and version fixes
- Add extensive README for every source, sink, core, and umbrella crate
- Add automated release workflow with cargo-release
- Add crate README update rule to CLAUDE.md
- Remove old publish.yml, replaced by release.yml
- Restrict releases to main branch only
- Optimize CI: parallelize jobs and test all features in isolation
- {{crate_name}} v{{version}}
55 crates released
faucet-auth 1.0.1faucet-cli 1.1.0faucet-common-bigquery 1.0.1faucet-common-elasticsearch 1.0.1faucet-common-gcs 1.0.1faucet-common-kafka 1.0.1faucet-common-mssql 1.0.2faucet-common-snowflake 1.0.1faucet-core 1.1.0faucet-lineage 1.0.0faucet-sink-bigquery 1.1.0faucet-sink-csv 1.1.0faucet-sink-elasticsearch 1.1.0faucet-sink-gcs 1.1.0faucet-sink-http 1.1.0faucet-sink-iceberg 1.0.0faucet-sink-jsonl 1.1.0faucet-sink-kafka 1.1.0faucet-sink-mongodb 1.1.0faucet-sink-mssql 1.1.0faucet-sink-mysql 1.1.0faucet-sink-parquet 1.1.0faucet-sink-postgres 1.1.0faucet-sink-redis 1.1.0faucet-sink-s3 1.1.0faucet-sink-snowflake 1.1.0faucet-sink-sqlite 1.1.0faucet-sink-stdout 1.1.0faucet-source-bigquery 1.1.0faucet-source-csv 1.1.0faucet-source-elasticsearch 1.1.0faucet-source-gcs 1.1.0faucet-source-graphql 1.1.0faucet-source-grpc 1.1.0faucet-source-kafka 1.1.0faucet-source-mongodb 1.1.0faucet-source-mongodb-cdc 1.0.0faucet-source-mssql 1.1.0faucet-source-mysql 1.1.0faucet-source-mysql-cdc 1.0.0faucet-source-parquet 1.1.0faucet-source-postgres 1.1.0faucet-source-postgres-cdc 1.1.0faucet-source-redis 1.1.0faucet-source-rest 1.1.0faucet-source-s3 1.1.0faucet-source-snowflake 1.1.0faucet-source-sqlite 1.1.0faucet-source-webhook 1.1.0faucet-source-websocket 1.1.0faucet-source-xml 1.1.0faucet-state-postgres 1.0.2faucet-state-redis 1.0.2faucet-stream 1.1.0faucet-transform-sql 1.0.0 - faucet-cli 1.0.1 and 11 more crates
Fixes
- Fix security issues, error semantics, and code quality across workspace
- Fix CI: install libcurl-dev for rdkafka-sys build
- Fix release.toml: remove invalid publish-delay key
- Fix release workflow: publish in waves to respect crates.io rate limit
Miscellaneous
- Bump version to 0.1.4
- Set faucet-stream version to 0.1.0
Other
- Add Auth::TokenEndpoint with ResponseValidator for fetching credentials from APIs
- Restructure into multi-crate workspace with source/sink categories and add comprehensive test coverage
- Add Pipeline orchestration for source-to-sink data transfer
- Add 6 new connectors: GraphQL, XML, gRPC sources and Postgres, JSONL, Snowflake sinks
- Extract shared utilities into faucet-core::util module
- Add 18 new connectors: 9 sources + 9 sinks
- Remove Kafka source+sink (rdkafka C dependency too heavy for CI)
- Add SQLite source connector (faucet-source-sqlite)
- Improve third-party connector developer experience
- Optimize all connectors for throughput
- Add config loading from JSON files and env vars
- Add config_schema() to Source and Sink traits via schemars
- Update README with config loading, schema introspection, and version fixes
- Add extensive README for every source, sink, core, and umbrella crate
- Add automated release workflow with cargo-release
- Add crate README update rule to CLAUDE.md
- Remove old publish.yml, replaced by release.yml
- Restrict releases to main branch only
- Optimize CI: parallelize jobs and test all features in isolation
- {{crate_name}} v{{version}}
12 crates released
- faucet-bigquery-common 0.1.0 and 4 more crates
Fixes
- Fix security issues, error semantics, and code quality across workspace
- Fix CI: install libcurl-dev for rdkafka-sys build
- Fix release.toml: remove invalid publish-delay key
- Fix release workflow: publish in waves to respect crates.io rate limit
Miscellaneous
- Bump version to 0.1.4
- Set faucet-stream version to 0.1.0
Other
- Add Auth::TokenEndpoint with ResponseValidator for fetching credentials from APIs
- Restructure into multi-crate workspace with source/sink categories and add comprehensive test coverage
- Add Pipeline orchestration for source-to-sink data transfer
- Add 6 new connectors: GraphQL, XML, gRPC sources and Postgres, JSONL, Snowflake sinks
- Extract shared utilities into faucet-core::util module
- Add 18 new connectors: 9 sources + 9 sinks
- Remove Kafka source+sink (rdkafka C dependency too heavy for CI)
- Add SQLite source connector (faucet-source-sqlite)
- Improve third-party connector developer experience
- Optimize all connectors for throughput
- Add config loading from JSON files and env vars
- Add config_schema() to Source and Sink traits via schemars
- Update README with config loading, schema introspection, and version fixes
- Add extensive README for every source, sink, core, and umbrella crate
- Add automated release workflow with cargo-release
- Add crate README update rule to CLAUDE.md
- Remove old publish.yml, replaced by release.yml
- Restrict releases to main branch only
- Optimize CI: parallelize jobs and test all features in isolation
- {{crate_name}} v{{version}}
No release changed that crate.