MongoDB CDC

Install

cargo install faucet-cli --features source-mongodb-cdc
faucet init --source mongodb-cdc

# Cargo.toml — use it as a library
cargo add faucet-source-mongodb-cdc

Starter config

source:
  type: mongodb-cdc
  config:
    connection_uri: ""    # REQUIRED — MongoDB connection URI.
    # scope: { type: collection }    # one of: collection, database, cluster
      # --- Alternative variants — replace the block above with one of these ---
      # type: database
      # database: ""    # REQUIRED
      #
      # type: cluster
    # operation_types: []    # Allowlist of operation types (`insert`/`update`/`replace`/`delete`/...).
    # full_document: null    # Post-image inclusion mode (maps to the driver `FullDocumentType`).
    # full_document_before_change: null    # Pre-image inclusion mode (maps to the driver `FullDocumentBeforeChangeType`).
    # start_from: { type: now }    # one of: now, earliest, resume_token, timestamp
      # --- Alternative variants — replace the block above with one of these ---
      # type: earliest
      #
      # type: resume_token
      # token: null    # REQUIRED
      #
      # type: timestamp
      # timestamp_secs: 0    # REQUIRED
    # aggregation_pipeline: []    # Optional extra aggregation-pipeline stages, each a JSON object, appended after the operation-type `$match`.
    # idle_timeout: 30    # Terminator: flush the buffer and end the fetch cycle after this much quiet.
    # max_await_time_ms: 1000    # Server-side blocking `getMore` wait.
    # batch_size: 1000    # Records per emitted `StreamPage`.
    # max_staged_records: 1000000    # Max change records buffered in memory before a page is emitted, after which the run aborts with a typed `FaucetError::Source`.

Capabilities

Config fields