Google Cloud Pub/Sub

Install

cargo install faucet-cli --features source-pubsub
faucet init --source pubsub

# Cargo.toml — use it as a library
cargo add faucet-source-pubsub

Starter config

source:
  type: pubsub
  config:
    subscription: ""    # REQUIRED — Subscription id (short name, not the fully-qualified path).
    # project_id: ""    # GCP project id that owns the topic / subscription.
    # endpoint: ""    # Override the Pub/Sub API endpoint (host:port or URL).
    # emulator_host: ""    # Point the client at a Pub/Sub emulator (`host:port`).
    # credentials: { type: application_default }    # one of: application_default, service_account_json_file, service_account_json_inline, anonymous
      # --- Alternative variants — replace the block above with one of these ---
      # type: service_account_json_file
      # config:
        # path: ""    # REQUIRED
      #
      # type: service_account_json_inline
      # config:
        # json: ""    # REQUIRED
      #
      # type: anonymous
    # value_format: null    # How each message's `data` payload is decoded into the emitted `data` field.
    # attributes_key: "__attributes"    # JSON key the message attribute map is surfaced under.
    # max_messages_per_pull: 100    # Messages requested per `pull` RPC (1–1000).
    # idle_termination_secs: 0    # Stop after this many seconds without a new message.
    # max_messages: 0    # Stop after this many messages in total.
    # batch_size: 1000    # Records per emitted `StreamPage`.
    # on_decode_error: null    # What to do with a message whose payload does not decode under `value_format`.
    # ack_deadline_extension_secs: 60    # Ack deadline, in seconds, the source keeps renewing on every message it has pulled but not yet acked (while a page is assembled and while the sink writes it), so a slow page is not redelivered into the same run.

Capabilities

Config fields