Connectors

PostgreSQL CDC source

Capture changes from selected PostgreSQL tables into SQIP

Use the PostgreSQL CDC source to continuously capture inserts, updates, and deletes from an approved list of PostgreSQL tables.

Before you begin

Ask your database administrator for:

  • The PostgreSQL hostname, port, and database name.
  • A username and password with access to the selected tables and change stream.
  • The table names in schema.table format.
  • The required TLS mode.
  • Confirmation that change data capture is enabled for the database.

Warning

Creating this connector usually requires help from a database administrator. SQIP validates the connection but cannot enable change data capture on the database for you.

Install the connector

Select the connector

In Connectors, find PostgreSQL CDC Source and select Select and install.

Choose the output

Enter an installation name, select the tenant, cluster, and namespace, and choose the output topic for captured changes.

Configure PostgreSQL

Enter the database and table details from the table below.

Add credentials

Enter or select the PostgreSQL username and password in SQIP's credential section.

Install and verify

Select Install connector and wait for Running. Insert or update a test row in an included table and confirm that a change record appears in SQIP.

Configuration fields

FieldWhat to enterExampleRequired
HostnameThe PostgreSQL server hostnamepostgres.example.comYes
PortThe PostgreSQL server port5432No
DatabaseThe database containing the selected tablesordersYes
TLS Modeverify-full, verify-ca, or requireverify-fullNo
Table Include ListOne or more exact table names in schema.table formatsales.orders, sales.order_itemsYes
Topic PrefixA short, unique prefix used to identify this database's change recordsorders-dbYes
Slot NameA unique lowercase name supplied by your database administrator; leave blank to let SQIP choose oneLeave blankNo
Publication NameA unique lowercase name supplied by your database administrator; leave blank to let SQIP choose oneLeave blankNo
Snapshot ModeHow SQIP handles rows already in the tablesinitialNo
ParallelismNumber of connector instances1Yes; fixed at 1

Enter the database Username and Password under One-time credentials. If your administrator supplied a prepared secret name, expand Use an existing secret reference instead and enter that name. Do not use both approaches.

TLS modes

TLS ModeMeaningRecommendation
verify-fullEncrypts the connection and verifies the certificate and hostnameRecommended
verify-caEncrypts the connection and verifies the certificate authorityUse only when required by your database setup
requireEncrypts the connection without full identity verificationUse only when approved by your administrator

Snapshot modes

Snapshot ModeWhat happens
initialImports current rows once, then continues capturing new changes
initial_onlyImports current rows once and then stops capturing new changes
neverCaptures only new changes and does not import existing rows

Tip

Use initial for most new connectors. Choose never only when existing rows have already been loaded another way.

Complete example

FieldInput
Hostnamepostgres.example.com
Port5432
Databaseorders
TLS Modeverify-full
Table Include Listsales.orders, sales.order_items
Topic Prefixorders-db
Slot NameLeave empty
Publication NameLeave empty
Snapshot Modeinitial
One-time username and passwordEnter the database credential, or use an existing secret reference

If installation fails

  • Confirm that each table uses the exact schema.table format, such as sales.orders.
  • Confirm that the username can read every selected table.
  • Ask the database administrator to confirm that change data capture is enabled and the account has the required permissions.
  • Leave Slot Name and Publication Name blank unless the database administrator supplied specific values.
  • If the database is private, ask your SQIP administrator to approve access.