Deep Dive

Connector lifecycle

Install, observe, pause, resume, restart, and safely remove connectors

A connector is a tenant-owned data flow between one SQIP topic and an external system. SQIP manages its configuration, desired state, and operational status.

Installation stages

The connector installer has four stages:

  1. Placement — choose the tenant, installation name, cluster, namespace, and topic.
  2. Configure — enter connector-specific settings, parallelism, and credentials.
  3. Review — confirm the connector version, direction, placement, and runtime settings.
  4. Install — queue the request and follow its status on the Connectors page.

Sources use an Output topic because they bring records into SQIP. Sinks use an Input topic because they deliver existing topic records elsewhere.

Installation names

An installation name must:

  • Contain 3–63 characters.
  • Start with a letter.
  • Use only letters, numbers, dots, underscores, or dashes.
  • Be unique for its tenant.

Example: orders-to-warehouse.

Credentials

SQIP supports two credential approaches:

ApproachWhen to use it
One-time credentialsEnter the token, username, or password directly in the installer. SQIP does not display it again.
Existing secret referenceSelect Use an existing secret reference instead when your administrator has already prepared a compatible secret.

Do not enter both. When you type a one-time credential, SQIP clears the existing reference; when you enter a reference, it clears the one-time values.

Desired state and observed phase

The desired state is what you asked SQIP to do. The phase is what SQIP currently observes.

ValueMeaning
RUNNINGThe connector should actively process records
PAUSEDThe connector should remain stopped without being deleted
PENDING or PROVISIONINGInstallation or a requested change is still being applied
RUNNING phaseThe connector is available and matches the requested state
DEGRADEDThe connector is available but needs investigation
FAILEDSQIP could not complete the requested state

It is normal for the observed phase to lag briefly behind the requested action.

Day-two actions

ActionUse it when
PauseYou need to stop data movement temporarily without losing the installation
ResumeYou are ready to continue a paused connector
RestartThe configuration is correct but the running process needs to be refreshed
Connector logsYou need status details or the reason an operation failed
DeleteThe data flow is permanently retired

Tenant administrators can install and delete connectors. Cluster administrators and delegated operators can perform lifecycle actions only when their permissions allow it.

Delivery behavior

Connectors are designed for reliable, at-least-once delivery. After a timeout or interruption, an item may be processed again.

  • Use stable record identifiers.
  • Prefer upsert or deduplication at destinations.
  • Avoid making a destination action unsafe to repeat.
  • Confirm both the source and destination after recovering from an incident.

Troubleshooting sequence

  1. Read the connector's message and phase on the Connectors page.
  2. Open Connector logs and review the most recent warning or error.
  3. Confirm that the endpoint, database, or file server is available.
  4. Confirm that credentials are current and authorized.
  5. Confirm that the selected topic and namespace still exist.
  6. Use Restart after resolving an external issue.
  7. Ask a tenant administrator to update configuration or credentials when required.