Skip to main content

Overview

Data Synchronization continuously applies changes from a source PostgreSQL database to a target PostgreSQL database. Use it when rows changed or deleted at the source must be applied to corresponding tables in an external database.

Screenshot TODO

Capture: The Data > Data Synchronization list showing names, collections, statuses, and available actions. Exclude real connection information.

Distinguish synchronization from dataset ingestion​

Required resultFeature to use
Store PostgreSQL change events in a D.Hub-managed dataset.Ingest PostgreSQL changes for a dataset
Apply PostgreSQL changes to an external PostgreSQL table.Data Synchronization

Data Synchronization updates and deletes actual rows at the target. Check the target table and key columns before starting it.

Review status and actions​

The list displays Name, Collection, Status, and Actions. While the execution status is being checked, the status is shown as — and the actions menu is locked.

  • Items that have not started show Start.
  • Running items show Stop.
  • With write access, you can use Start, Stop, and Edit.
  • With delete access, you can use Delete.
  • The actions menu is hidden when you do not have permission to change the item.

Drag a column boundary to resize it. Widths are saved in the current browser. Double-click a boundary to restore only that column's default width.

Check before starting​

Target database changes

Starting Data Synchronization updates or deletes rows in the target PostgreSQL database. Validate the mapping against a disposable target first, and confirm that the selected data connection has write access to the production database.

  • The source and target must use PostgreSQL data connections from the same collection.
  • Create target tables before starting.
  • An initial full copy is not supported. Only changes that occur after the replication slot is created are applied.
  • Saved settings are not applied immediately to a running job. Stop and restart the job to apply new settings.
  • When the same source database is used by another ingestion job, choose distinct replication slot names.

See Configure and run Data Synchronization for setup and execution. To review active ingestion and synchronization jobs together, open Run Status.