ERP data
ERP Change-Data Capture to PostgreSQL
Continuously replicates an SAP Business One database on SAP HANA into PostgreSQL, table by table and change by change, for reporting.
The problem
Reporting and downstream apps needed fresh ERP data without running heavy queries against the production SAP HANA database.
What I built
- Incremental sync of every table based on update timestamps, run in parallel per table with a persistent sync-state store.
- Trigger generation, monitoring and verification scripts for the replica.
- An alternative Airbyte source connector for SAP HANA.
- A long-running sync service packaged with Docker Compose.
Technical highlights
- After the first load, only changed rows are copied.