Skip to content
← All release notes
preview-2026.06.1previewimproved

Delta sync, watermarks, and warehouse-scale benchmarks

Incremental sync with watermarks and reconciliation, bulk-copy ingestion, and published query benchmarks at two million rows per source.

Written during the preview programme, before general availability. The features described here are part of SignalForge today.

Delta sync. Data sources can now declare an incremental strategy — updated-at fields, row versions, or a custom query — with watermark tracking, a configurable lookback window, and a scheduled full-reconcile pass to catch anything a delta missed. Entra ID users additionally use Microsoft Graph's native delta API.

Ingestion throughput. Ingest now uses bulk copy into a staging table with a single set-based reconcile, replacing row-by-row upserts. Ingest is verified at 500k rows per source; validation at 2M+ is in progress.

Query benchmarks. Keyset pagination and columnstore indexing keep report queries responsive at 2M rows per source — benchmark methodology and results are recorded in the engineering docs.

Sync failure classification. Failed syncs now report one of twelve actionable categories — credential rejected, endpoint unreachable, rate limited, schema mismatch, and more — with guidance instead of raw stack traces.