Integrity Checks¶
Integrity checks are the primary operational signal that a Numera data load has completed correctly. After every scheduled dbt load, 52 active checks run automatically. Each check is a SQL query that returns rows only when an invariant has been violated — zero rows means the check passed.
When a check fires, it indicates a data quality issue, a pipeline continuity problem, or a dimensional integrity gap. Checks are categorised by severity: Error-level failures mean the load has been flagged and the data should not be relied upon until the issue is investigated; Warning-level failures are advisory and the load continues.
Documentation by purpose¶
| Learning | Doing | Understanding |
|---|---|---|
| Understanding a Failing Check — walk through a real investigation from load report to resolution | Investigate a Failing Check — 6-step process applicable to any check | How Checks Work — what singular tests are, severity levels, and grace windows |
| Check Catalogue — all 52 checks with descriptions, lookback windows, and remediation steps |
"I just want to…" quick lookup¶
| Goal | Go to |
|---|---|
| Find out what a specific check means | Check Catalogue — search for the check name |
| Know what to do when a check fires | Investigate a Failing Check |
| Understand why a check fired after an upgrade | How Checks Work — timing and grace windows section |
| See all checks in one place | Check Catalogue |
| Learn from a worked example | Understanding a Failing Check |
Coverage summary¶
52 active integrity checks across 10 categories, covering data load completeness, dimensional integrity, SCD2 invariants, PnL and simulation correctness, risk metrics, schedule integrity, settlement data, pipeline health, and 15-minute power volumes.
| Category | Checks | Description |
|---|---|---|
| Data Load Completeness | 7 | Row count parity between raw source and staging layers |
| Dimensional Integrity | 7 | Deal-to-dimension linkage across PnL, delta, and deal history |
| SCD2 Integrity | 5 | Temporal and uniqueness invariants for scd_endur_deal_enhanced |
| PnL Integrity | 7 | Correctness and completeness of deal-level P&L data |
| Simulation Results | 3 | Completeness and validity of Endur simulation outputs |
| Risk Metrics | 2 | Delta and vega metrics linked to profile data |
| Schedule & Volume | 4 | Deal schedule completeness and volume field integrity |
| Settlement Integrity | 4 | Settlement event completeness and consistency |
| Pipeline Health | 1 | Snowflake deduplication task status |
| Power Volumes (15-minute) | 12 | Structural and reconciliation invariants for the 15m pipeline, including cancelled-deal residue protection |