Skip to content

Source Lineage & Impact

This page documents the dependency relationships between the raw source feeds that flow into the Numera platform and the customer-visible models they produce. It is designed to answer two operational questions:

  • Blast radius: If source feed X is delayed or incorrect, which customer models are affected?
  • Model provenance: For a given customer model, which source feeds must be healthy for it to be correct?

The analysis covers 134 customer-visible models (across ewe_numera and numera_core) and 71 active source feeds across 8 source systems. Dependency is resolved transitively — a source is listed as a dependency of a model if it contributes data at any point in the pipeline, including through intermediate staging and PIT layers.

Source Systems

Six primary source systems supply data to the platform. The table below shows the operational footprint of each.

Source System Description Active Feeds Customer Models Affected
raw_endur Endur trading system — deals, parties, market data, reference tables, simulation results 37 81
numera_common_data Shared reference data managed by Numera — timezones, axis definitions, calendar periods 9 34
manual_recalc Internal manual recalculation transactions — supplements Endur deal data 1 31
raw_clearing_bank_statements Clearing bank statement files from ABN AMRO and BNP Paribas 12 14
raw_cerqlar CerQlar renewable energy certificate trading platform 9 8
numera Numera platform metadata — dbt run state and integrity checks 1 2

Source independence

The clearing bank pipeline (raw_clearing_bank_statements) and the CerQlar pipeline (raw_cerqlar) are fully independent of the Endur pipeline. An Endur outage does not affect clearing statement or CerQlar models, and vice versa. The sole exception is fct_clearing_statement_open_position, which joins Endur party data to enrich positions with counterparty names.

Critical Sources

The following sources have the highest blast radius — an outage or schema change to these feeds propagates to the largest number of customer-facing models.

Rank Source System Models Affected Notes
1 reference raw_endur 65 Reference data table. Joins into almost every model in the warehouse.
2 deal raw_endur 37 Core deal snapshot. Required by all volume, P&L, scheduling, and settlement models.
3 manual_recalc_transaction manual_recalc 31 Used as the business case source for all EWE volume/P&L models and many core dimensions.
4 tran_info_type raw_endur 31 Transaction info type definitions. Required by deal dimensions and all downstream fact models.
5 deal_history raw_endur 28 Deal amendment history. Feeds the same models as deal.
6 gas_phys_location raw_endur 28 Physical location reference. Required by location dimensions and all volume models.
7 timezone numera_common_data 27 Timezone lookup table. Used by every model involving time-period calculations.
8 party raw_endur 26 Counterparty master data. Feeds party dimensions and all models with party joins.
9 idx_info_history raw_endur 26 Index definition history. Feeds index dimensions and volume models.
10 idx_info_types_history raw_endur 26 Index type classification history.
11 party_info_type raw_endur 25 Party attribute type definitions. Required alongside party for all party dimension models.
12 table_holiday_list_history raw_endur 25 Holiday calendar list. Feeds calendar and credit exposure models.
13 party_relationship_history raw_endur 25 Party relationship history. Required for business unit / legal entity resolution.
14 idx_def raw_endur 24 Index definitions. Feeds index dimensions and all volume fact models.
15 table_holiday_detail_history raw_endur 21 Holiday calendar detail. Feeds credit exposure and party agreement models.
16 sim_result raw_endur 20 Endur simulation results (UDSRs). Source for all credit exposure and party agreement models.

Cluster risk: party sources

party, party_info_type, and party_relationship_history are logically part of the same Endur entity and typically fail together. Combined they affect 25–26 models including all credit exposure, clearing open position, and volume fact models.

Full Source Impact Reference

All sources ranked by blast radius. Sources with impact 0 (no customer models downstream) are not shown.

Source System Customer Models
reference raw_endur 65
deal raw_endur 37
manual_recalc_transaction manual_recalc 31
tran_info_type raw_endur 31
deal_history raw_endur 28
gas_phys_location raw_endur 28
timezone numera_common_data 27
party raw_endur 26
idx_info_history raw_endur 26
idx_info_types_history raw_endur 26
party_info_type raw_endur 25
table_holiday_list_history raw_endur 25
party_relationship_history raw_endur 25
idx_def raw_endur 24
table_holiday_detail_history raw_endur 21
sim_result raw_endur 20
volume_type raw_endur 15
pwr_reference_data raw_endur 14
idx_gpt_def raw_endur 13
portfolio_history raw_endur 12
idx_unit raw_endur 6
deal_event raw_endur 5
party_agreement raw_endur 4
bnp_open_position raw_clearing_bank_statements 3
doc_info_type raw_endur 3
party_agreement_history raw_endur 3
deal_data raw_cerqlar 3
abn_daily_cash_movement raw_clearing_bank_statements 2
abn_open_position raw_clearing_bank_statements 2
axis_type numera_common_data 2
period_15m_timezone numera_common_data 2
run_start numera 2
stldoc_header raw_endur 2
unit_type raw_endur 2
fee_def_h raw_endur 2
agreement_ins_history raw_endur 2
idx_subgroup_history raw_endur 2
agreement_history raw_endur 2
market_adjusted_prices raw_endur 2
counterparties_data raw_cerqlar 2
trade_group_data raw_cerqlar 2
users_data raw_cerqlar 2
executions_data raw_cerqlar 2
abn_daily_cash_summary_account_level raw_clearing_bank_statements 1
abn_daily_cash_summary_client_level raw_clearing_bank_statements 1
abn_daily_purchase_n_sales raw_clearing_bank_statements 1
abn_daily_trxs raw_clearing_bank_statements 1
bnp_journal_entries raw_clearing_bank_statements 1
bnp_mc_statement raw_clearing_bank_statements 1
bnp_pns_with_com raw_clearing_bank_statements 1
bnp_pns raw_clearing_bank_statements 1
bnp_trades raw_clearing_bank_statements 1
axis_sub_type numera_common_data 1
axis numera_common_data 1
period_15m numera_common_data 1
timezone_conversion numera_common_data 1
dim_time numera_common_data 1
time_axis numera_common_data 1
stldoc_details raw_endur 1
vol_def raw_endur 1
idx_historical_prices raw_endur 1
unit_conversion raw_endur 1
ins_fee_param raw_endur 1
log raw_endur 1
user_business_case raw_endur 1
tran_data raw_cerqlar 1
certificates_data raw_cerqlar 1
tran_attribution raw_cerqlar 1
reservations_data raw_cerqlar 1
schedule_data raw_cerqlar 1
version_control devops 1

Customer Model Source Dependencies

For each customer-visible model, the source feeds it requires. Models with no source feeds are derived from static seeds or computed sequences (e.g., dim_date, dim_month) — they have no external dependency and cannot become stale due to a source outage.

Power Volumes (EWE)

Model Source Feeds Source Systems
fct_ewe_volume_pwr_by_business_case 16 raw_endur, numera_common_data, manual_recalc
fct_ewe_volume_pwr_by_business_case_deal 16 raw_endur, numera_common_data, manual_recalc
fct_ewe_volume_pwr_by_business_case_unfiltered 16 raw_endur, numera_common_data, manual_recalc
fct_ewe_volume_pwr_by_business_case_deal_unfiltered 16 raw_endur, numera_common_data, manual_recalc
fct_ewe_volume_pwr_floating_by_business_case 18 raw_endur, numera_common_data, manual_recalc
fct_ewe_volume_pwr_floating_by_business_case_deal 18 raw_endur, numera_common_data, manual_recalc
Key feeds for power volume models

The floating variants add market_adjusted_prices and idx_unit on top of the standard 16 feeds. All power volume models require manual_recalc_transaction as the source of business case assignments.

Credit Exposure (EWE)

Model Source Feeds Source Systems
fct_credit_exposure 7 raw_endur
fct_credit_exposure_month 7 raw_endur
fct_credit_pex_factor 3 raw_endur
Key feeds for credit exposure models

All three models depend on raw_endur.sim_result (Endur simulation results / UDSRs), party/party_info_type/party_relationship_history for counterparty enrichment, and table_holiday_detail_history/table_holiday_list_history for calendar adjustments.

Clearing Statements (EWE)

Model Source Feeds Source Systems
fct_clearing_statement_open_position 6 raw_clearing_bank_statements, raw_endur
fct_raw_abn_daily_cash_movement 1 raw_clearing_bank_statements
fct_raw_abn_daily_cash_summary_account_level 1 raw_clearing_bank_statements
fct_raw_abn_daily_cash_summary_client_level 1 raw_clearing_bank_statements
fct_raw_abn_daily_purchase_and_sales 1 raw_clearing_bank_statements
fct_raw_abn_daily_trxs 1 raw_clearing_bank_statements
fct_raw_abn_open_positions 1 raw_clearing_bank_statements
fct_raw_bnp_journal_entries 1 raw_clearing_bank_statements
fct_raw_bnp_mc_statement 1 raw_clearing_bank_statements
fct_raw_bnp_open_positions 1 raw_clearing_bank_statements
fct_raw_bnp_pns 1 raw_clearing_bank_statements
fct_raw_bnp_pns_with_com 1 raw_clearing_bank_statements
fct_raw_bnp_trades 1 raw_clearing_bank_statements
Clearing statement isolation

All fct_raw_* clearing models are direct one-to-one projections of a single source feed. The only model with cross-system dependency is fct_clearing_statement_open_position, which joins raw_endur.party/party_info_type/party_relationship_history to resolve counterparty names.

Party Agreements (EWE)

Model Source Feeds Source Systems
dim_party_agreement 4 raw_endur
dim_party_agreement_attribute 3 raw_endur

Monitoring & Data Arrival (EWE)

Model Source Feeds Source Systems
fct_data_arrival 17 raw_endur, raw_clearing_bank_statements, numera_common_data, manual_recalc

fct_data_arrival complexity

This monitoring model has the broadest cross-system dependency of any EWE model, spanning all four primary source systems. It is designed to track data freshness across pipelines, so its wide dependency footprint is intentional. If this model is stale, investigate across all source systems rather than assuming a single cause.

Deal Facts (numera-core)

Model Source Feeds Source Systems
fct_settle_deal 23 raw_endur, numera_common_data, manual_recalc
fct_deal_physcash 18 raw_endur, numera_common_data, manual_recalc
fct_event_deal 18 raw_endur, numera_common_data, manual_recalc
fct_deal_side 17 raw_endur, numera_common_data, manual_recalc
fct_deal_fee 10 raw_endur, manual_recalc
fct_deal_tran_info_history 9 raw_endur, manual_recalc
fct_deal 9 raw_endur, manual_recalc
fct_futures_cascade 9 raw_endur, manual_recalc
fct_var_pfolio 4 raw_endur
fct_sim_result 6 raw_endur, numera

Volume & Schedule (numera-core)

Model Source Feeds Source Systems
fct_schedule 13 raw_endur, manual_recalc
fct_schedule_history 13 raw_endur, manual_recalc
fct_volume_daily 13 raw_endur, manual_recalc
fct_volume_daily_old 13 raw_endur, manual_recalc
fct_volume_history_daily 13 raw_endur, manual_recalc

Settlements (numera-core)

Model Source Feeds Source Systems
fct_settle_deal 23 raw_endur, numera_common_data, manual_recalc
dim_payment 15 raw_endur, numera_common_data, manual_recalc
dim_settle_profile 8 raw_endur, manual_recalc

Monitoring & Completeness (numera-core)

Model Source Feeds Source Systems
fct_metric_completeness 15 raw_endur, numera_common_data, manual_recalc
fct_numera_load_time 15 raw_endur, numera_common_data, manual_recalc, numera
dim_metric_date 14 raw_endur, numera_common_data, manual_recalc
dim_metric_date_calendar 14 raw_endur, numera_common_data, manual_recalc
dim_metric_date_filter 14 raw_endur, numera_common_data, manual_recalc
dim_metric_scenario 4 raw_endur

Core Dimensions (numera-core)

Dimensions with external source dependencies (static/seed-based dimensions omitted):

Model Source Feeds Source Systems
dim_master_data 12 raw_endur
dim_index_attribute 8 raw_endur, numera_common_data
dim_settle_profile 8 raw_endur, manual_recalc
dim_deal_attribute 7 raw_endur, numera_common_data, manual_recalc
dim_delivery_location 6 raw_endur, manual_recalc
dim_deal_sub_attribute 5 raw_endur, numera_common_data
dim_party_external 4 raw_endur
dim_party_internal 4 raw_endur
dim_index 4 raw_endur, numera_common_data
dim_volatility 4 raw_endur, numera_common_data
dim_index_gpt 3 raw_endur, numera_common_data
dim_unit_conversion 3 raw_endur
dim_reference 3 raw_endur, manual_recalc
dim_point_of_delivery_location 3 raw_endur
dim_point_of_receipt_location 3 raw_endur

The following dimensions are seed-based or sequence-generated with no external source dependency. They cannot become stale and do not need to be considered in incident triage:

dim_date, dim_month, dim_trade_date, dim_trade_month, dim_delivery_start_date, dim_delivery_start_month, dim_delivery_end_date, dim_delivery_end_month, dim_pymt_date, dim_pymt_month, dim_current_date, dim_numera_version.

CerQlar (numera-core)

Model Source Feeds Source Systems
fct_cerqlar_deal 5 raw_cerqlar
fct_raw_cerqlar_deal 4 raw_cerqlar
fct_raw_cerqlar_certificates 1 raw_cerqlar
fct_raw_cerqlar_executions 1 raw_cerqlar
fct_raw_cerqlar_reservations 1 raw_cerqlar
fct_raw_cerqlar_schedule 1 raw_cerqlar
fct_raw_cerqlar_tran 1 raw_cerqlar
fct_raw_cerqlar_tran_attribution 1 raw_cerqlar

CerQlar isolation

All CerQlar models depend exclusively on raw_cerqlar feeds. An Endur or clearing bank outage has no impact on CerQlar models.