Справочник ключевых терминов курса Data Risk & Compliance Governance.
Элемент данных, ошибка / отсутствие / искажение которого приводит к материальному финансовому, регуляторному или операционному ущербу. CDE требует формального ownership, документированных правил качества, контролей и lineage. Концепт стандартизован через BCBS 239 (Принципы 3-4) и ECB RDARR Guide (May 2024).
Уровень значимости ошибки или искажения, при котором решения пользователей отчётности могли бы измениться. Quantitative threshold (rule of thumb 5% pre-tax income per SAB 99) дополняется qualitative factors (regulatory implications, segment significance, trend masking).
SAB Topic 1.M / SAB 99 (1999) — основа материальности в US ICFR; reinforced Munter statement March 2022.Авторитетный список всех CDE организации с метаданными: owner, steward, business definition, lineage references, controls references, BIA references, версия, статус (proposed / approved / retired). Обычно реализуется как module внутри data catalog (Collibra / Atlan / Alation / OpenMetadata).
Синоним CDE в большинстве регуляторных текстов. Терминология preferred APRA (Australia), OSFI (Canada) и несколькими US банками. DAMA, EDM Council, BCBS 239, ECB RDARR Guide, MAS используют CDE. SwiftRide и другие NYSE-направленные организации обычно используют CDE как mainstream-вариант.
Stage 1 в CDE lifecycle. Подача кандидата для CDE consideration. Анyone (data engineer, steward, owner, audit) может submit nomination form. Required fields: nominator, dataset_identifier, nomination_trigger (audit / incident / regulatory / new business / annual sweep), proposed_business_rationale, proposed_owner. Gate criteria: dataset identifiable, rationale не trivial, owner real person/role.
Stage 3 в CDE lifecycle. Data Council formal sign-off на CDE-статус, DQ tolerances, controls baseline, attestation cadence. Bi-weekly batch review (5-10 candidates per meeting). Registry entry создаётся on approval; Data Owner formal acceptance gate before maintenance phase.
Stage 5 в CDE lifecycle. Formal process retirement CDE с rationale (system decommission, business model change, regulatory delisting, re-scoping, replacement). Required steps: retirement proposal, impact analysis, replacement/migration plan, Data Council approval, retirement record (status=retired), archived evidence (SOX retention 7 years). Silent retirement — critical anti-pattern.
4 axes для structured CDE scoring: financial impact, regulatory exposure, operational dependency, reputational/legal risk. Industry frameworks (DCAM v3, MAS May 2024, Alation 2026 Field Guide) convergent на 4-dimension model. Каждый dimension score 1-5; weighted aggregate → CDE verdict.
Dimension D1 в CDE scoring framework. Измеряет прямой долларовый exposure при ошибке / искажении / отсутствии CDE-data за reporting period. Score 1 (negligible) до 5 (material per SAB 99, выше audit materiality threshold или triggers qualitative factor).
Dimension D2 в CDE scoring framework. Измеряет multi-regulator multiplier (сколько режимов одновременно subject) + penalty range. Score 1 (no external) до 5 (direct multi-regulator submission, penalties >$100M или license suspension risk). Multi-regulator data (KYC = AML + GDPR + PCI) часто scores 5 даже при moderate financial impact.
Dimension D3 в CDE scoring framework. Измеряет tier downstream business process. Score 1 (internal reporting only) до 5 (Tier-1, RTO < 4h, customer-facing real-time). Input для BIA в M6. SwiftRide Tier-1: trip matching, real-time pricing, KYC real-time check, payment processing.
Dimension D4 в CDE scoring framework. Измеряет probability + magnitude public / regulatory / customer-trust exposure при breach или error. Hardest to quantify; use proxies: % users affected (GDPR Art. 33 threshold), regulatory penalty range, recovery cost estimate, CEO/board attention probability.
Per-dimension weights в weighted CDE scoring formula. Context-dependent: G-SIB bank 25/35/25/15; pre-IPO US tech (SwiftRide T0) 30/30/20/20; healthcare 20/30/25/25; public utility 30/25/35/10. Calibrate before cycle, не mid-cycle. Re-calibration triggers: major incident, regulatory change, audit feedback, annual review.
Order правил для CDE кандидатов с одинаковым weighted score: (1) regulatory dimension wins, (2) financial dimension second, (3) imminent regulatory deadline, (4) past incident reference, (5) owner readiness, (6) lexical (last resort). Documented в CDE policy до первого scoring cycle для audit defensibility.
Quantitative или qualitative bar, выше которого misstatement требует correction / disclosure. Quantitative rule of thumb (5% pre-tax income per SAB 99) — initial step, не decisive. 'No basis in accounting literature or law' в isolation (SAB 99 direct quote). Qualitative factors override even при low quantitative magnitude. CDE programme threshold обычно 50-80% audit materiality для early warning.
9 факторов per SAB 99 (1999), которые могут turn misstatement material даже при small quantitative magnitude: (1) precise vs estimate; (2) masks earnings change; (3) hides analyst miss; (4) loss↔income flip; (5) significant segment; (6) regulatory compliance; (7) loan covenants; (8) management compensation; (9) conceals unlawful transaction. Все 9 mandatorily evaluated; cherry-picking — Munter 2022 enforcement priority.
SEC Staff Accounting Bulletin No. 99: Materiality. Published 12 Aug 1999, codified as SAB Topic 1.M. Fundamental authority для materiality в US ICFR. Establishes: quantitative thresholds — initial step не decisive; qualitative factors могут override; cherry-picking — wrong response. Reinforced by Munter Statement Mar 2022.
Paul Munter (SEC Acting Chief Accountant) Statement on Assessing Materiality (9 March 2022). Reinforced SAB 99, не изменил его. Created enforcement priority: cherry-picking quantitative threshold как defence для not-correcting known misstatements — explicit risk area для SEC enforcement.
Per DAMA-DMBOK 2 Chapter 10 — persistent, business-critical data describing entities (Customer, Product, Driver, Employee, Location, Asset). Не transactional; describes things, не events. Axis content type, ortоgonal к axis criticality (CDE). Same Master Data dataset может быть CDE OR not-CDE based on scoring framework.
Per DAMA-DMBOK 2 Chapter 10 — controlled vocabularies, code lists, lookup tables. Small in volume (десятки-сотни values), change infrequently. ISO codes (country, currency), internal status enums, regulatory mapping tables. Change management — strictest control (Council-level approval + version control + downstream sync). Может быть CDE (country codes feed tax jurisdiction → SOX).
Classification dataset одновременно по multiple ortogonal axes: criticality (CDE / not-CDE), content type (Master Data / Reference Data / Transactional), security (Public / Internal / Restricted / Confidential), privacy (PII / non-PII). Normal pattern: KYC profile = CDE + PII Art. 9 + Confidential. Controls — union из applicable categories. Single-axis thinking → control gaps.
Required artifact per CDE scoring cycle. Fields: cycle_id, date_run, weights_applied, framework_version, candidates_scored, outcomes (cde_confirmed / borderline / not_cde), back_test_incidents_passed, framework_improvements_identified, reviewed_by. Evidence для auditor — basis для each scoring decision later.
Calibration procedure: apply current CDE scoring framework к datasets involved в past incidents — would they been classified CDE based on framework? Validates framework predictive ability. Frequency: minimum yearly + trigger-based (major incident, regulatory change, M&A). Failed back-test = framework gap requires iteration before deployment.
Фреймворк внутреннего контроля от Committee of Sponsoring Organizations of the Treadway Commission. Текущая редакция — May 2013, заменила 1992 framework с 15 декабря 2014. Структура: 5 компонентов (Control Environment, Risk Assessment, Control Activities, Information & Communication, Monitoring) и 17 принципов. De facto framework для US SOX 404 management assessments.
Фреймворк ERM от COSO. Текущая редакция — June 2017 ('Enterprise Risk Management — Integrating with Strategy and Performance'), заменила COSO ERM 2004. 5 компонентов: Governance & Culture, Strategy & Objective-Setting, Performance, Review & Revision, Information / Communication / Reporting. 20 принципов.
Международный стандарт risk management. Текущая редакция — ISO 31000:2018. Предлагает принципы, framework и process для управления рисками. Часто используется параллельно с COSO ERM; ISO 31000 более общий, COSO ERM ближе к корпоративному финансовому контексту.
Модель организации governance, risk и control от Institute of Internal Auditors. Текущая версия — July 2020 update, заменила прежний 'Three Lines of Defense' (2013). 1-я линия — operational management; 2-я — risk/compliance functions; 3-я — internal audit. Governing body над линиями. Ключевой shift 2020 — убрали 'defense' language; emphasis также на value creation, не только protection.
Международный стандарт information security risk management. Fourth edition, опубликована Октябрь 2022. Operational complement к ISO 31000 для cyber/infosec risk. Aligned с ISO 27001:2022 Annex A (93 controls). Structure mirrors ISO 31000: scope/context → identification (asset+threat+vulnerability) → analysis (CVSS-style scoring) → evaluation (CIA criteria) → treatment (controls selection).
Стандарты Institute of Internal Auditors, released 9 Jan 2024, mandatory 9 Jan 2025. Заменили 2017 IPPF, Code of Ethics, Definition of Internal Auditing — консолидированы. Структура: 5 доменов, 15 принципов, 52 стандарта. Домены: (I) Purpose of Internal Auditing; (II) Ethics & Professionalism; (III) Governing the Internal Audit Function; (IV) Managing the Internal Audit Function; (V) Performing Internal Audit Services.
Уровень в Three Lines Model — Board of Directors + sub-committees (Audit, Risk). Accountability к stakeholders; sets risk appetite; establishes + resources internal audit; holds management accountable for 1st/2nd line effectiveness; ensures 3rd line independence.
В Three Lines Model — operational management. Owns risks tied к delivery of products/services. Designs + executes controls в day-to-day operations. First-level monitoring + self-assessment. Initial risk event response + escalation. В SwiftRide CDE-программе — BU Data Owners, engineering teams, BU leads.
В Three Lines Model — risk + compliance + CDO Office. Frameworks (taxonomy, controls catalog, policies); expertise + advice (challenge function, не execution); continuous monitoring + aggregated reporting; independent assessment контролей при дизайне (но не их operation — это 3rd line). В SwiftRide CDE-программе — CDO Office, CRO function, CCO function, MRM function.
В Three Lines Model — internal audit. Independent + objective assurance к governing body. Audits design + operating effectiveness контролей (1st и 2nd line). Reports findings к Audit Committee. Functional reporting к Audit Committee; administrative reporting к CEO (не CFO — иначе financial reporting conflict of interest). Independence — критичная требование per Principle 5.
Per COSO ERM Principle 7 — amount + type of risk, который organisation willing to pursue в pursuit of strategy. Deliberate strategic choice, не constraint. Высокий appetite не значит 'бесконтрольно'; значит 'осознанно accept высокий potential для achieving high value'. Должна быть actionable + measurable + governance-linked + regularly reviewed. Vague appetite = no appetite.
Acceptable variation around objectives. Если objective — 'monthly revenue $200M ±5%', tolerance — 5%. За пределами tolerance триггерится escalation. Numerical, measurable. Отличается от risk appetite (стратегический выбор) и от risk capacity (operational maximum).
Maximum risk, которое organisation can absorb без catastrophic failure. Constraint, не choice. Capacity функция capital, liquidity, regulatory headroom, reputation. Decision rule: appetite ≤ tolerance bands ≤ capacity. Operating beyond capacity = existential risk.
Primary artefact COSO ERM Principles 10-12 (Performance component). Структурированный список identified risks с scoring, responses, ownership. Production schema 14+ columns: risk_id, risk_statement, risk_category/axis, inherent likelihood/impact/score, current_controls, residual likelihood/impact/score, risk_response, risk_owner, related_cde, next_review_date. Traceability к CDE registry критична.
Data Management Capability Assessment Model от EDM Council, v3 released 30 June 2025. 8 components (новый Business Data Knowledge добавлен), 34 capabilities, 101 sub-capabilities, 6 maturity levels (0 None → 5 Enhanced). Key changes vs v2.2: Architecture merged (Data + Technology), Data Control Environment expanded с risk/security/audit. Industry-standard maturity framework для banking/financial services pre-IPO.
Новый component в DCAM v3 (June 2025). Формализует glossary, taxonomy, metadata, semantic layer. Previously embedded в other components; v3 promotes к first-class. SwiftRide T0 typically weakest area (OpenMetadata business glossary empty); explicit scoring drives investment + Board visibility.
Data Management Body of Knowledge от DAMA International. Current operational reference: DMBOK2 Revised (2017 revised printing). DMBOK3 project kicked off 25 June 2025; crowdsourced drafting через 2026; ETA 2026-2027. Structure DMBOK2 — 'DAMA Wheel' с 11 knowledge areas с Data Governance at hub. Russian translation only of DMBOK2 (Олимп-Бизнес, ISBN 978-5-9693-0404-8).
Legacy maturity model от CMMI Institute (now ISACA). Retired January 2022. ISACA folded selected content в CMMI v2.0; standalone DMM + certification не longer maintained. Most surveys recommend DCAM v3 как successor reference. Не adopt DMM для new programmes; migrate существующие deployments к DCAM.
5-tier pyramid Peter Aiken (VCU): Data Operations → Data Architecture → Data Governance → Master/Reference & Data Quality → Advanced Capabilities. Concept: lower tiers must be solid before upper tiers deliver value. Teaching device + diagnostic tool, не scored assessment; не replaces DCAM v3 для self-assessment.
Numerical score в DCAM v3 (0-5): 0 None, 1 Conceptual, 2 Developmental, 3 Defined, 4 Achieved, 5 Enhanced. Each component scored против objectives + evidence artefacts + questions. Pre-IPO scale-ups typically reach Level 3 across components; Level 5 (industry-leading) — post-IPO maturity targets.
Modern risk taxonomy для data: accuracy, availability, confidentiality, integrity, privacy, ethics. Classical CIA triad (confidentiality, integrity, availability) + 3 additions: accuracy (distinct от integrity — data correct в first place vs unauthorised modification); privacy (distinct от confidentiality — data subject rights, purpose limitation, lawful basis); ethics (algorithmic fairness, non-discrimination, transparency). Каждая axis — distinct regulatory drivers + typical controls.
Структурированный mapping от identified risk через 4 уровня к audit-defensible state: Risk → Control objective → Control activity → Evidence. Production matrix 15+ columns: risk_id, risk_axis, control_objective_id, control_objective, control_id, control_activity, control_type (Preventive/Detective/Corrective), control_frequency, control_owner, evidence_artefact, evidence_location, evidence_retention, tested_design, tested_operating.
Desired outcome (что нужно achieve), distinct от control activity (как operationalised). Stated как state describing desired condition. Multiple control activities могут serve single control objective (defense-in-depth). Без objective level — audit reviewability + control redesign flexibility теряются. Common mistake — confusing objective с activity.
Principle в risk-control matrix — каждый material risk должен иметь ≥2 controls, preferably mixed types (preventive + detective + corrective). Failure modes differ across control types; single control = single point of failure. SwiftRide example: driver earnings calculation error → 5 controls (2 preventive + 2 detective + 1 corrective).
Per PCAOB AS 1305 .03 — deficiency или комбинация deficiencies в ICFR, при которой существует reasonable possibility, что material misstatement annual или interim financial statements не будет prevented или detected timely. 'Reasonable possibility' — терминология FASB ASC 450.
Контроли общего IT-уровня, обеспечивающие надёжность всех application controls и автоматизированных контролей. Стандартные 4 домена: access management, change management, computer operations, system development. Failure ITGC fundamentally подрывает доверие к application controls. COSO 2013 Principle 11 и PCAOB AS 2201 .47.
Информация, произведённая аудируемой компанией и используемая аудитором как evidence. Per PCAOB AS 1105 .10 — аудитор обязан протестировать accuracy и completeness IPE либо контроли над её accuracy и completeness, плюс оценить достаточность precision и detail. CDE-программа существенно облегчает IPE-testing.
'An Audit of Internal Control Over Financial Reporting That Is Integrated with An Audit of Financial Statements'. Currently effective; amended version effective for fiscal years beginning on or after Dec 15, 2026 (postponed from 2025 in Aug 2025). Top-down risk-based approach, walkthroughs, ITGC integration.
Corporate Responsibility for Financial Reports. CEO/CFO лично certify каждый 10-Q/10-K: (a) review; (b) no untrue statements; (c) financial statements fairly present financial condition; (d) responsibility за disclosure controls + ICFR, evaluation effectiveness within prior 90 days. Включает disclosure controls (DC&P), не только ICFR.
Criminal Certification под 18 U.S.C. §1350. CEO/CFO certify, что report complies с Exchange Act + fairly presents financial condition. Penalties: knowing — up to $1M / 10 years; willful — up to $5M / 20 years. Это enforcement leverage для prosecutorial discretion в случае fraud.
Amended effective fiscal years beginning on/after 15 Dec 2025 (PCAOB Release 2024-007 — Technology-Assisted Analysis). ¶.10 — IPE testing required. ¶.10A — external electronic information (new). Principle-based + risk-scalable requirements.
Three severity tiers: ¶.01 Control deficiency — design/operation issue; ¶.02 Significant deficiency — merits Audit Committee attention; ¶.03 Material weakness — reasonable possibility material misstatement undetected; mirrors FASB ASC 450.
Per PCAOB AS 2201 ¶.21 — ICFR audit begins at financial statement level, then moves к entity-level controls, then к significant accounts/disclosures and relevant assertions, then identifies controls to test. Не bottom-up 'test every control'; focused audit. Drives scoping decisions.
Tracing one transaction end-to-end through origination → processes → IT, using same documents + IT as company personnel. 'Frequently the most effective way' to confirm control design per AS 2201. Demonstrates how controls actually operate.
SEC Acting Chief Accountant Munter statement 9 Mar 2022 reinforcing SAB 99 (1999). Key: 'As quantitative magnitude increases, it becomes increasingly difficult for qualitative factors to overcome the quantitative significance.' Re-anchors qualitative + quantitative materiality analysis.
'Principles for effective risk data aggregation and risk reporting' от Basel Committee on Banking Supervision, January 2013. 14 принципов (11 для банков + 3 для supervisors). Compliance deadline для G-SIBs — 1 January 2016. ECB Guide May 2024 операционализирует CDE-программы. Implementation review BCBS d559 (Nov 2023) — только 2 из 31 G-SIB fully compliant.
Пакет реформ Basel III от December 2017 (BCBS d424). Внедрение в ЕС через CRR3 (Reg 2024/1623) с 1 Jan 2025 и CRD6 (Dir 2024/1619) с 11 Jan 2026. UK PRA Basel 3.1 — 1 Jan 2027 (после двух отсрочек). US 'endgame' — re-proposed 19 March 2026 (3 NPRs); CET1 impact ~+1.4% vs +19% в 2023 NPR; comments close 18 Jun 2026; final Q4 2026 — Q1 2027.
Implementation review BCBS 239 across 31 G-SIBs. Только 2 банка fully compliant; no single principle fully implemented across all banks. Recurring weaknesses: governance maturity, fragmented IT, manual workarounds (24 of 31 G-SIBs use Excel for ≥1 risk category reconciliation). Drives ECB escalation toolkit.
Published 3 May 2024 (cover 30 Apr 2024). Operationalises BCBS 239 для euro-area significant institutions. Explicit CDE identification requirement. Management body accountability + comprehensive framework + integrated data architecture + DQ management с KPIs/KRIs + end-to-end lineage.
EU implementation Basel III Finalisation. CRR3 effective 1 Jan 2025; CRD6 applicable 11 Jan 2026 (transposed by MS). Output floor 50% (2025) → 72.5% (1 Jan 2030 — EU 2 years longer than BCBS 2028). Granular exposure-class reporting + SMA op-risk + FRTB.
BCBS d352 → d457 (revised Jan 2019). EU via CRR3 → Delegated Regulation (EU) 2025/1496 — locked 1 Jan 2027. Risk-factor-level P&L attribution test (Kolmogorov-Smirnov, Spearman), modellability tests (NMRF), real price observations (≥24/year per modellable risk factor), desk-level backtesting.
Replaces AMA per BCBS d424. Components: Business Indicator (BI) = ILDC + SC + FC. Capital = BI Component × Internal Loss Multiplier (ILM) в buckets 2-5. Internal loss data: 10 years (5 years transitional); material threshold EUR 20,000; mapped к Basel L1 event categories.
Effective 1 Jan 2018 (banks). 3-stage model: Stage 1 (12-month ECL, performing); Stage 2 (lifetime ECL, SICR triggered); Stage 3 (credit-impaired, lifetime + interest на net carrying). Core CDEs: PD point-in-time forward-looking, LGD forward-looking, EAD incl. drawdowns, forward-looking macro scenarios.
Trigger transition Stage 1 → Stage 2 в IFRS 9. Quantitative (PD movement above threshold; days past due ≥30 — rebuttable presumption) + qualitative (watch-list, forbearance). Documented + audited; reconciliation IFRS 9 staging vs Basel IRB PD recurring challenge.
Effective 1 Jan 2018. (1) Identify contract; (2) Identify performance obligations; (3) Determine transaction price; (4) Allocate price к obligations; (5) Recognise revenue as/when obligations satisfied. Disaggregated revenue disclosures by geography / product / customer type / duration / timing. SwiftRide trip-level CDE alignment.
Effective 1 Jan 2023 (с IFRS 9 jointly). Three measurement models: GMM (Fulfilment Cash Flows + CSM) — default; PAA (Premium Allocation Approach) — short-duration ≤1 year; VFA (Variable Fee Approach) — direct participating. Contract-group-level cash-flow projections; locked-in discount curves для CSM; coverage-unit schedule.
Replaces IAS 1. EU-endorsed 13 Feb 2026 (OJ 16 Feb 2026); effective 1 Jan 2027 (early application permitted). 5 mandatory P&L categories (Operating / Investing / Financing / Income Taxes / Discontinued); 2 new mandatory subtotals (operating profit + profit before financing & taxes); MPM disclosures с reconciliation, definition, calculation, changes.
FASB ASU 2016-13. Effective 2020 (large SEC filers) / 2023 (all others). US GAAP equivalent IFRS 9 ECL: lifetime expected loss day 1 (no 3-stage); same forward-looking-info concept but accounting timing different. Reconciliation IFRS 9 ↔ CECL operational challenge для dual-reporters.
Published 17 April 2026; rescinds SR 11-7 (2011) + SR 21-8 (BSA/AML statement, 2021). OCC Bulletin 2026-13 + FDIC FIL-15-2026 parallel. Key shifts: explicit risk-based + scalable framework; AI/ML models в scope; preserved foundational principles (model definition, three lines, validation, effective challenge, inventory).
Regulation (EU) 2016/679, applicable с 25 May 2018. Core articles: Art. 5 (principles), Art. 6 (lawful basis), Art. 9 (special categories), Art. 30 (records of processing), Art. 33-34 (breach), Art. 35 (DPIA), Art. 46 (transfers). Headline 2024-2025 fines: TikTok EUR 530M (May 2025), Meta EUR 1.2B (May 2023). Cumulative EU fines >EUR 7.1B since 2018.
Regulation (EU) 2024/1689. Phase-in: prohibited practices 2 Feb 2025; GPAI obligations 2 Aug 2025; high-risk Annex III 2 Aug 2026; high-risk Annex I 2 Aug 2027. Article 10 — data governance for high-risk AI (representativeness, bias, completeness). Annex IV — technical documentation. GPAI Code of Practice published 10 Jul 2025.
Закон Индии о защите цифровых персональных данных, принят 2023. DPDP Rules gazetted 14 Nov 2025, phased rollout to 13 May 2027. SDF (Significant Data Fiduciary) — обязательства DPO, DPIA, audit. Cross-border 'negative list' model (Rule 15) — pending notification.
Published 17 Dec 2024. Anonymity of trained models fact-specific; LI can ground training с three-step test; UNLAWFULLY TRAINED MODELS MAY TAINT DOWNSTREAM DEPLOYMENT. Drives DPIA for high-risk AI; intersects с AI Act Art. 10.
Published 16 Jan 2025. Pseudonymised data REMAINS personal data when re-identification possible. Tokenisation alone NOT sufficient. Full anonymisation requires irreversibility (k-anonymity, differential privacy, aggregation).
Adequacy decision Implementing Decision (EU) 2023/1795 от 10 Jul 2023. First challenge Latombe T-553/23 dismissed General Court 3 Sep 2025; appeal lodged 31 Oct 2025; CJEU may rule 2026-2027. NOYB / Schrems parallel 'Schrems III' civil-law route. Treat as 'valid + actively challenged'.
Applicable 12 Sep 2025. Data-by-design connected products 12 Sep 2026; cloud-switching fees fully banned 12 Jan 2027; unfair-terms 12 Sep 2027. User access к IoT data; cloud/edge switching rights (2-month notice); B2B fairness; non-EU providers — EU legal representative.
OAL approved 22 Sep 2025; effective 1 Jan 2026; operational obligations 1 Jan 2027; pre-use notices + risk assessments 1 Apr 2027. ADMT = technology processing PI using computation to replace or substantially replace human decision-making. Significant decisions = finance, housing, education, employment, healthcare. Pre-use notice + opt-out + access + human appeal mandatory.
8 high-risk areas: biometrics; critical infrastructure; education/vocational training; employment/workers management; essential private/public services (incl. credit scoring); law enforcement; migration/asylum/border; justice/democratic processes. Application date: 2 Aug 2026 statutory (Digital Omnibus may push к 2 Dec 2027 — uncertain).
Training/validation/testing datasets relevant, sufficiently representative, free of errors, complete для intended purpose. Documented practices: design choices, collection, preparation (annotation, labelling, cleaning), assumptions, prior data-availability, bias examination, bias-mitigation, gap identification. Geographic/contextual/behavioural considerations. Special-category data Art. 10(5) safeguards.
Comprehensive package for high-risk AI: general description, detailed system description, development methods, datasets, validation/testing, performance metrics, foreseeable risks, post-market monitoring, EU declaration of conformity, CE mark, instructions for use. Retained 10 years after market placement.
Per EU AI Act Arts. 53-55. All GPAI: technical documentation (Annex XI), info для downstream providers (Annex XII), copyright policy + training-data summary. GPAI с systemic risk (>10^25 FLOPs or designated): model evaluation, systemic-risk assessment + mitigation, serious-incident reporting, cybersecurity.
Three chapters: Transparency, Copyright, Safety & Security. Endorsed Commission + AI Board 1 Aug 2025. Voluntary, но signatories receive compliance presumption per Art. 53. Signatories (May 2026): Amazon, Anthropic, Google, IBM, Microsoft, OpenAI, Aleph Alpha; xAI safety-only; Meta declined.
Alternative method to meet control objective; requires Targeted Risk Analysis (TRA); documented + reviewed annually. NOT allowed для SAQs. Available only для full ROC (L1 merchant). Defined approach mandatory для SAQ levels.
People / processes / technologies storing / processing / transmitting CHD (PAN + name + expiry + service code) или SAD (full track, CVV, PIN). Connected-to + security-impacting systems also в scope. NOT same as Critical Data Element (CDE) — different concept; SwiftRide maintains bi-directional reference между PCI scope diagram + enterprise CDE registry.
Regulation (EU) 2022/2554, applicable c 17 Jan 2025. ICT risk management framework, incident reporting, threat-led penetration testing (TLPT), register of information для ICT third-party providers. First Register of Information submission — 30 Apr 2025. List of 19 CTPPs published 18 Nov 2025.
Максимально допустимое время на восстановление функциональности процесса / системы / данных после инцидента. Определяется бизнесом (Business Owner) в рамках BIA, реализуется техническими средствами (DBA). Tier-1 CDE обычно RTO < 1h, tier-3 — до нескольких суток.
Максимальный период после которого organisation reaches survival threshold — либо не существует as going concern, либо experience permanent harm (catastrophic customer loss, license revocation, irrecoverable reputation). ISO 22301:2019 Clause 8.2.2. Distinct от MTD; MTD < MTPD. SwiftPay MTPD ~24h.
Non-linear visualisation business impact от точки disruption до MTPD. 4-dimension (financial + operational + reputational + regulatory) per timepoint. Cliffs at regulatory deadlines (DORA Art. 19 4h), customer-trust tipping points, contractual penalty triggers. Linear-curve assumption — top BIA anti-pattern.
Default RTO/RPO derived from process tier через matrix. SwiftRide T+9M: Tier-1 RTO 1h RPO 5min (sync replication); Tier-2 RTO 8h RPO 60min (async); Tier-3 RTO 48h RPO 24h (daily backup). Data tier inherits worst-case среди all consuming processes; deviations documented per-CDE.
Write acknowledged only после both primary и replica committed. RPO ~0 sub-second; RTO 1-2h. Cost ~2x primary infrastructure. Mandatory для Tier-1 customer-facing real-time financial flows. Aurora Global Database synchronous mode, CockroachDB cross-region serializable. Latency penalty 50-100ms cross-region.
Write acknowledged после primary commit; replica updated WAL/binlog streaming. RPO 5-60 min normal, lag escalates under stress. Cost ~1.2x primary. Workhorse для Tier-2 регулярного reporting. Aurora read replica async, PostgreSQL streaming, S3 CRR, Kafka MirrorMaker.
Reverse-engineer existing BIA (owned Continuity Team / Risk function) к data layer вместо fresh BIA. CDO Office провidev mapping methodology (M6.2 4-level) + draft tolerances; Continuity Team retains artifact authority. 2-3 month elapsed vs 6+ months fresh; $50-100K vs $600K-1M. Maintains ISO 22301 governance integrity.
Business operations continuing без automated systems. 5 patterns: manual entry, cached/staged data, alternative partner, suspended-with-comms, degraded service. Per BCP documented decision tree per outage duration; invocation authority specified. SwiftPay 30min-2h failover к PayPal commercial agreement.
Continuously synchronised replica; takeover ~minutes. RTO sub-min (active-active) к 15 min (active-passive с auto-failover); RPO 0 (sync). Cost 1.5-2x primary. Aurora Global Database sync, Snowflake replication group с failover group. Mandatory для Tier-1 financial flows.
Standby replica с recent data; takeover hours. RTO 1-8h (warmup complexity); RPO 5-60 min (async replica). Cost 1.2-1.4x primary. Aurora read replica async, PostgreSQL streaming. Sufficient для Tier-2 regulatory reporting + lending pipelines.
Multiple regions serve traffic simultaneously; failure of one region — traffic shifts к others без orchestration. RTO sub-second; RPO 0 (sync writes к all regions). Cost N× primary; operational complexity high. Hyper-critical real-time systems (payment processors, real-time bidding). SwiftRide не uses currently — sync hot-standby sufficient для Tier-1 scale.
Documented cascade notification per incident: internal (IC → Tier-1 leadership 15min → C-suite 30min → board 1h) + external (customer 15min, bank-partner 30min, regulator per deadlines — DORA 4h, GDPR 72h, NIS2 24h, SEC 4 business days). Pre-approved templates; auto-trigger workflows; ISO 22301 Clause 8.4.3 requirement.
BCBS 239 Principle 5 — risk data production during stress/crisis; ECB RDARR Guide expects evidence через testing. Alternative compute + alternative source + manual aggregation + tightened SoD review. SwiftPay drill-tested annual stress-mode. Cold standby Snowflake DR account warmup 4h; Kafka backup stream reconstruction.
Tier-1: quarterly walkthrough + semi-annual simulation + annual full restore. Tier-2: semi-annual walkthrough + annual simulation. Tier-3: annual walkthrough minimum. DORA Art. 25 mandates annual basic testing all in-scope. TLPT every 3 years significant entities. SwiftRide first cold drill Q4 2026; first full restore 2027-Q1 post-IPO.
Lowest-investment test type. Stakeholders gather; scenario narrative; team walks через procedure verbally. 2-4h. Validates runbook correctness; identifies documentation gaps; trains team. Limitations: не validates actual recovery capability. SwiftRide Tier-3 annual default.
Mid-investment test type. Subset of recovery actually executed isolated environment — failover к replica without shifting production traffic. 4-8h. Validates procedures execute correctly; measures actual RTO/RPO. SwiftRide Tier-1 semi-annual; Tier-2 annual.
Highest-investment test type. Production traffic shifted к alternative region; primary deliberately offline; business operates on recovery infrastructure window; failback. 8-48h. Ultimate validation; required regulated entities periodic (DORA significant entities). SwiftRide first scheduled 2027-Q1 post-IPO.
Drill executed без pre-staging conditions (replication pre-validated, scripts pre-warmed). Realistic stress; surfaces gaps pre-warmed drills miss. PCAOB inspection 2024 + DORA Art. 25 endorse — 'testing should include scenarios reflecting real-world conditions'. SwiftRide first cold drill Q4 2026.
Mandatory section drill report; per-step recorded friction points (manual approval took 90s instead of 60s; one health-check needed retry; replica lag 8 min not 5 min). PCAOB 2024 spotlight — 'no deviations multiple cycles = audit red flag'. Captured через post-drill participant interview + independent observer notes.
S3 / Aurora backup vault с MinRetentionDays + MaxRetentionDays + ChangeableForDays cooling-off period. After cooling-off, immutable — даже AWS root cannot delete. Compliance Mode 7y SOX retention; cross-region copies к secondary vault. Backup plan rules — hourly incremental + daily full + cross-region copy + Glacier transition.
Point-in-time recovery up к 90 days (Enterprise edition max). Recover к any prior state; logical error reversal (formula bug, accidental DELETE). Configured DATA_RETENTION_TIME_IN_DAYS на database / schema / table level. Time Travel period — student-team self-service; immediate.
7-day Snowflake-managed recovery после Time Travel exhausted. Restore через Support ticket; SLA ~24h. Supplementary к Time Travel + replication; не suitable для Tier-1 primary recovery. Dropped tables recoverable только Fail-Safe (Time Travel doesn't cover dropped tables).
Drill artifacts per DR drill: PagerDuty incident archive, Slack channel archive, AWS RDS failover log, Snowflake ACCOUNT_USAGE replication events, Argo Rollouts revision history, smoke-test results, pre/post checksum verification, customer comms artifacts, deviation log, post-drill review minutes, auditor observer notes. 7y SOX retention; queryable Snowflake audit.drill_index. DORA Art. 24 documentation requirements.
Per DORA Pillar 3 Arts. 26-27 — required для significant entities at least every 3 years. TIBER-EU framework methodology typical. Simulates real-world cyber-attacks against critical systems с full red-team engagement. Не required для все DORA-scope entities (proportionality).
DORA Pillar 4 designation. List of 19 CTPPs published 18 Nov 2025 by EBA/EIOPA/ESMA — includes hyperscale cloud (AWS et al.) + data-centre + fin-services tech. Designated CTPPs: nominate EU legal entity, pay annual oversight fees, accept ESA inspection. List updated annually.
Annual filing per Pillar 4 Arts. 28-44. First submission 30 Apr 2025. ESAs 2024 dry-run baseline: ~1,000 entities, only 6.5% passed all 116 data-quality checks. Most-common failures: LEI validation, country-code format, orphan records. ETL должен include LEI / country-code / referential-integrity validators.
Adopted June 2025 Plenary. Standardised originator/beneficiary info cross-border peer-to-peer payments above USD/EUR 1,000 (name, address, DOB). Payment chain re-anchored on first FI to receive customer instruction. Fraud added as predicate offence. Jurisdictional implementation by end-2030.
Reg (EU) 2024/1620. Operational 1 Jul 2025 (Frankfurt); Chair Bruna Szego; absorbed EBA AML mandates 1 Jan 2026; first Single Programming Document published 4 Feb 2026 ('pivotal preparation period' 2026); direct supervision of первых 40 high-risk obliged entities starts 2028.
OFAC + EU + OFSI lists operationally distinct (~60% overlap Russia-related). 'Last screened against list version X.Y' = audit-grade CDE attribute per record. OFSI Bank of Scotland Nov 2025 GBP 160K fine emphasised correct configuration of screening DATA — transliteration, fuzzy match thresholds, DOB matching.
Transposition deadline 17 Oct 2024; 23 MS infringement procedures Q4 2025. Essential entities — 11 highly critical sectors (energy, transport, banking, FMI, health, water, digital infrastructure, ICT B2B, public admin, space); Important — medium-sized в critical sectors. SwiftRide ~3,200 FTE + digital platform → likely Essential. Penalties up to EUR 10M / 2% turnover (Essential).
Essential — large (≥250 staff / ≥EUR 50M turnover) в 11 highly critical sectors; penalties up to EUR 10M / 2% global annual turnover. Important — medium (≥50 staff / ≥EUR 10M turnover) в critical sectors; penalties up to EUR 7M / 1.4%. Both subject Art. 21 risk-management measures + 3-stage incident reporting (24h / 72h / 1 month).
Подход к CDE-дискавери, начинающийся от регуляторного или финансового отчёта (10-K Income Statement, GDPR Art. 30 ROPA, Pillar 3 disclosure). Decompose значимые line items → SOX accounts → systems → tables → columns. Leaf columns = CDE candidates. Inspiration — PCAOB AS 2201 ¶.21 top-down approach to ICFR audit. Сильно для defensibility; слабо для operational CDE.
Подход к CDE-дискавери от technical metadata + usage analytics. Inventory all datasets → column-level lineage → usage signals (Snowflake ACCESS_HISTORY, DataHub query stats) → criticality propagation от known CDE + ranked candidates. Captures operational + shadow CDE; misses low-frequency strategic data.
Recommended подход — top-down + bottom-up streams run параллельно, затем reconcile findings. Overlap zone (оба stream agree) = highest priority; single-stream items = secondary review. ECB RDARR Guide May 2024 effectively требует hybrid. SwiftRide approach — hybrid с приоритетом top-down для pre-IPO SOX-readiness. 1.5-2× effort vs single-stream.
Lineage at column granularity (а не table-level). Critical для CDE discovery + controls design — какие конкретные columns flow downstream к material reports. OpenLineage 1.46 column-level lineage facet defines DIRECT (value carries forward) / INDIRECT (input участвует в derivation logic) / masking (value transformed). Marquez / OpenMetadata / DataHub UI shows column-level с DIRECT/INDIRECT badges.
OpenLineage column-level lineage facet (spec 1.46) transformation types: **DIRECT** — output column derived напрямую from input column (e.g., `SELECT fare FROM trips`). **INDIRECT** — output не contains input value, но input участвует в derivation logic (WHERE / GROUP BY / JOIN). DIRECT — primary для CDE trace; INDIRECT — governance dependencies (filter on PII determines whose data flows).
OpenLineage column-level lineage boolean facet — input value transformed before flow (hashing, redaction, truncation, encryption). Example: `sha256(card_pan) AS pan_hash`. Useful для GDPR pseudonymisation tracking + PCI-DSS scope tracing.
Snowflake Enterprise+ edition view `SNOWFLAKE.ACCOUNT_USAGE.ACCESS_HISTORY` — column-level access logs per query. Schema includes QUERY_ID, QUERY_START_TIME, USER_NAME, DIRECT_OBJECTS_ACCESSED, BASE_OBJECTS_ACCESSED, OBJECTS_MODIFIED. 3h max latency; 1y retention. Primary source для bottom-up usage analytics в SwiftRide context.
DataHub Cloud aggregates query stats per dataset через Snowflake / BigQuery / Databricks usage emitters. Stores total_query_count, total_user_count, top_queries, top_columns. UI Usage tab — heatmap last-30d access frequency. Useful proxy без needing direct ACCESS_HISTORY query.
Bottom-up discovery rule — если column C ∈ Table T1 → используется в derivation column C' ∈ Table T2, и T1 в CDE registry, T2 automatically candidate. Recursive до transformation-cut-off (mask / aggregate-only-output breaking direct link). Compensates ranking weakness для quiet-but-critical CDE (quarterly regulatory submissions).
Stakeholder accountability matrix: Data Council (A: final approval) · CDO Office (R: process; A: completeness) · Domain Lead (R: validate; A: domain scope) · Business Owner (R: context; A: meaning + impact) · Data Steward (R: operational; A: day-to-day) · Data Engineering (R: lineage; A: tech metadata) · Compliance / Legal (R: regulatory map; A: applicability) · Internal Audit (R: walkthrough; A: audit-readiness) · External Audit (I: final). Один Accountable per role per CDE.
Структурированный вопросник per stakeholder role. 3 типа: (A) Business Owner — 45-60 min open-ended (decisions, incidents, data needs) + 30-45 min structured validation; (B) Data Engineer / Platform — 30-45 min technical (lineage, ownership metadata, DQ, retention, masking, SLA); (C) Auditor / Internal Audit — 45-60 min methodology + audit-readiness. Time-box discipline 4-8 weeks initial inventory mid-size org.
17 required + 13 optional fields per CDE entry. Required: cde_id, name, business_definition, technical_definition, business_owner, data_steward, classification, criticality_score, applicable_regulations, lineage_refs, control_refs, bia_refs, status, version, created_at, last_reviewed_at, next_review_due, retire_after. ECB RDARR Guide May 2024 mandates 4 elements (inventory + owners + definitions + lineage / DQ). 5-field minimum NOT compliant.
State machine для CDE entries: proposed → under_review → approved → maintained → retiring → retired (+ killed). Required approvers per transition: under_review → approved требует Data Council vote ≥60% quorum. Change history append-only; immutable; current state = projection. Killed entries preserved для audit log не deleted.
Microsoft Purview Unified Catalog formalises CDE как first-class object (preview→GA 2025). REST API `Create Critical Data Element` (`POST /datamap/api/criticalDataElements`). CDE = named logical container mapped к multiple physical columns (CustID/CID/Customer Identifier → Customer ID). Attached: ownership, classifications, DQ rules, policies. ЕДИНСТВЕННЫЙ vendor с CDE-native primitive May 2025-2026.
Atlan governance feature suite — maps assets к EU AI Act regulatory requirements; Context Agents auto-classify (PII detection); AI Governance Studio для AI Act mapping. SaaS continuous cadence; Gartner MQ MM 2025 Leader; #1 в 2 of 5 Critical Capabilities use cases. Strong для post-IPO AI Act 2 Aug 2026 readiness.
Collibra Platform module для tag-based access policy enforcement; integration с Snowflake / Databricks / BigQuery dynamic data masking + row-level security. Сложно с Collibra DQ + Lineage = end-to-end CDE-first design. Enterprise sales; quote-based.
Adaptive DQ rules engine (formerly OwlDQ acquired); outliers, shapes, source-to-target reconciliation, autonomy mode. 2025.03 last Java 8/11 release; 2025.06 first Java 17-only train. Tight integration с Collibra Platform = deepest catalog-DQ integration в enterprise tier.
Alation 2025 release — Documentation Agent, DQ Agent, Data Products Builder Agent (Q3 2025 GA); Aggregated Context API; AI Agent SDK с Anthropic MCP support. Agentic-first reframe of category. Business-user adoption + stewardship workflows strong.
OSS data catalog v2.4.0 (Jan 2025); v2.5 в полёте. Hadoop / Hortonworks / CDP-centric heritage; tag propagation + Ranger integration strong (historical strength). Declining velocity; HBase + Solr backend operational complexity; legacy in modern cloud stacks.
OSS data catalog v1.5.0.x (May 2025); commercial DataHub Cloud (formerly Acryl); LinkedIn-origin. Strong technical metadata + column-level lineage; engineering audience. 2025 roadmap: Universal Data Registry + Centralized Compliance + Policy Enforcement + Assertions redesign. Governance workflows менее polished чем Collibra.
Informatica IDMC (Intelligent Data Management Cloud); release trains Feb / Apr / Jul / Nov 2025; **CDMC-certified Jan 2025** (first major commercial offering CDMC-certified). Deepest scanner ecosystem; Manta-style static analysis (column-level + transformation-logic from SQL, stored procs, ETL XML). CLAIRE AI engine. Regulated-industry pedigree.
Two modes: (A) annual review — calendar-driven, mandatory baseline, 6-8 weeks для mid-size org; (B) change-triggered — event-driven narrow scope. SwiftRide Y+1 calendar: Q1 annual review; Q2 AI Act prep; Q3 SwiftCapital expansion; Q4 pre-audit; ad-hoc incident triggers within 30 days. Annual + triggers BOTH required.
Event-driven refresh trigger types: new product launch (T-1M optimal); M&A (T-60-90d); regulatory change (6 months before effective); incident (within 30 days post); tooling migration (90-180 days pre); organisation change (within 30 days transition); methodology update; audit finding. Each trigger has playbook + time-to-refresh target.
Automated weekly job detecting CDE entries showing staleness signals: no DQ run > 30 days; no attestation last 2 cycles; dead owner (HR exit > 30 days); no lineage event > 90 days; no catalog touches > 180 days; failed last 3 DQ runs; export-only access > 90 days. 2+ signals failed → automatic status_change к under_review + notification + ServiceNow ticket.
Progression: Level 1 ad-hoc (registry exists; reactive refresh; baseline T+3M); Level 2 planned (annual review calendar; change-trigger playbooks; T+9M target); Level 3 embedded SDLC (SDLC gates new pipeline / product launch CDE candidacy check; M8 detail; T+15M target); Level 4 continuous (real-time governance dashboard; governance-by-default; post-IPO Y+2+ mature). DCAM v3 alignment.
Артефакт, доказывающий, что контроль был выполнен. Минимальные атрибуты: timestamp, dataset version или hash, control / rule ID, result (pass / fail / exception), exception handling trail. Должно храниться immutable. Для SOX — retention 7 лет.
Формальное подтверждение Business Owner или Data Steward, что CDE и его контроли были effective за период (обычно quarterly). Cycle: gather evidence → review → sign-off → archive. Electronic signature принимается для большинства аудитов; wet signature — для специфических регуляторов.
Разделение обязанностей: один и тот же актор не должен инициировать, выполнять, и контролировать критическую операцию. В data world: автор pipeline ≠ approver ≠ deployer ≠ monitor. Сложно реализовать в маленьких командах — нужны compensating controls. SwiftRide 4-actor model — 5 distinct individuals across 4 teams.
Контроль, восстанавливающий состояние или ограничивающий ущерб после обнаружения проблемы. Примеры: automated rollback в Argo Rollouts, idempotent reprocess_driver_earnings(date_range) Airflow DAG, restatement procedure signed by CFO + General Counsel, restoration из backup. Дополняет detective controls.
Controls внутри конкретного бизнес-процесса или pipeline'а, привязанные к конкретному CDE или семейству CDE. 3 categories: input (schema, range, type, completeness), processing (reconciliation in-flight, double-entry, formula parity, sequence), output (cross-system reconciliation, threshold alerts, completeness, timeliness, distribution). Противопоставляются ITGC (cross-CDE infrastructure controls).
Application control category — блокирует invalid, malformed, или out-of-domain data до того, как они попадут в source-of-truth. Реализации: PostgreSQL CHECK constraints, Kafka Avro schema через Schema Registry BACKWARD compatibility, dbt source contracts с column types + non-null + uniqueness, GE Core 1.17.1 expectation suites runs on each batch.
Application control category — гарантируют что transformation от raw input к canonical output sound и без silent corruption. Patterns: reconciliation between intermediate stages (sum match, count match), double-entry / parity (debit/credit balances), formula validation (independent codepath spot-check 100 random rows), sequence / ordering controls для event-sourced pipelines.
Application control category — ensure что final output (CDE table, regulatory file, BI dashboard feed) accurate, complete, timely, и distributed appropriately. Patterns: cross-system reconciliation (Snowflake vs Aurora delta ≤0.05%), threshold alerts (per-driver outlier >$10K/day), completeness checks (240 BU×country partitions expected daily), timeliness (T+1 06:00 UTC SLA via Airflow SLA monitor), distribution access controls (Looker RBAC, signed regulatory exports).
Level 1 в 3-level control structure. Stated outcome что организация needs to achieve to mitigate risk. Stated as desired-state, не как activity. Format: '[CDE/process/data] is/produces/maintains [quality attribute] [within tolerance/time/scope]'. Stable identifier OBJ-{cde-id}-{NN}. Per material CDE — 1-3 control objectives derived from risk register (M2).
Level 2 в 3-level control structure. Specific operational mechanism implementing objective. Stated as activity verb. Format: '[Frequency] [system/actor] [verb] [target] [tolerance/criteria] → [resulting action]'. Per objective typically 1-2 activities — defense-in-depth. Stable identifier CTL-{cde-id}-{NNN}.
Level 3 в 3-level control structure. Artefact доказывающий что activity executed AND produced expected outcome. 6 required attributes: timestamp, immutable storage (S3 object lock compliance mode), signed/authenticated (HMAC-SHA256, OIDC, gpg-signed commits), outcome captured (pass/fail с full state), retention regulatory-aligned (SOX 7y, GDPR per Art. 30, AMLR 5-7y, EU AI Act 10y; most-restrictive wins для multi-regulator CDE), queryable by date/control_id/CDE_id/outcome/actor.
Evidence удовлетворяющее PCAOB AS 1105 ¶.10 (IPE — Information Produced by Entity) accuracy и completeness testing. Required: structured JSON с full reconstructable state (input values, threshold, computed delta, version of rule applied), immutable storage S3 object lock compliance mode, signed system identity (HMAC-SHA256 + AWS KMS), retention regulatory-aligned, queryable Snowflake audit.evidence_index. Distinguishable от operational logs (Slack, mutable Snowflake tables, vendor dashboards) — operational signal vs primary evidence.
Independent comparison между двумя authoritative sources одних и тех же business facts. Patterns: count match (records ±tolerance), sum match (delta ≤0.05% SOX-grade), hash compare (per-record md5), distribution match (percentile breakdown). BCBS 239 Principle 3 explicit 'reconciliation to source'. SwiftPay 2024 incident ($2.3M DACH underpayment, type promotion divergence Aurora vs Snowflake) — concrete consequence of missing reconciliation.
Events arriving past expected window (trip completed 23:55 UTC; CDC лагает 5 мин; OLAP receives 00:01 — другой day per OLAP timezone). Naive reconciliation marks as 'missing event'. Handling pattern: close-out window (e.g., 4h buffer T+1 04:00 UTC); adjustment journal (recon_adjustments table с period, original_value, adjusted_value, late_event_count, reason, signed_by); escalation для events >24h latency.
Alternative control providing assurance when primary control impractical (например, SoD impossible в small team). Patterns: CSO/executive override (single actor combines roles + retrospective sign-off within 24h), log-everything (immutable trail-driven assurance + independent reviewer monthly), 4-eyes minimum (≥2 distinct individuals), external attestation (Big 4 quarterly sample testing). PCAOB acceptable если achieve relevant control objective + operating effectively + tested.
GitHub feature enforcing rules на specific branches (typically main). SwiftRide config: PR required no direct push; ≥2 reviewers (одна должна быть CODEOWNERS); signed commits required (gpg); dbt build/test status checks must pass; force-push disabled даже для admins. Critical preventive ITGC control для SDLC; per PCI-DSS v4.0.1 Req. 6.4 mandatory для card-data systems.
GitHub feature defining required PR approvers per file path patterns. SwiftRide example: /dbt/models/marts/swiftpay/*.sql requires @finance-lead-carlos + @data-platform-lead-priya approval. SoD enforcement через CODEOWNERS — Finance Lead reviews business correctness, Data Platform Lead reviews technical; cannot self-approve. Anti-pattern: stale CODEOWNERS listing former employees → SoD broken; fix через Okta termination flow integration + quarterly review per M4.7.
Open standardised data lineage spec; current v1.46.0 (21 Apr 2025); LF AI & Data project. Schema spec 1-1-0; column-level lineage facet, pullRequestNumber facet (PR traceability), sourceCodeLocation facet (file + commit SHA), TestRunFacet (inline test results). Emitters: dbt-openlineage, Airflow OpenLineage provider, OpenLineage-Spark, openlineage-python client. Backends: Marquez (reference), DataHub, Atlan, OpenMetadata.
Lineage tracking на уровне отдельных columns (не tables). OpenLineage columnLineage facet — per output column, inputFields list с source dataset + field + transformations. 3 transformation types: DIRECT (column-for-column propagation, identity или transformation), INDIRECT (used в WHERE/JOIN/GROUP BY, не feeds value directly), MASKING (PII obfuscation — hash, redact, tokenize). Critical для impact analysis на schema changes downstream от CDE.
OpenLineage column-level transformation type — column-for-column propagation без semantic loss. Subtypes: IDENTITY (pass-through pg-trips.fare_total_cents → stg_trips.fare_total_cents) и TRANSFORMATION (arithmetic, cast, multiplier — stg_trips.fare_total_cents / 100.0 → fare_usd). Schema change на upstream DIRECT column → downstream rebuild required + impact analysis.
OpenLineage column-level transformation type — column используется для WHERE / JOIN / GROUP BY / aggregations; не feeds value напрямую. Например, customer_id используется для earnings aggregation join; precision change может affect group cardinality, но не data values. Schema change может degrade downstream functionality но не corrupt values.
OpenLineage column-level transformation type — transformation скрывает оригинал. Subtypes: HASH (SHA-256, token), REDACT (drop chars), TOKENIZE (vault reference). GDPR Art. 25 data minimization compliance. SwiftRide example: driver_email_hash через MASKING from drivers.email (SHA-256 + per-driver salt). Schema change на masked column должна preserve masking logic — otherwise PII leak risk.
Process идентификации downstream effects от proposed change (typically schema migration на CDE). Auto-triggered через OpenLineage event → Marquez graph traversal → CI script identifies CDE-marked downstream artefacts → PR comment auto-posted с impact requirements + Data Owner sign-off. SwiftRide template: per downstream CDE breakdown DIRECT/INDIRECT/MASKING facets, estimated cumulative impact, materiality verdict, re-test requirements, signed attestation. PCAOB AS 1305 — без impact analysis control design deficiency.
CI/CD pattern блокирующий schema change на CDE без full impact analysis + downstream re-test + Data Owner sign-off. Implementation: dbt build state:modified → OpenLineage event → Marquez query downstream → CI lineage script → PR comment + CODEOWNERS approval gate. Lineage-as-control workflow per M5.8 CTL-005 SwiftRide pattern. Blocking gate (cannot merge без resolution); evidence chain S3 object lock 7y.
Reference OpenLineage backend, LF AI & Data project; current ~0.51.x. PostgreSQL storage; queryable through REST API + UI. Features: lineage graph storage с column-level facets, run tracking (START/COMPLETE/FAIL states), dataset versioning, job versioning, tags + custom facets (CDE markers stored as custom facet cde.cdeId). Operational layer; primary evidence requires separate S3 object lock 7y export.
Per DAMA-DMBOK 2 (2017): completeness, accuracy, consistency, timeliness, uniqueness, validity. Каждая отвечает на distinct question (records present? values match real-world? consistent across systems? fresh enough? no duplicates? conform to domain rules?). Multi-dimensional coverage обязателен для material CDE. Mapping к regulatory needs: BCBS 239 Principle 3-5 + GDPR Art. 5(1)(d) + IFRS 13 reliability + EU AI Act Art. 10.
PCAOB AS 1105 ¶.10 definition. Information produced by audited entity (как противоположность external source). Аудитор обязан (1) test accuracy и completeness либо controls over accuracy и completeness; (2) evaluate sufficient precision и detail для auditor's purpose. AS 1105 amended 15 Dec 2025 (Release 2024-007 — technology-assisted analysis). Каждый artefact от entity (DQ run output, reconciliation log, dashboard snapshot, attestation statement) — IPE; auditor must либо recompute independently либо test generation controls.
Mandatory attributes для audit-grade evidence: (1) Timestamp UTC ISO 8601 trusted source; (2) Dataset version + hash (Snowflake Time Travel snapshot ID, dbt manifest SHA, S3 versionId, input_hash sha256); (3) Rule / Control ID stable identifier (CTL-{cde-id}-{NNN}); (4) Result + observed values + thresholds + threshold_version (sufficient precision per AS 1105 ¶.10); (5) Exception handling chain (Jira ticket + closure + compensating control + RCA); (6) Immutable storage (S3 Object Lock Compliance Mode 7y) + signed (HMAC-SHA256 через KMS).
Direct evidence — directly observes assertion being tested (reconciliation log showing delta < threshold = direct evidence values match). Indirect evidence — supports inference (code review approval = process control; doesn't directly show output correct). Auditor stacks direct evidence more heavily. Material CDE pattern: stack indirect (ITGC — change management) + direct (application controls — reconciliation); both required. Direct без indirect = outputs correct but process не repeatable; indirect без direct = process controls but outputs не verified.
Distinct concepts per PCAOB AS 2201. Design effectiveness — control as designed could prevent/detect material misstatement if operated correctly; tested через walkthrough (1 sample per control); evidence — design documentation (control matrix, runbooks, configs). Operating effectiveness — control actually operated as designed throughout reporting period; tested через multiple samples (PCAOB norms 25 daily, 40+ high-risk); evidence — operational artefacts (90 days reconciliation logs, CI run history, attestation sign-offs). PCAOB 2024 inspection findings frequently flag conflation.
PCAOB AS 1105 ¶.07-.08 implicit ordering: (1) External independent source (bank statements, regulator filings); most reliable. (2) Internal independent source (Internal Audit 3rd line, Risk Function 2nd line). (3) Internal source с strong controls (IPE with immutable storage + HMAC sig + recompute capability) — auditor tests controls + accepts. (4) Internal source weak controls (mutable Snowflake table, no signature). (5) Management representation alone — weakest; AS 1105 explicitly insufficient для material assertions. CDE programme target tier 3+ baseline; tier 1 where feasible (bank reconciliation).
AWS S3 WORM (Write Once Read Many) storage; once written с retention, cannot be deleted даже root account. AWS docs explicitly state 'Compliance mode = WORM'. Strongest immutability guarantee для evidence. Alternative — Governance Mode (root account может bypass с 's3:BypassGovernanceRetention'); weaker. SwiftRide CDE evidence default = Compliance Mode 7y retention; bucket policy enforced; cross-region replication eu-west-1 → eu-central-1; SSE-KMS encryption separate key; lifecycle к Glacier Deep Archive at year 1 (~$1.013/TB/month vs S3 Standard $23/TB).
Single point of integrity в evidence pipeline. AWS Lambda в separate AWS account (swr-evidence-prod); 3 responsibilities: (1) schema normalization (engine output → evidence-schema-v1); (2) signature (HMAC-SHA256 через KMS key alias/swr-evidence-signing-key; rotation 90 days); (3) emit к 3 sinks parallel — S3 Object Lock (primary) + OpenLineage Kafka topic + Snowflake audit.evidence_index. IAM defence: minimal access, default-deny DeleteObject, CloudTrail logged. Compromise = evidence chain compromise — tightest review (CODEOWNERS = audit + security + data platform).
Most-restrictive wins для multi-regulator CDE. Baselines: SOX 404 / PCAOB AS 1105 = 7 years; GDPR Art. 30 per organisation retention policy (typically 6 months — 5 years); AMLR / FATF R.11 = 5-7 years post-relationship-end; EU AI Act Art. 18 = 10 years from end of placing on market; PCI-DSS v4.0.1 Req. 10.5 = 1 year minimum; IRS / national tax = 3-7 years; BCBS 239 / ECB not specifically prescribed; DORA Arts. 11-12 = through ICT lifecycle + 5y. SwiftRide CDE-SWR-003 — SOX 7y dominates; CDE-SWR-004 pricing engine — EU AI Act 10y applies если high-risk classification.
OpenLineage spec v1.46.0 event type — eventType START/RUNNING/COMPLETE/ABORT/FAIL. Identifies execution. Core fields: eventTime, run (runId + facets), job (namespace + name + facets — sourceCodeLocation git SHA), inputs, outputs, producer. Facets extensible: columnLineage, dataQualityAssertions, schema, dataSource, storage, pullRequestNumber, testRunFacet. SwiftRide custom facet swiftrideEvidence — points back к S3 immutable storage; Marquez operational + S3 archive primary evidence parallel. Emitted dbt-openlineage + openlineage-spark + Airflow provider.
OpenLineage spec event type — dataset-only event без run. Use cases: schema change на dataset (column added/removed/typed); ownership change; dataset deprecation. Distinct от RunEvent (execution-tied). Emission patterns: Snowflake DDL detector Lambda на ALTER TABLE → DatasetEvent; dbt schema changes via build manifest comparison. Audit relevance — schema evolution history visible Marquez; PCAOB completeness testing covered.
PCAOB 2024 inspection anti-pattern. Manually maintained lineage diagrams (Confluence, Lucidchart) presented as evidence; не programmatically verified; drift inevitable. AS 1105 ¶.10 IPE — auditor cannot trust manual lineage representation; sample selection broken; recompute potentially incorrect. AS 1305 ¶.01 control deficiency. Fix: automated emission from CI/orchestration (dbt-openlineage, openlineage-spark, Airflow provider); Marquez UI replaces manual diagrams; quarterly Internal Audit verification automated lineage matches actual production code.
Tiered SLA framework. SEV-1: material CDE breach; immediate customer/regulator/financial impact; PagerDuty page; SLA — detection ≤15min, triage ≤30min, containment ≤1h, resolution ≤4h, RCA ≤5 business days, preventive ≤30 days с 30-day soak. SEV-2: CDE quality degradation без immediate customer impact; SLA detection ≤30min, resolution ≤24h, RCA ≤10 business days, preventive ≤60 days. SEV-3: Tier-3 / cosmetic; backlog grooming weekly; resolution ≤1 week. Severity assignment derived from CDE tier (M4.5 registry) × rule type.
PCAOB 2024 leading deficiency category. Manager closes incident без proper RCA; forces resolution accepted before verification; bypasses change management — direct production data fix без PR; re-classifies SEV-1 to SEV-3. Detection patterns: high-volume SEV-3 backlog without aging; SEV-1 incidents closed within 1 hour (unrealistic); same manager appearing as closer для high % of incidents; RCA documents lacking contributing factors. Detective controls: closure concentration metrics; independent 2nd line review SEV-1 RCAs; Internal Audit sample 5% quarterly; pattern analysis на outlier managers.
28-day cadence для material CDE attestation. 4 stages: Gather (Days 1-7) — Aggregator builds evidence pack per CDE через Workiva/AuditBoard connectors; Review (8-21) — Business Owner reviews + 2nd line Risk Function independent review + 3rd line Internal Audit sample testing; Sign-off (22-25) — Business Owner addresses questions + electronic signature; Archive (26-28) — signed attestation к S3 Object Lock 7y + Audit Committee report. Minimum quarterly для material CDE; annual baseline для non-material; tier-1 critical may add monthly internal review.
3 mandatory sections: (1) Effectiveness statement — Business Owner attest controls operated effectively per design; summary breakdown (Total controls, Effective without exception, Effective с documented exceptions, Ineffective). (2) Exceptions list — full handling chain per incident: Jira ticket ID + severity tier + detection/closure timestamps + SLA compliance + RCA URL + preventive action SHA + soak status. (3) Action items — preventive controls в soak, patterns identified требующих cross-CDE review, resource/staffing requests. Electronic signature mandatory (DocuSign / Workiva e-sig с OIDC identity capture + tamper-evident); wet signature scanned weakest. Accompanied by 2nd line Risk Function effectiveness conclusion.
Internal Audit + 2nd line Risk Function conduct full annual sample testing before Big 4 walkthrough. 10-week lead time. Workflow: pull all 4 quarterly attestation packs → synthesise annual view → re-perform sample testing на full year sample (PCAOB norms 25-40 samples × ~30 material controls = ~750-1200 samples total) → identify potential auditor concerns → resolve before external auditor arrives. Output: gap remediation list closed; programme ready Big 4 walkthrough. Big 4 не provides dry-run (independence reasons). SwiftRide T+12M planned Q1 2027 для FY 2026 audit Apr 2027; pre-IPO listing target Jun 2027.
Average time from incident detection к resolution per severity tier. CDO Office dashboard metric. SwiftRide targets: SEV-1 < 4h, SEV-2 < 24h, SEV-3 < 1 week. Distinct от MTTD (Mean Time To Detection) и MTTR-recovery (Mean Time To Recovery в DR context). Reporting layered: CDO Office daily operational; Audit Committee quarterly aggregated; External Auditor builds independently from raw evidence (не accepts pre-aggregated metric per AS 1105 ¶.10).
Strategic quarterly reporting view; 1-page executive summary + 5-7 page backup. Metrics: programme maturity (% material CDE complete coverage), material weakness indicators, quarterly attestation summary, audit findings trajectory, regulatory exposure scoring (DORA/GDPR/SOX 404 readiness), pre-IPO listing readiness (red/yellow/green по dimensions), resource adequacy, external regulatory factors. Tools: Hex / Tableau presentation-quality; scheduled distribution; comments на cells. Distinct от CDO Office operational view (Looker daily; 5-15 metrics) и External Auditor evidence view (no aggregated; raw access only).
PCAOB inspection red flag pattern. Dashboard shows 95%+ metrics green; auditor sceptical — 'is everything really fine?'. Audit programme operating < 12 months — 100% effectiveness statistically improbable; либо thresholds too loose (controls не actually testing material risks) либо metrics gamed (definition conflation, severity reclassification). Audit Committee oversight responsibility — periodic drill into evidence layer, не accept summary face-value. Fix: ensure dashboards reflect reality including yellow/red; if everything green for ≥ 6 months, audit suspicion warranted — re-tune thresholds; Internal Audit independent verification quarterly.
SwiftRide normalised JSON schema для все evidence payloads. Mandatory fields: evidence_version, evidence_id, timestamp_utc, control_id, cde_id, engine (tool, version, run_id, expectation_suite_version, expectation_suite_git_sha), input_state (dataset_fqn, snapshot_at, snapshot_pointer, input_hash sha256), rule (rule_id, rule_logic_version, thresholds), observed_values, result, exception, lineage_event_id, execution_metadata (runner_identity, runtime_seconds, aws_account, aws_region), signature (algorithm HMAC-SHA256, key_id, value). Failed run shape adds incident_id + severity + detected_at + compensating_control_activated + regulatory_clock_started. Closure record separate linked through original_evidence_ids.
5-step process для CDE-tagged dataset schema changes: (1) pre-commit hook detection adds `cde-review-required` label; (2) CODEOWNERS routing к @data-risk-managers + @data-steward-lead + business owner; (3) impact analysis CI job — lineage scan via OpenLineage + registry lookup + regulator mapping; (4) DPO/Privacy review для PII paths; (5) CAB classification — Standard/Normal/Emergency. PR cannot merge без approvals + CAB ticket. Enforces 2L (Data Risk Manager) + 1L (Business Owner) review independence per M2.3. Anti-pattern: data team sole reviewer = Three Lines failure + AS 2201 ¶.30+ design deficiency.
ITIL 4 Change Enablement practice — weekly review forum для Normal changes. SwiftRide CAB Tuesday 10:00 UTC; composition CDO + Data Platform Lead + Risk Function + Internal Audit observer; minimum quorum 60% attendance enforced; minutes captured live; impact analysis CI output displayed; mandatory questions per CDE-touching change. eCAB (emergency CAB) — async approval через Slack thread #change-emergency для Emergency changes; minimum 3 approvers с 1L + 2L roles; post-hoc CAB review mandatory at next regular meeting. Anti-pattern: rubber-stamp (attendance < 50% + minutes pre-filled + AS 2201 ¶.30+ deficiency).
ITIL 4 — pre-approved CAB через template; routine pattern низкого risk; engineer self-service через CI/CD pipeline + CODEOWNERS. Lead time < 24h. SwiftRide ~85% of changes; criteria: low blast radius + not CDE-touching + pre-approved template ID + version (CAB-approved quarter). Allowed во freeze period (pre-approved). Anti-pattern: Standard abuse — engineer marks CDE change as 'standard' чтобы skip CAB — governance theatre + AS 1305 deficiency. Fix: classification automated (CDE-tier-derived); manual override requires CDO joint sign-off.
ITIL 4 — non-routine; impact analysis required; CAB review weekly; lead time 7-14 days; SwiftRide ~13% of changes. Approver = full CAB (CDO + Data Platform Lead + Risk Function + Internal Audit observer). Required evidence: impact analysis document (lineage scan + affected CDE + downstream consumers) + test plan + staging dry-run results + CAB meeting minutes + approval signature (Workiva) + rollback plan + 24h soak before closure. Blast radius cap ≤ 3 BU; CDE-touching but не material payment/revenue/regulatory disclosure. Blocked during freeze period; CAB-overridable только по emergency.
ITIL 4 — incident-driven; cannot wait normal CAB cycle без material business/regulatory impact; lead time < 4h; SwiftRide ~2% of changes; target rate ≤ 6/quarter. Approver = eCAB (Emergency CAB) async через Slack thread с CDO + Business Owner + Engineering on-call + Risk Function + General Counsel + Internal Audit observer; minimum 3 approvers; quorum includes 1L + 2L. Post-hoc full CAB review mandatory next regular CAB. Evidence pack post-hoc accepted but mandatory: incident ticket ref + eCAB approval audit trail + pre-deployment risk assessment 1-page signed + deployment evidence + post-hoc full CAB review + Internal Audit observer notification (material CDE). Anti-pattern Emergency-as-routine — Emergency rate > 5% indicates either CAB cadence too slow или management override per PCAOB inspection 2024.
Window когда CDE-changes блокированы или сильно ограничены. SwiftRide types: (1) Quarter-end — last 5 business days quarter + 3 after; Standard pre-approved + Emergency only с CFO + CDO joint approval + Internal Audit notification. (2) Year-end + audit cycle — 15 Dec → 31 Jan covers Big 4 fieldwork. (3) Audit dry-run — 2 weeks before quarterly attestation cycle close. (4) Pre-IPO listing window — 4 weeks pre + 6 weeks post. (5) Regulatory filing window — 1 week before DORA RoI / GDPR ROPA submission. Anti-pattern long-tail freeze: scope narrowed к CDE-touching changes only; non-CDE proceed normally; CAB capacity planned post-freeze surge.
Scope of impact если CDE change goes wrong. SwiftRide 5 dimensions: (1) affected BU count, (2) downstream consumer count (OpenLineage scan direct + transitive; threshold > 10 transitive = high), (3) financial exposure $ revenue/GMV/loan portfolio at risk ($1M/day threshold), (4) regulatory exposure (notification clocks could fire — GDPR / DORA / SEC / PSD2 / AMLR), (5) CDE tier impact (tier 1 = automatic high, weight 30). Formula combines с thresholds < 20 Low / 20-60 Medium / > 60 High; computed автоматически через CI step `cde-impact-analysis`; output PR comment + CAB ticket. Decision data-driven, не emotion-driven.
Open Data Contract Standard — спецификация от Bitol (formerly EDM Council Data Contract initiative); v3.0.0 current 2025-2026. Для CDE расширенный с `cde.*` keys: tier (1/2/3) + id (CDE-SWR-NNN) + regulatorContext (GDPR/SOX/DORA/AI Act/IFRS 9) + businessOwner + dataSteward + controlReferences + evidenceContract. ODCS contract committed git; CI runs `cde-contract-validate` parity check ↔ implementation; build fail если drift. dbt-Bitol integration Q3 2025 — `dbt-contracts` плагин читает `meta.cde.*` keys; validates schema match. Anti-pattern post-hoc contract = AS 2201 design deficiency.
Configuration Management Database classification для CDE-bearing systems. Per-system attributes: system_id, system_name, system_type (application/database/cache/message-broker/BI/ETL/SaaS-vendor/infrastructure), business_owner, data_steward, cde_handling.stores/processes/transmits (list CDE-IDs), criticality (max CDE tier), regulator_context (GDPR/SOX/DORA/AI Act/PSD2/IFRS/AMLR flags), bcp_ref (BIA reference), lifecycle_state, dependencies upstream/downstream, vendor_relationships, cost_center, evidence_endpoint, last_verified. SwiftRide stack: Backstage primary + ServiceNow CMDB secondary (Yokohama release Q4 2025).
Runtime mechanism propagating ownership / classification metadata через всю infrastructure. SwiftRide 6 layers: catalog (OpenMetadata tagFQN 'CDE.tier-1' через governance classification glossary) → IaC (Terraform module cde_tagged_resource reads catalog + propagates) → AWS resource tags (S3, Snowflake, ECS, RDS) → Snowflake object tags v2 (tag inheritance database → schema → table → column; masking policies bound к tags) → Kubernetes labels + Datadog tags → evidence emission (audit.evidence_index queryable). Standard tag schema 9 keys: cde:id + cde:tier + cde:business_owner + cde:data_steward + cde:regulator_context + cde:bcp_ref + cde:retention + cde:sensitivity + cde:evidence_endpoint.
Backstage 1.30.x plugin SwiftRide `swr-cde-scorecard` — per-system score 7 weighted checks: CDE tag completeness (25%) + ownership freshness < 90 days (15%) + Terraform-managed/no drift (20%) + BCP reference linked (10%) + evidence pipeline operational < 24h (15%) + OpenLineage active < 24h (10%) + Backstage descriptor up-to-date < 30 days (5%). Per-CDE rolled-up score. Thresholds: tier 1 ≥ 90%; tier 2 ≥ 80%; tier 3 ≥ 70%. Dashboard visible CDO Office + Audit Committee; trending tracked M8.8 KPI. SwiftRide T+12M 60% adoption; T+15M target 100%.
SwiftRide standard pattern `cde_tagged_resource` Terraform module wraps CDE-bearing resources; validates `cde.id` exists OpenMetadata catalog; validates `cde.tier` matches registry; applies AWS resource tags (S3/RDS/ECS) + Snowflake object tags; emits Terraform output к metadata-emitter Lambda (drift baseline); emits OpenLineage event 'cde-resource-tagged'; calls Backstage catalog API для component registration. Direct AWS resource type usage для CDE-paths blocked в CI check. Anti-pattern tag-but-don't-enforce — drift accumulates; fix CI step cde-resource-tag-validate.
Daily 03:00 UTC automated `terraform plan` job over all CDE-tagged tfstates; detects state-vs-declaration divergence. Sources: manual AWS Console changes, auto-scaling actions, vendor-side updates, tag rotation incomplete. Severity classification: SEV-1 (tag deletion / encryption disabling / public access enabling); SEV-2 (ownership tag change / retention change); SEV-3 (cosmetic). Drift detected = either approved change (CAB approval missing → governance gap) или unauthorized change. Both = control deficiency under AS 1305 ¶.01. SwiftRide Q3 2026 detected 14 SEV-1/2 events; 12 resolved SLA; 2 escalated.
Параллельные notification clocks начинаются T+0 (detection) для CDE incidents. Per regulator: GDPR Art. 33 72h к DPA; GDPR Art. 34 'without undue delay' к data subjects; DORA Art. 19 4h initial / 72h intermediate / 1 month final; SEC Form 8-K Item 1.05 4 business days from materiality determination (effective 5 Sep 2023); PSD2 Art. 96 4h initial / interim / closure; NIS2 Art. 23 24h early warning / 72h notification / 1 month final; AMLD5 SAR 'without delay' (24-48h national); AMLR national supervisor 'without undue delay'. Multi-regulator coordination — single source of truth incident document + per-regulator template mapping + coordinated submission timeline для cross-regulator consistency.
Pattern coordinating notification submissions across parallel regulator clocks для consistency. Different regulators expect different message wording, different impact estimates, different remediation commitments. Inconsistency = supervisory finding. SwiftRide pattern: (1) Single source of truth incident document Confluence + S3 archive; updated as facts solidify. (2) Per-regulator template mapped от source document; General Counsel pre-approved templates. (3) Coordinated submission timeline — most-restrictive deadline drives cadence; subsequent submissions reference earlier ones. (4) Cross-functional bridge call — all regulator clocks discussed jointly. Tipping points: material data deviation → SEC/SOX (post-IPO); customer-facing impact → PSD2/DORA/GDPR; cross-border flow disruption → multiple DPA notifications.
Data Processing Agreement per GDPR Art. 28(3) 14 mandatory fields: (1) subject matter; (2) duration; (3) nature + purpose; (4) type personal data; (5) categories data subjects; (6) controller obligations + rights; (7) processor only on documented instructions (Art. 28(3)(a)); (8) confidentiality (Art. 28(3)(b)); (9) security measures Art. 32 (TOMs); (10) sub-processor restrictions (Art. 28(3)(d)); (11) data subject rights assistance (Art. 28(3)(e)); (12) Art. 32-36 obligations assistance (security + breach + DPIA); (13) deletion/return at end (Art. 28(3)(g)); (14) audit + inspection rights (Art. 28(3)(h)). SwiftRide template ~32 pages; variable sections TOMs + sub-processor schedule + TIA для non-EU vendors per CNIL Jan 2025; breach notification SLA 24h vendor → SwiftRide window.
SOC 2 Section IV — controls expected of customer для overall control framework. Vendor SOC 2 unqualified opinion presumes CUEC implemented. SwiftRide responsibility: map CUEC controls к SwiftRide controls (CTL-CDE-*); implement + test annually; evidence S3 evidence pipeline parallel к main CDE controls; quarterly attestation includes CUEC implementation status per vendor. Snowflake SOC 2 typical 14 CUEC; SwiftRide examples: monitor auth failures (CTL via Looker dashboard daily review), enforce MFA privileged users (Okta), key rotation 90-day cycle (Terraform-managed), masking policies (Snowflake column-level), access reviews quarterly (M7.5 attestation). Anti-pattern SOC 2 filed-and-forgotten — Risk Function annually extracts CUEC + maps + quarterly attestation coverage %.
DORA Arts. 28-44 requires annual register; first submission 30 April 2025. Fields per ESA template: entity identification (LEI, organization tree); ICT third-party provider identification (LEI, country, parent); contract characteristics (start, end, scope, criticality); function categories (RTS taxonomy); ICT services received; critical or important function support (yes/no per function); sub-contractor chain (LEI tree); substitutability of provider (exit strategy availability); cross-border data flows; concentration risk markers. SwiftRide workflow: CMDB → automated extraction quarterly → CDO + Risk Function + General Counsel review → vendor master cross-reference (LEI / parent / sub-processor) → substitutability analysis → ESA portal annual submission → S3 Object Lock 7y archive.
DORA Art. 31 — ESA-designated providers с criticality score. First list of 19 CTPPs published 18 Nov 2025 by EBA/EIOPA/ESMA jointly — includes hyperscale cloud providers (AWS, GCP, Azure), data-centre/colocation, financial-services-specific tech. Implications для CTPP: nominate EU legal entity if non-EU origin; pay annual oversight fees; accept ESA inspection rights; comply CTPP-specific obligations (TLPT, incident reporting к ESAs). Implications для financial entity using CTPP: additional subcontractor due diligence per Art. 30; documentation overhead; TLPT scope extends к CTPP-dependent services; contractual minimums increased Arts. 30-34. SwiftRide AWS designated CTPP = Q1 2027 contractual review.
DORA Art. 28(3)(g) + GDPR Art. 28(3)(g) — documented + tested plan migrating away from vendor если необходимо. 5 elements: (1) subprocessor/vendor lock-in assessment (data formats portable, APIs standardized, skills transferability); (2) migration plan concrete steps (target alternative provider, data export approach + format, application refactoring scope, timeline + cost estimate); (3) dual-running period (parallel + reconciliation parity + cutover criteria); (4) data return/destruction per DPA (certificate of destruction + SwiftRide-side verification); (5) periodic testing (annual tabletop exercise + quarterly plan freshness + lessons learned). Pre-IPO mature exit strategy для top-3 vendors expected by Big 4 auditor. Anti-pattern exit strategy theatre — document exists never tested.
Comprehensive overlay для CDE-touching AI/ML models combining EU AI Act Art. 10 + Annex IV + Annex III + SR 26-2 + SOC 2 AI/ML adaptation + drift monitoring + bias examination. Elements: Annex III high-risk classification (workers management / credit scoring / etc.); Art. 10 data governance for training (relevance + representativeness + errors-free + completeness + bias examination + special-category Art. 9 safeguards); Annex IV technical documentation pack (general description + system + risk-management + post-market monitoring + declaration of conformity + CE marking + instructions); SR 26-2 alignment (independent validation 2L + continuous monitoring + Three Lines); SOC 2 CUEC mapping для AI/ML-specific vendor (Vertex AI / Databricks ML). SwiftRide pricing engine V3 + SwiftCapital ECL V2 + matching V4 = 3 high-risk models.
Relationship between inputs и outputs changes (true labels drift; surge multiplier patterns change post-pandemic). As CDE control failure perspective: drift = signal training assumption no longer holds; model output may не be reliable; potential material misstatement if model feeds financial/regulatory decisions. SwiftRide monitoring threshold per model: pricing engine PSI for predictions > 0.2 daily SEV-2; SwiftCapital ECL prediction vs actual default rate > 1 SD weekly SEV-1. Drift detected → triggers M7.4 incident workflow; RCA + preventive action mandatory; risk register updated. Anti-pattern drift not connected к incident management.
Input feature distributions change (demographics shift, new geography onboarded, missing feature for new cohort). Different от concept drift (input-output relationship change). SwiftRide monitoring: KS-statistic feature distributions threshold > 0.15 daily для pricing engine. Detection through statistical tests on training vs production feature distributions; visualised dashboards с alerts. Triggers SEV-2 incident → bias examination triggered + retraining considered. EU AI Act Art. 10 explicit requirement к monitor representativeness + gap identification; data drift = manifestation of misalignment.
Federal Reserve SR 26-2 published 17 April 2026; rescinds SR 11-7 (2011) + SR 21-8 (2021); OCC Bulletin 2026-13 + FDIC FIL-15-2026 parallel. Key changes from SR 11-7: explicit risk-based scaling (smaller community banks lighter touch); AI/ML explicit в scope (SR 11-7 предшествовала modern AI); foundation model/GPAI considerations (reference EU AI Act + NIST AI RMF); continuous monitoring expectation; Three-line model alignment (owner 1L + independent validation 2L + audit 3L). SwiftRide derivative compliance — SwiftCapital partners US banking partner = partner subject SR 26-2; own internal alignment for SwiftPay US expansion. Maps к CDE governance: model inventory + independent validation + ongoing monitoring + documentation + validation cycle annual tier-1 / biennial tier-2 + change management.
SwiftRide CDE-function operating model T+15M — 12 people: CDO (1) + Data Risk Manager x2 (financial CDE focus + AI/privacy CDE focus) + Data Steward Lead (1) + Stewards x6 (per BU: SwiftPay/SwiftCapital/Rides/Delivery/SwiftAds/Marketplace) + Control Tester x2 (independent testing arm) + AI Risk Specialist (1). ~$2.3M annual loaded cost; ~0.4% of net revenue $2.1B TTM. Reports CEO; matrixed с CRO Risk Function для ERM aggregation; functional reporting Internal Audit к Audit Committee. Alternative patterns: CRO Office (risk-led, established banks); Compliance Office (legal-led, insurance/pharma); hybrid post-IPO.
Per IIA Three Lines Model 2020 — Operations + Management. Owns risks; runs day-to-day controls. SwiftRide 1L для CDE: Business Owner per BU (SwiftPay/SwiftCapital/Rides/Delivery/SwiftAds/Marketplace); engineering teams running controls; data product teams. Accountabilities: day-to-day evidence collection; control owner accountability — controls в production должны work; quarterly attestation sign-off (M7.5); incident handling 1L per M7.4. RACI: Accountable за BU CDE; Responsible за operational evidence collection.
Per IIA Three Lines Model 2020 — Risk + Compliance functions. Provides expertise + monitoring + challenge. SwiftRide 2L для CDE: CDO Office (CDO + Data Risk Manager + Data Steward Lead + Control Tester + AI Risk Specialist) + CRO Risk Function (independent review per attestation cycle). Accountabilities: risk methodology; programme oversight; independent review per attestation cycle (M7.5); 2L review 1L deliverables; CDO matrixed (2L expert + accountable owner); CRO Risk Function performs independent review (preserves 2L challenge function).
4 categories: (1) Coverage — programme scope; metrics CDE coverage %, tier-1 coverage %, control coverage %, lineage coverage %, vendor coverage %. (2) Control Effectiveness — quality; metrics control effectiveness %, SEV-1 control failure rate, attestation completion %, drift detection coverage %. (3) Operational — daily-running; metrics MTTR SEV-1 incidents, first regulator notification time, evidence pipeline completeness, change emergency rate, drift incident rate. (4) Audit Outcomes — external validation; metrics audit findings rate critical, findings closure timeline, recovery test pass rate, external auditor opinion class. Per metric — formula + target T+18M + accountable + drill-down. SwiftRide trajectory T0 (Q4 2025) → T+18M (Q2 2027): CDE coverage 8% → 92%; control effectiveness 62% → 94%; MTTR not measured → 3.6h; audit findings critical 11 → 1.
Anti-pattern KPI design — activity-based не outcome-based; '12 controls deployed Q3' sounds impressive; doesn't reflect effectiveness or coverage. Looks busy; не measures outcome. Fix: outcome-based metrics dominate — effectiveness %, coverage %, MTTR; activity metrics supplemental only. Related anti-patterns: gaming metrics (severity manipulation; PCAOB management override pattern); single-number dashboard (composite hides risk concentration; AS 2201 transparency expectation unmet); green-everywhere (statistical improbability; PCAOB inspection red flag); lagging-only (no forward indicators; no programme steerage; balance leading + lagging).
KPI Audit Outcomes category — count of critical findings / total findings × 100%. Critical = material weakness candidate per AS 1305. SwiftRide target T+18M ≤ 5% critical of total + ≤ 2 absolute. Trajectory: T0 (pre-IPO assessment Q4 2025) 11 critical / 25 total = 44% → T+9M 6/19 = 32% → T+15M 3/22 = 14% → T+18M 1/18 = 5.6%. Related: findings closure timeline (target ≤ 90 days critical / ≤ 180 days medium); external auditor opinion class (target unqualified — direct IPO blocker). Accountable: CDO + Audit Committee oversight.
Complete set of artefacts презентуемый external auditor: 8 категорий — (1) CDE Registry с approval workflow log; (2) Controls matrix + test plans + ITGC inventory + IPE designations; (3) Evidence samples + OpenLineage trail + reperformance capability через S3 immutable storage; (4) Exceptions log с RCA + recurrence analysis + AS 1305 classification; (5) Attestations (per-CDE quarterly + Section 302 + Section 404); (6) BIA + RTO/RPO + DRP test results; (7) Runbooks с execution traces + tabletop exercises; (8) Vendor SOC reports + CUEC implementation + DORA Register of Information. Auditor reading order — sequential 1→8 reflects logical dependency: scope → design → operating → exceptions → attestation → resilience → response → third-party. SwiftRide T+18M package — Workiva-indexed; instant retrieval через sampling API; не PDF dump.
Pre-final-audit engagement Big 4 для simulating walkthrough + surfacing deficiencies с remediation runway. SwiftRide T+12M dry-run: $280k Big 4 senior team engagement; 4 weeks; output 8 findings (3 critical / 4 medium / 1 minor); no material weakness candidates. 6 months runway для closure до final external audit T+18M. Critical timing — too early (T+6M) = nothing to audit; too late (T+15M) = no runway. Sweet spot — после 2 attestation cycles, before final audit. Findings closure tracking: 5 of 3 critical closed by T+15M; 3 в Q+6 remediation plan; auditor confidence boosted («we know what to fix»). PCAOB-aware: findings patterns align с inspection spotlight 2024 = healthy signal.
Sequential review of audit-readiness package в logical dependency order 1→8: Registry (scope) → Controls (design) → Evidence (operating effectiveness) → Exceptions (deficiency detection + AS 1305 classification) → Attestations (management assertion AS 2201 ¶.30-34) → BIA (resilience) → Runbooks (response) → Vendor SOC (third-party reliance). Each layer depends on prior — нельзя test controls without registry universe; нельзя evaluate exceptions without control baseline; нельзя rely на attestations без supporting evidence; etc. SwiftRide programme organises material in reading order; first 90 minutes of opening session = whether package real or performance. Reading flow knowledge enables programme to anticipate auditor questions + provide instant retrieval.
Internal exercise pre-external-audit где senior IA acts как «audit partner» — asks 10 toughest hypothetical questions; programme answers; gaps surface. SwiftRide simulation questions: (1) reclassification rationale; (2) compensating control когда primary unavailable; (3) BO pushback exception case; (4) bypass detection mechanism (SDLC gate); (5) AI Act conformity assessment status; (6) AS 1305 material weakness vs significant deficiency; (7) vendor concentration mitigation; (8) end-to-end SEV-1 walkthrough; (9) dry-run findings closure; (10) auditor priorities recommendation. Healthy programme answers structurally (frameworks + evidence + remediation plan); weak programme defensive или evasive. Run 2-3 weeks before final external audit.
Annual PCAOB staff publication (March each year for prior-year activity) identifying audit firm deficiencies. 2024 spotlight (Mar 2025): aggregate Part I.A deficiency rate 39% (down from 46% 2023); Big Four 20% (down from 26%); #1 cause — «deficiencies in firms\' testing of ITGCs over logical access and change management». Translation для CDE programmes: external auditors will focus testing on access management + change management ITGCs; if your programme weak here, expanded direct testing burden + opinion risk. Programme should heavy-invest M5.2 (ITGC) + M8.2 (change mgmt). Canonical annual reading; cross-reference с your dry-run findings — alignment = healthy signal.
[PCAOB Spotlight Mar 2025](https://pcaobus.org/documents/staff-update-2024-inspection-activities-spotlight.pdf)Logical relationship between programme activities determining sequence + parallel execution opportunities. SwiftRide 14-activity roadmap: A1 (Mandate) → A3 (Discovery) → A4 (Registry) → A5 (Controls) → A7 (Evidence pipeline) → A9 (Workiva) → A13 (Dry-run) → A14 (Final audit). Critical path = sequence невозможно compress. Parallel opportunities: A2 (OpenMetadata adoption) || A1; A6 (BIA) || A5 (Controls); A11 (Vendor) || A10 (SDLC). Dependency violations — anti-patterns: SDLC gate без registry = gate без criteria; Workiva Q+1 = shelfware; controls без registry = orphan controls. Manager управляет network propagation, не linear deliverables — registry update propagates к controls + BIA + evidence schema + KPI baseline.
Structured 18-month roadmap template — per quarter (Q+0 → Q+6) define: (1) milestones (id, label, activities, success criteria, blocker if missed); (2) headcount (per role); (3) costs (payroll + tooling + consulting + total); (4) risks in quarter (severity + mitigation); (5) audit committee briefing materials. SwiftRide actual: 7 quarters × 4-6 milestones avg = 30-40 milestones total; revision triggers — regulatory developments, capacity slips, tooling pivots, risk re-prioritisation; semver versioning roadmap document; CDO proposes, Risk Function challenges, Audit Committee approves material changes; documentation preserved.
Certification от DAMA International — data management profession breadth cert. Levels: Associate ($450) / Practitioner ($800) / Master ($1500+) / Fellow. Tests DMBOK 2nd edition (2017) — 11 knowledge areas: governance, modelling, architecture, quality, metadata, storage, security, integration, document management, reference data, BI, MDM. Exam 110 multiple-choice questions, 90 minutes, Pearson VUE. CPE 120 hours / 3 years. Career: foundational к senior. Required by некоторые CDO job descriptions. SwiftRide cert pattern: CDO holds Practitioner; Head of Data Governance pursued Practitioner during programme; Senior Data Engineer pursued Associate. Single most-recognised data-management cert globally.
ISACA certification — most-respected IT audit cert. Coverage: information systems auditing process; governance & management of IT; systems acquisition / development / implementation; operations / business resilience; protection of information assets. 150 multiple-choice; 4 hours; Pearson VUE. Prerequisites: 5 years IS audit/control/security experience (waivable to 2 years with education). $575 member / $760 non + $135 application. CPE 120 / 3 years (min 20/year). SOX practice mostly relies on CISA-holders for ITGC testing — Big Four ~70% prevalence senior associates. Cert чаще всего chosen by IT-audit-trajectory IA team members.
ISACA certification — IT risk management cert. Coverage: IT risk identification; assessment; response & mitigation; risk and control monitoring & reporting. Bridges IT и enterprise risk perspectives. Same cost as CISA ($575 member). 150 multiple-choice; 4 hours. Prerequisites: 3 years experience in 2 of 4 CRISC domains (more waivable than CISA). CPE 120 / 3 years. Useful for 2nd line Risk Function — risk identification + response. Less audit-focused than CISA; more risk-management-focused. SwiftRide 2nd Line Risk Officer holds CRISC; Vendor Governance Lead pursued CRISC during programme.
ISACA certification — privacy engineering cert (relatively new; launched 2020). Coverage: privacy governance; privacy architecture (PETs, anonymisation, encryption); data lifecycle management. 120 multiple-choice; 3.5 hours. Prerequisites: 3 years experience in 2 of 3 CDPSE domains (relatively waivable). $575 member / $760 non. CPE 120 / 3 years. Engineering-specific (vs CIPP/E lawyer-track) privacy cert. Bridges DPO regulatory knowledge с engineering implementation. GDPR-era launch; steadily gaining recognition в multi-jurisdiction privacy roles. SwiftRide DPO + 2nd Line Risk + Privacy Engineers pursued.
IIA certification — only cert specifically for internal audit profession. 3 parts: essentials of internal auditing; practice of internal auditing; business knowledge for internal auditing. Aligned с IIA Global Internal Audit Standards 2024 (effective 9 Jan 2025). Cost: $245 application + $395-450 per part = $1500+ total. 6-12 months progression. Prerequisites: bachelor + 24 months IA experience (waivable to 12 months with MA/CIA-program). CPE 40 hours/year (IIA member) / 80 hours / 2 years (practicing CIA). Mandatory expectation for most senior IA roles SOX-listed companies. SwiftRide Head of IA holds; Senior IA pursuing during programme.
IIA certification — risk-based audit + risk management assurance specialisation. Coverage: organisational governance related to risk management; principles of risk management processes; assurance role of internal audit. 100 multiple-choice; 2 hours. Prerequisites: CIA required для fast track; otherwise CRMA-only candidate. Cost: $300 (CIA holder) / $450 (non-CIA member) / $530 (non-member). 2-3 months prep. CPE 20 hours/year + maintenance CIA if held. Specialisation на top of CIA для risk-based audit work. Less universally required than CIA. Valuable для CDE programmes где IA role significant. SwiftRide Head of IA pursued during programme.
EDM Council certification — practical assessment leadership; teaches DCAM 3.0 capability model (8 components: program; business case; funding; data architecture; technology architecture; data quality; data governance; analytics management) + how to conduct capability assessments для organisations. Workshop-based + capstone assessment, не multiple choice. $2500-5000 (training + cert package). 1-2 months intensive. Prerequisites: data management experience; EDM Council membership recommended. ECB references DCAM в supervisory dialogues с banks. Most-recognised data-management capability model в banking + financial-services. Practical assessment tool, не theoretical. SwiftRide CDO pursued DCAM Assessor при joining (2024).
BCS (British Computer Society) certification — practical GDPR + UK GDPR implementation. Coverage: GDPR Articles in depth; DPIA methodology; data subject rights handling; ICO enforcement framework; international transfers. Multiple choice + case study; UK-centric. $500-800 (training + exam). 2-3 months. Prerequisites: none typically. Minimal CPE. Practical (vs CDPSE more architectural) privacy cert. Strong в UK + EU; recognised by ICO. Less rigorous than IAPP CIPP/E but cheaper + faster. Useful starter for privacy specialists или DPO team members in early career.
International Compliance Association certification — UK-based AML specialisation; widely-recognised. Coverage: AML legal framework + risk-based approach + customer due diligence + transaction monitoring + suspicious activity reporting + sanctions + politically exposed persons. Course-based + exam. ICA certifications structured into levels — Certificate / Specialist Certificate / Diploma. Useful для SwiftPay roles, AML compliance specialists, AML transaction monitoring engineers. Equivalent US-based: ACAMS CAMS (Association of Certified Anti-Money Laundering Specialists). SwiftRide AML Compliance team typically pursue both ICA + ACAMS для cross-jurisdictional coverage.