All test scripts and results are stored in the under \docs\tests\ . 6. Operational Performance | Metric | Target | Actual (Q1 2026) | Comments | |--------|--------|------------------|----------| | Avg. Run Time | ≤ 20 min (full load) | 17 min | Stable after 2025‑Q4 tuning. | | CPU Utilization (IR) | ≤ 70 % | 55 % | Auto‑scale kept usage low. | | Memory Utilization | ≤ 80 % | 63 % | No OOM events. | | Disk I/O (ADLS) | ≤ 5 GB/s | 4.2 GB/s | Within limits. | | Success Rate | ≥ 99.5 % | 99.8 % | 2 runs failed due to FTP timeout – fixed in patch 527‑01. | | Error‑Row Rate | ≤ 0.1 % | 0.07 % | Mostly invalid postal codes; routed to error folder. |
All data flows use (default 8 pipelines) and checkpoint to enable restartability. 5. Development & Testing | Phase | Activities | Tools | Acceptance Criteria | |-------|------------|-------|----------------------| | Requirements | Business rule workshops, data‑dictionary mapping | Confluence, Excel | Signed‑off BRD & data‑model. | | Design | Package diagram, control flow, data‑flow mapping | Visual Studio 2022 (SSDT) | Review sign‑off by Architecture Board. | | Implementation | Build package, parameterize connection strings, add logging | SSDT, Azure Key Vault | No hard‑coded secrets; unit‑test coverage ≥ 80 %. | | Unit Test | Row‑level validation, type‑casting, error‑path | NUnit + SSISDB Test Harness | Pass 99.9 % of test cases. | | Integration Test | End‑to‑end run against sandbox (masked data) | Azure DevTest Labs | Latency ≤ 30 min; error‑rate ≤ 0.05 %. | | UAT | Business users validate sample datasets | Power BI dashboards | Data matches source reports ± 0.1 %. | | Production Deployment | CI/CD pipeline promotes from dev → test → prod | Azure DevOps (YAML) | Zero‑downtime deployment, rollback < 5 min. | SSIS-527
Key outcomes to date:
| Metric | Target | Actual (Q1 2026) | |--------|--------|-----------------| | Daily records processed | 12 M | 11.7 M | | End‑to‑end latency (source → lake) | ≤ 30 min | 22 min | | Data‑quality error rate | ≤ 0.1 % | 0.07 % | | Package‑run success rate | ≥ 99.5 % | 99.8 % | | Resource utilization (Avg. DWU) | ≤ 80 % | 62 % | All test scripts and results are stored in