← Frameworks / CBEST / Coverage Analysis

CBEST Threat Intelligence-Led Penetration Testing โ€” SP 800-53 Coverage

How well do NIST SP 800-53 Rev 5 controls address each CBEST requirement? This analysis maps from framework clauses back to SP 800-53, with expert coverage weightings and gap identification.

Clauses: 10
Avg Coverage: 61.8%
Publisher: Bank of England
Coverage Distribution
Full (85-100%): 0 Substantial (65-84%): 6 Partial (40-64%): 3 Weak (1-39%): 1

Clause-by-Clause Analysis

Sorted by clause
CBEST.1 Governance and Oversight

Rationale

PM-01 information security program plan and PM-09 risk management strategy provide the organisational governance framework within which penetration testing sits. PM-02 senior information security officer establishes executive-level accountability. PM-29 (Rev 5) risk management program leadership addresses board-level engagement. PM-14 testing/training/monitoring programme creates governance oversight of testing activities. PL-01 planning policy and PL-02 system security plans establish the documented framework. CA-01 assessment policy and CA-06 authorisation provide the approval framework for security assessments.

Gaps

CBEST governance requires specific elements not addressed by SP 800-53. An executive sponsor is accountable for the assessment. A Control Group runs it, and its coordinator (the CGC) handles governance, quality assurance, project management and stakeholder coordination. The regulator approves any change to the Control Group, and only its members know of the test. The 2024 guide sets each party's duties in a RACI matrix (Annex B) and lists the minimum criteria a test must meet to count as CBEST (Annex A). SP 800-53 governance controls address security programme oversight but not the regulatory coordination and structured engagement model that CBEST mandates.

CBEST.2 Threat Intelligence Phase

Rationale

PM-16 (Rev 5) threat awareness programme establishes an organisational threat intelligence capability. RA-03 risk assessment and RA-05 vulnerability monitoring provide risk identification context. RA-10 (Rev 5) threat hunting addresses proactive threat-based analysis. PM-15 security groups and contacts enables participation in information-sharing communities relevant to threat intelligence. SI-05 security alerts and advisories supports integration of external threat feeds. These controls provide a foundation for threat awareness but do not address the bespoke intelligence gathering that CBEST requires.

Gaps

CBEST's threat intelligence phase is a specialised intelligence discipline that goes far beyond SP 800-53's threat awareness controls. Gaps include: targeted threat intelligence gathering specific to the firm's critical functions and UK financial infrastructure, development of bespoke threat actor profiles based on intent, capability, and opportunity assessment, creation of attack scenarios derived from real-world adversary tradecraft (TTPs) targeting the specific organisation, CBEST-mandated use of accredited Threat Intelligence Providers (TIPs) with financial sector expertise, delivery of a formal Threat Intelligence Report conforming to CBEST reporting standards, and intelligence-led targeting that drives the penetration test scope rather than generic vulnerability assessment.

CBEST.3 Penetration Testing Scope

Rationale

CA-08 penetration testing directly addresses the need for offensive security testing and scoping. PM-11 mission/business process definition and PM-08 critical infrastructure plan identify the critical functions and systems that should be in scope. RA-09 (Rev 5) criticality analysis identifies the most critical system components. RA-02 security categorisation classifies assets by impact. CM-08 system component inventory and CM-12 (Rev 5) information location support identification of in-scope systems and data flows. SA-09 external system services covers the oversight of, and agreements with, a service provider whose systems come into scope.

Gaps

CBEST scoping starts from important business services rather than generic risk assessment. The regulator names the services, the Control Group proposes the key systems behind each one from an impact assessment, and the two agree the compromise actions in a Scope Specification that the executive sponsor signs off. Testing runs on live production systems unless legal or ethical limits apply, and the compromise actions carry through to the threat intelligence scenarios and the test plan. Where a service depends on a third party, the third party may need to join the Control Group under the same secrecy rules, as the guide's supplementary guidance on outsourcing and third-party scenarios describes. SP 800-53 addresses system inventory, criticality and the oversight of external providers, but not this intelligence-led scoping agreed with the regulator.

CBEST.4 Red Team Execution

Rationale

CA-08 penetration testing is the closest control, authorising controlled attack simulation. SC-26 (Rev 5) honeypots and SC-35 (Rev 5) honeyclients provide deception technology relevant to red team evasion and detection testing. RA-06 technical surveillance countermeasures addresses specialised offensive assessment. RA-10 (Rev 5) threat hunting covers proactive adversary emulation techniques.

Gaps

CBEST red team execution is a highly specialised adversary simulation discipline that SP 800-53 does not prescribe. Gaps include: controlled multi-vector attack simulation replicating real adversary TTPs across network, application, social engineering, and physical vectors, stealth and evasion techniques that test the organisation's detection capabilities without triggering premature discovery, campaign management spanning weeks or months mimicking advanced persistent threat (APT) lifecycle, use of custom tooling and tradecraft calibrated to the threat intelligence scenarios, real-time coordination with the white team to manage safety and risk during live testing of financial infrastructure, command and control (C2) infrastructure setup and management, and lateral movement and privilege escalation within production environments. CA-08 authorises penetration testing but provides no guidance on red team tradecraft, campaign execution, or adversary emulation methodology.

CBEST.5 Blue Team Assessment

Rationale

SI-04 system monitoring and AU-06 audit review/analysis/reporting are the core detection controls tested during a blue team assessment. AU-13 monitoring for information disclosure addresses detection of data exfiltration. IR-04 incident handling and IR-05 incident monitoring evaluate the SOC's response process. CA-07 continuous monitoring and PM-14 testing/training/monitoring programme provide the framework for ongoing detection capability assessment. SC-07 boundary protection addresses network-level detection at security boundaries.

Gaps

CBEST blue team assessment evaluates detection and response effectiveness against the specific red team activity, going beyond what SP 800-53 detection controls address. Gaps include: measurement of detection time (mean time to detect) against specific adversary techniques, assessment of SOC analyst capability to identify and escalate sophisticated attack activity, evaluation of detection coverage gaps against the MITRE ATT&CK techniques employed by the red team, analysis of alert fidelity and false positive rates under adversary simulation conditions, assessment of the blue team's ability to correlate indicators across multiple detection sources during an active campaign, and evaluation of whether the blue team could have disrupted the attack at key kill chain stages. SP 800-53 mandates monitoring and detection controls but does not prescribe how to evaluate their effectiveness against realistic adversary simulation.

CBEST.6 Findings and Remediation

Rationale

CA-05 plan of action and milestones (POA&M) and PM-04 plan of action milestones process provide structured remediation tracking. RA-05 vulnerability monitoring addresses technical vulnerability identification and reporting. RA-07 (Rev 5) risk response ensures identified risks receive appropriate treatment decisions (accept, mitigate, transfer, avoid). SI-02 flaw remediation addresses patching and technical remediation. PM-31 (Rev 5) continuous improvement drives systematic improvement based on assessment findings.

Gaps

CBEST findings and remediation have specific requirements beyond SP 800-53's remediation controls. The Control Group drafts a Remediation Plan on the regulator's template, drawing on the threat intelligence and penetration test reports and on the weakest areas of the threat intelligence maturity and detection and response assessments. The regulator reviews the draft with the firm in a workshop. The final plan ties each technical finding to business risk and the important business services, records input from the board and senior management, covers tactical and strategic fixes, and applies the lessons to areas outside the test. The regulator then tracks the plan for six to twelve months or longer, and the firm reports progress on the template and confirms when actions close. SP 800-53 covers plans of action and risk response, but not this plan reviewed and supervised by the regulator.

CBEST.7 Assurance and Reporting

Rationale

CA-02 control assessments provide the framework for security assessment reporting. CA-05 POA&M and CA-07 continuous monitoring support ongoing assurance activities. PM-06 measures of performance tracks security programme effectiveness. PM-14 testing/training/monitoring programme governs the overall assessment lifecycle.

Gaps

CBEST reporting follows a prescribed regulatory format that SP 800-53 does not address. Gaps include: formal regulatory reporting to the PRA/FCA including the CBEST Summary Report and detailed Technical Report, executive summary suitable for board-level presentation covering threat landscape, test outcomes, and strategic risk implications, structured findings classification using the CBEST severity taxonomy (not generic risk ratings), confidential regulatory debrief with the PRA/FCA supervisory team, assurance that findings are communicated through appropriate governance channels including the firm's risk committee, and comparison of findings against the firm's risk appetite and operational resilience self-assessment. SP 800-53 addresses assessment reporting but not the regulatory-specific reporting obligations and formats that CBEST mandates.

CBEST.8 Provider Qualification

Rationale

SA-04 acquisition process establishes security requirements for service providers. SA-09 external system services governs the use of external service providers. SA-21 (Rev 5) developer screening addresses personnel vetting for external providers. PS-03 personnel screening provides a framework for background checks on testing personnel. PS-07 external personnel security addresses third-party staffing requirements. SR-06 supplier assessments (Rev 5) enables evaluation of provider capability and trustworthiness.

Gaps

CBEST provider qualification is an accreditation regime that SP 800-53 does not address. The Bank of England accredits the threat intelligence and penetration test service providers (TISPs and PTSPs), which must also be members of CREST and keep to its codes of conduct and ethics. Each provider employs certified individuals: a CREST Certified Threat Intelligence Manager (CCTIM) for threat intelligence, and for testing a CREST Certified Red Team Manager (CCRTM) or a Cyber Scheme Red Team Manager (CSRTM), which the guide now accepts as an alternative, with CREST Certified Red Team Specialists (CCRTS). Certified individuals sign off major activities and deliverables. The firm reports any attempt by a provider to manipulate the process to CREST, and a provider reports manipulation by the firm to the regulator. SP 800-53 addresses supplier evaluation in general terms, but the CBEST accreditation regime is a regulatory function outside its scope.

CBEST.9 Data Handling and Confidentiality

Rationale

SC-08 transmission confidentiality and integrity and SC-28 protection of information at rest protect test data in transit and at rest. SC-12 cryptographic key management and SC-13 cryptographic protection provide the encryption framework for securing sensitive CBEST materials. MP-01 media protection policy, MP-04 media storage, MP-05 media transport, and MP-06 media sanitisation address the lifecycle protection of test evidence and artefacts. PT-01 (Rev 5) PII processing policy and PT-02 (Rev 5) authority to process PII govern handling of personal data encountered during testing. SI-12 information management and retention addresses retention and disposal of test data. AC-03 access enforcement restricts access to CBEST materials.

Gaps

CBEST data handling requirements have specific elements beyond SP 800-53's data protection controls. Gaps include: specific handling classifications for CBEST materials (threat intelligence reports, test evidence, vulnerability findings, C2 infrastructure details), mandatory secure communications channels between the red team, white team, and regulator throughout the engagement, evidence handling chain of custody requirements for forensic-quality test artefacts, secure destruction requirements for offensive tools, implants, and C2 infrastructure after engagement completion, legal privilege considerations for CBEST findings and their protection from disclosure, and specific data handling agreements between the firm, providers, and the PRA/FCA governing test material classification and sharing restrictions.

CBEST.10 Continuous Improvement

Rationale

PM-31 (Rev 5) continuous improvement directly addresses systematic improvement based on assessment outcomes. CA-02 control assessments, CA-05 POA&M, and CA-07 continuous monitoring form an improvement lifecycle. IR-03 incident response testing validates that remediation actions have improved detection and response capability. AT-06 (Rev 5) training feedback enables adaptive training based on lessons learned from CBEST exercises. PM-06 measures of performance tracks improvement over time. PM-14 testing/training/monitoring programme integrates improvement into governance.

Gaps

CBEST continuous improvement requirements extend beyond SP 800-53's improvement controls. Gaps include: structured lessons-learned process specific to the CBEST engagement covering threat intelligence quality, red team execution effectiveness, and blue team detection performance, control uplift validation through targeted retesting to confirm that remediation actions have closed identified gaps, integration of CBEST findings into the firm's operational resilience self-assessment and impact tolerance testing, longitudinal tracking of CBEST outcomes across successive engagements to demonstrate maturity improvement, regulatory feedback loop where PRA/FCA supervisory observations inform subsequent CBEST scope and focus areas, and industry-wide lessons learned shared through the BoE's CBEST community to improve collective defence across UK financial infrastructure.

Methodology and Disclaimer

This coverage analysis maps from CBEST clauses/requirements back to NIST SP 800-53 Rev 5 controls, assessing how well the SP 800-53 control set addresses each framework requirement.

Coverage weighting represents an informed estimate based on control-objective alignment, not a definitive compliance determination. Weightings consider whether SP 800-53 controls address the intent of each framework requirement, even where terminology and structure differ.

This analysis should be validated by qualified assessors for use in compliance or audit activities. The authoritative source for any compliance determination is always the framework itself.