Transforming data collection: Bank of England and FCA deliver on phase one commitments – 6 July 2023

Communication to firms to provide an update on the progress of the joint transformation programme, which is being led by the Bank of England and FCA with industry to transform data collection from the UK financial sector.
Published on 06 July 2023

Joint transformation programme update

The Bank of England (the Bank) and the Financial Conduct Authority (FCA) are working together with industry to transform data collection from the UK financial sector. We are doing this through a joint transformation programme. In this publication we provide an update on the joint transformation programme since our last communication in March 2023 including updates on:

  • the delivery of the phase one recommendations;
  • the progress of the phase two use cases;
  • the Data Standards Review;
  • the future of Transforming Data Collection; and
  • our forthcoming Town Hall event on Thursday 13 July.

Transforming Data Collection

The Transforming Data Collection (TDC) joint transformation programme launched in July 2021. At that time, we committed to delivering tangible change in two years, setting the foundations for larger transformations to follow.

Today we are delighted to confirm that we have met our commitments in delivering on our phase one recommendations by July 2023. In doing so we have delivered benefits to ourselves and firms. Looking to the future, we are excited about the potential of the emerging phase two recommendations from phase two. At the same time, our 2031 target state and associated transformation roadmap is taking shape.

Transforming Data Collection is going to be a continuous journey, but we remain committed to delivering our vision.

Delivery of the phase one recommendations

At the end of our phase one discovery and design work, the joint transformation programme made recommendations for the Quarterly Derivatives statistical return (Form DQ) and Financial Resilience Survey (FRS). The Bank and the FCA responded agreeing to take forward seven solution recommendations.

Over the last year, the Bank and FCA programme teams have been working to develop and deliver the recommendations. During this time, we have tested prototypes with users to validate our solution designs. For some of the recommendations, these insights have led us to explore how the solutions can be designed to tackle wider issues being experienced for data collection.

Below is an update on the delivery of each of the recommendations.

Quarterly Derivatives statistical return (Form DQ)

The Bank agreed to take forward three recommendations for the Quarterly Derivatives statistical return (Form DQ) use case. The recommendations and Bank’s response are set out in our publication from July 2022.

Below is an update on the delivery of each of the recommendations for Form DQ.

What we said

What we delivered

1. Better reporting landing pages

  • enhance the statistical reporting and Form DQ landing pages;    
  • for other statistical reporting and future reporting requirements; and
  • investigate how it might be able to make further improvements to website features, and the associated business case for this, potentially then adding this to the transformation roadmap if it finds there is a business case.

The landing page for statistical reporting has been redesigned. We have also created new dedicated landing pages for Form DQ and Form BT. The new pages will go live on 31 July 2023.

All of the newly designed landing pages provide an improved experience for users and support better navigation. This is achieved through having a more logical structure, clearer headings and the surfacing of critical information from existing documents.

We have carried out three rounds of user testing for the redesigning of the pages. This testing has helped to inform our design work for the pages and ensure we improve the experience for users. The feedback for the final pages has been very positive. Users have expressed that the new pages are clear, organised and easy to understand.

When the pages are live, a feedback survey will be launched to measure user experience. There will be a link to the survey on the pages and it will be open to all users. We would encourage users to complete the survey. If the pages are well received, it will enable us to build a business case to roll out the design across all statistical returns and explore further enhancements.

2. Restructured reporting instructions:

  • restructure its existing reporting instructions and data definitions for Form DQ;
  • investigate how it might deliver the other recommendations in practice and the associated business case for this, potentially then adding these to the transformation roadmap, if they find there is a business case.

To ensure scalability across all statistical reporting, we investigated the prototypes and ideas developed during phase one. As part of our investigations, we tested the phase one prototypes with end users to gather insight and understand their needs. This enabled us to further iterate our designs.

Through our investigations, we discovered that it was not possible to create a set of reporting instructions for Form DQ alone. The end solution we develop needs to address the issues with instructions across all statistical reporting.

The programme team have designed and outlined a concept for the future state of the statistical reporting pages. This includes a single glossary for definitions and reporting instructions. The potential improvements the concept could achieve include:

  • making it easy for the user to check a definition and find reporting instructions;
  • tagging and filtering of definitions across multiple returns;
  • a web-based format to support better cross-linking with form instructions for more efficient work;
  • making the current 112 PDF instruction documents currently in use for statistical reporting accessible.

The initial testing of the concept has been well received with users however, further development is required. We are currently working on the business case for this solution and expect to publish next steps in Q1 2024.

3. Counterparty classification standardisation

  • investigate how to create a modernised representation of instructions and update associated public reference data, and the impact these changes would have. If it finds there is a business case, the Bank will implement the recommendations.
  • investigate further how to apply these changes across other statistical reporting, and explore the feasibility of developing a counterparty classification tool and standardising the System of National Account categorisation. If it finds there is a business case, the Bank will implement the recommendations.

The programme team carried out user research on the initial solution design recommendations from phase one. The recommended solutions aimed to standardise the classification instructions and expose its logic in form of a modernised representation.

Insights from our research revealed that the initial solution ideas would not address the underlying problems effectively and therefore we switched the focus of our work to developing a long-term solution.

A concept has been developed for a centralised solution that will provide firms with an automated classification answer for UK counterparties. The solution would mean a simpler process for firms, and eliminate the need for mapping work and interpreting instructions. This automated solution would also provide greater consistency of classification across reporting, and reduce inefficiencies on the side of both industry and the Bank.

As this information is relevant across national authorities, we hope to use this use case to improve data sharing processes at national level. Conversations have been started with the ONS as the owner of the national statistical business register. Within these cross-governmental conversations, the team further emphasise the need for a centralised methodology that would allow for an unambiguous identification of counterparties at national level.

We are undertaking a technical discovery in order to understand what is possible and create a business case for the new solution. The next steps for developing the concept are:

  • to create a visualisation of the process flow;
  • demonstrate the technical feasibility of the solution;
  • create a business case demonstrating the benefits for both the Bank and firms;
  • liaise with other agencies about data sharing and the concept of having a centralised counterparty ID methodology.

Financial Resilience Survey (FRS)

The FCA agreed to take forward four recommendations for the Financial Resilience Survey (FRS) use case. The recommendations and FCA’s response is set out in our publication from July 2022.

Below is an update on the delivery of each of the recommendations for FRS.

What we said

What we delivered

  1. RegHub portal & homepages
  • carry out discovery work and deliver a business case for inclusion in 23/24 business planning
  • investigate options with the Bank of England for a single data collection portal.

The programme team instructed a third party to carry out the discovery work and support delivery of a business case for a ‘RegHub’ portal and homepages. The FCA refers to this work as the Firm Portal.

During the discovery, research was carried out with both internal FCA users and over 40 firms representing all sizes and sectors to understand what users need from a regulatory reporting platform. Insights identified 140 pain points with the current firm experience and showed that the current platforms create challenges to accurately provide timely data for firms to meet their obligations. This could cause unnecessary burden to firms. Proposed solutions have been designed and developed which reduce this burden, improve firm experience and support more timely and accurate data collection.

A business case for implementation of the proposed solutions has been submitted to senior FCA stakeholders for evaluation. A multi-year implementation is expected:

  • Year 1 - unifying the Firm access to the FCA systems through a single homepage
  • Year 2 - further functionality added incrementally to address firm pain points identified in the research

The initial focus for implementation will be on firm experience across FCA platforms. Further investigation with the Bank is required for implementing a unified firm experience across all regulatory interactions.

2. Firm View at a Glance

  • carry out further discovery work by piloting with a group of firms using live data;
  • include confidentiality as a core requirement upon which the capability is designed and developed; and
  • add extending this to other reporting and additional capabilities to a pipeline of data collection change to be investigated.

Firms expressed that they do not receive any feedback from the FCA when they submit data and that there is no easy way to see what they have submitted.

Using the Financial Resilience survey data the team have created a visualisation of the data firms submit and has tested this with firms. Initial feedback from firms has been that this type of visualisation would be a very useful feature.

The next step is to present this to a wider set of firms.

3. Future Financial Resilience Survey

  • consider implementing the redesigned shorter survey into RegData without material changes and ending the ad-hoc survey; and
  • incorporate the principles proposed in the recommendation into the BAU data collection design process.

A consultation on the Financial Resilience Survey was completed in December 2022. We worked with firms to understand how we could improve the survey. To reduce the burden on firms, we reduced the number of questions asked in the survey from thirty to six. Final rules will be published this summer with the new return expected to go live in Q1 2024. This is the first example of regulators working more closely with firms to test the design of a collection before it is formalised through policy.

4. Intuitive Form Design

  • produce a prototype intuitive form for a single data collection;
  • pilot this in production for a single return and measure the benefits; and
  • if successful, scale to other existing and future data collections where value can be added.

The FCA has improved two forms CCR007 and FSA038 completed by over 22,000 firms to improve the quality of the data collected and the firm experience.

Changes to the return CCR007 went live in January 2023. The benefits analysis shows:

  • The quality of the data being submitted has improved as and total revenue for this market is more accurate
  • There is a reduction in firms submitting their regulatory reports late
  • The number of firms calling the FCA for support to complete the form shows a slight decrease and firms spending longer viewing the guidance pages

Building on the learnings from CCR007 we made changes to the return FSA038, these were implemented on 1 June 2023. 

As a result of this process the FCA is implementing a new process for designing forms for all new regular collections. We have considered retrospectively scaling this work across all 153 existing forms. However, given the size and complexity of this exercise coupled with policy constraints on the level of change that can be made to existing forms, we recommend the focus is on ensuring higher standards are in place for new and replacement collections currently being designed/re-designed. We welcome firm views on this.

How TDC lessons are changing Bank and FCA process for designing firm collections

Over the last two years of discovery, both the Bank and FCA have strong evidence to show how data collection design can be improved. We are now implementing these new processes across our organisations which includes changes such as:

  • more rigorous research with firms ahead of designing new collections to understand how data is currently captured,
  • testing new designs with firms earlier in the process and before consultation,
  • being clearer about why the data is being collected and what it will be used for,
  • issuing plain language guidance that can be easily accessed,
  • ensuring forms are designed taking account of firm behaviour to simplify and improve the experience. This includes aspects such as contextual guidance being provided as a firm is populating the form.

Update on phase two

The programme has made good progress since our last update in March. All use cases are now in the design stage with the exception of Incident, Outsourcing and Third Party Reporting (IOREP) which is in the discovery stage.

Below is an update on each of the phase two use cases.

Retail Banking Business Model Data (RBBMD)

Every 2-3 years, the FCA collects data which relates to retail bank’s business models in order to carry out an assessment of competition in the market. The ad hoc data collection which is sent to firms includes around 2,500 data points and the findings are published on the FCA website. The programme team are exploring ways to collect the data from firms which:

  • reduces burden on firms and improves efficiency of the collection process,
  • improves data quality at source reducing errors, time spent checking data and asking firms to resubmit
  • increases the capacity of competition to deliver value-adding work,
  • increases trust and confidence with firms for ad-hoc collections.

A range of potential prototypes are being tested with end users within the FCA and firms. This testing enables the team to assess the value of the potential solutions which informs further design work and prototype iterations. We believe the solutions developed may also be applicable for the Bank of England in future.

We expect to publish the use case recommendations and regulator response in Q4 2023.

Strategic Review of Prudential Data Collection (SRPDC)

For our review of prudential data collection from solo regulated firms, our discovery findings led to a focus on two hypotheses:

  1. By ensuring a shared understanding of what prudential data the FCA needs to fulfil its mission and how it will use that data, the FCA will reduce the reporting burden on firms and itself.
  2. By providing solo-regulated firms with simpler, clearer guidance and better data validation at the point of data entry, the FCA will improve the quality, accuracy and timeliness of the reporting data those firms submit.

The alpha phase has sought to test these hypotheses, focussing on the data which informs the prudential/financial section of the Single View of Firms (SVOF) dashboard (an interface which helps our frontline staff make more rapid and holistic firm assessments).

Through user research, the team have gained an understanding of how the data is used by the FCA and the pain points firms have with the current submission process. The insights from the research enabled us to identify potential opportunities for improving the quality of the data and develop an initial proof of concept prototype of simpler and more intuitive ways for firms to submit prudential data to the FCA. Ongoing research and usability tests have informed iterations to the prototype, whilst further research and a co-design workshop with both FCA and industry participants will inform future versions.

We expect to publish the use case recommendations and regulator response in Q3 2023.

Commercial Real Estate (CRE) data

Commercial Real Estate (CRE) data is crucial for the Bank's ability to monitor prudential risk in the financial sector. Work on the use case during phase one confirmed our initial hypothesis about CRE data: it’s crucially important data, but the current data we get is a poor fit for our needs, fragmented, and burdensome to collect.

During phase two, the programme team initially identified a set of ten potential solutions for the CRE use case. Positive feedback has been received from both of the programmes industry committees on these solutions. Seven of the potential solutions were moved into a design phase.

Taking both the complexity of the solutions and the available resource into consideration, the programme team has decided to take forward three solutions to the recommendation stage:

  • Data model - a structured representation of types of data and how they relate to each other within a particular domain
  • Instruction clarification - a public-facing resource where the user is able to understand and gain clarity on the instructions
  • End to end data quality management - an end-to-end service which remedies data quality issues for Bank users, and provides clarity to firm users on the quality of their submission

Throughout the discovery and design stage, the team have been conducting user research with firms. The insights gathered have informed the work for the use case and is helping us to develop a capability that we may be used more widely to support the design of data collections in future.

The programme team have been developing prototypes for the potential solutions and testing them with users. The feedback received is helping the team to refine the products and understand what is achievable.

We expect to publish the use case recommendations and regulator response in Q4 2023.

Incident, Outsourcing and Third Party Reporting (IOREP)

Ensuring the operational resilience of the financial sector is a key priority for the Bank of England, PRA and FCA. However, operational resilience is currently an area where the regulators lack high quality consistent data. Policy makers are considering the development of new incident, outsourcing and third party reporting policies. You can find more information about the operational resilience policy on PS6/21 | CP29/19 | DP1/18 Operational Resilience: Impact tolerances for important business services. By considering the design of this reporting policy as part of the joint transformation programme, we can help ensure this critical data is delivered in a way that minimises the impact on firms. At the same time, we think the use case will provide a chance to explore how best to deliver ‘event’ driven collections, where a new report is triggered when a given event occurs.

The Incident, Outsourcing and Third Party Reporting (IOREP) use case has now completed a period of discovery. The team have been conducting research interviews with end users and technical experts from the Bank, FCA and industry to gather insight into the issues faced by IOREP users. A report has been created summarising the key findings from this comprehensive research.

The team are now moving into the design stage. The key findings report will help to better inform the team’s design work for the use case.

We expect to publish the use case recommendations and regulator response in Q4 2023.

Data Standards Review

During phase one of the programme, the Data Standards Committee (DSC) commissioned a third-party review on the topic of data standards in financial services. The review aimed to identify the necessary conditions for achieving greater development and adoption of standards. The review was carried out by Ernst and Young (EY) and consisted of a public consultation exercise, interviews with relevant stakeholders and further research and analysis.

EY have completed their review and produced a report setting out the conclusions from their analysis and proposed next steps in this area.

The DSC have reviewed the final report from EY and reflected on its conclusions. In their role as the TDC programme’s industry forum in this area, the DSC has written a set of recommendations to the Bank and the FCA - focusing on the recommendations covered by the report’s conclusions.

The Bank and the FCA are considering the recommendations from the DSC. They are currently in the process of writing a response, outlining the actions they will take to address each of the DSC recommendations.

The full report, DSC recommendations and joint response from the Bank and FCA will be published to the TDC webpage by the end of July 2023.

Ahead of the publication of the full EY report, a summary of the report’s key themes is below.

  • Regulators and industry agree that there would be common benefit from greater development and adoption of data standards, provided that these are aligned to our objectives.
  • Data standards take many forms and serve many purposes, making this an area that is only broadly defined, with a very wide scope.
  • Given that various international and national bodies have responsibilities for standards, it is important that a coordinated approach is taken to their development and adoption.
  • Regulators need to continue to further develop a structured approach to data standards, with formal governance structures and processes for adoption of standards.
  • Industry would like to leverage and maximise adoption of existing standards that they see as beneficial, and avoid the risk of duplicating these in new standards work.

Digital Regulatory Reporting 2023 update

In 2020 the Bank, FCA and seven large reporting firms commissioned a report on Digital Regulatory Reporting (DRR). The recommendations in part led to the establishment of the TDC joint transformation programme. Earlier this year, we instructed PA Consulting to produce a short update to the 2020 report and to reflect on other regulatory DRR initiatives. As part of this, the report assessed five global initiatives and compared their approaches which led to six key findings.

The report reemphasised the importance of cross Industry collaboration, which has been a core part of TDC. The report highlighted the importance of Common data standards and their associated models to any DRR initiative.

You can read the full report here.

The joint transformation programme aims to take these findings, and the Data Standards review recommendations and response, to set out its next steps on data standards.

Future of Transforming Data Collection

The last two years have been a valuable exercise for us and firms. We have learnt a lot, delivered tangible value, and have a number of solutions that we are now taking forward to develop and scale.

TDC and the joint transformation programme is entering a new phase for both the Bank and FCA. In this new phase we will be prioritising implementation and transformation over learning and incremental delivery.

We will carry out this work as part of a refreshed strategy for transforming data collection we will look to publish in Q1 2024.

Town Hall

On Thursday 13 July, the joint transformation programme will be hosting a Town Hall at the Bank of England. In the first part of the event, our senior leadership team will provide an update on the progress of the programme. They will be showcasing the benefits that have been realised and delivered so far, and sharing our future plans for TDC. During this section there will be an opportunity to ask questions and provide feedback on the programme and on any of the information you have heard.

This first part of the event will be hybrid giving attendees the opportunity to attend both in person and online.

The second part of the event will be a showcase and networking session with refreshments. Attendees will have the opportunity to see the outcomes of the work that is being carried out, engage with the TDC senior leadership team and network with other TDC stakeholders that are engaged with the programme. Additionally, we will be showcasing some of the wider TDC initiatives taking place at both the Bank and the FCA, and sharing further information about the future of the programme. Input from industry is key to the programme’s success and there will be opportunities to provide feedback during this session.

The second part of the event will be in person only.

We would encourage you to attend the event in person if you can, and pass on the invitation to any relevant colleagues. The programme wouldn’t be possible without the participation and input from industry. It is important to us that you have this opportunity to have your say on the programme, the work we are doing and our plans for the future.

To find out more and express your interest in attending the Town Hall, please visit our registration page.