Data quality

The January publication remains unchanged in terms of dataset coverage and the methodology. The main point to note is this publication contains the scores and data to support the DQMI element of the quarter three performance against the Mental Health Commissioning for Quality and Innovation (CQUINS) Scheme.

We are also pleased to announce the release of the NHS Digital Provider Data Quality Assurance Framework. The framework is published as two separate but linked documents. Part 1 is aimed at provider organisations who, in terms of data quality assurance, need to get started. Part 2 of the framework is for those that are already looking at building on their existing data quality assurance processes and practices.

Each part of the framework covers five main themes:

• oversight
• process
• people
• systems
• measures

Within each section describes its objective, the benefits associate with it and current best practice. 

Several sections include a case study and links to supporting resources and the intention is to extend over time through a collaboration site that will be launched in February 2020.  

Each part of the framework also includes an Assurance Checklist to assist provider organisations assess where they are in terms of data quality assurance and what gaps there might be that the framework can help fill.

An electronic version of the checklist is in development and this page will be updated with a link once it is available. We will then be asking provider organisations to complete the checklist on a voluntary basis to provide insight into current data quality assurance across providers.

Finally, the framework has been developed to meet the requirements of Assertion 1.7 of the Data Security & Protection tool and support the published technical guidance. The intention is that by implementing the framework, a provider organisation will have the evidence needed to support their assessed level against Assertion 1.7.

Any questions about the above or the DQMI in general then please contact us at dqateam@nhs.net.

The DQMI is a monthly publication about data quality in the NHS, which provides data submitters with timely and transparent information.

Links to all of the DQMI publications, the associated methodology documents and the interactive report can be found below:

The Provider Data Quality Assurance Framework is aimed at provider organisations who, in terms of data quality assurance, need to get started and those that are looking to build on their existing data quality assurance processes and practices.  

The framework covers five main themes:

• oversight
• process
• people
• systems
• measures

Within each section describes its objective, the benefits associate with it and current best practice. 

Several sections include a case study and links to supporting resources and the intention is to extend over time through a collaboration site that will be launched in February 2020.

Each part of the framework also includes an Assurance Checklist to assist provider organisations assess where they are in terms of data quality assurance and what gaps there might be that the framework can help fill. The framework will continue to be developed and additional resources made available through this web page.

The documents can be accessed here:

• Provider Data Quality Assurance Framework – Part 1
• Provider Data Quality Assurance Framework – Part 2  

The framework has been developed to meet the requirements of Assertion 1.7 of the Data Security & Protection tool and support the published technical guidance.

Providers are encouraged to complete either part 1 or part 2 of the online data quality assurance self-assessment surveys. 

Self-assessment Data Quality Assurance checklist - Part 1

Self-Assessment Data Quality Assurance Checklist - Part 2

Both surveys (part 1 and part 2) correspond to part 1 and part 2 respectively of the Provider Data Quality Assurance Framework.

Responses to the survey will assist NHS Digital to understand national data quality assurance practice and associated support requirements.  

The two pieces of code below are used by NHS Digital’s MHSDS team to generate the raw data provided to the DQ team that we then process to produce the DQMI scores and associated reports.

The code is run against the MHSDS data after the data has been submitted and processed through the DPS Portal. It will, therefore, require modification locally to be run against the pre-submission data. 

Whilst we cannot assist in this modification, we would be willing to work with a small number of Mental Health Services providers to understand the technical steps required to use the code locally and to then share this learning alongside the code.

Create validity measures SQL

Create integrity measures SQL

Diagnostic codes for conditions that do not remit should not be lost from patient records over time - this "diagnostic persistence" is a measure of data quality.

The below factsheet highlights the proportion of patient episodes that include, or omit, a code for one of five clinical diagnoses where there is reason to expect that a code should continue to be recorded.

We reviewed diagnostic codes for all episodes of hospital care over a three month period, and then looked back to compare whether a relevant code was previously recorded.

February 2018

DQMI Comorbidity Outputs 17-18 Q2 Jul to Sep v1.0 Final [859kb](Opens in a new window)

February Diagnostic Persistence Infographic_FINAL v0.1 [518kb](Opens in a new window)

Note: The analysis is to show diagnostic coding for conditions that do not remit should not be lost from patient records over time - this "diagnostic persistence" is a measure of data quality, it is not to show poor diagnosis or treatment of conditions.

November 2017

DQMI Comorbidity Outputs Q1 Apr to Jun 17-18 v1.0 Final [209kb](Opens in a new window)

November Diagnostic Persistence Infographic_FINAL [519kb](Opens in a new window)

August 2017

Comorbidities analysis raw data [166kb](Opens in a new window) 

Comorbidities analysis Infographic [517kb](Opens in a new window)

Data Quality Assurance (DQA) activity is governed by the DQA Steering Group who meet every two months to provide overall strategic direction for DQA.

The group is made up of internal members, as well as external representatives from the Care Quality Commission, Department of Health and Social Care, NHS England and NHS Improvement. We are working to ensure that the provider community are also represented at the DQA Steering Group.

The group's Terms of Reference are available for reference, and any queries about the group should be directed to: DQAteam@nhs.net.

The DQA user forum meets quarterly with representatives from a number of clinical commissioning groups (CCGs), commissioning support units (CSUs), NHS England and the Care Quality Commission (CQC).

The forum is in its early stages but has already seen some very positive actions come out of the first meeting to proactively support the improvement of data quality.

A DQA provider forum meets quarterly with representatives from 20 provider organisations from around the country.

The forum is supported by a national provider E-forum enabling further engagement from over 100 active members.