Skip to main content

Multiple submission window model for MHSDS

A multiple submission window model for the Mental Health Services Data Set (MHSDS) will be available to providers from April 2020. This will enable providers to resubmit data for each full financial year.

From April 2020, NHS Digital implemented a multiple submission window model (MSWM) for MHSDS, which allows providers to retrospectively submit data for a specific reporting period once the initial provisional and performance submission windows have closed.

This webpage is particularly aimed at data providers so they understand how data should be submitted and how the data is used. This webpage was updated in November 2020 to present the latest position.

The Multiple Submission Window Model should only be employed where:

  • a new provider starts submitting data mid-year for the first time
  • an issue was identified in a provider’s submission for that month that requires resubmission
  • the resubmission of a particular month’s data has resulted in data associated with earlier or later months being impacted

Resubmission of data is optional, and we anticipate providers will use this process only in exceptional circumstances. There is no need to resubmit data unless the resubmitted data are considered to be of higher quality than the original submission or if the data being resubmitted has a knock-on effect on other data (for example, where a change to April’s submission impacts the May and June submissions, then all three months should be resubmitted).

The provisional window and performance windows will remain (previously the primary and refresh windows). Data can then be resubmitted (refreshed) in each update window. The final window will be the last chance to amend data for the financial year. The ‘last good file’ submitted for each month will be used to generate final statistics at the end of the year.

The MSWM only allows resubmission of data for months in the current financial year. For example, once the provisional and performance submission windows have closed for May 2020 it will be possible to make a resubmission for this month’s data up until May 2021 (the end of the submission period for 2020 data).

However, this cut off will apply to all data associated with that financial year, thus the resubmission window will be shorter as the year progresses, for example, January 2021 data can only be resubmitted until May 2021 also, while March 2021 will have no resubmission period (just the standard Provisional and Performance windows, which ends in May 2021).


Key submission changes data providers need to know about

So that NHS Digital can process the new data effectively there have been several changes to how data is submitted:

  • as per now, each month of data must be submitted in a separate file
  • the SDCS Cloud submission portal will now look different as the month being submitted can be specified by the user
  • there has been a change to the validation applied in the MHS000 Header table
  • data item ORGANISATION IDENTIFIER (CODE OF PROVIDER) will now be rejected if the code provided does not match a code that is live in the national organisation identifier code tables for the reporting period - this is designed to improve data quality, by preventing data from flowing that is attributed to an organisation that does not exist at the specified point in time
  • where your organisation has changed during 2019/20 you will need to submit data prior to the organisation change using your log in details for the old organisation
  • there has been a change to the derivation FILE TYPE found in the MHS000 Header table which now indicates how many months after the reporting period the file was submitted for example, May data submitted in August would show as ‘3’. This replaces the old ‘Primary’ flag (now '1') or ‘Refresh’ flag (now '2')
  • the change makes it clear how long after the reporting period the data was submitted, and can therefore also be used to identify during which window the submission was made - for example, an extract that relates to data collected during April, and has the code ‘7’, would have been submitted in November submission window

Dates are for 2021-21 submission windows

April data May data June data July data
FileType Dates of submission Dates of submission Dates of submission Dates of submission
1 - 9 Jun to 26 Jun 27 Jun to 20 Jul 21 Jul to 20 Aug
2 9 Jun to 26 Jun 27 Jun to 20 Jul 21 Jul to 20 Aug 21 Aug to 18 Sep
3 27 Jun to 20 Jul 21 Jul to 20 Aug 21 Aug to 18 Sep 19 Sep to 20 Oct
4 21 Jul to 20 Aug 21 Aug to 18 Sep 19 Sep to 20 Oct 21 Oct to 19 Nov
5 21 Aug to 18 Sep 19 Sep to 20 Oct 21 Oct to 19 Nov 20 Nov to 18 Dec
6 19 Sep to 20 Oct 21 Oct to 19 Nov 20 Nov to 18 Dec 19 Dec to 21 Jan
7 21 Oct to 19 Nov 20 Nov to 18 Dec 19 Dec to 21 Jan 22 Jan to 18 Feb
8 20 Nov to 18 Dec 19 Dec to 21 Jan 22 Jan to 18 Feb 19 Feb to 18 Mar
9 19 Dec to 21 Jan 22 Jan to 18 Feb 19 Feb to 18 Mar 19 Mar to 22 Apr
10 22 Jan to 18 Feb 19 Feb to 18 Mar 19 Mar to 22 Apr 23 Apr to 21 May
11 19 Feb to 18 Ma 19 Mar to 22 Apr 23 Apr to 21 May -
12 19 Mar to 22 Apr 23 Apr to 21 May - -
13 23 Apr to 21 May - - -

 


Why the Multiple Submission Model is being implemented

The Mental Health Services Data Set (MHSDS) has historically operated on a monthly submission cycle, where data providers have two opportunities to submit data – the provisional submission which opens one day after the end of the reporting month, and the refresh submission, which opens one month after the reporting month.

These two submission windows are currently the only opportunity that providers have to submit data for that specific reporting period. If data is found to be incorrect or missing, this results in an inaccurate reflection of mental health services when viewing data and analytical reports. This inflexibility has resulted in additional data collection burden on healthcare providers.

It has therefore been agreed that the multiple submission window model described in Information Standard DCB0011 Amd 43/2019 is implemented in advance of the implementation date of MHSDS v4.1 i.e. within financial year 2019-20.


How providers should change submission behaviour

Providers must continue to submit a month’s data at least once in the provisional or performance window and only employ the multiple submission window model where:

  • a new provider starts submitting data mid-year for the first time
  • an issue was identified in a provider’s submission for that month that requires resubmission
  • the resubmission of a particular month’s data has resulted in data associated with earlier or later months being impacted

NHS Digital and NHS England will be regularly monitoring the number of resubmissions of providers. NHS Digital will be highlighting misuse of the MSWM and any issues to NHS England regional colleagues, and commissioners, as part of the quarterly Deep Dives.


Year to date submission model guidance for submitters

We have provided some guidance for submitters on resubmission. 


How NHS Digital will use the data submitted as part of the Multiple Submission Model

The way the data is employed will change slightly for those measures that consider performance of the provider over time, taking advantage of the MSWM. This is described below:

The Provisional Report will continue to be produced as it is important to have an early view of the data especially for issues such as Delayed Transfers of Care (DToC).

The Performance Report (previously the Final Report) will be produced using the same timeframe that is currently adopted, i.e. following the two months for submission.

These reports will be classed as “Experimental Statistics”, containing all measures that would have been included previously and any new measures will be added to this publication in due course.

The Provisional And Performance Reports will employ all relevant data available to NHS Digital at the time the reports are issued (up to the closure of the Performance Submission window). This takes advantage of the MSWM as follows:

  • if a provider has resubmitted historic data (resolving issues) or submitted historic data for the first time (catch up), this will be included in the calculation of measures that consider data over a period of time thus better reflecting the performance of the provider, an example measure that would be improved is MHS69 - the number of children and young people receiving at least two contacts
  • prior to the MSWM, the measure would have been calculated using incorrect data or missing data if it had been submitted in error or not been submitted during the Provisional or Performance window
  • measures that reflect the performance of the provider during the Provisional or Performance Window will continue to be produced as before, using only data submitted in the Provisional or Performance window

Any data submitted post the creation of the Provisional or Performance Reports will not be included in the calculation of measures until the Final Report, see below:

The notes and data quality documentation associated with these publications will include information relating to the MSWM, and the impact it may have had on the publication (at a high level).

On a monthly basis the MSWM tracker shall be published, this will record the new submissions that have been made for that month post the creation of the Performance (previously the Final) publication. For instance, if a provider had not submitted data by the time of the publication and now has or a provider has increased or decreased the volume of records for that month substantially, this will be stated. This will not result in an update to the performance publication.

In line with the Annual Bulletin or earlier; once all the submissions have been finalised, that is, post May of the following financial year, a Final Publication Report shall be created for each month. It is not proposed that the changes/impact from the Performance Publication are assessed, as this will have been documented through the MSWM Tracker described above. This new Final Report shall be added to the publication page for the relevant month.

NHS Digital will continue using data submitted during the first two submission months (Provisional and Performance data) to calculate the Data Quality Maturity Index.


How NHS England and Improvement will use the data providers submit as part of the Multiple Submission Model

NHS England and Improvement will use data published by NHS Digital, where possible, to monitor performance against national standards. Usage of the multiple submission window model will also be closely monitored and fed back to the system.

Different approaches may be used in other NHS England and Improvement products, but this will be clearly indicated.


How other organisations will use the data that providers submit as part of the Multiple Submission Model

MHSDS data will continue to be used in the current range of products and many of these will use the updated data available during the year.

NHS Digital extracts are built from data generated at window-close snapshot time. Extracts will reflect the most recently submitted version of data and will not be available for earlier data submissions that have been replaced.

Therefore, the data included in the extracts will be the latest data as at the last end of a specific reporting period point, as set out in the submission timetable.

This means that analyses undertaken for any annual audits (e.g. Early Intervention Psychosis – National Clinical Audit of Psychosis) will be using any updated data submitted by providers as part of the Multiple Submission Model window. This also applies to data used for the NHS Oversight Framework, and used by the Care Quality Commission, Public Health England and NHS Improvement.


Find out more

This change follows consultation with a range of stakeholders and the publication of the Information Standard Notice (ISN) for the Mental Health Services Data Set (MHSDS) v4.1 (commenced April 2020).

Multiple Submission Model Review

NHS Digital will be conducting a review of the use of the mental health multiple submission window model early in 2021.

If you have any feedback please email our Contact Centre on enquiries@nhsdigital.nhs.uk or telephone us on 0300 303 5678.

Last edited: 24 November 2020 5:30 pm