Skip to main content

Publication, Part of

Safeguarding Adults, England, 2018-19

Official statistics

Data Quality Statement

Purpose

This data quality statement will provide users with an evidence-based assessment of the quality of the data used in the Safeguarding Adults Collection 2018-19 experimental statistics, reporting against the nine European Statistical System (ESS) quality dimensions and principles appropriate to this output.

In doing so, this meets our obligation to comply with the UK Statistics Authority (UKSA) Code of Practice for Official Statistics, particularly Principle Q3.1 which states that ”Statistics should be produced to a level of quality that meets users’ needs. The strengths and limitations of the statistics and data should be considered in relation to different uses, and clearly explained alongside the statistics.”


Relevance

The degree to which a statistical product meets user needs in terms of content and coverage

The purpose of the Safeguarding Adults publication is to inform government in their role to monitor the impact of social care policy and practice. In particular it may help support the Department of Health and Social Care develop adult safeguarding policy. The data can be used to estimate the amount and type of safeguarding activity taking place. This can help to inform assessments of how policy reforms might impact on the volume and nature of safeguarding work carried out by local social services, the police, the NHS and other agencies. The data also help to inform speeches and briefings for ministers and senior officials.

It is also used by local government to assess activity, and Safeguarding Adult Boards, and their independent Chairs, to build a picture of safeguarding activity in each local area as part of their remit to provide assurance that safeguarding arrangements are in place. Local authorities have informed us of a number of ways they have found safeguarding data useful to them:

  • measuring/monitoring local performance
  • sharing best practice
  • policy development
  • service development, planning and improvement
  • management information, local reporting, accountability
  • informing business cases
  • identifying any immediate priorities/areas for concern

The information can also used by others such as researchers and journalists looking at local authority performance, charitable organisations such as the Alzheimer’s Society and Mind, and by service users and the public to hold local authorities and the government to account.


Accuracy and reliability

The difference between an estimated value and the true value.

As part of the data collection process NHS Digital release a spreadsheet-based validation tool through which local authorities can run their annual data to check the accuracy of individual records. Use of this tool is not mandatory but many local authorities choose to use it to identify errors before making their submissions. There is no limit to the numbers of submissions that local authorities can make.

NHS Digital process all submissions following the mandated submission deadline and produce an automated data quality summary report for each submitting local authority. The data quality summary report examines variance in volume of activity in comparison to the previous year volumes, and the completeness and validity of the data submitted. It includes a number of data integrity validations, primarily ensuring that different tables had the same total values where relevant. There was also the facility for submitters to record observations and explanations regarding their data. This leads to clarification being sought and double checking carried out by local authority officials, where figures are deemed to be outliers; potential errors and misunderstandings are known to have been eliminated.

Local authorities then had an opportunity to amend and resubmit their data and add any supporting commentary if they wished to before the second and final deadline.

NHS Digital worked with local authorities to resolve any residual issues, to ensure that the data submitted reflected as accurate a picture of safeguarding activity in the year as possible. In some instances, this was not possible before the final data submission deadline; any data issues that were unresolved are noted in the data quality key information.

The finalised data were subject to the same data quality analysis and the results are shown the data tables of this publication. It is hoped that this analysis will provide users of the report with a clearer sense of the quality controls applied to the underlying data both at a national level and at individual local authority level.


Coverage

The collection was sent to all 152 local authorities and responses were mandatory, regardless of whether safeguarding cases had been handled in the reporting year by the authority. Returns were received from all 152 local authorities. Nil returns were acceptable and are valid, though none were received; all local authorities reported some safeguarding activity.

In the SAC data tables provided by local authorities, all data relating to individuals involved in safeguarding concerns and “Other” safeguarding enquiries are submitted on a voluntary basis, (except for table SG1f). Furthermore (in table SG1e) there are 18 reported health conditions (RHC) for which collection and submission remain voluntary for Section 42 enquiries.


Timeliness and punctuality

Timeliness describes the time between the date of publication and the date to which the data refer. Punctuality describes the time between the actual publication and the planned publication of a statistic.

This report contains data for the financial year and covers the period 1 April to 31 March. The publication is released several months after the final submission deadline when local authorities provide the data to NHS Digital, following data processing, analysis and validation.

The release is in line with pre-announced publication dates.


Accessibility and clarity

Accessibility describes the ease with which users can access data.

This publication is available from the NHS Digital website and consists of data tables (including statistics by local authority) in Microsoft Excel format, reference documents in html format and a web-based Power BI comparator tool.

Reuse of our data is subject to conditions

Clarity describes the quality and sufficiency of metadata, illustrations and accompanying advice

A list of the data items collected together with their definitions can be found in the guidance notes for the data collection

The documents under the SAC section of the list can be used to identify what data have been collected from local authorities and to understand the terminology used within the SAC reporting products.

Background information and context around Safeguarding Adults legislation and the data collection is also presented as part of the publication.


Coherence and comparability

Coherence is the degree to which data derived from different sources or methods, but that refers to the same topic, is similar

There are no other nationally published sources of data on adult safeguarding activity with which these data could be compared.

Comparability is the degree to which data can be compared over time and domain, for example, geographic level

The SAC is an updated version of the Safeguarding Adults Return (SAR) which collected safeguarding data for the 2013-14 and 2014-15 reporting periods. Changes were made to bring the collection in line with the Care Act (2014). Some of the categories collected have remained the same but there are also some significant differences.

The main change is in how cases opened in the reporting year are categorised. Previous reports have used individuals “Known” and “Unknown” to the local authority, but this distinction was removed in the SAC. Previous reports recorded details of individuals with Safeguarding Referrals, but the SAC now records individuals with Safeguarding Enquiries. While these will be largely equivalent they may not be directly comparable, and care will need to be taken when comparing to data prior to 2015-16. Since 2015-16 the publication has utilised the Care Act 2014 definitions to classify individuals involved under Section 42 of the Act.

There have also been some changes since 2015-16 in terms of the voluntary/mandatory nature of providing some data items. These are detailed in the guidance notes for each annual SAC collection.

Publications from previous years are available.

Survey of local practice

There is a degree of variation between local authorities in reporting certain measures of the SAC. In many instances this variation will result from differing interpretations of the Care Act by local authorities, rather than from poor data quality per se. In order to better understand local practice across England, NHS Digital undertook a voluntary survey of local authorities following closure of the submission window to understand how they defined and recording aspects of adult safeguarding within their SAC submission. Responses can be used to inform analysis of the data and have been published verbatim , Users are encouraged to use these responses to aid interpretation of the data submitted by local authorities and any differences between local authorities.

The data and survey responses indicate care must be taken when comparing the following areas:

Safeguarding concerns: The data identifies a wide variety in the numbers of concerns submitted by local authorities, and in particular the ‘conversion rate’ of concerns to enquiries. Discussions with local authorities have identified that differing approaches to how concerns are addressed by the ‘front door’ services will vary from council. In some local authorities concerns are filtered out before they reach the safeguarding team and are not included in the submitted data. Where they exist, Multi Agency Safeguarding Hubs (MASHs) may have an impact on the numbers of concerns that are reported in the SAC. Care must be taken in inferring differences in safeguarding practice through the conversion rates.

Enquiry ‘threshold’: The point at which initial investigations following a concern then become an enquiry varies according to explanations provided by data providers. Some apply a higher threshold than others, and this should be acknowledged when comparing volumes of safeguarding enquiries between local authorities.

Section 42 and Other enquiries: The methodology by which local authorities determine whether enquiries are undertaken under Section 42 of the Care Act or not varies, as can be seen from the counts of Other queries submitted in the SAC. Therefore, care should be taken when comparing data in these chapters as there will not be a complete picture of safeguarding in those authorities with high numbers proportions of Other enquiries. It should be noted that the distinction between Section 42 and Other enquiries only exists within the SAC; within the survey and 43.6% of completed responses stated that the distinction between Section 42 and Other was not used for local reporting purposes.


Trade-offs between output quality components

Trade-offs are the extent to which different aspects of quality are balanced against each other

In order to balance aspects of data quality two data submission periods are made available for local authorities. Data Quality reports and support were made available to those local authorities who submitted by the first deadline, in order to give data providers the opportunity to address any issues found. Local authorities were able to make updates to their data during this validation period. After the second submission period the dataset is then finalised. Any issues remaining are noted in the data quality information published, but no attempt is made to amend the data.


Assessment of user needs and perceptions

The processes for finding out about users and uses, and their views on the statistical products

The content of the Safeguarding Adults Collection was determined as a result of a review of the NHS Digital adult social care data collections which began in 2010. The review considered changes in the delivery of social care and looked into what information should be provided to monitor the most important current and future priorities. With the approval of the Department of Health and Social Care (DHSC), the Department of Communities and Local Government (DCLG) and other key stakeholder organisation, including the Association of the Directors of Adult Social Services (ADASS), changes were made to the Safeguarding data collection, as described in the consultation report.

A Working Group exists with the aim of developing the Safeguarding Adults Collection to reflect the requirements of users and policy. The group includes representatives from NHS Digital, ADASS, Department of Health, Care Quality Commission and local authorities.

Following closure of the data submission window, data providers had the opportunity to complete an online user survey to provide feedback on all Adult Social Care data collections and reporting processes hosted by NHS Digital for 2018-19

We are always interested in knowing if the Safeguarding Adults Collection is meeting your needs and, if not, what improvements we could make for the future. If you would like to make any comments, please contact us as below:

Email: [email protected]  

Telephone Enquiries: 0300 303 5678


Performance, cost and respondent burden

The SAC collection is mandated for all local authorities. The data collection process used in this publication is subject to assurance by the Data Coordination Board. This is to ensure that data collections do not duplicate other collections, minimise the cost to all parties and have a specific use for the data collected.

The burden of the SAC collection has been assessed and approved, the burden of any changes to the collection are similarly assessed, to ensure that they do not create undue burden for local authorities.


Confidentiality, transparency and security

All statistics are subject to a standard NHS Digital risk assessment prior to issue. The risk assessment considers the sensitivity of the data and whether any of the reporting products may disclose information about specific individuals. Methods of disclosure control are discussed and the most appropriate methods implemented. As a result of this process, all statistics associated with this data collection have been rounded to the nearest multiple of five, and values less than five have been suppressed in tables where necessary. All percentages are rounded to the nearest 0.1 per cent.

NHS Digital aims to be transparent in all its activities. A description of the collection process and any issues with the quality of the SAC data are documented in the publication.

SAC data are submitted to NHS Digital through a secure electronic file transfer system called SDCS. The submitted files are transferred from SDCS and stored on a secure network with restricted access folders. Only a limited number of analysts are granted access to the SAC folders.

Please see links below for more information about related NHS Digital policies:

Statistical Governance Policy:

Freedom of Information Process

Data Access Request Service

Privacy and data protection

 



Last edited: 23 June 2021 5:33 pm