Skip to main content

Publication, Part of

Statistics on Obesity, Physical Activity and Diet, England, 2020

Official statistics, National statistics

National Statistics

Data Quality Statement

Purpose of document

This data quality statement aims to provide users with an evidence based assessment of quality of the statistical output included in this publication. 

It reports against those of the nine European Statistical System (ESS) quality dimensions and principles appropriate to this output. The original quality dimensions are: relevance, accuracy and reliability, timeliness and punctuality, accessibility and clarity, and coherence and comparability; these are set out in Eurostat Statistical Law. However more recent quality guidance from Eurostat includes some additional quality principles on: output quality trade-offs, user needs and perceptions, performance cost and respondent burden, and confidentiality, transparency and security.

In doing so, this meets NHS Digital’s obligation to comply with the UK Statistics Authority (UKSA) code of practice for statistics and the following principles in particular:

  • Trustworthiness pillar, principle 6 (Data governance) which states “Organisations should look after people’s information securely and manage data in ways that are consistent with relevant legislation and serve the public good.”
  • Quality pillar, principle 3 (Assured Quality) which states “Producers of statistics and data should explain clearly how they assure themselves that statistics and data are accurate, reliable, coherent and timely.”
  • Value pillar, principle 1 (Relevance to Users) which states “Users of statistics and data should be at the centre of statistical production; their needs should be understood, their views sought and acted upon, and their use of statistics supported.”
  • Value pillar, principle 2 (Accessibility) which states “Statistics and data should be equally available to all, not given to some people before others. They should be published at a sufficient level of detail and remain publicly available.”

Relevance

This dimension covers the degree to which the statistical product meets user needs in both coverage and content.

This publication is considered to be of particular interest to NHS and independent sector providers in England and to English NHS commissioning organisations. However, data and findings are likely also to be of interest to a much broader base of users.


Accuracy and reliability

This dimension covers, with respect to the statistics, their proximity between an estimate and the unknown true value.

Most of the information in this report has been previously published. The sources of the information are trusted sources; the majority being either National or Official Statistics. Most sources referenced in this report include a Methodology section for further information.

Hospital admissions from Hospital Episode Statistics (HES) data

The data presented in this report are for inpatients only. Outpatient procedures are not included in these figures due to the primary diagnosis code being poorly populated, and there being no certainty that procedures are for obesity diagnoses.

Further general information on HES data quality, including specific known issues can be found here:
https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/hospital-episode-statistics/the-processing-cycle-and-hes-data-quality.

Prescription data

Data on the number of prescription items and Net Ingredient Cost (NIC) for drugs prescribed for obesity give a measure of how often a prescriber writes a prescription and it is not an ideal measure of the volume of drugs prescribed as different practices may use different durations of supply. The NIC is the basic cost of a drug as listed in the Drug Tariff or price lists; it does not include discounts, prescription charges or fees.

NHS Prescription services have coded Mazindol within BNF section 4.5 Drugs used in the treatment of obesity, but as prescription data has no information as to why it was prescribed it cannot be stated it was definitely used for the treatment of obesity in this instance. Consequently Mazindol has been excluded, from prescribing data since 2012. The number of data items affected is very small and has a negligible effect on the totals overall.

Survey data

Some of the information presented in the report is taken from survey data. Sometimes the mode of data collection used in a survey can have an impact on how respondents answer the questionnaire. For example, surveys conducted via a face-to-face interview such as the Health Survey for England (HSE) provide an opportunity for an interviewer to use a computer to record the respondent’s answers which will improve the quality of the data by ensuring all the questions are completed and not allowing any invalid answers. By comparison data collected via a self-completion survey such as Smoking, Drinking and Drug Use Amongst Young People (SDD) will have none of these inbuilt validations.

Face-to-face interviews also provide an opportunity to guide the respondent through any interpretation issues such as advice on portion sizes, which is more difficult in a face-to-face interview.

Both modes however may suffer from respondents being tempted to give answers which are considered to be more socially acceptable. This could occur either through the surveys being completed in the home when other family members are present, or through the interviewer being present at a face-to-face interview. However, HSE does include some information such as height and weight (and therefore BMI), and blood pressure which are measured by a nurse and therefore not affected in the same way as the respondent’s answers.


Timeliness and punctuality

Timeliness refers to the time gap between publication and the reference period. Punctuality refers to the gap between planned and actual publication dates.

This compendia report is published annually and presents or signposts the most up-to-date information available.


Accessibility and clarity

Accessibility is the ease with which users are able to access the data, also reflecting the format in which the data are available and the availability of supporting information. Clarity refers to the quality and sufficiency of the metadata, illustrations and accompanying advice.

All reports are accessible on the NHS Digital website. NHS Digital produced data tables are provided in Excel format and as csv files, as part of the government’s requirement to make public data public.


Coherence and comparability

Coherence is the degree to which data which have been derived from different sources or methods but refer to the same topic are similar. Comparability is the degree to which data can be compared over time and domain.

Obesity related hospital admissions

Changes to the figures over time need to be interpreted in the context of improvements in data quality and coverage, improvements in coverage of independent sector activity and changes in NHS practice.

Improved use of secondary diagnosis codes

There is continuing evidence that recording of secondary diagnosis codes is improving over time, which may have contributed (though not fully) to the increases seen in ‘admissions where obesity was a factor’ over the last ten years. This is demonstrated by looking at year on year increases in the mean number secondary diagnosis codes that were applied to these admissions as below.

Year Mean diagnosis codes % Difference
2007/08 4.5 1.8
2008/09 4.5 0.2
2009/10 4.6 2.0
2010/11 5.0 8.0
2011/12 4.9 -1.2
2012/13 5.0 1.7
2013/14 5.2 3.7
2014/15 5.3 1.9
2015/16 5.4 1.7
2016/17 5.6 4.0
2017/18 6.1 7.8
2018/19 6.5 7.0

Break in time series – 2019/10

There is a break in time series in 2009/10. Analysis of obesity coding of admissions data over time identified two issues affecting the obesity related admissions data prior to 2009/10. Firstly, in 2009/10 the introduction of a specific procedure code for maintenance of gastric band added approximately 1,500 records in that year. Secondly, there is evidence that the obesity primary diagnosis code was not applied as consistently before this time, based on analysis of the proportion of bariatric surgery records that included an obesity primary diagnosis.

This effects all the admissions time series data but most significantly ‘admissions attributable to obesity’ (tables 2.1 and 2.2) and ‘obesity admissions for bariatric surgery‘ (tables 4.1 and 4.2). It is less significant in the ‘admissions where obesity was a factor’ measure (tables 3.1 and 3.2), as the impact represents a much smaller part of that data.

Changes to recording of gastric band maintenance

Practices vary between hospitals as to whether gastric band maintenance procedures (introduced as a specific OPCS-4.5 code from 2009/10) are recorded as being carried out in outpatient or inpatient settings. As the data presented in this report are for inpatients only, inconsistencies over time have contributed to the changes seen in recent years. Time series data that excludes maintenance and revisional procedures, (thus removing the effect of these varying recording practices) is shown in table 4.1 (Primary bariatric surgery).

Most providers record none or very few gastric band maintenance procedures as inpatient admissions, but the changes known to us that have a significant effect on the national totals are as below. Though this affects all the obesity related admissions measures (with the exception of primary bariatric surgery), it is less significant in the ‘admissions where obesity was a factor’ measure (tables 3.1 and 3.2), as bariatric surgery represents a much smaller part of that data (less than 1% in 2017/18).

Please note, the figures quoted are for episodes involving gastric band maintenance where there was no primary bariatric surgery in the same episode (as those that also had a primary bariatric surgery procedure code would be included in the counts regardless).

2013/14
Between 2009/10 and 2012/13 Derby Hospitals NHS Foundation Trust (RTG) recorded around 750 to 1,250 obesity related admissions per year involving gastric band maintenance. In 2013/14 and subsequent years this number was zero or close to zero. In 2013/14 this change represented around half of the decrease in the national bariatric surgery figures (-1,640 overall).

Between 2009/10 and 2012/13 King’s College Hospital NHS Foundation Trust (RJZ) recorded around 250 to 400 obesity related admissions per year involving gastric band maintenance. In 2013/14 this number dropped to 53, and just 2 in 2014/15. They have since recorded around 100 per year.

2015/16

From 2015/16 Heart of England NHS Foundation Trust (RR1) has recorded around 300 to 400 obesity related admissions per year involving gastric band maintenance, compared to close to zero prior to 2015/16. In 2015/16 this change accounted for around three quarters of the increase in the national bariatric surgery figures (+406 overall).

Changes to procedure codes effecting the bariatric surgery time series

In 2012/13, changes were made to give a standard definition of “bariatric surgery” using the same methodology as Healthcare Resource Groups (HRGs). The new HRGs were created in 2011/12 Reference Costs collection as a result of work between the National Casemix Office at NHS Digital, the British Obesity and Metabolic Surgery Society (BOMSS) and the Chapter F Digestive System Expert Working Group (EWG). This definitional change has a minimal effect on the previous years’ data; between 20 and 30 cases a year from 2009/10 onwards when OPCS 4.5 and 4.6 codes were used, following on from the introduction of a specific code for maintenance of gastric band in OPCS-4.5 in 2009/10. Appendix B shows the current list of OPCS codes included in the definition of bariatric surgery.

More information on the change of codes in 2012/13 is included in the methodological change notice at:

http://content.digital.nhs.uk/media/13556/Statistics-on-Obesity-Physical-Activity-and-Diet-England-2014/pdf/MethChange201402_SOPAD.pdf

In 2016/17, the National Casemix office updated the definition above to remove 2 previously included OPCS codes, and so the data in this publication has been updated to reflect this, creating a break in time series from 2016/17. Based on data in recent years (2015/16 to 2017/18), the change reduces the total by between 250 and 320 records per year.

More information on the change of codes in 2016/17 is included in the methodological change notice at:

https://digital.nhs.uk/binaries/content/assets/website-assets/publications/publications-admin-pages/methodological-changes/methchange20190205_sopad.pdf

Changes to the calculation of hospital admission rates

Admission rates per head of population were changed in the 2017 report to be age standardised based on the European Standard Population. Prior to 2017, these rates were not standardised. More information is available from the methodological change notice at:

http://content.digital.nhs.uk/media/23838/Announcement-of-methodological-change-to-Statistics-on-Obesity-Physical-Activity-and-Diet-England---2017/pdf/MethChange20170316_SOPAD.pdf

Other HES data issues
2016/17
Around one third of all records for Nottingham University Hospitals Trust were submitted to the Hospital Episode Statistics database without patient identifiers such as postcode. This means it was not possible to assign a Local Authority or Clinical Commissioning Group of Residence to these admission records, so they will not appear in the tables. This will mainly affect the Nottingham and Nottinghamshire areas with a smaller impact on surrounding areas and the East Midlands and England totals.


Trade offs between output quality components

This dimension describes the extent to which different aspects of quality are balanced against each other.

Most previously published sources referenced in this report include a methodology section which will contain specific information about trade-offs.

New analyses by NHS Digital consist of HES statistics. HES data quality information, including details of trade-offs, is available here:

https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/hospital-episode-statistics/the-processing-cycle-and-hes-data-quality


Assessment of user needs and perceptions

This dimension covers the processes for finding out about users and uses and their views on the statistical products.

The compendia reports on drug misuse, alcohol, smoking and obesity were subject to a National Statistics consultation in 2016. The report on the findings of the consultation and the NHS Digital response are available at:

http://content.digital.nhs.uk/article/6770/Consultation-on-Lifestyles-Compendia-Reports

NHS Digital is keen to gain a better understanding of the users of this publication and of their needs; feedback is welcome and may be sent to enquires@nhsdigital.net (please include ‘SOPAD’ in the subject line).


Performance, cost and respondent burden

This dimension describes the effectiveness, efficiency and economy of the statistical output.

All data used within this report is either already published or is part of an existing dataset. Therefore, no data is collected specifically for this report.


Confidentiality, transparency and security

The procedures and policy used to ensure sound confidentiality, security and transparent practices.

These publications are subject to a NHS Digital risk assessment prior to issue.

Some of the data contained in this publication are National or Official Statistics. The code of practice for statistics is adhered to from collecting the data to publishing.

Details of relevant NHS Digital procedure and policy information can be found below:

NHS Digital Statistical Governance Policy

NHS Digital Freedom of Information Process

NHS Digital Statement of Compliance with Pre-Release Order

NHS Digital Disclosure Control Procedure

 


Last edited: 8 July 2021 4:17 pm