Data cleaning
The children in need census data is collected through the DfE COLLECT (collections online for learning, education, children and teachers) system.
When local authorities upload their data to COLLECT a series of validation rules are run to identify any errors or queries with the data. Local authorities then undertake cleaning of their data to resolve these issues; with the department providing help and support throughout this period. A local authority can also add notes to their data return to explain any outstanding issues. These notes are examined by the department during the quality assurance process and, where applicable, followed up and resolved with the individual local authority.
Once all errors and queries have been resolved or explained, local authorities submit a final return. A full list of validation rules for checking queries and errors is available in the children in need census guide to submitting data (opens in a new tab) (opens in new tab).
DfE then carry out further quality assurance of the data so that it can make an assessment of the data quality and highlight any issues to users.
Further validation checks are built into COLLECT to highlight where key measures (for example the number of referrals) have increased or decreased substantially between census years. Where changes exceed the threshold DfE requests local authorities to check their data and confirm that it is correct. It should be noted that a large change between years does not necessarily imply the information provided is inaccurate and may be explained, for example, by changes in local practice.
For a full explanation of the methodologies for data cleaning see Children in Need methodology.
Issues relating to specific local authorities
Hampshire, 2024
Hampshire local authority moved to a new case management and reporting system and their return in 2024 had significant data quality issues and was assessed to not be sufficiently reliable to use. Therefore, their data for 2024 is presented in all of the underlying data files as ‘u’ to indicate low reliability and 2023 figures for Hampshire are included in the 2024 totals for the South East region and England.
Hackney, 2022, 2021
Hackney had a cyberattack in December 2020, which had a significant impact on their information management systems. As a result, 2020 figures for Hackney have been included in the 2021 and 2022 national and regional totals, but data in the underlying data files for Hackney has been presented as ‘x’ to indicate not available.
Factors identified at the end of assessment
Factors identified at the end of assessment were collected and reported for the first time in 2014; however, data was only published at national level due to concerns about its quality. Since 2015 data has been published at local authority level, with coverage continuing to improve.
It should be noted that not all episodes have factors recorded, but this has improved over time. Nonetheless, there can be differences in the recording practices between local authorities therefore this data should be treated with caution and shouldn’t be taken to represent the national, regional or local authority level prevalence of particular issues.
In addition, local authorities have been encouraged to report all relevant factors identified at the end of assessment, which may account for some of the increases seen in recent years and means the majority of children have more than one factor recorded for each episode of need. This should be taken into consideration when assessing time series assessment factor data.