Methodology

Graduate labour market statistics

Published

Methodology note

Introduction

Graduate Labour Market Statistics (hereafter referred to as GLMS) was first published by the Department for Business, Innovation and Skills (BIS) in December 2014, on a quarterly and annual basis. Responsibility for English Higher Education policy, and hence this publication, transferred to the Department for Education (DfE) in Summer 2016.

The GLMS publication uses the Labour Force Survey (LFS) data to look at the labour market outcomes of graduates and postgraduates, and compares them with those of non-graduates. The annual version of the GLMS publication provides a more detailed focus on the employment and earnings outcomes of graduates by their specific characteristics as well. Due to the devolution of Higher Education policy, only individuals domiciled within England are considered. 

This document provides guidance for users regarding the generation and interpretation of figures in the GLMS publication.

Definitions and Coverage

Graduates, postgraduates and non-graduates

Graduate – defined as individuals whose highest qualification is an undergraduate degree at Bachelors level. This category also includes those classified as graduates who are currently enrolled in education courses, including studying towards a Master’s or PhD.

Postgraduate – defined as individuals whose highest qualification is any degree higher than an undergraduate degree, such as a Master’s or PhD. This category also includes those who have attained a Postgraduate Certificate in Education, as well as those in the category “other postgraduate degrees or professional qualifications”.

Non-graduate – defined as individuals whose highest qualifications are at a lower level than an undergraduate degree (National Qualification Framework (NQF[1]) Level 5 or below). This includes individuals with Foundation Degrees, Apprenticeships, A-Levels or GCSEs as their highest qualification, as well as people with lower or no qualifications. It also includes non-graduates who are enrolled on education courses, such as A-level qualified individuals who are at studying at university. For a list of qualifications included in each definition please see Annex A.

Note that degree apprenticeships cannot currently be identified in the LFS data. Individuals with a degree apprenticeship as their highest qualification are recorded against either the ‘degree’ or ‘trade apprenticeship’ category. Since we classify ‘trade apprenticeships’ as ‘non-graduates’, this means that the ‘graduate’ category will undercount and the ‘non-graduate’ category will overcount. ONS have confirmed that a graduate apprenticeship category will be in included for the January to March 2022 quarter onwards. 

Individuals whose highest qualification is at NQF Level 6, 7 or 8 but the qualification is not classed as a degree are not considered as part of this analysis. 

The definitions have been used to provide information on the outcomes of those that complete a degree, compared to those that do not, to inform Higher Education policy.

It should be noted that the definitions of graduates and non-graduates in Graduate Labour Market Statistics differ from those used in certain other publications which focus on graduate outcomes, such as the Office of National Statistics’ (ONS) “Graduates in the Labour Market 2013”, which defines graduates as those whose highest qualifications are NQF Level 4 or higher. The statistics in this release are not directly comparable with those publications due to the differences in definitions.

Population

Outcomes are presented for two different age groups: the Working Age Population and the Young Population.

Working Age Population – all individuals domiciled in England aged 16-64.

Young Population – all individuals domiciled in England aged 21-30.

GLMS provides a breakdown of outcomes for a ‘young’ sub-population. This is to reflect the fact that the large majority (over 80%)[2] of those studying an undergraduate degree are under the age of 30, and that new entrants to the labour market are likely to have a limited amount of work experience. Analysis of this sub-group allows comparisons between similarly-aged graduates and non-graduates.

Employment

Employed – individuals that had at least one hour of paid employment in the reference week. This includes individuals that worked both full time and part time.  

High Skilled Employment – a job categorised within the Standard Occupation Classification (SOC 2020) codes 1-3. SOC 1-3 includes managers, directors and senior officials; professional occupations and associate professional occupations. Note that for earlier releases of GLMS, previous SOC classifications were used. The re-classification of SOC in the GLMS 2021 release means that there is a discontinuity in the GLMS series, and care should be taken when comparing with previous publications. For more information on SOC please see the ONS website.[3] 

Medium/Low Skilled Employment – a job categorised within the Standard Occupation Classification (SOC 2020) codes 4-9. SOC 4-9 includes administrative and secretarial occupations; skilled trades’ occupations; caring, leisure and other service occupations; sales and customer service occupations; process, plant and machine operatives and elementary occupations. 

Unemployed – individuals that were not in employment during the reference week and were actively seeking work.  

Inactive – also known as the economicallyinactive, these are individuals that were not employed and did not seek work over the reference period or were seeking work over the reference period, but unavailable to start work. 

Employment Rate – the proportion of the total specified population who are employed. The total population will vary based on whether we are focusing on the working age population (16-64 year olds) or the young population (21-30 year olds). 

High-skilled Employment Rate – the proportion of the total specified population who report being in high skilled employment. The total population will vary based on whether we are focusing on the working age population (16-64 year olds) or the young population (21-30 year olds).  

The high-skilled employment rate presented in the GLMS is not the proportion of those employed that are in a high-skilled job; it is the proportion of all graduates that are in a high skilled job. For example, a High-skilled Employment Rate for working age graduates of 70%, would mean that 7 out of 10 of all graduates aged 16-64 were in a high skilled job.  

Unemployment Rate – the proportion of the specified economically active population (i.e. in work or unemployed) who are unemployed. This excludes individuals who are economically inactive. Unemployment is defined under the International Labour Organization (ILO) measure, which assesses the number of jobless people who want to work, are available to work and are actively seeking work. This is consistent with the ONS definition of unemployment. 

Inactivity Rate – the proportion of the total specified population who report being economically inactive in the labour market. The total population will vary based on whether we are focusing on the working age population (16-64 year olds) or the young population (21-30 year olds). 

Proportion of Part-time Workers - the proportion of the total specified population who report that they work part time. The total population is comprised of individuals who report that they work either full time or part time (i.e not including those who are unemployed or inactive) but will vary based on whether we are focusing on the working age population (16-64 year olds) or the young population (21-30 year olds). 

Salaries

Populations are specified as above. Median salaries are calculated as the annual equivalent of the weighted median gross weekly earnings of individuals who are in full-time employment, including overtime pay. Individuals working on a part-time basis are not included in the earnings analysis. Median salaries are given in nominal terms, so do not account for inflation. They are rounded to the nearest £500, in line with HESA’s Graduate Outcomes statistics [4]. The method for calculating the weighted median has been adjusted for the 2021 publication. Previously, weights for respondents with identical salaries were considered separately; in the revised methodology, the weights for respondents with identical salaries are combined. This has resulted in changes to the back series for several groups compared with the 2020 publication as follows. For example, after rounding, 5% of rows in the GLMS 2021 Yearly Salaries by Gender table changed by £500 in either direction. We consider the new approach to be more robust and in keeping with the interpretation of LFS weights as numbers of individuals in the population sharing the same characteristics. Weighted medians are calculated in R with the use of the weightedmedian function in the spatstat.geom package. 

Coverage

GLMS only covers English domiciled individuals (those whose permanent home is in England) as authority over Higher Education has been devolved to Scotland, Wales and Northern Ireland. 

Data

GLMS is produced using data from the UK quarterly Labour Force Survey (LFS) - a survey of households living at private addresses in the UK. Its purpose is to provide information on the UK labour market which can then be used to develop, manage, evaluate, and report on labour market policies. For more information on the methodology and quality of the LFS data please refer to the ONS website.[5]  

As the results presented in these publications are based on survey data, they represent estimates. Therefore, any findings should be interpreted with caution as they may not necessarily be statistically significant.  

Weighting: The LFS collects information on a sample of the population. To enable us to make inferences from this sample to the entire eligible population we must apply weights to the sample data. This entails assigning each responding or imputed case a weight, which can be thought of as the number of people in the population which that case represents. These weights are calculated such that they sum to a set of known population totals, and the weights of an entire dataset will sum to the eligible population of the UK. For further information on LFS weighting, please refer to the ONS User Guidance for the LFS. [6] 

Labour Force Survey (LFS) datasets are routinely reweighted in line with population estimates. In 2018 a new weighting variable was introduced, PWT18, applying to LFS datasets from July-September 2011 onwards. In 2021 a further reweighting was applied to the LFS, with 2020 (PWT20) population weights being applied to both the 2020 and the 2021 LFS quarterly data. The reweighting project completed by the Office for National Statistics has resulted in the following revisions to the GLMS:  

  • The results from 2020 and 2021 have been calculated using the 2020 LFS weights. 
  • The results from July-September 2011 up to 2019 have been calculated using the 2018 LFS weights. 
  • The results for the years 2006 up to and including April-June 2011 have been calculated using the 2014 LFS weights.  

The effect of the change in weighting is generally negligible (usually 0.1 percentage points or zero). 

In March 2020, as a result of the public health issues caused by the coronavirus (COVID-19) pandemic, the ONS altered the way it contacted people for their initial interviews for the LFS, from face-to-face interviewing to telephone-based. This change had an impact on both the level of response and the non-response bias of the survey, and the subsequent survey estimates. To mitigate the impact of this the ONS introduced housing tenure within the LFS weighting methodology for periods from January to March 2020 onwards. This change in approach is considered to produce outcomes which are more consistent with external sources and expectations than if not using tenure within the weighting.[7] 

Though the introduction of housing tenure helped to improve the reliability of the LFS, it did not fully address the issue of a lower level of response from non-UK nationals. One of the consequences of this was that the LFS data between Q1 and Q3 2020 showed a large fall in the non-UK born population and large increase in the UK born population. The ONS investigated this issue further using real time information tax data matched with the Migrant Worker Scan (MWS), which confirmed this problem. Therefore in 2021, ONS used this real time information data to help inform the re-weighting of the LFS, whilst additional analysis at regional and country level was used to provide better understanding of how the COVID pandemic affected different areas of the UK. [8] 

GLMS  only provides simple outcome measures based on survey data and do not control for the differences in characteristics between graduates, postgraduates, and non-graduates. This means that the outcomes reported may not be wholly attributable to the fact that an individual holds a particular qualification, but instead could reflect other factors, such as their wider skills, experience, or natural ability. That is, other factors such as regional variations, parental background, gender, innate ability or ethnicity may also have an impact on employment and earnings outcomes that we do not measure in this analysis. 

For more detailed econometric analysis of the earnings and employment differentials between graduates and non-graduates, see research published by the DfE on the absolute[9] and lifetime[10] returns to undergraduate degrees, and previous BIS research on the impact of university degrees on the lifecycle of earnings[11]

The R code used to produce the data for the publication is available for access via GitHub

Conversion of quarterly data for the annual publication

All rates in the GLMS (employment rates, high skilled employment rates, unemployment rates, inactivity rates and the proportion of part-time workers) are calculated for each quarter of LFS data individually and then the mean average taken to generate an annual rate, thus accounting for seasonality over the year. Respondents are interviewed for five successive waves at three-monthly intervals and 20% of the sample is replaced every quarter. They provide the data required to calculate the above rates in every quarter for five waves; this method makes sure that there is no double counting of respondents.

Respondents only provide earnings data in waves 1 and 5 of the survey compared to other key indicators such as employment that are reported for all waves. The respondent coloured green and circled in Figure 1 below is the same individual sampled. The respondent gives their salary in Q1 2014 and then also gives their salary in Q1 2015, regardless of whether it has changed or not but not in the three quarters in between.

Given that salary data is only collected in one quarter of each given year there is no risk of double counting the salary data of respondents when generating an annual nominal median salary. Therefore, all median salary calculations in the GLMS give the median of all salary data collected for the specified population over the four quarters of data, thus accounting for seasonality over the year. Although the LFS has a slightly larger sample size in Q2, meaning that marginally more weight is placed on salary data in this quarter when calculating the annual nominal median salary, the benefit of a much larger sample size outweighs this small discrepancy. The method used here avoids calculating the figure for each quarter and then taking a mean average of them (the method used for calculating the above rates), but given the differences in how salary data is collected in the LFS (explained above) this would be a less statistically robust method.

Graduate breakdown definitions

The annual GLMS publication provides a more detailed focus on the employment and earnings outcomes of graduates by their specific characteristics. The breakdowns included are age group, gender, ethnicity, disability status, degree class, subject group, occupation and industry.

Age groups  21-30 year olds; 31-40 year olds; 41-50 year olds; 51-60 year olds.

Gender – Male; Female.

Ethnicity  White; Asian; Black; Other. Asian is defined in the Labour Force Survey (LFS) as Asian or Asian British. Black is defined in the LFS as Black, African, Caribbean or Black British. Other combines four groups within the LFS; Mixed or Multiple ethnic groups, Chinese, Arab or Other ethnic group. Other has been combined together as at the disaggregated level the sample sizes were insufficient for robust analysis. The ‘Other’ ethnicity category includes graduates from a wide range of ethnic backgrounds. This category has been included for completeness within the data; however there is likely to be a high level of variation between graduates in this group and caution should be exercised when making comparisons with this group.

Disability status – Disabled; Not Disabled. This breakdown is based on the legal definition found in the Equality Act (2010) which defines a disability as “a physical or mental impairment which has a substantial and long-term adverse effect on your ability to carry out normal day-to-day activities”.

Degree class – First; Upper second (2:1); Lower second (2:2); Third.

Subject Group – Science, Technology, Engineering and Mathematics (STEM); Law, Economics and Management (LEM); Other Social Sciences, Arts and Humanities. STEM includes: medicine and dentistry; medical related subjects; biological sciences; agricultural sciences; physical and environmental sciences; mathematical sciences and computing’ engineering’ technology; architecture. LEM includes: law; economics; business and financial studies. OSSAH includes: mass communication and documentation; linguistics (English, Celtic and ancient); European languages; Eastern, Asiatic, African, American and Australasian languages and literature; humanities; arts; education. All of these subcategories are given as they are defined in the Labour Force Survey user guide.

Occupation – Managers, directors and senior officials (SOC 1); Professional occupations (SOC 2); Associate professional and technical occupations (SOC 3); Medium skilled employment (SOC 4-6); Low skilled employment (SOC 7-9).

Sector – Manufacturing; Construction; Distribution, hotels and restaurants; Transport and communication; Banking and finance; Public administration, education and health. All of these subcategories are given as they are defined in the Labour Force Survey user guide. Agriculture, forestry and fishing, energy and water and other services were excluded from the analysis due to small sample sizes that meant robust findings were not possible.

Revisions policy

There may be changes to the GLMS statistics produced should there be any changes to the Labour Force Survey questions or coverage, or changes in population weights as recommended by the ONS. Any changes to GLMS will be explained in an update to the Methodology Note.

[1] https://www.gov.uk/what-different-qualification-levels-mean/compare-different-qualification-levels 

[2] See Figure 5: https://www.hesa.ac.uk/news/20-07-2021/sb260-higher-education-graduate-outcomes-statistics/activities 

[3] https://www.ons.gov.uk/methodology/classificationsandstandards/standardoccupationalclassificationsoc/soc2020 

[4] https://www.hesa.ac.uk/index.php?option=com_content&view=article&id=1899&Itemid=239#salary 

[5] https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/employmentandemployeetypes/methodologies/labourforcesurveyuserguidance 

[6] https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/employmentandemployeetypes/methodologies/labourforcesurveyuserguidance 

 [7] https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/employmentandemployeetypes/articles/coronavirusanditsimpactonthelabourforcesurvey/2020-10-13 

[8] https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/employmentandemployeetypes/articles/coronavirusandtheimpactonpayrollemployment/experimentalanalysis 

[9] https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/759278/The_impact_of_undergraduate_degrees_on_early-career_earnings.pdf 

[10] https://www.gov.uk/government/publications/undergraduate-degrees-lifetime-labour-market-returns 

[11] https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/229498/bis-13-899-the-impact-of-university-degrees-on-the-lifecycle-of-earnings-further-analysis.pdf 

Annexes

Annex A

Annex A: List of qualifications within each category

Postgraduate

Master’s Degree 

PhD or Doctorate

Postgraduate Certificate in Education (PGCE)

Other Postgraduate Degree or Professional Qualification

Graduate

Bachelor’s Degree, also referred to as first degrees

Non-Graduate

Examples:

  • Foundation Degrees (NQF Level 5)
  • Higher National Diploma (NQF Level 5)
  • Higher National Certification (NQF Level 4)
  • A-Levels (NQF Level 3)
  • Advanced Apprenticeship (NQF Level 3)
  • GCSEs (NQF Level 2)
  • Intermediate Apprenticeship (NQF Level 2)
  • National Vocational Qualification Levels 1 - 4 (NQF Levels 1 - 5)
  • Foundation Diploma (NQF Level 1)
  • GCSE at grades D – G (NQF Level 1)
  • No Qualifications

Qualifications not considered in this analysis

Undergraduate degrees that are not at Bachelors level

Professional Diplomas, Certificates or Awards at Levels 6, 7 or 8