by Tej Nathwani and Ghislaine Dell

with a foreword and afterword by SRHE Network Convenors Tracy Scurry and Daria Luchinskaya

Foreword

As many of us working with graduate employment statistics will know, it’s difficult to find up-to-date large-scale data of graduates’ experiences of work. In the SRHE event Exploring graduate outcomes: Do we need to look beyond earnings and occupation?, Tej Nathwani (HESA) introduced a new graduate outcomes measure capturing subjective aspects of job quality, while Ghislaine Dell (Head of Careers at Bath University and member of the AGCAS Research and Knowledge Committee) reflected on the implications from a practitioner perspective. In this follow-up blog, Tej and Ghislaine comment on the issues in capturing subjective graduate outcomes and outline directions for future research. HESA is keen to get your feedback on its measures: see the end of the blog for how to get in touch.

Capturing job quality in HESA’s Graduate Outcomes survey

Tej Nathwani

Since the financial crisis, there has been a fundamental rethink about the way we measure economic and societal progress, with greater attention now given to subjective forms of data. At the individual or micro level, this has resulted in growing international interest in the quality of work – essentially those parts of our employment that correlate with our wellbeing. From a UK perspective, Scotland led the way in bringing this matter to the forefront with the formation of the Fair Work Convention. Not long after, we saw the Taylor Review of Modern Working Practices published, which recommended the dissemination of regular data on eighteen job quality indicators covering seven broad dimensions.

Graduate outcomes in the UK have historically been assessed solely on the basis of earnings and whether individuals find themselves working in professional or managerial occupations. Yet, research examining the aspirations of higher education students indicates that they want a career that uses their skills, aligns with their ambitions and that can enable them to make impact. Under the Fair Work Convention framework, these aspects embody fulfilling employment. Furthermore, funding and regulatory bodies also want to see all graduates find such work.

With no data currently available on this matter, this clearly represents an information gap in graduate labour market statistics. As an organisation that adheres to the Code of Practice for Statistics, HESA have therefore started to conduct research to fill this space. This has involved using three questions in the Graduate Outcomes questionnaire relating to these features of employment to form a single composite measure that captures fulfilment (or the ‘job design and nature of work’ as it is also commonly referred to). Our ambition is to introduce this into our official statistics/open data in forthcoming years.

Indeed, with the importance of job quality set to grow, one pathway we are currently exploring for the future development of the Graduate Outcomes survey is the addition of new questions on other elements of decent work, as identified by the Measuring Job Quality Working Group.    

Ghislaine Dell

Students make career decisions for very personal and subjective reasons. Recent research from Cibyl shows us that the most frequently looked for qualities in students’ career choices are interesting work, career progression, good work-life balance, and training & development. This matches very well to the proposed new job quality indicator. The Government’s continued emphasis on degrees offering good return on investment is at odds with what the workforce of the future are seeking. Notably, Tej’s analysis showed that, after about £25,000, higher salary does not increase graduates’ reported wellbeing, but more fulfilling work, as captured by the new measures, does. From a governmental and individual perspective, then, knowing what jobs are ‘good jobs’ is important for a thriving society. An indicator which focuses on fulfilment could enable students to make a more informed choice between possible career directions.

However, there is a potential issue around the way in which we can capture this. For example, if we take ‘I am utilising what I learnt in my studies in my work’. Many graduate jobs are discipline-agnostic, and so a chemist, for example, would not be using ‘what they learnt’ in terms of Chemistry, in a financial services job. HESA’s cognitive testing of its survey questions provides a starting point for understanding how respondents are likely to approach these statements. However, further development of the phrasing of these questions is arguably necessary to ensure that the explanation of ‘skills mismatch’ isn’t simply attributable to graduates working in a field different to the one they studied.

 A key challenge will be to work on improving response rates so that each provider can report on this new measure with confidence. Currently, the subjective “graduate voice” questions in Graduate Outcomes are not compulsory, they rarely form part of the official narrative and minimal time is devoted to analysing and understanding the responses. If we are truly to maximise the potential of this measure, these issues need to be addressed.

The new measure both fills an information gap and provides a lever for inclusion of job quality into official statistics augmenting its importance for governments and providers.

Afterword

The lively discussion that followed this SRHE event, organised by the Employability, Enterprise and Work-based Learning Network, reflects the genuine interest and excitement in being able to gather job quality statistics at scale for the first time. HESA is plugging the long-standing information gap, enabling new research directions to take off in practitioner, academic and policy communities and providing better careers information, advice and guidance to students and graduates. There is still work to be done to improve the measures and scope to expand the coverage of job quality indicators in particular extending understanding of how students interpret and understand these questions. Your feedback, whether based on experience or research, can help in the future development of this measure.

Feedback on the types of statistics users would like to see incorporated into HESA open data based on the new measure are most welcome, as are views on potential amendments/additions to the Graduate Outcomes survey. Please send your thoughts to official.statistics@hesa.ac.uk.

For more information about the Employability, Enterprise and Work-based Learning Network and future events please see: Employability, Enterprise and Work-based Learning | SRHE

For more information about AGCAS and the Research and Knowledge Committee please see: Research and Knowledge from AGCAS

Contributors

Tej Nathwani is a Principal Researcher (Economist) at HESA, which is now part of Jisc.

Ghislaine Dell is Head of Careers, University of Bath and member of AGCAS’ Research and Knowledge Committee.

SRHE Network Convenors: Dr Daria Luchinskaya is a Lecturer at the University of Strathclyde Business School and Professor Tracy Scurry is a Professor of Work and Employment at Newcastle University Business School.