How a collaboration between our historians and the UK Data Archive has brought history to life and transformed research.
Digital, creative and cultural
Professor Edward Higgs
Rapid industrialisation and urbanisation on a massive scale, combined with a doubling of the population from just under 18 million to over 36 million brought profound change to Victorian Britain.
Essex historians have brought this immense social and economic change vividly to life by using digitised Census data.
The rich resource, which has made available online 35 million household observations and over 200 million individual observations recorded during censuses between 1851 and 1911, is transforming research on social, economic and demographic change in Victorian Britain.
“Censuses place each individual in the country on census night in particular administrative districts and give standardised information for them. Since the questions asked are largely standard, we can see how the nature of places changes over time,” explained Professor Edward Higgs, co-investigator on the Integrated Census Microdata (I-CeM) Project.
Each census contains vast amounts of information on house and household structures, and for each individual including name, marital status, relationship to the head of the household, age, sex, occupation and some medical disabilities.
“By combining census data with other sources of information such as birth, marriage and death records, we have been able to link information enriching our understanding of the processes of change,” added Professor Higgs.
"By combining census data with other sources of information such as birth, marriage and death records, we have been able to link information enriching our understanding of the processes of change."
Raw census data, provided by a commercial partner, FindMyPast, gave Professor Higgs a starting point.
Working with his co-investigator, Professor Kevin Schürer of the University of Leicester, two research officers and a team of 30 Essex students, Professor Higgs began the massive task of checking, sorting and standardising the data.
“One of the things we had to do was sort out the data geographically, since a lot of it was jumbled up, and we had to make sure the transcriptions were accurate. Variables, like occupations which could be described in multiple ways, had to be coded too so that the eventual online resource could recognise that things like agricultural labourer, farm labourer, and farmer’s hand were all the same,” said Professor Higgs.
Creating a resource of reliably comparable data took the I-CeM team three years to complete.
Large-scale academic analysis of original manuscript sources had previously been time-consuming, limiting the scope and geographical scale of research.
Today the online I-CeM platform, with its dataset held at the Essex-based UK Data Archive, is transforming research by making available one of the largest historical datasets in the world.
The I-CeM Project was funded by the Economic and Social Research Council.