Theory of Change: a new approach to data by Schools Library Services in the UK
Loading...
Date
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
For a long time, Schools Library Service (SLS) Managers in the UK have wanted a means to collect and analyse meaningful data from the schools they serve, in order both to measure the impact of SLSs in the enhancement of teaching and learning in primary and secondary schools and to demonstrate the value for money their services provide.
A sub-group of SLS managers within the professional body ASCEL (Association of Senior Children’s and Education Librarians), worked with Sharon Markless from Kings College London, a respected academic in this field, to develop a Theory of Change framework fit for use across all SLSs, many of whom operate with very different subscription models. A national approach enables SLSs to not only gauge their own value and effectiveness, but also share data and develop their services. It also benefits schools by drawing on their data to show the value of the school library and its services to its stakeholders.
The attraction of Theory of Change has been in the ability to create a robust framework allowing for the build-up of relevant data which can be applied to benefits and outcomes across the UK regionally and nationally, creating from existing collection methods a wealth of data in a much shorter space of time than can be achieved by traditional methods of surveying schools. This is because existing data collection is coupled with replicable group evaluation activities that can yield results more effectively. Surveys are rarely answered by an adequate sample, are very time-consuming for analysts and rely on absolute clarity of understanding both of question setters and respondents to achieve meaningful results. The framework looks at all the opportunities to collect segments of data and then merge them to create an overall picture.
This paper details the background to SLSs and why this data collection is needed, the process of defining the framework and the benefits many will now be able to reap from adopting the framework both to collect data and to contribute to wide-reaching evaluation outcomes.
Description
Keywords
Citation
ActKnowledge (2011) Theory of Change basics. ActKnowledge, New York. [2019-05-15] Available at: http://www.theoryofchange.org/wp-content/uploads/toco_library/pdf/2011_-_Montague-Clouse_-_Theory_of_Change_Basics.pdf
ASCEL (2003) Secondary School Library National Survey and Benchmarking General Report – unpublished.
ASCEL (2013) SLS services 2013 summary - unpublished
ASCEL (2016) Summary of SLS Survey Autumn 2015 – unpublished.
Creaser, C and Maynard, S (2005). A survey of library services to schools and children in the UK 2004-05. LISU, Loughborough.
Greene, J.C. (2012). “Engaging Critical Issues in Social Inquiry by Mixing Methods.” American Behavioral Scientist, 56(6), 755-773. https://doi.org/10.1177/0002764211433794
Greene, J.C. (2015) “Evaluation as a socio-political intervention.” Spazio Filosofico,
http://www.spaziofilosofico.it/wp-content/uploads/2015/02/Greene.pdf
Markless, Sharon et al. (2000) Schools Library Services: from survival to growth? Library and Information Commission Research Report 49 Twickenham, Middx.: IMA for the LIC 2000 ISBN: 0-9538432-3-8.
http://www.informat.org/pdfs/schools-library-services.pdf
Markless, Sharon (2018) Evaluating impact [a workshop presentation to SLS Managers, January 2018].
Mayne, John ( 2012 ). “Contribution analysis: Coming of age?” Evaluation, 18 (3), 270 – 280. Available at: http://dx.doi.org/10.1177/1356389012451663
Mayne, John (2015). “Useful theory of change models”. The Canadian Journal of Program Evaluation, 30 (2) 119-142 [2019-05-15] Available at: https://jmss.org/index.php/cjpe/article/view/31062/25218