Towards a model for holistic electronic resources assessment at American University Library
Loading...
Date
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This paper describes a methodology established at American University Library to assess its collection of electronic resources. The project initially analyzed usage statistics for databases only, but over the years, the assessment has expanded to include additional resources such as e-journals and e-books, as well as qualitative assessment metrics and additional applications for promoting the library’s value and impact.
This assessment project was initiated out of a university mandate to reduce the library’s overall budget by 3% over a two-year budget planning cycle. To meet this short-term goal, the library’s Electronic Resources Librarian and Director of Technical Services in collaboration with the Electronic Resources Management Unit developed a workflow for collecting COUNTER compliant usage statistics for databases. These usage statistics were analyzed against financial payments for each title to establish a cost per use measure. Based on this data, the librarians developed tiers of database titles which could be cancelled based on university financial requirements.
This paper defines the COUNTER code of practice in its former and current release, and how to integrate this data with financial information to create a cost per use metric for comparison between resources. In addition, the paper will outline the assessment project at American University Library which used this data to determine the value of a resource to the library and the impact of cancellation. The paper will describe the subsequent phases of assessment which included e-journals and e-books. With publishers transitioning to COUNTER Release 5, the paper identifies future challenges in modeling longitudinal usage data across COUNTER releases. Finally, the paper reaffirms the necessity to move beyond measures such as cost per use for collection evaluation, and supply vision towards a model where qualitative guidelines are added to enhance and provide context for the quantitative usage statistics.
Description
Keywords
Citation
Barton, G. P., Relyea, G. E., & Knowlton, S. A. (2018). Rethinking the Subscription Paradigm for Journals: Using Interlibrary Loan in Collection Development for Serials. College & Research Libraries, 79:2, 279-290. doi: 10.5860/crl.79.2.279
Bucknell, T. (2012). Garbage In, Gospel Out: Twelve Reasons Why Librarians Should Not Accept Cost-per-Download Figures at Face Value. The Serials Librarian, 63:2, 192-212. https://doi.org/10.1080/0361526X.2012.680687
Cooper, M. M. (2013). Librarians as Hunter-Gatherers: Lessons Learned from an Excursion. Journal of Electronic Resources Librarianship, 25:4, 283-293. https://doi.org/10.1080/1941126X.2013.847679
Covey, D. T. (2002). Usage and Usability Assessment: Library Practices and Concerns. Council on Library and Information Resources, Digital Library Federation. Accessed at https://files.eric.ed.gov/fulltext/ED459856.pdf
Davis, P. M. & Price, J. S. (2006). E-Journal Interface Can Influence Usage Statistics: Implications for Libraries, Publishers, and Project COUNTER. Journal of the American Society for Information Science and Technology, 57:9, 1243-1248.
Enoch, T. & Harker, K. R. (2015). Planning for the Budget-ocalypse: The Evolution of a Serials/ER Cancellation Methodology. The Serials Librarian, 68:1-4, 282-289. https://doi.org/10.1080/0361526X.2015.1025657
Fry, A. (2013). A Hybrid Model for Managing Standard Usage Data: Principles for E-Resource Statistics Workflows. Serials Review, 39:1, 21-28. https://doi.org/10.1016/j.serrev.2012.12.001
Gao, W. (2016). Beyond Journal Impact and Usage Statistics: Using Citation Analysis for Collection Development. The Serials Librarian, 70:1-4, 121-127. https://doi.org/10.1080/0361526X.2016.1144161
Lewellen, R. & Plum, T. (2016). Assessment of e-Resource Usage at University of Massachusetts Amherst: A MINES for Libraries Study Using Tableau for Visualization and Analysis. Research Library Issues, 288, 5-20. doi:10.29242/rli.288.2.
Nash, J. L. & McElfresh, K. R. (2016). A Journal Cancellation Survey and Resulting Impact on Interlibrary Loan. Journal of the Medical Library Association, 104:4, 296-301.
http://dx.doi.org/10.3163/1536-5050.104.4.008
Oakleaf, M. (2010). The Value of Academic Libraries: A Comprehensive Research Review and Report. Chicago: Association of College and Research Libraries.
Pastva, J., Shank, J., Gutzman, K. E., Kaul, M. & Kubilius, R. K. (2018). Capturing and Analyzing Publication, Citation, and Usage Data for Contextual Collection Development. The Serials Librarian, 74:1-4, 102-110. https://doi.org/10.1080/0361526X.2018.1427996
Pesch, O. (2011). Perfecting COUNTER and SUSHI to Achieve Reliable Usage Analysis. The Serials Librarian, 61:3-4, 353-265. https://doi.org/10.1080/0361526X.2011.617294
Pesch, O. (2017). COUNTER Release 5: What’s New and What It Means to Libraries. The Serials Librarian, 73:3-4, 195-207. https://doi.org/10.1080/0361526X.2017.1391153
Pratesi, A.L. (2018). Use(less) Data: Discovery, COUNTER, and Music Databases. Music Reference Services Quarterly, 21:4, 171-184. doi: 10.1080/10588167.2018.1527276
Sutton, S. (2013). A Model for Electronic Resources Value Assessment. The Serials Librarian, 64:1-4, 245-253. https://doi.org/10.1080/0361526X.2013.760417
Tucker, C. & Sinha, R. (2018). New Perspectives in Collection Assessment: Flexible, Customized Delivery of Collection Evaluation Data. Paper presented at IFLA WLIC 2018; Kuala Lumpur, Malaysia. http://library.ifla.org/id/eprint/2100
Wical, S. H. & Vandenbark, R. T. (2015). Combining Citation Studies and Usage Statistics to Build a Stronger Collection. Library Resources & Technical Services, 59:1, 33-42. doi:10.5860/lrts.59n1.33