Snowball Metrics – providing a robust methodology to inform research strategy – but do they help?
Abstract
Universities and funders need robust metrics to help them develop and monitor evidence-based strategies. Metrics are a part, albeit an important part, of the evaluation landscape, and no single metric can paint a holistic picture or inform strategy. A “basket of metrics” alongside other evaluation methods such as peer review are needed. Snowball Metrics offer a robust framework for measuring research performance and related data exchange and analysis, providing a consistent approach to information and measurement between institutions, funders and government bodies. The output of Snowball Metrics is a set of mutually agreed and tested methodologies: “recipes”. These recipes are available free-of-charge and can be used by anyone for their own purposes. A freely available API: the Snowball Metrics Exchange service (SMX), acts as a free “broker service” for the exchange of Snowball Metrics between peer institutions who agree that they would like to share information with each other and any institution can become a member of the SMX. In this paper, we present a use case where the University of St Andrews reviewed its institutional level KPIs referring to the Snowball Metrics recipes. In conclusion, quantitative data inform, but do not and should not ever replace, peer review judgments of research quality – whether in a national assessment exercise, or for any other purpose. Metrics can support human judgment and direct further investigation to pertinent areas, thus contributing to a fully rounded view on the research question being asked. We suggest using a “basket of metrics” approach measuring multiple qualities and applied to multiple entities.
Citation
Clements , A , Darroch , P I & Green , J 2017 , ' Snowball Metrics – providing a robust methodology to inform research strategy – but do they help? ' , Procedia Computer Science , vol. 106 , pp. 11-18 . https://doi.org/10.1016/j.procs.2017.03.003
Publication
Procedia Computer Science
Status
Peer reviewed
ISSN
1877-0509Type
Journal article
Rights
© 2017 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license. https://creativecommons.org/licenses/by-nc-nd/4.0/
Collections
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Related items
Showing items related by title, author, creator and subject.
-
Examining fish quality : the evaluation of the use of lipids as a measure of condition in wild Atlantic salmon
Howe, Alexandra Jane (University of St Andrews, 2015-06-24) - ThesisConsidering the response of organisms to their environment is difficult; it is made more so if population numbers cannot be closely monitored. In such cases different methods of population assessment are required. This ... -
Topics in estimation of quantum channels
O'Loan, Caleb J. (University of St Andrews, 2010-06-23) - ThesisA quantum channel is a mapping which sends density matrices to density matrices. The estimation of quantum channels is of great importance to the field of quantum information. In this thesis two topics related to ... -
On the expected exclusion power of binary partitions for metric search
Vadicamo, Lucia; Dearle, Alan; Connor, Richard (Springer, Cham, 2022-09-29) - Conference itemThe entire history and, we dare say, future of similarity search is governed by the underlying notion of partition. A partition is an equivalence relation defined over the space, therefore each element of the space is ...