St Andrews Research Repository

St Andrews University Home
View Item 
  •   St Andrews Research Repository
  • University of St Andrews Research
  • University of St Andrews Research
  • University of St Andrews Research
  • View Item
  •   St Andrews Research Repository
  • University of St Andrews Research
  • University of St Andrews Research
  • University of St Andrews Research
  • View Item
  •   St Andrews Research Repository
  • University of St Andrews Research
  • University of St Andrews Research
  • University of St Andrews Research
  • View Item
  • Login
JavaScript is disabled for your browser. Some features of this site may not work without it.

Snowball Metrics – providing a robust methodology to inform research strategy – but do they help?

Thumbnail
View/Open
Clements_2017_PCS_SnowballMetrics_CC.pdf (405.6Kb)
Date
21/03/2017
Author
Clements, Anna
Darroch, Peter I.
Green, John
Keywords
Snowball Metrics
Metrics
Research metrics
Basket of metrics
Snowball Metrics Exchange
Metric recipe
Research evaluation
Metric methodology
Research impact
Research quality
Z665 Library Science. Information Science
ZA4050 Electronic information resources
QA76 Computer software
3rd-DAS
Metadata
Show full item record
Altmetrics Handle Statistics
Altmetrics DOI Statistics
Abstract
Universities and funders need robust metrics to help them develop and monitor evidence-based strategies. Metrics are a part, albeit an important part, of the evaluation landscape, and no single metric can paint a holistic picture or inform strategy. A “basket of metrics” alongside other evaluation methods such as peer review are needed. Snowball Metrics offer a robust framework for measuring research performance and related data exchange and analysis, providing a consistent approach to information and measurement between institutions, funders and government bodies. The output of Snowball Metrics is a set of mutually agreed and tested methodologies: “recipes”. These recipes are available free-of-charge and can be used by anyone for their own purposes. A freely available API: the Snowball Metrics Exchange service (SMX), acts as a free “broker service” for the exchange of Snowball Metrics between peer institutions who agree that they would like to share information with each other and any institution can become a member of the SMX. In this paper, we present a use case where the University of St Andrews reviewed its institutional level KPIs referring to the Snowball Metrics recipes. In conclusion, quantitative data inform, but do not and should not ever replace, peer review judgments of research quality – whether in a national assessment exercise, or for any other purpose. Metrics can support human judgment and direct further investigation to pertinent areas, thus contributing to a fully rounded view on the research question being asked. We suggest using a “basket of metrics” approach measuring multiple qualities and applied to multiple entities.
Citation
Clements , A , Darroch , P I & Green , J 2017 , ' Snowball Metrics – providing a robust methodology to inform research strategy – but do they help? ' , Procedia Computer Science , vol. 106 , pp. 11-18 . https://doi.org/10.1016/j.procs.2017.03.003
Publication
Procedia Computer Science
Status
Peer reviewed
DOI
https://doi.org/10.1016/j.procs.2017.03.003
ISSN
1877-0509
Type
Journal article
Rights
© 2017 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license. https://creativecommons.org/licenses/by-nc-nd/4.0/
Collections
  • University of St Andrews Research
URI
http://hdl.handle.net/10023/10533

Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

Related items

Showing items related by title, author, creator and subject.

  • Using metric space indexing for complete and efficient record linkage 

    Akgün, Özgür; Dearle, Alan; Kirby, Graham Njal Cameron; Christen, Peter (Springer, 2018) - Conference item
    Record linkage is the process of identifying records that refer to the same real-world entities in situations where entity identifiers are unavailable. Records are linked on the basis of similarity between common attributes, ...
  • The assemblage of Digital Engagement Metrics as a market device : the case of independent film. 

    Franklin, Michael (University of St Andrews, 2016-06-24) - Thesis
    Digital technology has radically disrupted the established ways of organising the film industry. However, digital initiatives such as marketing and distribution strategies involving social media and online distribution ...
  • Fairer citation based metrics 

    Arandelovic, Ognjen (2016-09) - Journal article
    I describe a simple modification which can be applied to any citation count based index (e.g. Hirsch’s h-index) quantifying a researcher’s publication output. The key idea behind the proposed approach is that the merit for ...
Advanced Search

Browse

All of RepositoryCommunities & CollectionsBy Issue DateNamesTitlesSubjectsClassificationTypeFunderThis CollectionBy Issue DateNamesTitlesSubjectsClassificationTypeFunder

My Account

Login

Open Access

To find out how you can benefit from open access to research, see our library web pages and Open Access blog. For open access help contact: openaccess@st-andrews.ac.uk.

Accessibility

Read our Accessibility statement.

How to submit research papers

The full text of research papers can be submitted to the repository via Pure, the University's research information system. For help see our guide: How to deposit in Pure.

Electronic thesis deposit

Help with deposit.

Repository help

For repository help contact: Digital-Repository@st-andrews.ac.uk.

Give Feedback

Cookie policy

This site may use cookies. Please see Terms and Conditions.

Usage statistics

COUNTER-compliant statistics on downloads from the repository are available from the IRUS-UK Service. Contact us for information.

© University of St Andrews Library

University of St Andrews is a charity registered in Scotland, No SC013532.

  • Facebook
  • Twitter