Articles | Volume 14
https://doi.org/10.5194/asr-14-305-2017
https://doi.org/10.5194/asr-14-305-2017
03 Nov 2017
 | 03 Nov 2017

Evaluating co-creation of knowledge: from quality criteria and indicators to methods

Susanne Schuck-Zöller, Jörg Cortekar, and Daniela Jacob

Abstract. Basic research in the natural sciences rests on a long tradition of evaluation. However, since the San Francisco Declaration on Research Assessment (DORA) came out in 2012, there has been intense discussion in the natural sciences, above all amongst researchers and funding agencies in the different fields of applied research and scientific service. This discussion was intensified when climate services and other fields, used to make users participate in research and development activities (co-creation), demanded new evaluation methods appropriate to this new research mode.

This paper starts by describing a comprehensive and interdisciplinary literature overview of indicators to evaluate co-creation of knowledge, including the different fields of integrated knowledge production. Then the authors harmonize the different elements of evaluation from literature in an evaluation cascade that scales down from very general evaluation dimensions to tangible assessment methods. They describe evaluation indicators already being documented and include a mixture of different assessment methods for two exemplary criteria. It is shown what can be deduced from already existing methodology for climate services and envisaged how climate services can further to develop their specific evaluation method.

Download
Short summary
Climate services and other fields, that are used to integrate the users in research activities (co-creation), are pledging for existing evaluation methods to be widened up. The authors harmonize the different elements of evaluation in an evaluation cascade, scaling down from very general evaluation dimensions to tangible assessment methods and suggest how to proceed in developing evaluation criteria and indicators. Two examples demonstrate how co-creation of knowledge could be assessed.