EVALUATING KNOWLEDGE TRANSFER AND IMPACT: METRICS, PROCEDURES AND GOVERNANCE FOR SCIENCE AND INNOVATION
Cordoba, 12–13 December 2019
Organizer: Institute for Advanced Social Studies-CSIC
With the collaboration of the University of Cordoba through the Associated Unit IESA-UCO “Innovation and Knowledge Transfer”
Web site: kti-conference2019.org
Knowledge transfer has become one of the most important activities of universities and research organizations. An explicit mission of these institutions is to translate their capacities and results to various social agents, including industry, governments and citizens, and to generate benefits of social and economic nature.
However, knowledge transfer has always been a complex issue to deal with. Different research practices produce different research outputs that are disseminated through multiple channels, addressed to different audiences and with a different impact. The multiplicity of results and stakeholders involved in knowledge transfer complicates the evaluation and management of these practices.
As a result, in recent years several initiatives have emerged in an attempt to improve assessment of these activities. On the one hand, new procedures and metrics are designed to observe knowledge transfer channels and to capture social, political and economic impacts. And on the other, policies and regulations are implemented to stimulate, promote and assess these practices. An example of this trend is the current exercise of the evaluation of knowledge transfer activities of researchers by the Spanish CNEAI, which has led to over 17,000 applications from all over the research community.
Fair evaluation of these practices and their impact presents several challenges and uncertainty. The current governance of research, through policies and incentives for knowledge transfer, can cause unplanned consequences in the organization of science and innovation. The metrics of these activities must be critically defined and used to reflect the footprint of research on society. A critical discussion on their utilization in research evaluation exercises is also required. Despite this, evidence shows that many research fields perform numerous transfer activities that are disregarded in research evaluations because of the lack of appropriate tools for observing their occurrence and their impact.
Designing a suitable research evaluation system, then, calls for a combination of regulations, measurement tools, and management systems that can be easily put in practice. This international conference attempts to contribute to three basic areas of research evaluation: transfer-related governance, measurement of knowledge transfer and impact (altmetrics) and procedures for implementing evaluation processes for persons and organizations.
The main goal of this conference is to create a new forum to encourage the growing discussion on the measurement and evaluation of knowledge transfer at the interface between the scholarly community and the research funding and evaluation agencies. Participants will discuss perspectives and meanings of knowledge transfer and impact, alternative indicators and measurement tools, research policies, evaluation criteria, and their management implications. The conference will specifically focus on standards for improving the design of evaluation schemes for knowledge transfer and impact.
To this end, the conference aims to gather experts from different backgrounds: researchers on both new metrics of science and the organization of science, evaluation managers and policy-makers. This forum seeks to foster interdisciplinary research, by advocating proposals and solutions that will encourage responsible science and innovation.
There are two routes to participation:
– Plenary acts: several symposiums will be arranged with acknowledged researchers and evaluation experts.
-Sessions for paper presentations: the conference makes a “call for papers” aimed at researchers working in related topics.
Participation and submission of abstracts
The organizers invite submissions of extended abstracts (1,000 words) in English or Spanish, along with the authors’ full details and the research topic. Please send abstracts to firstname.lastname@example.org and email@example.com
A peer-review process will be in place to select the most relevant contributions. Abstracts will be evaluated by a scientific committee. Accepted papers will be presented in parallel sessions and will be candidates for publication in a journal and a book collaborating with the conference.
The conference will be structured around three research tracks. Each one will have its own plenary act and two parallel sessions (four papers per session). The research tracks will include tentatively the following topics, although other related topics are welcome:
Track 1. The governance of transfer and impact
- Meanings of transfer and impact
- Public policies to promote transfer and impact. National and international experiences
- Institutional quality: regulations to stimulate transfer and impact. Fair evaluation practices
Track 2. The measurement of transfer and impact (Altmetrics and other alternative measurement tools)
- State-of-the-art of the metrics of knowledge transfer and impact
- Evaluation of information sources (data providers)
- Conceptual and empirical discussions: disciplinary differences, meaning and context, types of transfer and impact
Track 3. The implementation of evaluation processes for transfer and impact
- The role of funding and evaluation agencies in transfer and impact
- Evaluation processes for research activities (research projects, accreditation, disseminations, etc.)
- Assessment exercises for researchers
- Assessment exercises for organizations
Several papers presented in the conference will be invited for inclusion in two important publications (journal special issue and edited book). Full papers will be peer-reviewed by the editorial team of each publication through their usual procedures. The publications collaborating with the conference will be announced before the closure of the submission process.
Language: The language of the presentations will be English or Spanish, according to the participants in each parallel session. In order to be considered for publication, abstracts (and full texts later) should be submitted in English.
- Call for papers: extended deadline: September 30
- Evaluation: September 30 – October 15
- Notification of acceptance: October 15
- Registration: October 15 – November 30
- Final programme: December 1
- Conference: December 12-13
José Luis Ortega, firstname.lastname@example.org
Manuel Fernández Esquinas, mfernández@iesa.csic.es
Institute for Advance Social Studies, CSIC
Associated Research Unit CSIC-UCO “Innovation and Knowledge Transfer”
Antonio García Molina, UCO, email@example.com
José Antonio Pedraza, UCO, firstname.lastname@example.org
Maribel Sánchez Rodríguez, UCO, email@example.com
Rocío Muñoz Benito, UCO, firstname.lastname@example.org
Paula Espinosa, CSIC, email@example.com
Fernando Aguado, CSIC, firstname.lastname@example.org
Jaime Aja, UCO, email@example.com
Associated Research Unit on ”Innovation and Knowledge Transfer”, CSIC/University of Córdoba
Registration: 100 euro
Registration fees will cover organization costs, conference materials for participants and coffee breaks.
An optional farewell dinner and other social activities for participants will be arranged.
Mike Thelwall, University of Wolverhampton
Isidro Aguillo, Institute of Public Policies-CSIC
Enrique Orduña-Malea, Universidad Politécnica de Valencia
Jordi Molas, INGENIO-CSIC and Polytechnic University of Valencia
Elena Castro, INGENIO-CSIC and Polytechnic University of Valencia
Emilio Delgado, University of Granada
Daniel Torres, EC3_Metrics, UGR
Álvaro Cabezas, Sexenios.com and EC3_Metrics
Carmen Pérez Esparrells, Autonomous University of Madrid
Ana Fernández Zubieta, Complutense University of Madrid
Nicolás Robinson García, TU Delft
Julia Olmos Peñuela, University of Valencia
Elea Giménez Toledo, Institute of Philosophy, CSIC
Carolina Cañibano, INGENIO-CSIC and Polytechnic University of Valencia
Spanish National Research Council (CSIC)
Institute for Advance Social Studies (IESA)
Plaza Campo Santo de los Mártires, 7