EVALUATING KNOWLEDGE TRANSFER AND IMPACT: METRICS, PROCEDURES AND GOVERNANCE FOR SCIENCE AND INNOVATION

EVALUATING KNOWLEDGE TRANSFER AND IMPACT: METRICS, PROCEDURES AND GOVERNANCE FOR SCIENCE AND INNOVATION

Cordoba, 12–13 December 2019

Organizer: Institute for Advanced Social Studies-CSIC

With the collaboration of the University of Cordoba through the Associated Unit IESA-UCO “Innovation and Knowledge Transfer”

Web site: kti-conference2019.org

Context

Knowledge transfer has become one of the most important activities of universities and research organizations. An explicit mission of these institutions is to translate their capacities and results to various social agents, including industry, governments and citizens, and to generate benefits of social and economic nature.

However, knowledge transfer has always been a complex issue to deal with. Different research practices produce different research outputs that are disseminated through multiple channels, addressed to different audiences and with a different impact. The multiplicity of results and stakeholders involved in knowledge transfer complicates the evaluation and management of these practices.

As a result, in recent years several initiatives have emerged in an attempt to improve assessment of these activities. On the one hand, new procedures and metrics are designed to observe knowledge transfer channels and to capture social, political and economic impacts. And on the other, policies and regulations are implemented to stimulate, promote and assess these practices. An example of this trend is the current exercise of the evaluation of knowledge transfer activities of researchers by the Spanish CNEAI, which has led to over 17,000 applications from all over the research community.

Fair evaluation of these practices and their impact presents several challenges and uncertainty. The current governance of research, through policies and incentives for knowledge transfer, can cause unplanned consequences in the organization of science and innovation. The metrics of these activities must be critically defined and used to reflect the footprint of research on society. A critical discussion on their utilization in research evaluation exercises is also required. Despite this, evidence shows that many research fields perform numerous transfer activities that are disregarded in research evaluations because of the lack of appropriate tools for observing their occurrence and their impact.

Designing a suitable research evaluation system, then, calls for a combination of regulations, measurement tools, and management systems that can be easily put in practice. This international conference attempts to contribute to three basic areas of research evaluation: transfer-related governance, measurement of knowledge transfer and impact (altmetrics) and procedures for implementing evaluation processes for persons and organizations.

Objectives

The main goal of this conference is to create a new forum to encourage the growing discussion on the measurement and evaluation of knowledge transfer at the interface between the scholarly community and the research funding and evaluation agencies. Participants will discuss perspectives and meanings of knowledge transfer and impact, alternative indicators and measurement tools, research policies, evaluation criteria, and their management implications. The conference will specifically focus on standards for improving the design of evaluation schemes for knowledge transfer and impact.

To this end, the conference aims to gather experts from different backgrounds: researchers on both new metrics of science and the organization of science, evaluation managers and policy-makers.  This forum seeks to foster interdisciplinary research, by advocating proposals and solutions that will encourage responsible science and innovation.

Organization

There are two routes to participation:

– Plenary acts: several symposiums will be arranged with acknowledged researchers and evaluation experts.

-Sessions for paper presentations: the conference makes a “call for papers” aimed at researchers working in related topics.

Participation and submission of abstracts

The organizers invite submissions of extended abstracts (1,000 words) in English or Spanish, along with the authors’ full details and the research topic. Please send abstracts to jortega@orgc.csic.es and mfernandez@iesa.csic.es

A peer-review process will be in place to select the most relevant contributions. Abstracts will be evaluated by a scientific committee. Accepted papers will be presented in parallel sessions and will be candidates for publication in a journal and a book collaborating with the conference.

Topics

The conference will be structured around three research tracks. Each one will have its own plenary act and two parallel sessions (four papers per session). The research tracks will include tentatively the following topics, although other related topics are welcome:

Track 1. The governance of transfer and impact

  • Meanings of transfer and impact
  • Public policies to promote transfer and impact. National and international experiences
  • Institutional quality: regulations to stimulate transfer and impact. Fair evaluation practices

Track 2. The measurement of transfer and impact (Altmetrics and other alternative measurement tools)

  • State-of-the-art of the metrics of knowledge transfer and impact
  • Evaluation of information sources (data providers)
  • Conceptual and empirical discussions: disciplinary differences, meaning and context, types of transfer and impact

Track 3. The implementation of evaluation processes for transfer and impact

  • The role of funding and evaluation agencies in transfer and impact
  • Evaluation processes for research activities (research projects, accreditation, disseminations, etc.)
  • Assessment exercises for researchers
  • Assessment exercises for organizations

Publication options

Several papers presented in the conference will be invited for inclusion in two important publications (journal special issue and edited book). Full papers will be peer-reviewed by the editorial team of each publication through their usual procedures. The publications collaborating with the conference will be announced before the closure of the submission process.

Language: The language of the presentations will be English or Spanish, according to the participants in each parallel session. In order to be considered for publication, abstracts (and full texts later) should be submitted in English.

Dates

  • Call for papers: extended deadline: September 30
  • Evaluation: September 30 – October 15
  • Notification of acceptance: October 15
  • Registration: October 15 – November 30
  • Final programme: December 1
  • Conference: December 12-13

Organizers

José Luis Ortega, jortega@orgc.csic.es

Manuel Fernández Esquinas, mfernández@iesa.csic.es

Institute for Advance Social Studies, CSIC

Associated Research Unit CSIC-UCO  “Innovation and Knowledge Transfer”

Organization Comittee

Antonio García Molina, UCO, agmolina@uco.es

José Antonio Pedraza, UCO, japedraza@uco.es

Maribel Sánchez Rodríguez, UCO,  td1sarom@uco.es

Rocío Muñoz Benito, UCO, dt1muber@uco.es

Paula Espinosa, CSIC, paula.espinosa93@gmail.com

Fernando Aguado, CSIC, f_aguado@hotmail.com

Jaime Aja, UCO, jaime.aja@uco.es

Associated Research Unit on ”Innovation and Knowledge Transfer”, CSIC/University of Córdoba

Conference fees

Registration: 100 euro

Registration fees will cover organization costs, conference materials for participants and coffee breaks.

An optional farewell dinner and other social activities for participants will be arranged.

Scientific committee

Mike Thelwall, University of Wolverhampton

Isidro Aguillo, Institute of Public Policies-CSIC

Enrique Orduña-Malea, Universidad Politécnica de Valencia

Jordi Molas, INGENIO-CSIC and Polytechnic University of Valencia

Elena Castro, INGENIO-CSIC and Polytechnic University of Valencia

Emilio Delgado, University of Granada

Daniel Torres, EC3_Metrics, UGR

Álvaro Cabezas, Sexenios.com and EC3_Metrics

Carmen Pérez Esparrells, Autonomous University of Madrid

Ana Fernández Zubieta, Complutense University of Madrid

Nicolás Robinson García, TU Delft

Julia Olmos Peñuela, University of Valencia

Elea Giménez Toledo, Institute of Philosophy, CSIC

Carolina Cañibano, INGENIO-CSIC and Polytechnic University of Valencia

Venue

Spanish National Research Council (CSIC)

Institute for Advance Social Studies (IESA)

Plaza Campo Santo de los Mártires, 7

14004 Córdoba-Spain

Leave a Reply

Your email address will not be published. Required fields are marked *