The Project
ARRAtools4U aims to assist universities and higher education institutions in Germany in implementing the Agreement on Reforming Research Assessment (ARRA) by adressing practical processes, methodological approaches, and providing resources. The materials developed and tested at the participating institutions are collected here and made accessible to all interested audiences.
Work Package 4 Evaluation and adaptation
Work Package 5 Implementation
Work Package 3 Designing implementation tools
Work Package 2 Identifying gaps
Work Package 1 Awareness raising
This figure presents the project workflow along with the developed tools.
Work Package 1 - Awareness raising
At the beginning and end of the project, online surveys capture the knowledge and attitudes of university members regarding the reform of research assessment. In addition, targeted and cross-group information sessions, workshops, and webinars facilitate awareness-raising, exchange, and active involvement in the reform process. Accompanying materials, such as explanatory videos, fact sheets, and brochures, support the sustainable integration of the reform within the institution.
Work Package 2 - Identifying gaps
Through a structured gap analysis, reform needs within the institution are identified and synergies with existing processes are highlighted. The developed template is piloted and refined at the German Sport University Cologne in collaboration with Bielefeld University, before making it available for broader use.
Work Package 3 - Designing implementation tools
Building on the gap analysis, reform processes are collaboratively developed and piloted in selected areas with relevant committees. These measures are documented, assessed, and transformed into guidelines, allowing other institutions to benefit from the insights gained. The goal is to create practical, tested approaches that offer clear guidance while remaining flexible enough to suit diverse institutional contexts.
Work Package 4 - Evaluation and adaptation
At Bielefeld University, a gradual, participatory process is being developed to initiate the reform of research assessment and incorporate diverse perspectives from academia and institutional committees. The structure of the comprehensive university, specifically its differently organised faculties, plays a central role in this process. Psychology and Sport Science serve as the pilot faculty. The experiences gained are documented in a best-practice handbook and made accessible as a tool.
Work Package 5 - Implementation
The tools developed in the project are shared, discussed, and further refined within national and European networks. Workshops, conferences, and presentations foster dialogue and help ensure that the results are widely disseminated.
Reforming research assessment:
Context and rationale
Currently, research assessment relies predominantly on quantitative bibliometric indicators, such as the number of publications, citation counts, or the so-called Journal Impact Factor. However, these metrics capture only part of the actual contributions made by researchers and research institutions. To address these challenges, the “Agreement on Reforming Research Assessment” (ARRA) was published in July 2022. It is the result of a broad consultation process involving over 350 organisations from more than 40 countries, led by the European University Association (EUA), Science Europe, and the European Commission. The Agreement sets out shared principles and commitments for a comprehensive reform of research assessment, aiming to appropriately recognise and account for the diversity and quality of research outputs and activities across different evaluation contexts.
To support the implementation of ARRA at the institutional level, the “Coalition for Advancing Research Assessment” (CoARA) was established in December 2022. As a network of research funders, universities, research institutions, scholarly societies, and other relevant stakeholders who have signed ARRA, CoARA provides a platform for exchanging best practices and for collaborative learning in the development of new assessment criteria and methods.
In Germany, several institutions have already signed ARRA and joined CoARA to initiate a reform in research assessment. Meanwhile, many institutions are facing the question of how to implement the reform within their existing structures. So far, there are only a few practical examples or guidelines that provide orientation and support for implementation.
For more information, please see:
