Reforming How Researchers Are Assessed
The OPUS project is an EU-funded project implemented by an eighteen-organisations consortium led by The Oceanic Platform of the Canary Islands (PLOCAN). The main goal was to develop coordination and support measures to reform the assessment of research(ers), along with the following:
- Conduct a comprehensive state-of-the-art on existing literature and initiatives for Open Science
- Develop a comprehensive set of interventions to implement Open Science at RPOs and RFOs
- Develop a Researcher Assessment Framework (RAF) and Open Science Career Assessment Matrix (OSCAM2) to incentivise and reward Open Science practices by researchers, and RPOs and RFOs
- Test the interventions and indicators and metrics via action plans in pilots at RPOs and RFOs
- Utilise a stakeholder-driven feedback loop to develop, monitor, refine, and validate actions
- Synthesise outcomes into policy briefs and a revised OS-CAM2 for research(er) assessment
OPUS has been running since 1 September 2022 and is set to conclude on 31 August 2025.
OPUS has developed a Researcher Assessment Framework and a set of interventions for Open Science, aiming to build a system that incentivises and rewards researchers for adopting practices such as open access to research outputs, early and open sharing of research, participation in open peer review, ensuring the reproducibility of results, and engaging all stakeholders in co-creation.
Four Key Project Pillars
#1: State-of-the-Art on an Open Science Ecosystem
We reviewed existing literature and identified key experts, initiatives, and networks related to research assessment and Open Science (including creating a database of over 150 experts, identifying 36 relevant Horizon Europe projects, and mapping 34 relevant networks for the project).
The initiatives include key (1) projects, (2) experts and organisations, (3) networks and schemes.
The literature reviews focused on (1) research(er) assessment, (2) incentives and rewards, (3) precarity of research careers, (4) gender equality, (5) industry practices.
LEAD: RESOLVO.eu
#2: Interventions for Open Science
We developed interventions for RPOs and RFOs to implement a reformed research(er) assessment system and supported RPOs and RFOs in implementing the RAF and OSCAM2, focusing on the policies, resources, awareness-raising, and training required for implementation. These interventions were tested by pilot RPOs and RFOs in Activity #4 (WP4).
We also conducted a baseline audit of the interventions tested in the pilots, co-monitored and evaluated them in collaboration with the pilot RPOs and RFOs, and subsequently developed a final set of interventions for Open Science at RPOs and RFOs.
LEAD: CRAC-Vitae
#3: Researchers Assessment Framework
OPUS developed a Researcher Assessment Framework (RAF) to recognise the wide diversity of activities conducted by researchers, developed an Open Science Career Assessment Matrix (OSCAM2) to incentivise and reward Open Science practices by researchers, and supported the pilot organisations.
This framework moves beyond traditional metrics such as publication counts and journal impact factors, instead offering a balanced and inclusive Researcher Assessment Framework (RAF) that formally recognises Open Science practices.
LEAD: TECHNOPOLIS CONSULTING GROUP BELGIUM
#4: Pilots to Implement and Monitor Open Science
The OPUS project developed and implemented a set of Final Action Plans to drive the adoption of Open Science (OS) across diverse institutional contexts and to implement the RAF within the OPUS pilots (three RPOs and two RFOs). It also conducted mutual learning exercises based on the implementation of these action plans, which in practice involved:
-
Establishing a Pilot Committee composed of project partners (UNL, ABIS, JISC, RCL, RESOLVO SRL, TGB, TrustInside, UCY, UEFISCDI, UNIRI, VU, YERUN) to coordinate across the pilots; and
-
Forming a Mutual Learning Group consisting of pilot RPOs and RFOs, along with experts, to support and reflect on the pilots (UEFISCDI, JISC, RCL, TGB, TrustInside, UCY, UNIRI, UNL, VU, YERUN).
LEAD: YERUN
#5: Policy Briefs on Open Science
OPUS developed policy briefs on Open Science and OSCAM2 to assess research careers.
As a significant output of the OPUS project, the Final Policy Brief serves as a comprehensive guide to policymakers, science managers, and other institutional leaders, presenting key lessons learnt and policy advice to support the uptake of Open Science practices at the institutional and individual researcher’s levels.
The revised OSCAM provides a concrete researchers assessment framework to evaluate researchers at RPOs and RFOs.
LEAD: UNESCO
#6: Project Coordination & Data Management
The OPUS Project Coordinator – PLOCAN ensured the coordination and data management of the project. This specifically involved developing all plans and reports related to project coordination and data management, and ensuring that all partners collectively contributed to the successful implementation of the project. Some of the activities included:
-
Establishing a Consortium Agreement
-
Coordinating and managing all project activities, the internal and external flow of information, the provision of deliverables, and the implementation of risk mitigation strategies
Project Coordinator: PLOCAN
#7: Dissemination, Communication&Exploitation
OPUS Project team developed a Dissemination & Communications plan with strategic and targeted measures for promoting the Open Science and project results and inform key stakeholders and the public.
OPUS Project team managed communication and dissemination activities to promote the project, progress of the project, and project key exploitable results for societal and scientific purposes.
LEAD: ICoRSA
Project Consortium
All 18 organisations implementing the OPUS project are active at the European level spanning the whole spectrum of Open Science.
Advisory Board
The advisory board of the OPUS project is composed of prominent figures in the fields of research policy, open science, and higher education. It includes representatives from leading universities and science organizations across Europe, each bringing a wealth of experience in academic leadership and research initiatives.
Organisation | Name | Position |
---|---|---|
European University Association | Amanda Crowfoot | Secretary General |
Universidad Carlos III de Madrid | Eva M. Mendez Rodriguez | Deputy Vice-president for Research Policies |
Vrije Universiteit Brussel | Jean-Claude Burgelman | Professor of Open Science |
Science Europe | James Morris | Senior Policy Officer |
French ministry for higher education, research and innovation / EOSC | Volker Beckmann | Program Manager |
Stockholm University | Wilhelm Widmark | Library Director |
Leiden University | Barend Mons | Scientific director, International office GO FAIR |