#ResearchAssessment

The Open and Universal Science (OPUS) project is working to reshape how research and researchers are assessed, focusing on developing and testing new indicators and methods. This initiative, which promotes open science practices, involves three Research Performing Organisations (RPOs)—Nova University Lisbon, the University of Rijeka (UNIRI), and the University of Cyprus, as well as two Research Funding Organisations (RFOs) from Lithuania and Romania (RCL and UEFISCDI). Through these pilot projects, the institutions are collaborating with external experts and learning from one another to improve their approaches.

OPUS aims to create a research assessment framework that is more inclusive and comprehensive, moving beyond traditional metrics such as bibliometrics and journal impact factors. TThe framework aims to recognise the wide diversity of activities by researchers and incentivise and reward Open Science.

Let’s take a closer look at how the University of Cyprus is contributing to this change.

The State of Open Science at the University of Cyprus: Promoting Engagement, Transparency, and Reproducibility

Open science is a key focus at the University of Cyprus, with a strong commitment to fostering transparency, accessibility, and collaboration in research. While the university’s open science policy is voluntary, meaning researchers are not required to publish in open science outlets, it is highly encouraged. Already, over 60% of the university’s publications are available through open access, showing significant progress in this area.

Supporting Open Access and Open Data

To further promote open science, the University of Cyprus has introduced several initiatives. These include providing funding for researchers to publish in open access journals and to support the publication and management of open data. By offering financial incentives, the university aims to encourage a culture of openness among its researchers.

Embedded video: https://youtu.be/q28J99tjXSo?feature=shared

Enhancing Reproducibility Through Practical Tools

A key part of the university’s approach to open science is improving the reproducibility of research. The university has developed seminars that focus on practical tools and methods to help researchers produce reproducible work. These sessions are designed to equip researchers with the skills they need to ensure their studies can be replicated and validated by others—an essential element of high-quality scientific work.

Engaging Citizens in Research

Citizen engagement is another important aspect of the university’s open science initiatives. By involving stakeholders and the public through participatory science, the university hopes to make research more transparent and impactful. Awareness events have already been held, aiming to promote the idea that involving citizens in scientific research can lead to better, more accessible results.

Future Plans for Open Science Integration

Looking ahead, the University of Cyprus is committed to further integrating open science principles into its policies and practices. The university’s open science policy has already been approved by its governing bodies, marking an important step forward. Researchers are encouraged to create ORCID identifiers, which help make their work publicly available and connected to the broader research community.

Although the university acknowledges that it is still in the early stages of fully integrating open science into all aspects of its operations, it is making steady progress. The university is part of several projects and initiatives, including the OPUS project, the European Open Science Cloud (EOSC), and the COARA National Chapter, all of which support its efforts to advance open science.

Embedding Open Science into its Research Culture

The University of Cyprus is committed to embedding open science into its research culture. With a focus on open access publishing, reproducibility, and citizen engagement, the university is working towards a research environment that is more inclusive and transparent. As it continues to develop its policies and practices, the university aims to make further progress in supporting open science and its benefits for the wider community.

The Open and Universal Science (OPUS) project is at the forefront of reshaping how research and researchers are evaluated, focusing on developing and testing innovative indicators and strategies. This initiative, dedicated to promoting open science practices, brings together three Research Performing Organisations (RPOs)—Nova University Lisbon, the University of Rijeka (UNIRI), and the University of Cyprus—along with two Research Funding Organisations (RFOs) from Lithuania and Romania (RCL and UEFISCDI). Through pilot programmes, these institutions collaborate, gain insights from external experts, and participate in shared learning experiences to improve their methodologies.

The central aim of OPUS is to establish a more inclusive  framework for assessing research, moving away from conventional metrics such as bibliometrics and journal impact factors. The framework aims to recognise the wide diversity of activities by researchers and incentivise and reward Open Science.

Let’s explore how the NOVA University is contributing to this transformation.

The State of Open Science at Nova University: Transparent and Responsible Research Practices

Nova University is steadfastly committed to advancing scientific research and disseminating knowledge for the benefit of society. At Nova, this vision is closely tied to a strong dedication to the principles of open science. The university recognises that science can only truly advance through the adoption of open, transparent, reproducible, and responsible research practices.

Commitment to Open Science and Institutional Alignment

Nova University is fully dedicated to implementing open science principles and aligning its institutional policies with the national policy established by the Portuguese Foundation for Science and Technology (FCT). This national policy is currently under revision and is expected to be released soon. In anticipation, Nova is working on synchronising its own open science policy document with these updated national guidelines.

In order to facilitate this transition, Nova University is preparing an Open Science Guide, designed to provide clear guidelines to researchers and address the main questions they may have. This guide will not only reflect national principles but also align with international standards, including the recommendations from UNESCO, the European Commission, Science Europe, and other relevant bodies. Nova’s participation in international networks such as YERUN further enhances its integration of open science practices.

Longstanding Commitment to Open Access

Nova University has been promoting open science for over a decade. One of its earliest initiatives was the integration of a national repository network, managed by the Portuguese Foundation for Science and Technology (FCT). For many years, Nova’s own repository has been mandatory for the deposit of open access publications, including master’s and PhD theses.

Nearly eight years ago, Nova implemented a direct connector between its Current Research Information System (CRIS) “PURE” and the national repository. This strategic move has significantly increased the number of open access publications deposited, streamlining the process for researchers who only need to deposit their work once. Currently, nearly two-thirds of all Nova University publications are available as open access, ranking the university among the top Portuguese institutions in terms of open access output.

Data and Software Sharing

Nova University has also embraced open science practices in relation to research data and software. Researchers are encouraged to use platforms like Zenodo for dataset sharing and GitHub for software, in accordance with national guidelines promoted by FCT. This ensures that research outputs beyond publications are also made widely accessible, further strengthening Nova’s commitment to transparency and open collaboration.

Transformative Agreements and Open Science Policy

Nova University supports open access through transformative agreements with leading publishers. These agreements allow researchers to publish in open access journals either at a discounted rate or in hybrid journals at no additional cost. Such initiatives have made open science more accessible for the academic community, further reinforcing Nova’s role as a leader in this area.

The university is now entering a phase of policy consolidation, with the aim of releasing a comprehensive open science policy document and accompanying guide. This guide will serve as a valuable resource for researchers, providing clear explanations of the main concepts, principles, and practices associated with open science. It will also offer examples of useful tools and centralise the most relevant information into a single, user-friendly document accessible at any time.

Integration of Ethics, Integrity, and Open Science

At Nova University, open science principles are deeply integrated into research practices and institutional policies, ensuring that ethics and research integrity remain at the forefront of all scientific endeavours. These values are reflected in the regulations used to assess researcher performance, where open science compliance is becoming a key factor.

A more transparent, responsible, and collaborative research environment

Nova University’s commitment to open science is clear and unwavering. Through strategic initiatives, policy alignment, and a strong infrastructure for open access, Nova is looking forward to a more transparent, responsible, and collaborative research environment. The forthcoming open science policy document and guide will further support the research community, helping them navigate the complexities of open science and ensuring that Nova remains at the cutting edge of global scientific progress.

With the release of its comprehensive open science guide and continued focus on ethical and responsible research, Nova University will continue to lead by example, promoting open science as a key driver of innovation and societal benefit.

The Open and Universal Science (OPUS) project is leading the way in transforming research and researcher assessment by developing and testing new indicators and interventions. This initiative, aimed at fostering open science practices, has engaged three Research Performing Organisations (RPOs)—Nova University Lisbon, the University of Rijeka (UNIRI), and the University of Cyprus—and two Research Funding Organizations (RFOs) from Lithuania and Romania (RCL and UEFISCDI). Through these pilots, the organisations are collaborating, learning from external experts, and engaging in mutual learning exercises to refine their approaches.

The key goal of OPUS is to create a more inclusive and comprehensive research assessment framework that moves beyond traditional metrics like bibliometrics and journal impact factors. The framework aims to recognise the wide diversity of activities by researchers and incentivise and reward Open Science.

Let’s explore how the University of Rijeka is contributing to this transformation.

The State of Open Science at the University of Rijeka: Innovation and Collaboration at the Heart of the Academic Community

Open science has become a key priority at the University of Rijeka (UNIRI), establishing a strong foundation for transparency and accessibility of scientific research. The university aligned itself with European trends by adopting the European Open Science Declaration in 2019, committing to the principle that research funded by public sources should be publicly accessible. This has positioned UNIRI as a leader in open science in Croatia, focusing on increasing the visibility and impact of its researchers.

Since 2021, the university has formalised its open science policy, outlining specific actions and responsibilities for its implementation. In this context, UNIRI has connected its strategy with numerous European initiatives, including its involvement in the Young Universities for the Future of Europe (YUFE) alliance. Five of the nine research groups within the YUFE alliance come from the University of Rijeka, further confirming the university’s commitment to open science.

The Centre for Open Science and the University Library

The university has made significant progress through the development of the Centre for Open Science (OPUS) within the University Library, aimed at promoting, popularising, and implementing open science. OPUS is integrated into UNIRI’s strategy, providing support to researchers through educational programmes, repository management, and collaboration with other institutions. The University Library, along with individual faculties, actively maintains specific repositories and conducts the selection of quality scientific journals, further encouraging open access publication and enhancing the visibility of scientific papers.

A particular emphasis is placed on avoiding predatory journals, with educational programmes helping researchers understand the benefits of using open tools such as Google Scholar, ORCID, and Research ID. These activities aim to centralise and simplify researchers’ access to information, helping them navigate the modern scientific landscape more effectively.

National and International Collaboration

The University of Rijeka is an active participant in national initiatives such as the Croatian node of the Research Data Alliance and the Croatian Open Science Cloud. Through collaboration with national bodies, UNIRI contributes to the development and alignment of research policies with European standards. These efforts are focused on creating a structured environment where goals are clearly defined, and individuals and organisations are supported in the implementation of open science.

Participation in European projects, such as the YUFE alliance, allows the university to exchange best practices with partners from other countries, solve similar challenges, and improve its research activities. This exchange of experiences enables better integration of UNIRI into the European research space and strengthens its capacity for innovation and collaboration.

Young Researchers: Drivers of Future Trends

Young researchers have been recognised as key stakeholders in the implementation of open science. Their willingness to embrace new trends and their long-term presence within the scientific system make them the drivers of future development. The University of Rijeka, together with its Faculty of Law and the doctoral school, actively engages young researchers in projects, providing them with the necessary resources and support.

These efforts ensure that the university remains at the forefront of open science initiatives, while young scientists gain valuable experience that will guide them throughout their careers. Collaboration with experts from various disciplines, as well as involvement in national and international projects, provides them with opportunities to develop skills that will help them make an impact on the global scientific stage.

Continuous Commitment to Open Science

The University of Rijeka shows continuous commitment to open science through the development of infrastructure, education, and international cooperation. These efforts not only increase the visibility of researchers but also contribute to creating an inclusive and sustainable research environment. With the support of young researchers, the university is laying the groundwork for the future of science, where knowledge sharing and collaboration are key to innovation and progress.

By integrating with national and international initiatives, the University of Rijeka remains dedicated to its mission of advancing open science and contributing to global scientific progress.

On September 11, 2024, Ioana Spanache (Science Policy & Research Assessment Expert) and Alina Irimia (Open Science Coordinator) from UEFISCDI presented insights into Romania’s pioneering pilot to develop an Openness Researcher Profile (OP). This initiative, part of the GraspOS Community of Practice, aims to reshape how researchers’ contributions are recognized and aligned with global Open Science (OS) and research assessment reforms.

UEFISCDI’s Strategic Role in Romanian Research

As Romania’s primary competitive research funder and policy advisor, UEFISCDI oversees the BrainMap platform, a national hub connecting over 62,250 researchers, innovators, and entrepreneurs. Key responsibilities include:

• Funding high-quality research projects through national/international calls.
• Advising ministries on education, research, and digitalization policies.
• Promoting Open Science (OS) and Responsible Research Assessment (RRA) through initiatives like CoARA and the OPUS project.

Objectives of the Openness Researcher Profile Pilot

The pilot seeks to integrate OS practices into researcher evaluations while aligning with CoARA commitments and EU standards. Key goals include:

1. Designing a template for the OP within BrainMap, incorporating:
   • Narrative CV elements (e.g., summaries, achievements).
   • Dedicated sections for OS contributions (e.g., open data sharing, collaborative projects)
2. Testing usability through workshops with 100+ researchers to refine content and user experience
3. Enhancing visibility of diverse research outputs, including mentorship, leadership, and societal impact

Structure of the Openness Researcher Profile

The OP template organises contributions into eight categories:

Category	Key Components
Research	Publications, patents, experimental methods
Openness Profile	OS contributions (e.g., open datasets, preprints, DMPs)12
Education	Mentorship, curriculum development
Leadership	Roles in research consortia or policy initiatives
Innovation	Technology transfer, commercialization
Communication	Public engagement, science outreach
Reviewer Section	Peer review activities, editorial roles

This structure draws inspiration from the OPUS Research Assessment Framework and the Knowledge Exchange’s Openness Profile concept.

Collaborative Development Process

• Workshops: Over 100 researchers participated in interactive sessions to analyze current evaluation practices and identify data sources for the OP
• Alignment with EU Policies: The template integrates Horizon Europe requirements, such as Data Management Plans (DMPs), to ensure compatibility
• Visibility vs. Evaluation: While BrainMap profiles are mandatory for grant applications, the OP is designed for monitoring and visibility, not formal evaluation

Strategic Context: Romania’s Open Science Roadmap

The pilot aligns with Romania’s National Strategy for RDI 2022-2027 and the White Paper on Open Science (2023-2030), which mandates:

• FAIR data management as a funding requirement.
• Recognition of diverse research outputs (e.g., software, citizen science projects).
• Infrastructure development for the European Open Science Cloud (EOSC).

UEFISCDI’s Openness Researcher Profile pilot represents a critical step toward transparent, inclusive research assessment in Romania. By bridging national platforms like BrainMap with global OS standards, the initiative aims to empower researchers while fostering a culture of collaboration and openness. The outcomes of this pilot could serve as models for other EU nations navigating similar reforms.

The Open and Universal Science (OPUS) project is leading the way in transforming research and researcher assessment by developing and testing new indicators and interventions. This initiative, aimed at fostering open science practices, has engaged three Research Performing Organisations (RPOs)—Nova University Lisbon, the University of Rijeka (UNIRI), and the University of Cyprus—and two Research Funding Organizations (RFOs) from Lithuania and Romania (RCL and UEFISCDI). Through these pilots, the organisations are collaborating, learning from external experts, and engaging in mutual learning exercises to refine their approaches.

The key goal of OPUS is to create a more inclusive and comprehensive research assessment framework that moves beyond traditional metrics like bibliometrics and journal impact factors. Instead, it aims to reward open science practices, interdisciplinary research, and broader societal impacts.

Let’s explore how these pilot institutions are contributing to this transformation.

---

University of Rijeka (UNIRI): Strengthening Research Assessment Practices

As one of the OPUS Project pilots, the University of Rijeka (UNIRI) is taking significant steps to refine its research assessment practices. With the implementation of OPUS’s Research Assessment Framework (RAF), UNIRI has introduced a set of innovative indicators and interventions designed to encourage and reward open science practices.

Achievements at UNIRI:

• Innovative Assessment Practices: The university has adopted new assessment methods that align with open science principles, promoting transparency and collaboration among researchers.
• Enhanced Collaboration: The RAF has fostered greater interdisciplinary collaboration, leading to more comprehensive research outputs and stronger partnerships.

UNIRI’s participation in the OPUS project highlights its commitment to a progressive and inclusive research environment. 

See more: UNIRI Video Interview

---

Nova University Lisbon: Research Assessment Reform

 As an early signatory of international agreements on research assessment reform, Nova University is actively reshaping its evaluation processes to reflect the changing landscape of scientific research.

Key Initiatives at Nova University:

• Research Impact Narratives Challenge: This initiative encourages researchers to articulate the societal impact of their work, moving beyond traditional metrics and highlighting the real-world value of their research.
• International Standards Alignment: Nova University has revised its research performance evaluation policies to align with responsible research assessment principles, ensuring a more holistic and inclusive approach.

The university is also actively pursuing the HR Excellence in Research Award, which further underscores its commitment to improving research assessment practices and aligning them with European Commission guidelines. 

See more: Nova University Video Interview

---

University of Cyprus: Advancing Open Science and Research Assessment

Through its participation in OPUS, the University of Cyprus is making significant strides in enhancing research assessment and promoting open science. The university has committed to reform by signing key declarations like DORA and COARA, ensuring that its research assessments align with the latest open science principles.

Key Strengths at the University of Cyprus:

• Balanced Evaluation Methods: The university’s research assessments incorporate both quantitative and qualitative metrics, ensuring a comprehensive evaluation process that reflects diverse research outputs.
• Open Science Integration: The introduction of OPUS’s RAF has helped the university to clearly map out actions that will further embed open science practices into its research ecosystem.

Despite challenges, such as the need for better recognition of peer review contributions and locally relevant research, the University of Cyprus is committed to refining its processes and contributing to the broader research community’s understanding of open science assessment.

See more: University of Cyprus Video Interview

---

UEFISCDI (Romania): Modernizing Research Assessment for Greater Impact

The Executive Agency for Higher Education, Research, Development, and Innovation Funding (UEFISCDI) in Romania is playing a pivotal role in the modernization of research assessment through the OPUS project. As Romania’s main research funding body, UEFISCDI is introducing reforms that reward researchers for embracing open science.

Key Achievements at UEFISCDI:

• Advanced Digital Platforms: UEFISCDI has implemented platforms like Brainmap, which facilitates research collaboration and data management with over 60,000 registered accounts.
• Balancing Metrics: The agency is moving away from traditional impact factors and bibliometric-based assessments, focusing on more comprehensive metrics that account for societal contributions and open science practices.

UEFISCDI’s participation in OPUS has already influenced its funding calls, introducing new indicators in pilot programmes to promote excellence and openness. This aligns with the agency’s broader efforts in projects like GRASP-OS, further enhancing its leadership in research assessment reform.

See more: UEFISCDI Video Interview

---

Leading the Change in Research Assessment

These pilot institutions, through their involvement in the OPUS project, are driving a fundamental shift in how research and researchers are assessed. By focusing on open science, societal impact, and responsible research practices, the OPUS project is helping to create a more inclusive and forward-thinking research environment across Europe.

The results from these pilots are being compiled into policy briefs and thematic workshops, which will help raise awareness, build trust, and promote the uptake of open science across the research community.