Open Science Career Assessment Matrix 2 (OSCAM2)

OPUS helps reform the assessment of research

The OSCAM2 provides a comprehensive framework of indicators designed to recognise the diverse range of Open Science practices undertaken by researchers in their assessment processes. It builds upon the indicators established in the Researcher Assessment Framework (RAF), applying an Open Science lens, typically referring to activities that are made openly available or are focused on the advancement of Open Science itself.

As with the RAF, the OSCAM2 indicators can be applied both qualitatively and quantitatively by Research Performing Organisations (RPOs) and Research Funding Organisations (RFOs). Indicators are structured across three dimensions: processes, outputs, and outcomes.

RPOs and RFOs are encouraged to select, refine, and implement the indicators in alignment with their strategic priorities and institutional needs.

Key Features of OSCAM2

  • Designed for integration into institutional policies at RPOs and RFOs
  • Adaptable to disciplinary, organisational, and national contexts
  • Indicators are intended to be selected, refined, prioritised, and implemented as required

The RAF is structured around 4 main categories of activities, which aredivided into subcategories of these activities and consist of indicator groups of related indicators/metrics.

Target Users and Stakeholders

  • Research Performing Organisations (RPOs)
  • Research Funding Organisations (RFOs)
  • Policymakers and ministries of research
  • Members of the CoARA network
  • Human Resources departments and evaluation committees
  • National Open Science Coordinators

Open Science Researcher Assessment Framework

Research

The research category consists of 6 subcategories for proposals, methods, data, software, publications, and materials with Open Science indicators and metrics for researcher assessment.

Proposal Development

This focuses on proposals for research projects to an RPO or RFO which are openly available. There is flexibility in how the proposals are made ‘openly available’.

Indicator Type Indicator
Process # Developing Project Proposals Openly Available
Output # Submitted Project Proposals Openly Available
Outcome # Granted Project Proposals Openly Available
Methods Development

This subcategory focuses on methods to conduct research which are openly available. There is flexibility in how the method sets are actually made ‘openly available’ for use by the public.

Indicator Type Indicator
Process # Developing Method Sets Openly Available
Output # Finalised Method Sets Openly Available
Outcome # Openly Available Method Sets Implemented
# Openly Available Method Sets Accessed
# Openly Available Method Sets Cited

Data

This subcategory focuses on research data planning, management, and peer review, which are openly available. There is flexibility in the inclusion or exclusion of a focus on FAIR and how data management plans, data sets, and data peer reviews are made ‘openly available’ for public use.

Data Planning
Indicator Type Indicator
Process #(FAIR) Developing Data Management Plans Openly Available
Output # (FAIR) Finalised Data Management Plans Openly Available
Outcome # (FAIR) Implemented Data Management Plans Openly Available
Data Management
Indicator Type Indicator
Process # Developing (FAIR) Data Sets Openly Available
Output # Finalised (FAIR) Data Sets Openly Available
# Archived (FAIR) Data Sets Openly Available
Outcome # Openly Available (FAIR) Data Sets Accessed
# Openly Available (FAIR) Data Sets Cited
Data Review
Indicator Type Indicator
Process # Draft (FAIR) Data Set Peer Reviews Openly Available
Output # Submitted (FAIR) Data Set Peer Reviews Openly Available
Outcome # Accepted (FAIR) Data Set Peer Reviews Openly Available

Software

This subcategory focuses on research software development and peer review which are openly available. There is flexibility in software sets and peer reviews being ‘openly available’.
Software Development
Indicator Type Indicator
Process # Developing Software Sets Openly Available
Output # Finalised Software Sets Openly Available
# Archived Software Sets Openly Available
Outcome # Openly Available Software Sets Accessed
# Openly Available Software Sets Cited
Software Review
Indicator Type Indicator
Process # Draft Software Set Peer Reviews Openly Available
Output # Submitted Software Set Peer Reviews Openly Available
Outcome # Accepted Software Set Peer Reviews Openly Available

Publications

This subcategory focuses on research publications and peer reviews which are openly available. There is flexibility in how the publications and peer reviews are made ‘openly available’. There is also flexibility in the version of the publication which may be a preprint, Author Accepted Manuscript (AAM), or Version of Record (VoR) as well as the type of open access such as green or gold. There is
further flexibility in whether the publicat ions adhere to the principles of Plan S.
Publication Drafting
Indicator Type Indicator
Process # Draft Publications Openly Available
Output # Submitted Publications Openly Available
Outcome # Published Publications Openly Available
# Openly Available Publications Accessed
# Openly Available Publications Cited
Publication Review
Indicator Type Indicator
Process # Draft Publication Peer Reviews Openly Available
Output # Submitted Publication Peer Reviews Openly Available
Outcome # Accepted Publication Peer Reviews Openly Available
Materials Development

This subcategory focuses on research materials which are openly available. There is flexibility in how the material sets aremade’openly available’ depending on the type of materials.

Indicator Type Indicator
Process # Developing Material Sets Openly Available
Output # Finalised Material Sets Openly Available
Outcome #Implemented Material Sets Openly Available
# Openly Available Material Sets Accessed
# Openly Available Material Sets Cited
Education

The education category consists of 5 subcategories for courses, resources, teaching, supervision, and skills development with related Open Science indicators/metrics for researcher assessment.

Courses

This subcategory focuses on educational courses which are on Open Science or openly available. There is flexibility in the definition of courses on ‘Open Science’ which may focus on many or specific Open Science practices as well as how the courses are made ‘openly available’.
Course Development
Indicator Type Indicator
Process # Open Science Courses Being Developed
# Developing Courses Openly Available
Output # Open Science Courses Finalised
# Finalised Courses Openly Available
Outcome # Open Science Courses Implemented
# Implemented Courses Openly Available

Resources

This subcategory focuses on educational resources which are on Open Science or openly available. There is flexibility in the definition of resources on ‘Open Science’ which may focus on many or specific Open Science practices as well as how the resources are made ‘openly available’.

Resource Development
Indicator Type Indicator
Process # Open Science Resources Being Developed
#Developing Resources Openly Available
Output # Open Science Resources Finalised
# Finalised Resources Openly Available
Outcome # Open Science Resources Implemented
# Implemented Resources Openly Available
 

Teaching

This subcategory focuses on teaching students and courses which are on Open Science or openly available. There is flexibility in the definition of courses on ‘Open Science’ which may focus on many or specific Open Science practices as well as how the courses are ‘openly available’.
Student Teaching
Indicator Type Indicator
Process # Open Science Course Hours Assigned
Output # Open Science Course Hours Taught
Outcome # Students Passed in Open Science Courses
# Students Passed in Openly Available Course

Supervision

This subcategory focuses on supervising students in Open Science and making student theses openly available. There is flexibility in the definition of ‘Open Science’ which may include many or specific Open Science practices and how thestudent theses are ‘openly available’.

Student Supervision
Indicator Type Indicator
Process # Students Being Supervised in Open Science
Output # Students Supervised in Open Science
Outcome # Supervised Student Theses Openly Available
# Supervised Students in Open Science Graduate

Skills

This subcategory focuses on skills development in Open Science by researchers. There is flexibility in the definition of ‘courses’ and ‘certificates’ which may include variation in course scope and duration and ‘Open Science’ which may focus on many or specific Open Science practices. Courses and certificates may cover research, education, leadership, and valorisation skills.

Skills Development
Indicator Type Indicator
Process # Open Science Skills Courses Being Followed
Output # Open Science Skills Courses Completed
Outcome # Open Science Skills Certificates Obtained
Leadership

The leadership category consists of 4 subcategories for people, project, and organisational unit management and recognition with Open Science indicators/metrics for researcher assessment.

People

This subcategory focuses on supervising staff in Open Science. There is flexibility in the definition of ‘Open Science’ which may include many or specific Open Science practices. There is also flexibility in how these are ‘openly available’ and how projects are ‘involving Open Science’.
Staff Supervision
Indicator Type Indicator
Process # Staff Being Supervised in Open Science
Output # Staff Supervised in Open Science
Outcome # Supervised Staff Theses Openly Available
# Supervised Staff Projects involving Open Science

Projects

This subcategory focuses on managing projects involving Open Science. There is flexibility in the definition of ‘involving Open Science’ which may include variation in the scope and duration of projects and ‘Open Science’ which may include many or specific Open Science practices.

Project Management
Indicator Type Indicator
Process # Projects involving Open Science Being Managed
Output # Projects involving Open Science Completed
Outcome # Projects involving Open ScienceSuccessfully Evaluated

Organisation

This subcategory focuses on managing organisational units involving Open Science. There is flexibility in the definition of ‘Open Science’ which may include many or specific Open Science practices. There is also flexibility in the selection of ‘unit management outputs’ and ‘unit management outcomes’ involving Open Science, which could be taken from relevant outputs and outcomes already identified in the RAF and should be formally agreed within the organisation.

Unit Management
Indicator Type Indicator
Process # Unit Management Positions in Open Science Assigned
Output # Unit Management Positions in Open Science Completed
#Agreed Unit Management Outputs involving Open Science
Outcome # Agreed Unit Management Outcomes involving Open Science

Recognition

This subcategory focuses on the recognition of researchers through expert positions in Open Science. There is flexibility in the definition of ‘Open Science’ including many or specific practices and how ‘expert position outputs’ and ‘expert position outcomes’ are ‘openly available’.

Expert Positions
Indicator Type Indicator
Process # Expert Positions in Open Science Assigned
Output # Expert Positions in Open Science Completed
# Open Science Expert Position Outputs
# Expert Position Outputs Openly Available
Outcome # Expert Position Outcomes Openly Available
# Expert Achievement Awards for Open Science
Valorisation

The valorisation category consists of 3 subcategories for communication, engagement, and innovation along with associated Open Science indicators/metrics for researcher assessment

Communication

This subcategory focuses on research communication via public writing and public speaking, which is openly available. There is flexibility in how the publications and appearances are made ‘openly available’ and also in the definition of ‘Open Science’ including many or specific practices.

Public Writing
Indicator Type Indicator
Process # Draft Publications Openly Available
Output # Published Publications Openly Available
Outcome # Openly Available Publications Accessed
# Openly Available Publications Cited
Public Speaking
Indicator Type Indicator
Process # Appearances on Open Science Planned
Output # Appearances on Open Science Given
Outcome # Appearances on Open Science Accessed
# Appearances on Open Science Cited
# Appearances Openly Available

Engagement

This subcategory focuses on intersectoral and citizen engagement involving Open Science. There is flexibility in the definition of ‘Open Science’ including many or specific Open Science practices. There is also flexibility in the selection of ‘intersectoral outputs’ and ‘intersectoral outcomes’ as well as ‘citizen science outputs’ and ‘citizen science outcomes’ for Open Science, which could be taken from
relevant outputs and outcomes for Open Science already identified in the RAF.
Intersectoral Engagement
Indicator Type Indicator
Process # Intersectoral Engagements involving Open Science
Output # Intersectoral Outputs involving Open Science
Outcome # Intersectoral Outcomes involving Open Science
# Organisations Engaged for Open Science
Citizen Engagement
Indicator Type Indicator
Process # Citizen Science Activities involving Open Science Ongoing
Output # Citizen Science Activities involving Open Science Completed
# Citizen Science Outputs involving Open Science
Outcome # Citizen Science Outcomes involving Open Science
# Citizen Scientists Engaged in Open Science

Innovation

This subcategory focuses on the open innovation of research including research exploitation and entrepreneurial spirit involving Open Science as in Table 36. There is flexibility in the definition of ‘Open Science’ including many or specific Open Science practices and how research outputs are ‘openly available’. Spin-offs and start-ups may be focused on supporting or exploiting Open Science.
Research Exploitation
Indicator Type Indicator
Process # Openly Available Research Outputs Being Legalised
Output # Openly Available Research Outputs with Defined IPR
# Openly Available Research Outputs Patented
Outcome # Research Outputs with Open Licenses
Entrepreneurial Spirit
Indicator Type Indicator
Process # Open Science Spin-offs/Start-ups Being Created
Output # Open Science Spin-offs/Start-ups Created
Outcome # Open Science Spin-off/Start-up Employees
# Open Science Spin-off/Start-up Products
# Open Science Spin-off/Start-up Services
Research Assessment Framework (RAF) Purpose

The Research Assessment Framework (RAF) serves as a dynamic tool to reform the evaluation of researchers, encouraging and rewarding Open Science practices in project applications, career development, and progression at Research Performing Organisations (RPOs) and Research Funding Organisations (RFOs). RAF encompasses the entire spectrum of research, education, leadership, and valorisation activities. It is designed to be adaptable across countries, disciplines, and organisations, offering both quantitative and qualitative approaches to implementing indicators.

Privacy Preferences

When you visit our website, it may store information through your browser from specific services, usually in the form of cookies. Our Privacy Policy can be read here.

Here you can change your Privacy preferences. It is worth noting that blocking some types of cookies may impact your experience on our website and the services we are able to offer.

Click to enable/disable Google Analytics tracking code.
Click to enable/disable Google Fonts.
Click to enable/disable Google Maps.
Click to enable/disable video embeds.
Our website uses cookies, mainly from 3rd party services. Define your Privacy Preferences and/or agree to our use of cookies.