Open Science Career Assessment Matrix 2 (OSCAM2)
OPUS helps reform the assessment of research
The OSCAM2 provides a comprehensive framework of indicators designed to recognise the diverse range of Open Science practices undertaken by researchers in their assessment processes. It builds upon the indicators established in the Researcher Assessment Framework (RAF), applying an Open Science lens, typically referring to activities that are made openly available or are focused on the advancement of Open Science itself.
As with the RAF, the OSCAM2 indicators can be applied both qualitatively and quantitatively by Research Performing Organisations (RPOs) and Research Funding Organisations (RFOs). Indicators are structured across three dimensions: processes, outputs, and outcomes.
RPOs and RFOs are encouraged to select, refine, and implement the indicators in alignment with their strategic priorities and institutional needs.
Key Features of OSCAM2
- Designed for integration into institutional policies at RPOs and RFOs
- Adaptable to disciplinary, organisational, and national contexts
- Indicators are intended to be selected, refined, prioritised, and implemented as required
The RAF is structured around 4 main categories of activities, which aredivided into subcategories of these activities and consist of indicator groups of related indicators/metrics.
Target Users and Stakeholders
- Research Performing Organisations (RPOs)
- Research Funding Organisations (RFOs)
- Policymakers and ministries of research
- Members of the CoARA network
- Human Resources departments and evaluation committees
- National Open Science Coordinators
Open Science Researcher Assessment Framework
Proposal Development
This focuses on proposals for research projects to an RPO or RFO which are openly available. There is flexibility in how the proposals are made ‘openly available’.
Indicator Type | Indicator |
Process | # Developing Project Proposals Openly Available |
Output | # Submitted Project Proposals Openly Available |
Outcome | # Granted Project Proposals Openly Available |
Methods Development
This subcategory focuses on methods to conduct research which are openly available. There is flexibility in how the method sets are actually made ‘openly available’ for use by the public.
Indicator Type | Indicator |
Process | # Developing Method Sets Openly Available |
Output | # Finalised Method Sets Openly Available |
Outcome | # Openly Available Method Sets Implemented # Openly Available Method Sets Accessed # Openly Available Method Sets Cited |
Data
This subcategory focuses on research data planning, management, and peer review, which are openly available. There is flexibility in the inclusion or exclusion of a focus on FAIR and how data management plans, data sets, and data peer reviews are made ‘openly available’ for public use.
Data Planning
Indicator Type | Indicator |
Process | #(FAIR) Developing Data Management Plans Openly Available |
Output | # (FAIR) Finalised Data Management Plans Openly Available |
Outcome | # (FAIR) Implemented Data Management Plans Openly Available |
Data Management
Indicator Type | Indicator |
Process | # Developing (FAIR) Data Sets Openly Available |
Output | # Finalised (FAIR) Data Sets Openly Available # Archived (FAIR) Data Sets Openly Available |
Outcome | # Openly Available (FAIR) Data Sets Accessed # Openly Available (FAIR) Data Sets Cited |
Data Review
Indicator Type | Indicator |
Process | # Draft (FAIR) Data Set Peer Reviews Openly Available |
Output | # Submitted (FAIR) Data Set Peer Reviews Openly Available |
Outcome | # Accepted (FAIR) Data Set Peer Reviews Openly Available |
Software
Software Development
Indicator Type | Indicator |
Process | # Developing Software Sets Openly Available |
Output | # Finalised Software Sets Openly Available # Archived Software Sets Openly Available |
Outcome | # Openly Available Software Sets Accessed # Openly Available Software Sets Cited |
Software Review
Indicator Type | Indicator |
Process | # Draft Software Set Peer Reviews Openly Available |
Output | # Submitted Software Set Peer Reviews Openly Available |
Outcome | # Accepted Software Set Peer Reviews Openly Available |
Publications
Publication Drafting
Indicator Type | Indicator |
Process | # Draft Publications Openly Available |
Output | # Submitted Publications Openly Available |
Outcome | # Published Publications Openly Available # Openly Available Publications Accessed # Openly Available Publications Cited |
Publication Review
Indicator Type | Indicator |
Process | # Draft Publication Peer Reviews Openly Available |
Output | # Submitted Publication Peer Reviews Openly Available |
Outcome | # Accepted Publication Peer Reviews Openly Available |
Materials Development
This subcategory focuses on research materials which are openly available. There is flexibility in how the material sets aremade’openly available’ depending on the type of materials.
Indicator Type | Indicator |
Process | # Developing Material Sets Openly Available |
Output | # Finalised Material Sets Openly Available |
Outcome | #Implemented Material Sets Openly Available # Openly Available Material Sets Accessed # Openly Available Material Sets Cited |
Courses
Course Development
Indicator Type | Indicator |
Process | # Open Science Courses Being Developed # Developing Courses Openly Available |
Output | # Open Science Courses Finalised # Finalised Courses Openly Available |
Outcome | # Open Science Courses Implemented # Implemented Courses Openly Available |
Resources
This subcategory focuses on educational resources which are on Open Science or openly available. There is flexibility in the definition of resources on ‘Open Science’ which may focus on many or specific Open Science practices as well as how the resources are made ‘openly available’.
Resource Development
Indicator Type | Indicator |
Process | # Open Science Resources Being Developed #Developing Resources Openly Available |
Output | # Open Science Resources Finalised # Finalised Resources Openly Available |
Outcome | # Open Science Resources Implemented # Implemented Resources Openly Available |
Teaching
Student Teaching
Indicator Type | Indicator |
Process | # Open Science Course Hours Assigned |
Output | # Open Science Course Hours Taught |
Outcome | # Students Passed in Open Science Courses # Students Passed in Openly Available Course |
Supervision
This subcategory focuses on supervising students in Open Science and making student theses openly available. There is flexibility in the definition of ‘Open Science’ which may include many or specific Open Science practices and how thestudent theses are ‘openly available’.
Student Supervision
Indicator Type | Indicator |
Process | # Students Being Supervised in Open Science |
Output | # Students Supervised in Open Science |
Outcome | # Supervised Student Theses Openly Available # Supervised Students in Open Science Graduate |
Skills
This subcategory focuses on skills development in Open Science by researchers. There is flexibility in the definition of ‘courses’ and ‘certificates’ which may include variation in course scope and duration and ‘Open Science’ which may focus on many or specific Open Science practices. Courses and certificates may cover research, education, leadership, and valorisation skills.
Skills Development
Indicator Type | Indicator |
Process | # Open Science Skills Courses Being Followed |
Output | # Open Science Skills Courses Completed |
Outcome | # Open Science Skills Certificates Obtained |
People
Staff Supervision
Indicator Type | Indicator |
Process | # Staff Being Supervised in Open Science |
Output | # Staff Supervised in Open Science |
Outcome | # Supervised Staff Theses Openly Available # Supervised Staff Projects involving Open Science |
Projects
This subcategory focuses on managing projects involving Open Science. There is flexibility in the definition of ‘involving Open Science’ which may include variation in the scope and duration of projects and ‘Open Science’ which may include many or specific Open Science practices.
Project Management
Indicator Type | Indicator |
Process | # Projects involving Open Science Being Managed |
Output | # Projects involving Open Science Completed |
Outcome | # Projects involving Open ScienceSuccessfully Evaluated |
Organisation
This subcategory focuses on managing organisational units involving Open Science. There is flexibility in the definition of ‘Open Science’ which may include many or specific Open Science practices. There is also flexibility in the selection of ‘unit management outputs’ and ‘unit management outcomes’ involving Open Science, which could be taken from relevant outputs and outcomes already identified in the RAF and should be formally agreed within the organisation.
Unit Management
Indicator Type | Indicator |
Process | # Unit Management Positions in Open Science Assigned |
Output | # Unit Management Positions in Open Science Completed #Agreed Unit Management Outputs involving Open Science |
Outcome | # Agreed Unit Management Outcomes involving Open Science |
Recognition
This subcategory focuses on the recognition of researchers through expert positions in Open Science. There is flexibility in the definition of ‘Open Science’ including many or specific practices and how ‘expert position outputs’ and ‘expert position outcomes’ are ‘openly available’.
Expert Positions
Indicator Type | Indicator |
Process | # Expert Positions in Open Science Assigned |
Output | # Expert Positions in Open Science Completed # Open Science Expert Position Outputs # Expert Position Outputs Openly Available |
Outcome | # Expert Position Outcomes Openly Available # Expert Achievement Awards for Open Science |
Communication
This subcategory focuses on research communication via public writing and public speaking, which is openly available. There is flexibility in how the publications and appearances are made ‘openly available’ and also in the definition of ‘Open Science’ including many or specific practices.
Public Writing
Indicator Type | Indicator |
Process | # Draft Publications Openly Available |
Output | # Published Publications Openly Available |
Outcome | # Openly Available Publications Accessed # Openly Available Publications Cited |
Public Speaking
Indicator Type | Indicator |
Process | # Appearances on Open Science Planned |
Output | # Appearances on Open Science Given |
Outcome | # Appearances on Open Science Accessed # Appearances on Open Science Cited # Appearances Openly Available |
Engagement
Intersectoral Engagement
Indicator Type | Indicator |
Process | # Intersectoral Engagements involving Open Science |
Output | # Intersectoral Outputs involving Open Science |
Outcome | # Intersectoral Outcomes involving Open Science # Organisations Engaged for Open Science |
Citizen Engagement
Indicator Type | Indicator |
Process | # Citizen Science Activities involving Open Science Ongoing |
Output | # Citizen Science Activities involving Open Science Completed # Citizen Science Outputs involving Open Science |
Outcome | # Citizen Science Outcomes involving Open Science # Citizen Scientists Engaged in Open Science |
Innovation
Research Exploitation
Indicator Type | Indicator |
Process | # Openly Available Research Outputs Being Legalised |
Output | # Openly Available Research Outputs with Defined IPR # Openly Available Research Outputs Patented |
Outcome | # Research Outputs with Open Licenses |
Entrepreneurial Spirit
Indicator Type | Indicator |
Process | # Open Science Spin-offs/Start-ups Being Created |
Output | # Open Science Spin-offs/Start-ups Created |
Outcome | # Open Science Spin-off/Start-up Employees # Open Science Spin-off/Start-up Products # Open Science Spin-off/Start-up Services |