OPUS helps reform the assessment of research

Interventions for Open Science/Researcher Assessment

OPUS has developed a set of interventions for Open Science toward a system that incentivises and rewards researchers to take up practices of providing open access to research outputs, early and open sharing of research, participation in open peer-review, measures to ensure reproducibility of results, and involving all stakeholders in co-creation.

The RAF is designed to comprehensively cover the full spectrum of researcher activities and offer researchers the possibility to be assessed on all relevant activities in a given assessment period, rather than solely on the traditional metrics of the number of peer-reviewed publications and citations and the journal impact factor (JIF). The inclusion of Open Science metrics in a given RAF at an RPO or RFO ensures that Open Science activities are explicitly recognised in the assessment. It remains the prerogative of RPOs and RFOs to determine how exactly to reward researchers for Open Science.

1. Generic Researcher Assessment Framework: Indicators and Metrics

The RAF is structured around 4 main categories of activities, which are divided into subcategories of these activities and consist of indicator groups of related indicators/metrics.

1.1 Interventions

The interventions are divided by the indicator that they support and then are subdivided into the following categories.

Each indicator group further consists of 3 types of indicators with associated quantitative metrics:

  • Process: Activity which is in development or is ongoing
  • Output: Clear endpoint or tangible product of a process
  • Outcome: Immediate or short-term result of an output

They are supported by five categories of interventions:

2. Meta-Interventions

Research Assessment Framework and Open Science Career Assessment Matrix

Meta Interventions: This set of meta-interventions has been developed as an overarching set of interventions for any RPO or RFO that wishes to implement the RAF or OSCAM Framework. They are intended as a starting point for consideration and implementation at a the top level of an organisation.

Research Assessment Framework Open Science Career Assessment Matrix
Senior management decision and approval to use the framework at their institution.

Senior management decision on the set of indicators they wish to use in their institution.

Senior management develop policies and procedures that support the collection of metrics and data relevant to the indicators with clear guidelines and expectations.

Senior management approval and decision, involving all relevant parties to collect and make open metrics and data that are specific to the selected indicator.

Senior management decision on which indicators they wish to use in their institution.

Senior management develop policies and procedures that support collection of metrics and data relevant to the specific indicators and advocate making open access with clear guidelines and explanation.

 

Research Assessment Framework Open Science Career Assessment Matrix
Allow researchers time (and supporting budget) to record the relevant metrics and upload the relevant evidence for the selected indicators.

Ensure there is a member (or members) of staff responsible for monitoring, assisting and understanding any ethical queries that arise form collection of data relevant to the selected indicators.

Provide expertise and support relevant to the topic of the selected indicators.

Allow researchers time (and supporting budget) to record, upload and make open metrics and data relevant to the selected indicators.

Ensure there is a member (or members) of staff responsible for monitoring upload of metrics and data relevant to the selected indicator are open with an understanding of any ethical issues this may create.

Provide expertise and support relevant to the topic of the selected indicators and how to make the topic open.

 

Research Assessment Framework Open Science Career Assessment Matrix
Ensure there is an appropriate and easily accessible database or repository to record the metrics and data relevant to the selected indicators. Ensure there is a suitable and easily accessible database or repository to record data and metrics relevant to the selected indicators and that this is open access.
Research Assessment Framework Open Science Career Assessment Matrix
Ensure researchers are aware of what they should be recording for the selected indicators and where they can get training in how to do this and who they should go to for help.

Ensure researchers understand the benefit to them as individuals and the institution of recording the metrics and data relevant to the indicators and that they understand the link to researcher assessment.

Ensure researchers know that they should record and ensure open access for all documents relevant to the selected indicators and where they can receive training in how to do this and who they should go to for help.

Explain to researchers the benefit of making the selected indicators open to them as individuals and the institution and that they understand the link to researcher assessment.

Research Assessment Framework Open Science Career Assessment Matrix
Train researchers in where and how to log metrics and data relevant to the selected indicators.

Train researchers in the skills relevant to the topic of the selected indicators

Ensure there are a range of best practice proposal examples that researchers can access and draw upon relevant to the selected indicators.

 

Train researchers in where and how to log and ensure open access documents relevant to selected indicators.

Train researchers and develop skills relevant to specific indicators.

Train researchers in how to make documents relevant to specific indicators open access including issues specific to academic discipline and any ethical concerns.

Ensure there are best practice open access examples relevant to the specific indicators selected.

Research

The research category consists of 6 subcategories for proposals, methods, data, software, publications, and materials with associated generic indicators/metrics for researcher assessment.

Proposals

Generic Interventions for Research
Indicator Type Quantitative Metric
Process # of Project Proposals Being Developed
Output # of Project Proposals Submitted
Outcome # of Project Proposals Granted
Category RAF Proposal Development Interventions
Policy Senior management approval and decision to collect the number of project proposals being developed, submitted, and granted across the institution.

Senior management develop policies and procedures to support the collection of the number of proposals being developed, submitted and granted across the institution including clear guidelines and explanations.

Resources Allow researchers time (and supporting budget) to record the number of project proposals being developed, submitted and granted and upload the relevant evidence.

Ensure there is a member (or members) of staff responsible for monitoring, assisting and understanding any ethical queries that arise from the collection of the number of project proposals being developed, submitted and granted.

Provide expertise and support in proposal writing and development

Repository Ensure there is an appropriate and easily accessible database or repository to record the number of project proposals being developed, submitted and granted.
Awareness Raising Ensure researchers know that they should record all project proposals being developed, submitted, and granted and where they can get training in how to do this and who they should go to for help.

Ensure researchers understand the benefit to them as individuals and the institution of recording the number of project proposals being developed, submitted, and granted, that they have trust in the process and that there is a clear link to researcher assessment.

Training Train researchers in where and how to log project proposals being developed, submitted, and granted.

Train researchers in proposal writing and development.

Ensure there are a range of best practice proposal examples that researchers can access and draw upon.

Methods

Generic Interventions for Research 
Indicator Type Indicator
Process #Method Sets Being Developed
Output # Method Sets Finalised
Outcome # Method Sets Implemented
Outcome # Method Sets Accessed

# Method Sets Cited

Category RAF Methods Development Interventions
Policy Senior management approval and decision to collect number of methods sets being developed, finalised and implemented across the institution.

Senior management approval and decision to collect the number of method sets accessed and cited across the institution.

Senior management develop policies and procedures to support the collection of method sets being developed, finalised and implemented across the institution including clear guidelines and explanations.

Senior management develop policies and procedures to support the collection of method sets access and cited across the institution including clear guidelines and explanations.

Resources Allow researchers time (and supporting budget) to record the number of methods sets, being developed, finalised and implemented across the institution and upload the relevant evidence.

Allow researchers time (and supporting budget) to record the number of methods sets accessed and cited across the institution and upload the relevant evidence.

Ensure there is a member (or members) of staff responsible for monitoring, assisting, and understanding any ethical queries with the recording of the number of method sets being developed and finalised.

Ensure there is a member (or members) of staff responsible for monitoring, assisting and understanding any ethical queries with the recording of the number of methods sets accessed and cited across the institution.

Provide expertise and support in development and management of method sets.

Repository Ensure there is a suitable and easily accessible database or repository to record method sets being developed, finalised and implemented across the institution.

Ensure there is an appropriate and easily accessible database or repository to record method sets accessed and cited across the institution.

Awareness Raising Ensure researchers know that they should record all method sets, being developed, finalised, and implemented and where they can receive training in how to do this and who they should go to for help.

Ensure researchers know that they should record all method sets accessed and cited and where they can receive training in how to do this and who they should go to for help.

Ensure researchers understand the benefit of recording the number of methods sets being developed and utilised to them as individuals and the institution, that they trust the process and that there is a clear link to research assessment.

Training Train researchers in where and how to log the number of methods sets developed and finalised across the institution.

Train researchers in where and how to log the number of methods sets accessed and cited across the institution.

Train researchers in the development of method sets.

Ensure there are a range of best practice examples of method sets that researchers can access and draw upon.

Data

Data Planning
Indicator Type Indicator
Process #(FAIR) Data Management Plans Being Developed
Output # (FAIR) Data Management Plans Finalised
Outcome # (FAIR) Data Management Plans Implemented
Category RAF Data Planning Interventions
Policy Senior management approval and decision to collect the number of data management plans being developed, finalised, and implemented across the institution.

Senior management develop policies and procedures to support the collection of the number of data management plans being developed, finalised and implemented including clear guidelines and explanations.

Resource Allow researchers time (and supporting budget) to record the number of data management plans being developed, finalised and implemented across the institution and upload the relevant evidence for the selected indicators.

Ensure there is a member (or members) of staff responsible for monitoring, assisting and understanding any ethical queries with that arise from monitoring the number of data management plans developed, finalised and implemented across the institution.

Provide expertise and support in the development of quality data management plans.

Repository Ensure there is an appropriate and easily accessible database or repository to record the number of data management plans being developed, finalised and implemented across the institution.
Awareness Raising Ensure researchers know that they should record the number of data management plans being developed, finalised, and implemented and where they can receive training in how to do this and who they should go to for help.

Ensure researchers understand the benefit of them as individuals and the institution of recording the number of data management plan, that they trust the process and that there is a link to researcher assessment.

Training Train researchers in where and how to record the number of data management plans being developed, finalised, and implemented.

Train researchers in development of quality data management plans.

Ensure there are best practice examples of data management plans that researchers can access and draw upon.

Data Management
Indicator Type Indicator
Process # (FAIR) Data Sets Being Developed
Output # (FAIR) Data Sets Finalised
# (FAIR) Data Sets Archived Outcome
Outcome # (FAIR) Data Sets Accessed
# (FAIR) Data Sets Cited
Category RAF Data Management Interventions
Policy Senior management approval and decision to collect the number of FAIR data management plans being developed, finalised and archived across the institution.

Senior management approval and decision to collect the number of FAIR data management plans accessed and cited across the institution.

Senior management develop policies and procedures to support the collection of the number of FAIR data management plans being developed, finalised and archived across the institution with clear guidelines and expectations.

Senior management develop policies and procedures to support the collection of the number of FAIR data management plans accessed and cited across the institution with clear guidelines and expectations.

Resource Allow researchers time (and supporting budget) to record the number of FAIR data management plans being developed, finalised, and archived across the institution.

Allow researchers time (and supporting budget) to record the number of FAIR data management plans accessed and cited across the institution.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries that arise for the number of data management plans being developed, finalised, and archived across the institution.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries that arise for the number of FAIR data management plans accessed and cited across the institution.

Provide expertise and support in the development of FAIR data management plans.

Repository Ensure there is a suitable and easily accessible database or repository to record the number of FAIR data management plans being developed, finalised and archived across the institution.

Ensure there is an suitable and easily accessible database or repository to record the number of FAIR data management plans accessed and cited across the institution.

Awareness Raising Ensure researchers know that they should record the number of FAIR data management plans being developed, finalised, and archived and where they can receive training in how to do this and who they should go to for help.

Ensure researchers know that they should record the number of FAIR data management plans accessed and cited and where they can receive training in how to do this and who they should go to for help.

Ensure researchers understand the benefit of recording the number of FAIR data plans in these ways and that they understand the benefit to them as individuals and the institution, that the trust the process and the link to researcher assessment.

Training Train researchers in where and how to record the number of FAIR data management plans being developed, finalised, and implemented.

Train researchers in where and how to record the number of FAIR data management plans developed accessed and cited.

Train researchers in the development of FAIR data management plans.

Ensure there are a range of best practice examples of FAIR data management plans that researchers can access and draw upon.

 

Data Review
Indicator Type Indicator
Process # (FAIR) Data Set Peer Reviews Being Drafted
Output # (FAIR) Data Set Peer Reviews Submitted
Outcome # (FAIR) Data Set Peer Reviews Accepted
Category RAF Data Review Interventions
Policy Senior management approval and decision to collect the number of peer reviews being drafted, submitted, and accepted across the institution.

Senior management develop policies and procedures to support the collection of the number of peer reviews being drafted, submitted and accepted across the institution, with clear guidelines and expectations.

Resource Allow researchers time (and supporting budget) to record the number of peer reviews being drafted submitted and accepted across the institution.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries for collecting the number of peer reviews being drafted, submitted and accepted.

Provide expertise and support in the development of peer reviews

Repository Ensure there is an appropriate and easily accessible database or repository to record the number of peer reviews being drafted, submitted and accepted.
Awareness Raising Ensure researchers know that they should record all peer reviews being drafted, submitted, and accepted and where they can receive training in how to do this and who they should go to for help.

Ensure researchers understand the benefit to them as individuals and to the institution of collecting the number of peer reviews being drafted, submitted and accepted that the trust the process and understand the link to researcher assessment.

Training Train researchers in where and how to record peer reviews being drafted, submitted, and accepted.

Train researchers in the peer review process.

Ensure there are best practice examples of peer reviews that researchers can access and draw upon.

Software

Generic Interventions for Research 
Indicator Type Indicator
Process # Software Sets Being Developed
Output # Software Sets Finalised
# Software Sets Archived
Outcome # Software Sets Accessed
# Software Sets Cited
Category RAF software Development Interventions
Policy Senior management approval and decision to collect the number of software sets being developed, finalised, and archived across the institution.

Senior management approval and decision to collect the number of software sets accessed and cited across the institution.

Senior management develop policies and procedures to support the collection of the number of software sets being developed, finalised and archived across the institution with clear guidelines and explanation.

Senior management develop policies and procedures to support the collection of the number of software sets accessed and cited across the institution with clear guidelines and explanation.

Resource Allow researchers time (and supporting budget) to record and upload the relevant evidence for the number of software sets being developed, finalised, and archived across the institution.

Allow researchers time (and supporting budget) to record and upload the relevant evidence for the number of software sets accessed and cited across the institution.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries for recording the number of software sets developing, finalised and archived.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understand any ethical queries with recording the number of software sets accessed and cited.

Provide expertise and support in the development of software sets.

Repository Ensure there is an appropriate database or repository to record the number of software sets being developed, finalised and archived across the institution.

Ensure that there is an appropriate database to record the number of software sets accessed and cited across the institution.

Awareness Raising Ensure researchers know that they should record all software sets being developed, finalised, and implemented and where they can receive training in how to do this and who they should go to for help and support.

Ensure researchers know that that they should record all software sets accessed and cited and where they can receive training in how to do this and who they should go to for help and support.

Ensure researchers understand the benefit to them as individuals and to the institution of recording the number of software sets utilised, that the trust the process and understand the link to researcher assessment.

Training Train researchers in where and how to record software sets being developed, finalised, and implemented.

Train researchers in where and how to record software sets cited and accessed.

Train researchers in development of software sets.

Ensure there are best practice examples of software sets that researchers can access and draw upon.

 

Software Review
Indicator Type Indicator
Process # Software Set Peer Reviews Being Drafted
Output # Software Set Peer Reviews Submitted
Outcome # Software Set Peer Reviews Accepted
Category RAF Software Review Interventions
Policy Senior management approval and decision to collect the number of software set peer reviews being drafted, submitted and accepted.

Senior management develop policies and procedures to support the collection of software set peer reviews that are being drafted, submitted and accepted including guidelines and explanation

Resource Allow researchers time (and supporting budget) to record the number of software set peer reviews being drafted, submitted, and accepted across the institution and upload relevant supporting evidence.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries for the recording the number of software set peer reviews being drafted, submitted and accepted.

Provide expertise and support in the development of software set peer reviews

Repository Ensure there is an appropriate and easily accessible database or repository to record the number of software peer reviews being drafted, submitted and accepted.
Awareness Raising Ensure researchers know that they should record all software set peer reviews being drafted, submitted, and accepted and where they can receive training in how to do this and who they should go to for help.

Ensure researchers understand the benefit of recording the number of software sets peer reviews being drafted, submitted and accepted to them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training Train researchers in where and how to record software set peer reviews being drafted, submitted, and accepted.

Train researchers in the software set peer review process.

Ensure there are best practice examples of software peer reviews that researchers can access and draw upon.

Publications

Generic Interventions for Research 
Indicator Type Indicator
Process # Publications Being Drafted
Output # Publications Submitted
Outcome # Publications Published
# Publications Accessed
# Publications Cited
Category Research Assessment Framework
Policy Senior management approval and decision to collect the number of publications being drafted, submitted, and published across the institution.

Senior management approval and decision to collect the number of publications accessed and cited across the institution.

Senior management develop policies and procedures to support the collection of the number of publications being drafted submitted and published across the institution with clear guidelines and explanation.

Senior management develop policies and procedures to support the collection of the number of publications accessed and cited across the institution with clear guidelines and explanation.

Resource Allow researchers time (and supporting budget) to record the number of publications being drafted, submitted, and published across the institution and upload the relevant evidence.

Allow researchers time (and supporting budget) to record the number of publications, accessed and cited across the institution and upload the relevant evidence.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries for collecting the number of publications being drafted, submitted, and published across the institution.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries with collecting the number of publications accessed and cited across the institution.

Provide expertise and support in quality publications.

Repository Ensure there is an appropriate and easily accessible database or repository to record the number of publications being drafted, submitted, and published across the institution.

Ensure that there is an appropriate and easily accessible database or repository to record the number of publications accessed and cited across the institution.

Awareness Raising Ensure researchers know that they should record all publications being drafted, submitted, and published and where they can receive training in how to do this and who they should go to for help and support.

Ensure researchers know that that they should record all publications accessed and cited and where they can receive training in how to do this and who they should go to for help and support.

Ensure researchers understand the benefit of recording the number of publications to both individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training Train researchers in where and how to record publications being drafted, finalised, and implemented.

Train researchers in where and how to record publications cited and accessed.

Train researchers in how to publish.

Ensure that there are best practice examples of a range of quality publications that researchers can access and draw upon.

Publication Review
Indicator Type Indicator
Process # Publication Peer Reviews Being Drafted
Output # Publication Peer Reviews Submitted
Outcome # Publication Peer Reviews Accepted
Category RAF Publication Review Interventions
Policy Senior management approval and decision to collect the number of publication peer reviews being drafted, submitted, and accepted.

Senior management develop policies and procedures to support the collection of the number of publication peer reviews being drafted, submitted, and accepted, with clear guidelines and expectations.

Resource Allow researchers time (and supporting budget) to record the number of publication peer reviews being drafted, submitted, and accepted and to upload the relevant evidence.

Ensure there is a member (or members) of staff responsible for recording, assisting with and understanding any ethical queries for recording the number of publication peer reviews being drafted, submitted, and accepted.

Provide expertise and support in the development of publication peer reviews.

Repository Ensure there is an appropriate and easily accessible database or repository to record the number of publication peer reviews being drafted submitted and accepted.
Awareness Raising Ensure researchers know that they should record all publication peer reviews being drafted, submitted, and accepted and where they can get training in how to do this and who they should go to for help.

Ensure researchers understand the benefit of recording publication peer reviews to them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training Train researchers in where and how to record publication peer reviews being drafted, submitted, and accepted.

Train researchers in the publication peer review process.

Ensure there are best practice examples of publication peer reviews that researchers can access and draw upon.

Materials

Generic Interventions for Research 
Indicator Type Indicator
Process # Material Sets Being Developed
Output # Material Sets Finalised
Outcome # Material Sets Implemented
# Material Sets Accessed
# Material Sets Cited
Category Research Assessment Framework Interventions
Policy Senior management approval and decision to collect the number of materials being developed, finalised, and implemented across the institution.

Senior management approval and decision to collect the number of materials accessed and cited across the institution.

Senior management develop policies and procedures to support the collection of the number of materials being developed, finalised, and implemented across the institution including clear guidelines and explanation.

Senior management develop policies and procedures to support the collection of the number of materials accessed and cited across the institution including clear guidelines and explanation.

Resource Allow researchers time (and supporting budget) to record the number of materials being developed, finalised, and implemented across the institution and upload the relevant evidence.

Allow researchers time (and supporting budget) to record the number of materials being developed, accessed, and cited across the institution and upload the relevant evidence.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries for recording the number of materials developing, finalised and implemented across the institution.

Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical queries for recording the number of materials accessed and cited across the institution.

Provide expertise and support in materials development.

Repository Ensure there is an appropriate and easily accessible database or repository to record the number of materials being developed, finalised, and implemented across the institution.

Ensure that there is an appropriate and easily accessible database to record the number of materials accessed and cited across the institution.

Awareness Raising Ensure researchers know that they should record all materials being developed, finalised, and implemented and where they can receive training in how to do this and who they should go to for help and support.

Ensure researchers know that that they should record all materials accessed and cited and where they can receive training in how to do this and who they should go to for help and support.

Ensure researchers understand the benefit of recording the number of materials being developed, finalised and implemented to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training Train researchers in where and how to record materials being developed, finalised and implemented.

Train researchers in where and how to record materials cited and accessed.

Train researchers in materials development.

Ensure there are a range of best practice examples of quality materials that researchers can access and draw upon.

Education

The education category consists of 5 subcategories for courses, resources, teaching, supervision, and skills development with associated generic indicators/metrics for researcher assessment.

Courses

Course Development
Indicator Type Indicator
Process # Courses Being Developed
Output # Courses Finalised
Outcome # Courses Implemented
Category Research Assessment Framework
Policy ·       Senior management approval and decision to collect information on the number of courses being developed, finalised and implemented across the institution.

·       Senior management develop policies and procedures to support the collection of information on the number of courses being developed, finalised, and implemented including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of courses being developed, finalised and implemented across the institution and upload the relevant evidence.

·       Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical issues the collection of the number of courses being developed, finalised and implemented across the institution.

·       Provide expertise and support in course development,

Repository ·       Ensure there is an appropriate and easily accessible database or repository to record the number of courses being developed, finalised, and implemented across the institution.
Awareness Raising ·       Ensure researchers know that they should record all courses being developed, finalised, and implemented and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about courses, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record courses being developed, finalised, and implemented.

·       Train researchers in course development

·       Ensure there are a range of best practice examples of courses developed that researchers could access and draw upon.

Resources

Resource Development
Indicator Type Indicator
Process # Resources Being Developed
Output # Resources Finalised
Outcome # Resources Implemented
Outcome # Resources Accessed
# Resources Cited
Category RAF Resource Development Interventions
Policy ·       Senior management approval and decision to collect information on the number of resources being developed, finalised, and implemented.

·       Senior management approval and decision to collect information on the number of resources accessed and cited.

·       Senior management develop policies and procedures to collect information on the number of resources being developed, finalised, and implemented with clear guidelines and explanation.

·       Senior management develop policies and procedures to collect information on the number of resources accessed and cited with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of resources being developed, finalised, and implemented across the institution and upload the relevant evidence.

·       Allow researchers time (and supporting budget) to record the number of resources accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical issues for the collection of the number of resources being developed, finalised, and implemented across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical issues for the collection of the number of resources accessed and cited across the institution.

·       Provide expertise and support in resource development.

Repository ·       Ensure there is an appropriate and easily accessible database or repository to record the number of resources being developed, finalised and implemented across the institution.

·       Ensure there is an appropriate and easily accessible database or repository to record the number of resources accessed and cited across the institution

Awareness Raising ·       Ensure researchers know that they should record all resources, being developed finalised and implemented and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record all resources that have been accessed and cited and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit of recording the number of resources being developed, finalised and implemented to both themselves as individuals, that they trust the process and understand the institution and the link to researcher assessment.

Training ·       Train researchers in where and how to record resources being developed, finalised and implemented.

·       Train researchers in resource development.

·       Ensure there are a range of best practice examples of resources developed that researchers can access and draw upon.

Teaching

Student Teaching
Indicator Type Indicator
Process # Course Hours Assigned
Output # Courses Hours Taught
Outcome # Students Passed in Courses
Category RAF student Teaching Interventions
Policy ·       Senior management approval and decision to collect information on the number of course hours assigned and taught across the institution.

·       Senior management approval and decision to collect number of students passed in relevant courses across the institution.

·       Senior management develop policies and procedures to support the collection of the number of course hours assigned and taught across the institution with clear guidelines and explanation.

·       Senior management develop policies and procedures to support the collection of the number of students that have passed these courses with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of courses that are being currently taught and have been taught across the institution and upload relevant evidence.

·       Allow researchers or others time (and supporting budget) to record the number of students that have passed these courses across the institution and upload relevant evidence.

·       Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical issues for the collection of the number of course hours assigned and taught across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring, assisting with and understanding any ethical issues for the recording of the number of students that have passed these courses across the institution.

·       Provide expertise and support in teaching.

Repository ·       Ensure there is an appropriate and easily accessible database or repository to record the number of course hours assigned and taught across the institution.

·       Ensure there is an appropriate and easily accessible method or database for recording the number of students that achieve a pass in relevant courses.

Awareness Raising ·       Ensure researchers know that they should record all course hours assigned and taught and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record number of students who achieve a pass in relevant courses taught.

·       Ensure researchers understand the benefits to them as individuals and the institution of recording this data on course hours assigned, taught and student pass rates and that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record course hours assigned and taught.

·       Train researchers in where and how to record the number of students who achieve a pass in relevant courses taught.

·       Train researchers in teaching methods.

·       Ensure there are a range of best practice courses available that researchers can access and draw upon.

Supervision

Student Supervision
Indicator Type Indicator
Process # Students Being Supervised
Output # Students Supervised
Outcome # Supervised Student Theses
# Supervised Students Graduated
Category RAF Supervision Interventions
Policy ·       Senior management approval and decision to collect the number of students currently being supervised or that have been supervised across the institution.

·       Senior management approval and decision to collect the number of student theses of those supervised and number of students graduated across the institution.

·       Senior management develop policies and procedures to support the collection of the number of students that researchers are currently supervising or have supervised including clear guidelines and explanation.

·       Senior management develop policies and procedures to support the collection of the number of students who publish a theses or graduate with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of courses that are being currently supervised or have been supervised in the past across the institution.

·       Allow researchers time to record the number of students theses and the number of students graduated across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of students that are currently or have been supervised.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the recording number of students graduated and theses.

·       Provide expertise and support in supervision.

Repository ·       Ensure there is an appropriate database to record the number of students currently being supervised or that have been supervised.

·       Ensure there is an appropriate method or database for recording the number of students that have completed their theses and graduated.

Awareness Raising ·       Ensure researchers know that they should record all students currently being supervised and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record and monitor the number of students they have supervised who have completed their thesis or graduated.

·       Ensure researchers understand the benefits to them as individuals and the institution of recording this data on students they are or have supervised and the resulting number who have produced a theses or graduated that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record students that are currently being or that have been supervised.

·       Train researchers in where and how to record the number of students they have supervised who have completed their thesis or graduated.

·       Train researchers in supervision.

·       Ensure researchers know where to go to receive support in supervision.

·       Try to find best practice examples of supervision that researchers can access and draw upon.

Skills

Skills Development
Indicator Type Indicator
Process # Skills Courses Being Followed
Output # Skills Courses Completed
Outcome # Skills Certificates Obtained
Category RAF Skills Interventions
Policy ·       Senior management approval and decision to collect information on the number of skills courses researchers are following, have completed, and obtained across the institution.

·       Senior management develop policies and procedures to support the collection of information on the number of courses researchers are following, have completed and obtained including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of courses they are following, have completed and obtained by them individually.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of skills courses researchers are following, have completed and obtained across the institution.

·       Provide a comprehensive programme of skills courses for researchers

Repository ·       Ensure there is an appropriate and easily accessible database for researchers to record the number of skills courses they are following, have completed and obtained.
Awareness Raising ·       Ensure researchers know that they should record the number of skills courses, they are following, have completed and obtained and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about skills courses, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record the number of skills courses they are following, have completed and obtained.

·       Train researchers in the programme of skills courses for researchers that are offered by the institution.

·       Ensure there is clear advice and guidance on attending skills courses with a clear link to career development and academic success.

Leadership

The leadership category consists of 4 subcategories for managing people, projects, organisational units, and recognition with associated generic indicators/metrics for researcher assessment.

People

Staff Supervision
Indicator Type Indicator
Process # Staff Being Supervised
Output # Staff Supervised
Outcome # Supervised Staff Theses
# Supervised Staff Projects
Category RAF Staff Supervision Interventions
Policy ·       Senior management approval and decision to collect the number of staff that a researcher is supervising or has supervised across the institution.

·       Senior management approval and decision to collect the number of theses and projects that have been produced by staff that a researcher is supervising or has supervised.

·       Senior management develop policies and procedures to support the collection of the number of staff that researchers are supervising or have supervised including clear guidelines and explanation.

·       Senior management develop policies and procedures to support the collection of the number of theses written or projects completed by staff a researcher has supervised or is supervising including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of staff they are currently supervising or have supervised across the institution.

·       Allow researchers time (and supporting budget) to record the number of theses written and projects completed by staff that have supervised or are supervising across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of staff that a researcher is currently supervising or has supervised.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of these written or projects completed by staff that a researcher is supervising or has supervised.

·       Provide expertise and support in supervision of staff.

Repository ·       Ensure there is an easily accessible and suitable database or repository to record the number of staff currently being supervised or that have been supervised by the researcher.

·       Ensure there is an easily accessible database or repository for recording the number of theses written or projects completed by staff supervised by the researcher.

Awareness Raising ·       Ensure researchers know that they should record number of staff they are currently supervising or that they have supervised and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of theses written and projects completed by staff that have supervised or are supervising and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about staff supervision, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number of staff they have supervised or are supervising.

·       Train researchers in where and how to record the number of theses written or projects completed by staff they have supervised or are supervising.

·       Train researchers in supervision of staff.

·       Ensure researchers know where to go to receive support in supervision of staff.

·       Try to find best practice examples of supervision of staff that researchers can access and draw upon.

Projects

Project Management
Indicator Type Indicator
Process # Projects Being Managed
Output # Projects Completed
Outcome # Projects Successfully Evaluated
Category Project Management Interventions
Policy ·       Senior management approval and decision to collect the number of projects that a researcher is managing, has completed and that have been successfully evaluated.

·       Senior management develop policies and procedures to support the collection of the number of projects that a researcher is managing, has completed and that have been successfully evaluated including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number projects they are managing, have completed and that have been successfully evaluated across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of projects that a researcher is managing, has completed and that have been successfully evaluated.

·       Provide expertise and support in project management.

Repository ·       Ensure there is an appropriate database to record the number of projects researchers are managing, have completed and that have been successfully evaluated.
Awareness Raising ·       Ensure researchers know that they should record the number of projects they are currently managing, have completed and that have been successfully evaluated and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about project management, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number of projects they are currently managing, have completed and that have been successfully evaluated.

·       Train researchers in project management.

·       Ensure researchers know where to go to receive support in project management.

·       Try to find best practice examples of project managment that researchers can access and draw upon.

Organisation

Unit Management
Indicator Type Indicator
Process # Unit Management Positions Assigned
Output # Unit Management Positions Completed
# Agreed Unit Management Outputs
Outcome # Agreed Unit Management Outcomes
Category RAF Unit Management Interventions
Policy ·       Senior management approval and decision to collect the number of Unit Management Positions assigned and completed by a researcher across the institution.

·       Senior management approval and decision to collect the number of agreed outputs and outcomes for the unit across the institution.

·       Senior management develop policies and procedures to support the collection of the number of unit management positions assigned and completed by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of agreed outputs and outcomes for the unit across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of unit positions that they have been assigned and completed across the institution.

·       Allow researchers time (and supporting budget) to record the number of agreed outputs and outcomes from units across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of unit positions assigned and that have completed.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of agreed outputs and outcomes from units.

·       Provide expertise and support in Unit (team or department) management.

Repository ·       Ensure there is an appropriate database to record the number of unit management positions that have been assigned and completed.

·       Ensure there is an appropriate database to record the number of agreed outputs and outcomes for units.

Awareness Raising ·       Ensure researchers know that they should record the unit positions assigned and completed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of agreed outputs and outcomes for units and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about unit management, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number of unit positions they have been assigned and have completed.

·       Train researchers in where and how to record the number of agreed outputs and outcomes for units.

·       Train researchers in unit (team or department) management

·       Ensure researchers know where to go to receive support in Unit Management.

·       Try to find best practice examples of Unit Managment that researchers can access and draw upon.

Recognition

Expert Positions
Indicator Type Indicator
Process # Expert Positions Assigned
Output # Expert Positions Completed
# Expert Position Outputs
Outcome # Expert Position Outcomes
# Expert Achievement Awards
Category RAF ExpertPositions Interventions
Policy ·       Senior management approval and decision to collect the number of expert positions assigned and completed by a researcher across the institution.

·       Senior management approval and decision to collect the number of expert position outputs, outcomes and achievement awards across the institution.

·       Senior management develop policies and procedures to support the collection of expert positions assigned and completed by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of expert position outputs, outcomes and achievement awards for the unit across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of expert positions assigned and completed across the institution.

·       Allow researchers time (and supporting budget) to record the number of expert positions outputs, outcomes, and achievement awards across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of expert positions assigned and that have completed.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of expert positions outputs, outcomes and achievement awards.

·       Provide expertise and supporting in achieving expert positions.

Repository ·       Ensure there is an appropriate database to record the number of expert positions that have been assigned and completed.

·       Ensure there is an appropriate database to record the number of expert positions outputs, outcomes and achievement awards.

Awareness Raising ·       Ensure researchers know that they should record any expert positions assigned and completed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of expert positions outputs, outcomes and achievement awards where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about expert positions, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number of expert positions they have been assigned and have completed.

·       Train researchers in where and how to record the number of expert positions outputs, outcomes and achievements awards.

·       Train researchers in how to find expert position opportunities.

·       Ensure researchers know where to go to receive support in expert positions.

·       Provide best practice examples and case studies of expert positions that researchers can access and draw upon.

Valorisation

The valorisation category consists of 3 subcategories for communication, engagement, and innovation activities along with associated generic indicators/metrics for researcher assessment.

Communication

Public Writing
Indicator Type Indicator
Process # Publications Being Drafted
Output # Publications Published
Outcome # Publications Accessed
# Publications Cited
Category RAF Public Writing Interventions
Policy ·       Senior management approval and decision to collect the number of publications being drafted and published across the institution.

·       Senior management approval and decision to collect the number of publications accessed and cited across the institution.

·       Senior management develop policies and procedures to support the collection of publications being drafted and published by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of publications accessed and cited by a researcher including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of publications being drafted and published across the institution.

·       Allow researchers time (and supporting budget) to record the number of publications accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of publications drafting and published across the institution.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of publications accessed and cited across the institution.

·       Provide expertise and supporting in public writing.

Repository ·       Ensure there is an appropriate database to record the number of publications being drafted and published across the institution.

·       Ensure there is an appropriate database to record the number of publications accessed and cited across the institution.

Awareness Raising ·       Ensure researchers know that they should record any publications being drafted and have published and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of publications accessed and cited and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about public writing, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number publications they are being drafted and have published.

·       Train researchers in where and how to record the number of publications they have accessed and cited.

·       Train researchers in public writing.

·       Ensure researchers know where to go to receive support in public writing.

·       Try to find best practice examples and case studies of public writing that researchers can access and draw upon.

Public Speaking
Indicator Type Indicator
Process # Appearances Planned
Output # Appearances Made
Outcome # Appearances Accessed
# Appearances Cited
Category RAF Public Speaking Interventions
Policy ·       Senior management approval and decision to collect the number of public speaking appearances planned and made across the institution.

·       Senior management approval and decision to collect the number of public speaking appearances accessed and cited across the institution.

·       Senior management develop policies and procedures to support the collection of public speaking appearances planned and made by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of public speaking appearances accessed and cited by a researcher including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of public speaking appearances planned and made across the institution.

·       Allow researchers time (and supporting budget) to record the number public speaking appearances accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of public speaking appearances planned and made across the institution.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of public speaking appearances accessed and cited across the institution.

·       Provide expertise and supporting in public writing.

Repository ·       Ensure there is an appropriate database to record the number of public speaking appearances planned and made across the institution.

·       Ensure there is an appropriate database to record the number of public speaking appearances accessed and cited across the institution.

Awareness Raising ·       Ensure researchers know that they should record any public speaking appearances they have planned or have made and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of public speaking appearances and cited and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about public speaking, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number public speaking appearances they have planned or have made.

·       Train researchers in where and how to record the number of public speaking appearances they have accessed and cited.

·       Train researchers in public speaking.

·       Ensure researchers know where to go to receive support in public speaking.

·       Provide best practice examples and case studies of public speaking that researchers can access and draw upon.

Engagement

Intersectoral Engagement
Indicator Type Indicator
Process # Intersectoral Engagements
Output # Intersectoral Outputs
Outcome # Intersectoral Outcomes
# Organisations Engaged
Category RAF Intersectoral Engagement Interventions
Policy ·       Senior management approval and decision to collect the number of intersectoral engagements and outputs by a researcher across the institution.

·       Senior management approval and decision to collect the number of intersectoral outcomes and organisations engaged across the institution.

·       Senior management develop policies and procedures to support the collection of intersectoral engagements and outputs by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of intersectoral outcomes and organisations engaged across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of intersectoral engagements and outputs across the institution.

·       Allow researchers time (and supporting budget) to record the number of intersectoral outcomes and organisations engaged across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of intersectoral collaborations and outputs across the institution.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of intersectoral outcomes and organisations engaged with across the institution.

·       Provide expertise and supporting in intersectoral collaborations.

Repository ·       Ensure there is an appropriate database to record the number of intersectoral collaborations and outputs across the institution.

·       Ensure there is an appropriate database to record the number of intersectoral outcomes and organisations engaged with across the institution.

Awareness Raising ·       Ensure researchers know that they should record any intersectoral collaborations and outputs developed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of outcomes and organisations engaged with and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about intersectoral engagement and that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number of intersectoral collaborations and outputs developed.

·       Train researchers in where and how to record the number of intersectoral outcomes and organisations engaged with.

·       Train researchers in how to find intersectoral collaborations.

·       Ensure researchers know where to go to receive support in finding and achieving intersectoral collaborations.

·       Provide best practice examples and case studies of intersectoral collaborations that researchers can access and draw upon.

Citizen Engagement
Indicator Type Indicator
Process # Citizen Science Activities Ongoing
Output # Citizen Science Activities Completed
# Citizen Science Outputs
Outcome # Citizen Science Outcomes
# Citizen Scientists Engaged
Category RAF Citizen Engagement Interventions
Policy ·       Senior management approval and decision to collect the number of citizen science activities that are ongoing and completed researchers across the institution.

·       Senior management approval and decision to collect the number of citizen science outputs, outcomes and citizen scientists engaged across the institution.

·       Senior management develop policies and procedures to support the collection of citizen science activities that are ongoing or completed by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of citizen science outputs, outcomes and number of citizen scientists engaged by individual researchers across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of citizen science activities that are ongoing and completed across the institution.

·       Allow researchers time (and supporting budget) to record the number of citizen science outputs, outcomes and the number of citizen scientists engaged across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of citizen scientist activities ongoing and completed across the institution.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of citizen science, outputs and outcomes and the number of citizen scientists engaged with across the institution.

·       Provide expertise and supporting in citizen science.

Repository ·       Ensure there is an appropriate database to record the number of citizen science activities ongoing and completed across the institution.

·       Ensure there is an appropriate database to record the number of citizen science outputs, outcomes and the number of citizen scientists engaged with across the institution.

Awareness Raising ·       Ensure researchers know that they should record any intersectoral citizen science activities that are ongoing and completed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of citizen science outputs, outcomes and the number of citizen scientists engaged with and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about citizen science and that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number of citizen scientists activities ongoing and completed.

·       Train researchers in where and how to record the number of citizen science outputs, outcomes and the number of citizen scientists engaged with.

·       Train researchers in citizen science.

·       Ensure researchers know where to go to receive support in citizen science.

·       Provide best practice examples and case studies of citizen science that researchers can access and draw upon.

Innovation

Research Exploitation
Indicator Type Indicator
Process # Research Outputs Being Legalised
Output # Research Outputs with Defined IPR
# Research Outputs Patented
Outcome # Research Outputs with Licenses
Category RAF Research Exploitation Interventions
Policy ·       Senior management approval and decision to collect the number of research outputs that are in the process of being legalised across the institution.

·       Senior management approval and decision to collect the number of research outputs with defined IPR, patented and with licenses by researchers across the institution.

·       Senior management develop policies and procedures to support the collection of the number of research outputs that are in the process of being legalised by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of research outputs with defined IPR, patents or licenses by individual researchers across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of research outputs that are currently in the process of being legalised across the institution.

·       Allow researchers time (and supporting budget) to record the number the number of research outputs with defined IPR, patents awarded and licensed.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of research outputs in the process of being legalised across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring the number or research outputs with defined IPR, patents awarded and licensed across the institution.

·       Provide expertise and supporting in legalisation of research outputs including defined IPR, patents and licensing

Repository ·       Ensure there is an appropriate database to record the number of research outputs in the process of being legalised across the institution.

·       Ensure there is an appropriate database to record the number of research outputs with defined IPR, patents awarded and licensed across the institution.

Awareness Raising ·       Ensure researchers know that they should record any research outputs in the process of being legalised and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of research outputs with defined IPR, patents awarded and licensed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about research exploitation and that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number of research outputs that are in the process of being legalised.

·       Train researchers in where and how to record the number of research outputs with defined IPR, patents awarded, and licenses granted.

·       Train researchers in legalisation of research outputs including IPR, patents and licensing.

·       Ensure researchers know where to go to receive support in legalisation of research outputs including defined IPR, patents and licensing.

·       Provide best practice examples and legalisation of research outputs including defined IPR, patents and licensing that researchers can access and draw upon.

Entrepreneurial Spirit
Indicator Type Indicator
Process # Spin-offs/Start-ups Being Created
Output # Spin-offs/Start-ups Created
Outcome # Spin-off/Start-up Employees
# Spin-off/Start-up Products
# Spin-off/Start-up Service
Category RAF Entrepreneurial Spirit Interventions
Policy ·       Senior management approval and decision to collect the number of Spin-offs/Start-ups that are in the process currently being created or that have been created across the institution.

·       Senior management approval and decision to collect the number of Spin-off/Start-up employees, products and services across the institution.

·       Senior management develop policies and procedures to support the collection of the number of Spin-offs/Start-ups that are in the process currently being created her including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of Spin-off/Start-up employees, products and services across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of Spin-offs/Start-ups that are in the process currently being created or that have been created across the institution.

·       Allow researchers time (and supporting budget) to record the number the number of Spin-off/Start-up employees, products and services across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of of Spin-offs/Start-ups that are in the process currently being created or that have been created across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of Spin-off/Start-up employees, products and services across the institution.

·       Provide expertise and support in Spin-offs and Start-ups

Repository ·       Ensure there is an appropriate database to record the number of research outputs in the process of being legalised across the institution.

·       Ensure there is an appropriate database to record the number of research outputs with IPR, patents awarded and licensed across the institution.

Awareness Raising ·       Ensure researchers know that they should record Spin-offs/Start-ups that are in the process currently being created or that have been created across the institution. and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of Spin-off/Start-up employees, products and services across the institution and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about entrepreneurial spirit, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record Spin-offs/Start-ups that are in the process currently being created or that have been created

·       Train researchers in where and how to record the number of Spin-off/Start-up employees, products and services.

·       Train researchers in how to establish a Spin-offs/Start-ups

·       Ensure researchers know where to go to receive support in Spin-offs/Start-ups

·       Try to find best practice examples and legalisation of Spin-offs/Start-ups that researchers can access and draw upon.

2. Open Science Researcher Assessment Framework: Indicators and Metrics

Research

The research category consists of 6 subcategories for proposals, methods, data, software, publications, and materials with Open Science indicators and metrics for researcher assessment.

Proposals

Proposal Development
Indicator Type Indicator
Process # Developing Project Proposals Openly Available
Output # Submitted Project Proposals Openly Available
Outcome # Granted Project Proposals Openly Available
Category OSCAM Proposal Development Interventions
Policy ·       Senior management approval and decision to collect and make open project proposals being developed, submitted, granted across the institution, and record the funding received.

·       Senior management develop policies and procedures to make project proposals openly available (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open project proposals being developed, submitted and granted across the institution and to record the funding received.

·       Ensure there is a member (or members) of staff responsible for monitoring upload and ensuring openly available project proposals being developed, submitted and granted are open with an understanding of any ethical issues this may create, and that they record the funding received.

·       Provide expertise and support in proposal writing and development.

Repository ·       Ensure there is suitable and easily accessible database or repository to record project proposals, developed, submitted and granted and that this is open access and can record the funding received.
Awareness Raising ·       Ensure researchers know that they should record and ensure open access for all project proposals, developed, submitted, granted and the funding received and where they can receive training in how to do this and who they should go to for help.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about project proposals that are openly available, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to log and ensure open access of project proposals being developed, submitted, granted and the funding received.

·       Train researchers in proposal writing and development.

·       Train researchers in how to make proposals openly available including issues specific to academic discipline and any ethical concerns.

·       Ensure there are best practice examples of open access proposals developed.

Methods

Methods Development
Indicator Type Indicator
Process # Developing Method Sets Openly Available
Output # Finalised Method Sets Openly Available
Outcome # Openly Available Method Sets Implemented
# Openly Available Method Sets Accessed
# Openly Available Method Sets Cited
Category OSCAM Methods Development Interventions
Policy ·       Senior management approval and decision to collect the number of methods sets being developed, finalised, and implemented across the institution.

·       Senior management approval and decision to collect the number of methods sets accessed and cited across the institution.

·       Senior management develop policies and procedures to make method sets being developed, finalised, and implemented openly available (where possible) with clear guidelines and explanation.

·       Senior management develop policies and procedures to record the number of openly available method sets accessed and cited (where possible) with clear guidelines and expectations

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open access method sets, being developed, finalised, and implemented across the institution.

·       Allow researchers time (and supporting budget) to record, upload and make open access method sets accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring upload of method sets developed, finalised, and implemented across the institution and ensuring they are open access, with an understanding of any ethical issues this may create.

·       Ensure there is a member (or members) of staff responsible for monitoring upload of method sets accessed and cited across the institution and ensuring they are open access; with an understanding of any ethical issues this may create.

·       Provide expertise and support in development and management of method sets and ensuring they are open access,

Repository ·       Ensure there is a suitable and easily accessible database or repository to record method sets developed, finalised, and implemented and that this is open access.

·       Ensure there is a suitable and easily accessible database or repository to record method sets accessed and cited and that this is open access.

Awareness Raising ·       Ensure researchers know that they should record and make open access all method sets, developed, finalised, and implemented and where they can receive training in how to do this and who they should go to for help.

·       Ensure researchers know that they should record and make open access all method sets accessed and cited and where they can receive training in how to do this and who they should go to for help.

·       Explain to researchers the benefit of making method sets open access to both them as individuals and the institution, that they trust the process and understand the link to research assessment.

Training ·       Train researchers in where and how to log openly available method sets being developed, finalised and implemented.

·       Train researchers in where and how to log openly available method sets accessed and cited.

·       Train researchers in development of openly available method sets.

·       Train researchers in how to ensure method sets are open access including issues specific to academic discipline and any ethical concerns.

·       Ensure there are a range of best practice examples of open access method sets.

Data

Data Planning
Indicator Type Indicator
Process #(FAIR) Developing Data Management Plans Openly Available
Output # (FAIR) Finalised Data Management Plans Openly Available
Outcome # (FAIR) Implemented Data Management Plans Openly Available
Category OSCAM Data Planning Interventions
Policy ·       Senior management approval and decision to collect the number of openly available data management plans being developed, finalised, and implemented across the institution.

·       Senior management policies and procedures to make data management plans openly available (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open access data management plans being developed, finalised, and implemented across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring upload and ensuring data management plans being developed, finalised, and implemented are open access (where possible) with an understanding of any ethical issues this may create.

·       Provide expertise and support in the development of openly available data management plans.

Repository ·       Ensure there is a suitable and easily accessible database or repository to record project proposals being developed, finalised and implemented and that this is open access.
Awareness Raising ·       Ensure researchers know that they should record and ensure open access for all data management plans being developed, finalised and implemented and where they can receive training in how to do this and who they should go to for help.

·       Explain to researchers the benefit of making data management plans open access to both them as individuals and the institution and the link to researcher assessment.

Training ·       Train researchers in where and how to share openly available data management plans being developed, finalised, and implemented.

·       Train researchers in the development of openly available data management plans.

·       Train researchers in how to make data management plans open access including any issues specific to the relevant academic discipline and any ethical concerns.

·       Ensure there are a range of best practice examples of openly available data management plans

Data Management
Indicator Type Indicator
Process # Developing (FAIR) Data Sets Openly Available
Output # Finalised (FAIR) Data Sets Openly Available
# Archived (FAIR) Data Sets Openly Available
Outcome # Openly Available (FAIR) Data Sets Accessed
# Openly Available (FAIR) Data Sets Cited
Category OSCAM Data Management Interventions
Policy ·       Senior management approval and decision to collect the number of openly available FAIR data management sets being developed, finalised, and archived across the institution.

·       Senior management approval and decision to collect the number of openly available FAIR data management sets accessed and cited across the institution.

·       Senior management develop policies and procedures to make FAIR data sets openly available (where possible) with clear guidelines and explanations.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open FAIR data management plans being developed, finalised and archived across the institution.

·       Allow researchers time (and supporting budget) to record and upload and make open FAIR data management plans accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring upload of and ensuring FAIR data sets being developed, finalised and archived are open access (where possible) with an understanding of any ethical issues this may create.

·       Ensure there is a member (or members) of staff responsible for monitoring upload of and ensuring FAIR data sets accessed and cited are open access (where possible) with an understanding of any ethical issues this may create

·       Provide expertise and support in the development of openly available FAIR data sets.

Repository ·       Ensure there is a suitable and easily accessible database or repository to record FAIR datasets developed, finalised and implemented and that this is open access.

·       Ensure there is a suitable and easily accessible database or repository to record FAIR datasets accessed and cited and that this is open access.

Awareness Raising ·       Ensure researchers know that they should record all openly available FAIR datasets developed, finalised and implemented and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record all openly available FAIR datasets accessed and cited and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of making FAIR datasets openly available to both them as individuals and the institution, that they trust the process and understand the link to research assessment.

Training ·       Train researchers in where and how to log and ensure open access of FAIR datasets developed, finalised, and implemented.

·       Train researchers in where and how to record open access FAIR datasets cited and accessed.

·       Train researchers in the development of openly available FAIR datasets

·       Train researchers in how to make FAIR datasets open access including any issues specific to academic disciplines and any ethical concerns.

·       Ensure there are best practice examples of openly available FAIR datasets developed.

Data Review
Indicator Type Indicator
Process # Draft (FAIR) Data Set Peer Reviews Openly Available
Output # Submitted (FAIR) Data Set Peer Reviews Openly Available
Outcome # Accepted (FAIR) Data Set Peer Reviews Openly Available
Category OSCAM Data Review Interventions
Policy ·       Senior management approval and decision to collect and make open (FAIR) Data set peer reviews being drafted, submitted and accepted.

·       Senior management develop policies and procedures to make (FAIR) data set peer reviews openly available (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open (FAIR) data set peer reviews being drafted, submitted and accepted across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring upload and ensuring (FAIR) data set peer reviews being drafted, submitted and accepted are open with an understanding of any ethical issues this may create.

·       Provide expertise and support in the development of openly accessible (FAIR) data set peer reviews.

Repository ·       Ensure there is a suitable and easily accessible database or repository to record (FAIR) data set peer reviews drafting, submitted and accepted and that this is open access.
Awareness Raising ·       Ensure researchers know that they should record and ensure open access for all (FAIR) data set peer reviews being drafted, submitted and accepted and where they can receive training in how to do this and who they should go to for help.

·       Explain to researchers the benefit of making(FAIR) data set peer reviews open access to both them as individuals and the institution and the link to researcher assessment.

Training ·       Train researchers in where and how to share openly available (FAIR) data set peer reviews being drafted, submitted and accepted.

·       Train researchers in the (FAIR) data set peer review process.

·       Train researchers in how to make (FAIR) data set peer review open access including any issues specific to the relevant academic discipline and any ethical concerns.

·       Ensure there are a range of best practice examples of (FAIR) data set peer reviews.

Software

Software Development
Indicator Type Indicator
Process # Developing Software Sets Openly Available
Output # Finalised Software Sets Openly Available
# Archived Software Sets Openly Available
Outcome # Openly Available Software Sets Accessed
# Openly Available Software Sets Cited
Category OSCAM Software Development Interventions
Policy ·       Senior management approval and decision to make software sets being developed, finalised and archived across the institution openly available,

·       Senior management approval and decision to make software sets accessed and cited across the institution openly available,

·       Senior management develop policies and procedures to make software sets openly available (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open software sets being developed, finalised and archived across the institution.

·       Allow researchers time (and supporting budget) to collect the number of software sets accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring the upload and ensuring software sets being developed, finalised and archived are open access (where possible) with an understanding of any ethical issues this may create.

·       Provide expertise and support in the development of openly available software sets

Repository ·       Ensure there is a suitable and easily accessible database to record software sets being developed, finalised and archived and that this is open access.

·       Ensure there is a suitable and easily accessible database to record software sets accessed and cited and that this is open access.

Awareness Raising ·       Ensure researchers know that they should record and ensure open access for all software sets being developed, finalised and archived and where they can receive training in how to do this and who they should go to for help.

·       Ensure researchers know that they should record and ensure open access for all software sets accessed and cited and where they can receive training in how to do this and who they should go to for help.

·       Explain to researchers the benefit of making software sets open access to both them as individuals and the institutions and the link to researcher assessment.

Training ·       Train researchers in where and how to share openly available software sets being developed, finalised and archived.

·       Train researchers in where and how to share openly available software sets accessed and cited.

·       Train researchers in development of openly available software sets.

·       Train researchers in how to make software sets open access including any issues specific to the relevant academic discipline and any ethical concerns.

·       Ensure there are a range of best practice examples of open access software sets.

Software Review
Indicator Type Indicator
Process # Draft Software Set Peer Reviews Openly Available
Output # Submitted Software Set Peer Reviews Openly Available
Outcome # Accepted Software Set Peer Reviews Openly Available
Category OSCAM Software Review Interventions
Policy ·       Senior management approval and decision to collect the number of openly available software set peer reviews being drafted, submitted and accepted across the institution.

·       Senior management develop policies and procedures to make software set peer reviews openly available (where possible) with clear guidelines and expectations.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open access software set peer reviews being drafted, submitted and accepted across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring upload and ensuring software set peer reviews drafting, submitted and accepted are open access (where possible) with an understanding of any ethical issues this may create.

·       Provide expertise and support in the development of openly available software set peer reviews

Repository ·       Ensure there is a suitable and easily accessible database or repository to record software set peer reviews being drafted, submitted, and accepted and that this is open access.
Awareness Raising ·       Ensure researchers know that they should record and ensure open access for all software set peer reviews being drafted, submitted, and accepted and where they can receive training in how to do this and who they should go to for help.

·       Explain to researchers the benefit of making software set peer reviews open access to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record open software set peer reviews drafted, submitted and accepted.

·       Train researchers in the software set peer review process.

·       Train researchers in how to make software set peer reviews open access including any issues specific to the relevant academic discipline and any ethical concerns.

·       Ensure there are a range of best practice examples of open access software set peer reviews.

Publications

Publication Drafting
Indicator Type Indicator
Process # Draft Publications Openly Available
Output # Submitted Publications Openly Available
Outcome # Published Publications Openly Available
# Openly Available Publications Accessed
# Openly Available Publications Cited
Category OSCAM Publication Drafting Interventions
Policy ·       Senior management approval and decision to make publications being drafted, submitted and published openly available,

·       Senior management approval and decision to make publications accessed and cited across the institution openly available,

·       Senior management develop policies and procedures to make publications openly available (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open publications being drafted, submitted and published across the institution.

·       Allow researchers time (and supporting budget) to collect the number of publications accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring upload and ensuring publications are open access (where possible) with an understanding of any ethical issues this may create.

·       Provide expertise and support in the development of openly available publications

Repository ·       Ensure there is a suitable and easily accessible database or repository to record publications being drafted, submitted and published that this is open access.
Awareness Raising ·       Ensure researchers know that they should record and ensure open access for all publications being drafted, submitted and published and where they can receive training in how to do this and who they should go to for help.

·       Ensure researchers know that they should record and ensure open access for all publications accessed and cited and where they can receive training in how to do this and who they should go to for help.

·       Explain to researchers the benefit of making publications open access to both them as individuals and the institutions that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to share openly available publications being drafted, submitted and published.

·       Train researchers in where and how to record openly available publications accessed and cited.

·       Train researchers in drafting publications.

·       Train researchers in how to make publications open access including any issues specific to the relevant academic discipline and any ethical concerns.

·       Ensure there are a range of best practice examples of openly available publications

Publication Review
Indicator Type Indicator
Process # Draft Publication Peer Reviews Openly Available
Output # Submitted Publication Peer Reviews Openly Available
Outcome # Accepted Publication Peer Reviews Openly Available
Category OSCAM Publication Review
Policy ·       Senior management approval and decision to make publication peer reviews that are being drafted, submitted and published openly available.

·       Senior management approval and decision to collect the number of openly available peer reviews that are being drafted, submitted and accepted across the institution.

·       Senior management develop policies and procedures to make publication peer reviews openly available (where possible) with clear guidelines and expectations.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open access publication peer reviews drafting, submitted and accepted across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring upload and ensuring publication peer reviews drafting, submitted and accepted are open access (where possible) with an understanding of any ethical issues this may create.

·       Provide expertise and support in the development of openly available publication peer reviews.

Repository ·       Ensure there is a suitable and easily accessible database or repository to record publication peer reviews that are being drafted, submitted and accepted across the institution.
Awareness Raising ·       Ensure researchers know that they should record and ensure open access for all publication peer reviews drafting, submitted and accepted and where they can receive training in how to do this and who they should go to for help.

·       Explain to researchers the benefit of making publication peer reviews open access to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record openly available publication peer reviews being drafted, submitted and accepted.

·       Train researchers in the publication peer review process.

·       Train researchers in how to develop openly available publication peer reviews including any issues specific to the relevant academic discipline and any ethical concerns.

·       Ensure there are a range of best practice examples of openly available publication peer reviews.

Materials

Materials Development
Indicator Type Indicator
Process # Developing Material Sets Openly Available
Output # Finalised Material Sets Openly Available
Outcome #Implemented Material Sets Openly Available
# Openly Available Material Sets Accessed
# Openly Available Material Sets Cited
Category OSCAM Material Set Interventions
Policy ·       Senior management approval and decision to collect number of openly available material sets being developed, finalised and implemented across the institution.

·       Senior management approval and decision to collect number of openly available material sets accessed and cited across the institution.

·       Senior management develop policies and procedures to make material sets openly available (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open access material sets developed, finalised and implemented across the institution.

·       Allow researchers time (and supporting budget) to record openly available material sets accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring upload of and ensuring materials being developed, finalised and implemented are open access (where possible) with an understanding of any ethical issues this may create.

·       Ensure there is a member (or members) of staff responsible for recording the number of openly available materials accessed and cited with an understanding of any ethical issues this may create.

·       Provide expertise and support in the development of openly available material sets.

Repository ·       Ensure there is a suitable and easily accessible database or repository to record material sets being developed, finalised, and accessed and that this is open access.

·       Ensure there is a suitable and easily accessible database to record openly available material sets accessed and cited.

Awareness Raising ·       Ensure researchers know that they should record and ensure open access for all material sets being developed, finalised and implemented and where they can receive training in how to do this and who they should go to for help.

·       Ensure researchers know that they should record all openly available material sets accessed and cited and where they can receive training in how to do this and who they should go to for help.

·       Explain to researchers the benefit of making material sets open access to both them as individuals and the institutions, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to share openly accessible material sets being drafted, finalised and implemented.

·       Train researchers in where and how to record openly available material sets accessed and cited.

·       Train researchers in developing material sets.

·       Train researchers in how to make material sets open access including any issues specific to the relevant academic discipline and any ethical concerns.

·       Ensure there are a range of best practice examples of open access material sets.

Education

The education category consists of 5 subcategories for courses, resources, teaching, supervision, and skills development with related Open Science indicators/metrics for researcher assessment.

Courses

Course Development
Indicator Type Indicator
Process # Open Science Courses Being Developed
# Developing Courses Openly Available
Output # Open Science Courses Finalised
# Finalised Courses Openly Available
Outcome # Open Science Courses Implemented
# Implemented Courses Openly Available
Category Open Science Career Assessment Matrix Interventions
Policy ·       Senior management approval and decision to collect the number of open science courses that are being developed, finalised and implemented across the institution.

·       Senior management approval and decision to collect the number of openly available courses that are being developed finalised and implemented across the institution.

·       Senior management develop policies and procedures to make open courses that are being developed, finalised and implemented open access (where possible) with clear guidelines and explanation.

·       Senior management develop policies and procedures to implement open science courses with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open courses that are being developed, finalised and implemented across the institution.

·       Allow researchers time (and supporting budget) to record, upload and make open, open science courses that are openly available that are being developed, finalised and implemented across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of open science courses developed, finalised and implemented across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring number courses openly available and for assisting with making them open access (where possible) with an understanding of any ethical issues this may create.

·       Provide expertise in design of open science courses

·       Provide expertise in course development

Repository ·       Ensure there is an appropriate database and repository to record the number of open science courses being developed, finalised and implemented across the institution.

·       Ensure there is a suitable and easily accessible database or repository to record and upload courses openly available.

Awareness Raising ·       Ensure researchers are aware of the institution policy to make open science courses as open as possible.

·       Ensure researchers know that they should record, upload and share all open science courses being developed, finalised and implemented and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record, upload and share all courses developed openly.

·       Explain to researchers the benefit of making open science courses open access to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record open science courses being developed, finalised and implemented.

·       Train researchers in where and how to make open science courses openly available.

·       Train researchers in open science course development

·       Train researchers in how to share courses developed, finalised and implemented openly.

Resources

Resource Development
Indicator Type Indicator
Process # Open Science Resources Being Developed
#Developing Resources Openly Available
Output # Open Science Resources Finalised
# Finalised Resources Openly Available
Outcome # Open Science Resources Implemented
# Implemented Resources Openly Available
 
Category OSCAM Resource Development Interventions
Policy ·       Senior management approval and decision to collect information on the number of open science resources being developed, finalised and implemented.

·       Senior management approval and decision to collect information on the number of resources openly available being developed, finalised and implemented.

·       Senior management develop policies and procedures to support the collection of information on the number of open science resources being developed finalised and implemented including clear guidelines and explanation.

·       Senior management develop policies and procedures to support the collection of information on the number of resources openly available being developed, finalised and implemented including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record, upload and make open, open science resources being developed, finalised and implemented.

·       Allow researchers time (and supporting budget) to record upload and make open, resources openly available being developed, finalised and implemented.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of resources being developed, finalised and implemented across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of resources openly available, being developed, finalised and implemented.

·       Provide expertise and support in resource development and how to ensure course materials are open access.

·       Provide expertise in design of open science resources.

Repository ·       Ensure there is an appropriate database and repository to record the number of open science resources being developed, finalised and implemented across the institution.

·       Ensure there is an appropriate database and repository to record the number of resources openly available.

Awareness Raising ·       Ensure researchers are aware of the institution policy to make resources as open as possible.

·       Ensure researchers know that they should record, upload and share all open science resources being developed, finalised and implemented and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record, upload and share all resources developed openly.

·       Explain to researchers the benefit of making resources openly available to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record resources being developed, finalised and implemented.

·       Train researchers in resource development

·       Train researchers in how to share resources being developed, finalised and implemented openly.

·       Train researchers in how to incorporate open science in the resources they develop.

·       Ensure there are best practice examples of open access resources available.

Teaching

Student Teaching
Indicator Type Indicator
Process # Open Science Course Hours Assigned
Output # Open Science Course Hours Taught
Outcome # Students Passed in Open Science Courses
# Students Passed in Openly Available Course
Category OSCAM Student Teaching Interventions
Policy ·       Senior management approval and decision to collect the number of open science courses hours assigned or taught across the institution.

·       Senior management approval and decision to collect the number of students that have passed open science courses or courses openly available open science currently being taught or that have been taught across the institution.

·       Senior management policies and procedures to make open science courses that are currently being taught or that have been taught open access (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record and upload the number of open science courses that are currently being taught or that have been taught across the institution and make materials open access.

·       Allow researchers time to record the number of students who have passed open science courses or courses openly available across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of open science courses that are currently being taught or have been taught across the institution and any ethical issues this might create.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of students who have passed open science courses or courses openly available and providing assistance with ensuring materials are open access with an understanding of any ethical issues this may create.

·       Provide expertise and support in teaching and how to ensure course materials are open access.

·       Provide expertise in design of open science courses

Repository ·       Ensure there is an appropriate database and repository to record and upload the number of open science courses that are currently being taught or have been taught across the institution.

·       Ensure there is an appropriate database to record the number of students who have passed open science courses or courses openly available that are currently being taught or have been taught across the institution.

·       Ensure there is an appropriate database to record the number of students who have passed teaching courses that are openly available both currently or that have been taught across the institution.

Awareness Raising ·       Ensure researchers are aware that open science courses are available to them for teaching purposes.

·       Ensure researchers know that they should record, upload and share all open science courses taught or currently being taught.

·       Ensure researchers know that they should record, upload and share all open science teaching courses (where possible) and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of making courses that are being taught or have been taught openly available to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record and upload courses being currently taught or that have been taught.

·       Train researchers in teaching methods.

·       Train researchers in how to share open science courses taught and courses that have been taught openly.

·       Train researchers in how to incorporate open science in their course materials.

·       Ensure there are best practice examples of open access teaching courses available.

Supervision

Student Supervision
Indicator Type Indicator
Process # Students Being Supervised in Open Science
Output # Students Supervised in Open Science
Outcome # Supervised Student Theses Openly Available
# Supervised Students in Open Science Graduate
Category OSCAM Student Supervision Interventions
Policy ·       Senior management approval and decision to collect the number of students that researchers are supervising and have supervised in open science.

·       Senior management approval and decision to collect number of supervised student theses that are openly available and the number of supervised students in open science that have graduated.

·       Senior management develop policies and procedures that support the collection of the number of researchers that are being supervised or have been supervised in open science (where possible) with clear guidelines and explanation.

·       Senior management develop policies and procedures that support the collection of the number of researchers supervised student theses that are openly available and the number of supervised students in open science that have graduated (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time to record the number of students that they are supervising or have supervised in open science.

·       Allow researchers time to record the number of supervised student theses that are openly available and the number of supervised students in open science that have graduated.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of students that are being supervised or have been supervised in open science across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring the theses that are openly available and the number of supervised students in open science that have graduated.

·       Provide expertise and support in open science supervision.

Repository ·       Ensure there is an appropriate database to record the number of students currently being supervised or that have been supervised in open science.

·       Ensure there is an appropriate method or database for recording the number of supervised theses that are openly available and the number of supervised students in open science that have graduated

Awareness Raising ·       Ensure researchers know that they should record all students currently being supervised or that have been supervised in open science and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of supervised theses that are openly available and the number of supervised students in open science that have graduated and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting data on the number of students that are being or have been supervised in open science to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record the number of students that are currently or that have been supervised.

·       Train researchers in where and how to record the number of students they have supervised who have completed their thesis or graduated.

·       Train researchers in open science supervision.

·       Ensure researchers know where to go to receive support in supervision.

·       Ensure there are some best practice examples of open science supervision available.

Skills

Skills Development
Indicator Type Indicator
Process # Open Science Skills Courses Being Followed
Output # Open Science Skills Courses Completed
Outcome # Open Science Skills Certificates Obtained
Category OSCAM Skills Development Interventions
Policy ·       Senior management approval and decision to collect information on the number of open science skills courses individuals are following, have completed and obtained across the institution.

·       Senior management develop policies and procedures to support the collection of information on the number of open science skills courses individuals are following, completed and obtained including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of open science skills courses individuals are following, have completed and obtained by them,

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of open science skills courses individuals are following, have completed and obtained across the institution, with an understanding of any ethical issues this may create.

·       Provide a comprehensive programme of open science skills courses for researchers.

Repository ·       Ensure there is an appropriate and easily accessible database for researchers to record the number of open science skills courses they are following, have completed, and obtained.
Awareness Raising ·       Ensure researchers know that they should record the number of open science skills courses they are following, have completed, and obtained and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about open science skills courses, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record the number of open science skills courses they are following, have completed and obtained.

·       Train researchers in the programme of open science skills courses for researchers that are offered by the institution.

·       Ensure there is clear advice and guidance on attending open science skills courses with a clear link to career development and academic success.

Leadership

The leadership category consists of 4 subcategories for people, project, and organisational unit management and recognition with Open Science indicators/metrics for researcher assessment.

People

Staff Supervision
Indicator Type Indicator
Process # Staff Being Supervised in Open Science
Output # Staff Supervised in Open Science
Outcome # Supervised Staff Theses Openly Available
# Supervised Staff Projects involving Open Science
Category Open Science Career Assessment Matrix
Policy ·       Senior management approval and decision to collect the number of staff that researchers are supervising and have supervised in open science.

·       Senior management approval and decision to collect number of supervised student theses that are openly available and the number of supervised staff projects in open science by staff researchers are supervising or have supervised.

·       Senior management develop policies and procedures that support the collection of the number of staff that are being supervised or have been supervised in open science (where possible) by researchers with clear guidelines and explanation.

·       Senior management develop policies and procedures that support the collection of the number of staff theses that are openly available and the number of staff projects involving open science by staff that are currently being supervised or have been supervised by researchers.

Resource ·       Allow researchers time to record the number of staff that they are supervising or have supervised in open science.

·       Allow researchers time to record the number of supervised staff theses that are openly available and the number of staff projects in open science by staff researchers are supervising or have been supervised.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of staff that are being supervised or have been supervised in open science by researchers across the institution, with an understanding of any ethical issues this may create.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of theses that are openly available and the number of staff projects involving open science by staff that are currently being supervised or have been supervised by researchers with an understanding of any ethical issues this may create.

·       Provide expertise and support in open science supervision.

Repository ·       Ensure there is an appropriate database or repository to record the number of staff currently being supervised or that have been supervised in open science.

·       Ensure there is an appropriate database or repository for recording the number of supervised staff theses that are openly available and the number of staff projects involving open science by staff that have been supervised by researchers or are currently being supervised.

Awareness Raising ·       Ensure researchers know that they should record all staff currently being supervised or that have been supervised in open science and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of supervised staff theses that are openly available and the number of supervised staff projects involving open science and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting data on the number of staff that are being or have been supervised in open science to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

·       Explain to researchers the benefit of collecting data on staff theses that are openly available and staff projects involving open science in which they have supervised staff to both them as individuals, and the institution, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record the number of staff that are currently or that have been supervised by researchers.

·       Train researchers in where and how to record the number of staff theses that have been written and are openly available and the number of open science projects in which staff they have supervised or are supervising are involved.

·       Train researchers in open science supervision.

·       Ensure researchers know where to go to receive support in supervision of staff.

·       Ensure there are some best practice examples of open science staff supervision available.

Projects

Project Management
Indicator Type Indicator
Process # Projects involving Open Science Being Managed
Output # Projects involving Open Science Completed
Outcome # Projects involving Open ScienceSuccessfully Evaluated
Category OSCAM Project Management Interventions
Policy ·       Senior management approval and decision to collect the number of projects involving open science that researchers are currently managing, have completed or have been successfully evaluated across the institution.

·       Senior management develop policies and procedures that support the collection of the number of projects involving open science that researchers are managing, have completed and that have been successfully evaluated (where possible) with clear guidelines and explanation.

Resource ·       Allow researchers time to record the number of projects involving Open Science they are currently managing, have completed and that have been successfully evaluated.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of projects involving Open Science that researchers are currently managing, have completed and that have been successfully evaluated across the institution with an understanding of any ethical issues this may create.

·       Provide expertise and support in projects involving Open Science.

Repository ·       Ensure there is an appropriate database or repository to record the number of projects involving open science that researchers are managing, have completed and that have been successfully evaluated.
Awareness Raising ·       Ensure researchers know that they should record the number of projects involving Open Science they are managing, have completed and that have been successfully evaluated and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting data on the number of projects that they are managing, have completed and that have been successfully evaluated to both them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record the number of projects that they are currently managing, have completed and that have been successfully evaluated.

·       Train researchers in projects involving Open Science.

·       Ensure researchers know where to go to receive support in projects involving Open Science.

·       Ensure there are some best practice examples of projects involving Open Science available.

Organisation

Unit Management
Indicator Type Indicator
Process # Unit Management Positions in Open Science Assigned
Output # Unit Management Positions in Open Science Completed
#Agreed Unit Management Outputs involving Open Science
Outcome # Agreed Unit Management Outcomes involving Open Science
Category OSCAM Unit Management Interventions
Policy ·       Senior management approval and decision to collect the number of unit management positions in open science that researchers have been assigned and completed.

·       Senior management approval and decision to collect the number of agreed Unit management outputs and outcomes involving open science.

·       Senior management develop policies and procedures that support the collection of the number of unit management positions in open science that are assigned and completed with clear guidelines and explanation.

·       Senior management develop policies and procedures that support the collection of the number of agreed unit management outputs and outcomes involving open science with clear guidelines and explanation.

Resource ·       Allow researchers time to record the number of unit management positions in open science that researchers have been assigned and completed.

·       Allow researchers time to collect the number of agreed unit management outputs and outcomes involving open science.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of unit management positions in open science that researchers have been assigned and completed across the institution with an understanding of any ethical issues this may create.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of agreed unit management outputs and outcomes involving open science across the institution, with an understanding of any ethical issues this may create.

·       Provide expertise and support in projects involving Unit Management in Open Science.

Repository ·       Ensure there is an appropriate database to record the number of Unit Management positions in open science assigned and completed.

·       Ensure there is an appropriate database to record the number of agreed unit management outputs and outcomes involving open science.

Awareness Raising ·       Ensure researchers know that they should record the number of Unit Management positions in open science assigned and completed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number agreed unit management outputs and outcomes involving open science and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting data on the number of Unit management positions in open science assigned and completed to them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

·       Explain to researchers the benefit of collecting data on the number of unit management outputs and outcomes involving open science to them as individuals and the institution, so that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record the number of unit management positions in open science assigned and completed.

·       Train researchers in where and how to record the number of agreed unit management outputs and outcomes involving open science.

·       Train researchers in Unit management in open science.

·       Ensure researchers know where to go to receive support in Open Science Unit Management.

·       Ensure there are some best practice examples of projects involving Open Science Unit Management.

Recognition

Expert Positions
Indicator Type Indicator
Process # Expert Positions in Open Science Assigned
Output # Expert Positions in Open Science Completed
# Open Science Expert Position Outputs
# Expert Position Outputs Openly Available
Outcome # Expert Position Outcomes Openly Available
# Expert Achievement Awards for Open Science
Category OSCAM Expert Positions Interventions
Policy ·       Senior management approval and decision to collect the number of open science expert positions that researchers have been assigned and completed.

·       Senior management approval and decision to collect the number of open science expert position outputs, expert position outputs openly available, expert position outcomes openly available and expert achievement awards in open science.

·       Senior management develop policies and procedures that support the collection of the number of open science expert positions that researchers have been assigned and completed with clear guidelines and explanation.

·       Senior management develop policies and procedures that support the collection of the number of open science expert position outputs, expert position outputs openly available, expert position outcomes openly available and expert achievement awards in open science with clear guidelines and explanation.

Resource ·       Allow researchers time to record the number of open science expert positions that researchers have been assigned and completed.

·       Allow researchers time to record the number of open science expert position outputs, expert position outputs openly available, expert position outcomes openly available and expert achievement awards in open science with clear guidelines and explanation.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of open science expert positions that researchers have been assigned and completed across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring the number of expert position outputs, expert position outputs openly available, expert position outcomes openly available and expert achievement awards in open science across the institution.

·       Provide expertise and support in projects involving open science expert positions.

Repository ·       Ensure there is an appropriate database to record the number of open science expert positions that researchers have been assigned and completed.

·       Ensure there is an appropriate database to record the number of expert position outputs, expert position outputs openly available, expert position outcomes openly available and expert achievement awards in open science across the institution.

Awareness Raising ·       Ensure researchers know that they should record the number of open science expert positions that researchers have been assigned and completed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of Expert position outputs, expert position outputs openly available, expert position outcomes openly available and expert achievement awards in open science and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting data on the number of open science expert positions that researchers have been assigned and completed them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

·       Explain to researchers the benefit of collecting data on the number of expert position outputs, expert position outputs openly available, expert position outcomes openly available and expert achievement awards in open science to them as individuals and the institution and the link to researcher assessment.

Training ·       Train researchers in where and how to record the open science expert positions that researchers have been assigned and completed.

·       Train researchers in where and how to record the number of expert position outputs, expert position outputs openly available, expert position outcomes openly available and expert achievement awards in open science,

·       Train researchers in open science expert positions.

·       Ensure researchers know where to go to receive support in open science expert positions.

·       Ensure there are some best practice examples of projects involving open science expert positions.

Valorisation

The valorisation category consists of 3 subcategories for communication, engagement, and innovation along with associated Open Science indicators/metrics for researcher assessment

Communication

Public Writing
Indicator Type Indicator
Process # Draft Publications Openly Available
Output # Published Publications Openly Available
Outcome # Openly Available Publications Accessed
# Openly Available Publications Cited
Category OSCAM Public Writing Interventions
Policy ·       Senior management approval and decision to collect the number of openly available publications that are being drafted and published across the institution.

·       Senior management approval and decision to collect the number of openly available publications accessed and cited across the institution.

·       Senior management develop policies and procedures to support the collection and sharing of openly available publications drafting and published by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of openly available publications accessed and cited by a researcher including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record and upload the number of openly available publications drafting and published across the institution.

·       Allow researchers time (and supporting budget) to record the number of openly available publications accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of openly available publications that are being drafted and published across the institution and support to help make them open.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of openly available publications accessed and cited across the institution.

·       Provide expertise and supporting in public writing.

Repository ·       Ensure there is an appropriate database to record and share the number of openly available publications that are being drafted and published across the institution.

·       Ensure there is an appropriate database to record the number of openly available publications accessed and cited across the institution.

Awareness Raising ·       Ensure researchers know that they should record and make open (where possible) publications they are drafting and have published and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of openly available publications accessed and cited and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers understand the benefit to individuals and the institution of recording this information about openly available publications, that they trust the process and understand the link to researcher assessment

Training ·       Train researchers in where and how to record the number and upload the documents for openly available publications they are drafting and have published.

·       Train researchers in where and how to record the number of openly available publications they have accessed and cited.

·       Train researchers in openly available public writing.

·       Ensure researchers know where to go to receive support in openly available public writing.

·       Try to find best practice examples and case studies of openly available public writing that researchers can access and draw upon.

Public Speaking
Indicator Type Indicator
Process # Appearances on Open Science Planned
Output # Appearances on Open Science Given
Outcome # Appearances on Open Science Accessed
# Appearances on Open Science Cited
# Appearances Openly Available
Category OSCAM Public Speaking Interventions
Policy ·       Senior management approval and decision to collect the number of public speaking appearances on open science planned and given across the institution.

·       Senior management approval and decision to collect the number open science public speaking appearances accessed and cited across the institution.

·       Senior management approval and decision to make as collect and make public speaking appearances openly available (where possible).

·       Senior management develop policies and procedures to support the collection of open science public speaking appearances planned and given by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of open science public speaking appearances accessed and cited by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to public speaking appearances openly available (where possible) including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of open science public speaking appearances planned and given across the institution.

·       Allow researchers time (and supporting budget) to record the number open science public speaking appearances accessed and cited across the institution.

·       Allow researchers time (and supporting budget) to make public speaking appearances openly available (where possible).

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of open science public speaking appearances planned and made across the institution.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of open science public speaking appearances accessed and cited across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring, assisting and helping to make open public appearances (where possible.)

·       Provide expertise and supporting in public speaking

Repository ·       Ensure there is an appropriate database to record the number of open science public speaking appearances planned and made across the institution.

·       Ensure there is an appropriate database to record the number of open science public speaking appearances accessed and cited across the institution.

·       Ensure there is an appropriate database to record and assist with making open, openly available public appearances.

Awareness Raising ·       Ensure researchers know that they should record any open science public speaking appearances they have planned or have made and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record the number of open science public speaking appearances and cited and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting data on the number of openly available public speaking appearances they have planned and make to them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

·       Explain to researchers the benefit of making public appearances openly available (where possible) to them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

Training ·       Train researchers in where and how to record the number open science public speaking appearances they have planned or have made.

·       Train researchers in where and how to record the number of open science public speaking appearances they have accessed and cited

·       Train researchers in where and how to record and share openly available public speaking appearances.

·       Train researchers in open science public speaking

·       Train researchers in public speaking

·       Ensure researchers know where to go to receive support in public speaking.

·       Try to find best practice examples and case studies of open science public speaking that researchers can access and draw upon.

Engagement

Intersectoral Engagement
Indicator Type Indicator
Process # Intersectoral Engagements involving Open Science
Output # Intersectoral Outputs involving Open Science
Outcome # Intersectoral Outcomes involving Open Science
# Organisations Engaged for Open Science
Category OSCAM Intersectoral Engagement Interventions
Policy ·       Senior management approval and decision to collect the number of intersectoral engagements and outputs for open science by a researcher across the institution.

·       Senior management approval and decision to collect the number of intersectoral outcomes for open science and organisations engaged for open science across the institution.

·       Senior management develop policies and procedures to support the collection of intersectoral collaborations involving open science and outputs for open science by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of intersectoral outcomes for open science and organisations engaged for open science across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record the number of intersectoral collaborations involving open science and outputs for open science across the institution.

·       Allow researchers time (and supporting budget) to record the number of intersectoral outcomes for open science and organisations engaged for open science across the institution.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of intersectoral collaborations for open science and intersectoral outputs for open science across the institution.

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of intersectoral outcomes for open science and organisations engaged for open science. across the institution.

·       Provide expertise and supporting in intersectoral collaborations involving open science.

Repository ·       Ensure there is an appropriate database to record and make open the number of intersectoral collaborations involving and outputs for open science across the institution.

·       Ensure there is an appropriate database to record and make open the number of intersectoral outcomes for open science and organisations engaged for open science with across the institution.

Awareness Raising ·       Ensure researchers know that they should record and make open any intersectoral collaborations involving open science and outputs for open science developed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record and make open the number of intersectoral outcomes for open science and organisations for open science engaged with and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting and making open data on the number of intersectoral engagements involving open science and outputs for open science to both, them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

·       Explain to researchers the benefit of collecting and intersectoral outcomes for open science and organisations engaged for open science both to them as individuals and the institution, that they trust the process and the understand the link to researcher assessment.

Training ·       Train researchers in where and how to record and make open intersectoral collaborations involving open science and outputs for open science.

·       Train researchers in where and how to record and make open intersectoral outcomes for open science and organisations engaged for open science.

·       Train researchers in how to find open science intersectoral collaborations.

·       Ensure researchers know where to go to receive support in finding and achieving open science intersectoral collaborations.

·       Try to find best practice examples and case studies of open science intersectoral collaborations that researchers can access and draw upon.

Citizen Engagement
Indicator Type Indicator
Process # Citizen Science Activities involving Open Science Ongoing
Output # Citizen Science Activities involving Open Science Completed
# Citizen Science Outputs involving Open Science
Outcome # Citizen Science Outcomes involving Open Science
# Citizen Scientists Engaged in Open Science
Category OSCAM Citizen Engagement Interventions
Policy ·       Senior management approval and decision to collect the number of citizen science activities involving open science that are ongoing and completed researchers across the institution.

·       Senior management approval and decision to collect the number of citizen science for open science outputs, outcomes and citizen scientists engaged across the institution.

·       Senior management develop policies and procedures to support the collection of citizen science activities involving open science that are ongoing or completed by a researcher including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of citizen science outputs for open science, outcomes for open science and number of citizen scientists engaged by individual researchers across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record and make open the number of citizen science activities involving open science that are ongoing and completed across the institution.

·       Allow researchers time (and supporting budget) to record the number of citizen science outputs for open science, outcomes for open science and the number of citizen scientists engaged across the institution and make them open (where possible).

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of citizen scientist activities ongoing and completed across the institution and to support open access (where possible)

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of citizen science, outputs and outcomes and the number of citizen scientists engaged with across the institution and to support open access (where possible)

·       Provide expertise and supporting in citizen science involving open science

Repository ·       Ensure there is an appropriate database to record and make open the number of citizen science activities involving open science ongoing and completed across the institution.

·       Ensure there is an appropriate database to record and make open the number of citizen science outputs for open science, outcomes for open science and the number of citizen scientists engaged with across the institution.

Awareness Raising ·       Ensure researchers know that they should record and make open any citizen science activities involving open science that are ongoing and completed and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record and make open the number of citizen science outputs for open science, outcomes for open science and the number of citizen scientists engaged with and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting and making open data on the number of citizen science activities involving open science that are ongoing or completed to both, them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

·       Explain to researchers the benefit of collecting and making open the number of citizen science outputs for open science, outcomes for open science and the number of citizen scientists engaged to both them as individuals and the institution, that they trust the process and understand the link to research assessment.

Training ·       Train researchers in where and how to record the number of citizen scientist’s activities involving open science that are ongoing and completed.

·       Train researchers in where and how to record the number of citizen science outputs for open science, outcomes for open science and the number of citizen scientists engaged in open science with.

·       Train researchers in citizen science for open science.

·       Ensure researchers know where to go to receive support in citizen science involving open science.

·       Try to find best practice examples and case studies of citizen science involving open science that researchers can access and draw upon.

Innovation

Research Exploitation
Indicator Type Indicator
Process # Openly Available Research Outputs Being Legalised
Output # Openly Available Research Outputs with Defined IPR
# Openly Available Research Outputs Patented
Outcome # Research Outputs with Open Licenses
Category OSCAM Research Exploitation Interventions
Policy ·       Senior management approval and decision to collect the number of openly available research outputs that are in the process of being legalised across the institution.

·       Senior management approval and decision to collect the number of openly available research outputs with defined IPR, patents awarded, and licenses granted across the institution.

·       Senior management develop policies and procedures to support the collection of the number of openly available research outputs that are in the process of being legalised across the institution including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of openly available research outputs with defined IPR, patents awarded and licenses granted by individual researchers across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record and make open the number of openly available research outputs that are in the process of being legalised across the institution.

·       Allow researchers time (and supporting budget) to record the number of openly available research outputs with defined IPR, patents awarded, and licenses granted make them open (where possible).

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of openly available research outputs in the process of being legalised across the institution and to support open access (where possible)

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of openly available research outputs with defined IPR, patents awarded, and licenses granted across the institution and to support open access (where possible)

·       Provide expertise and supporting in openly available research outputs, defined IPR, Patents and Licensing

Repository ·       Ensure there is an appropriate database to record and make open the number of openly available research outputs that are currently in the process of being legalised across the institution.

·       Ensure there is an appropriate database to record and make open the number of openly available research outputs with defined IPR, patents awarded and licenses granted across the institution.

Awareness Raising ·       Ensure researchers know that they should record and make open openly available research outputs that are currently in the process of being legalised and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record and make open the number of openly available research outputs with defined IPR, patents awarded and licenses granted and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting and making openly available research outputs that are in the process of being legalised to both, them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

·       Explain to researchers the benefit of collecting and making open openly available research outputs with defined IPR, patents awarded, and licenses granted to both them as individuals and the institution, so that they trust the process and understand the link to research assessment.

Training ·       Train researchers in where and how to record the number of openly available research outputs that are in the process of being legalised.

·       Train researchers in where and how to record the number of openly available research outputs with defined IPR, patents awarded and licenses awarded.

·       Train researchers in openly available research outputs legalising, defined IPR, patents and licensing.

·       Ensure researchers know where to go to receive support in legalisation of research outputs, defined IPR, patents and licensing.

·       Try to find best practice examples and case studies of openly available research outputs defined IPR, patents and licensing citizen science that researchers can access and draw upon.

Entrepreneurial Spirit
Indicator Type Indicator
Process # Open Science Spin-offs/Start-ups Being Created
Output # Open Science Spin-offs/Start-ups Created
Outcome # Open Science Spin-off/Start-up Employees
# Open Science Spin-off/Start-up Products
# Open Science Spin-off/Start-up Services
Category OSCAM Entrepreneurial Spirit Interventions
Policy ·       Senior management approval and decision to collect the number of open science spin-offs/starts ups that are being created or have been created across the institution.

·       Senior management approval and decision to collect the number of open science spin-offs/start-ups employees, products and services across the institution.

·       Senior management develop policies and procedures to support the collection of the number of open science spin-offs/starts ups that are being created or have been created across the institution including clear guidelines and explanation.

·       Senior management develop policies and procedures to collect the number of open science spin-offs/start-ups employees, products and services across the institution including clear guidelines and explanation.

Resource ·       Allow researchers time (and supporting budget) to record and make open the number of open science spin-offs/starts ups that are being created or have been created across the institution.

·       Allow researchers time (and supporting budget) to record the number of open science spin-offs/start-ups employees, products and services across the institution including clear guidelines and explanation.

·       Ensure there is a member (or members) of staff responsible for monitoring and assisting with the collection of the number of open science spin-offs/starts ups that are being created or have been created and to support open access (where possible)

·       Ensure there is a member (or members) of staff responsible for monitor and assisting with the collection of the number of open science spin-offs/starts ups that are being created or have been created and to support open access (where possible)

·       Provide expertise and support in all aspects of open science start-ups/spin-offs

Repository ·       Ensure there is an appropriate database to record and make open the number of number of open science spin-offs/starts ups that are being created across the institution.

·       Ensure there is an appropriate database to record and make open the number of number of open science spin-offs/start-ups employees, products and services across the institution.

Awareness Raising ·       Ensure researchers know that they should record and make open, open science spin-offs/starts ups and where they can receive training in how to do this and who they should go to for help and support.

·       Ensure researchers know that they should record and make open the open science spin-offs/starts ups and where they can receive training in how to do this and who they should go to for help and support.

·       Explain to researchers the benefit of collecting and making openly available open science spin-offs/starts to both, them as individuals and the institution, that they trust the process and understand the link to researcher assessment.

·       Explain to researchers the benefit of collecting and making open, open science spin-offs/starts ups that are being created or have being created and the number of employees, products and services these created to both them as individuals and the institution, that they trust the process and understand the link to research assessment.

Training ·       Train researchers in where and how to record the number of open science spin-offs/start ups openly available that are being or have been created.

·       Train researchers in where and how to record the number of open science spin-offs/start-ups employees, products and services.

·       Train researchers in all aspects of Open Science Spin-off/Start-up.

·       Ensure researchers know where to go to receive support in Open Science Spin-off/Start-ups

·       Try to find best practice examples and case studies of Open Science Spin-off/Start ups that researchers can access and draw upon.

Research Assessment Framework (RAF) Purpose

The Research Assessment Framework (RAF) serves as a dynamic tool to reform the evaluation of researchers, encouraging and rewarding Open Science practices in project applications, career development, and progression at Research Performing Organisations (RPOs) and Research Funding Organisations (RFOs). RAF encompasses the entire spectrum of research, education, leadership, and valorisation activities. It is designed to be adaptable across countries, disciplines, and organisations, offering both quantitative and qualitative approaches to implementing indicators.

Privacy Preferences

When you visit our website, it may store information through your browser from specific services, usually in the form of cookies. Our Privacy Policy can be read here.

Here you can change your Privacy preferences. It is worth noting that blocking some types of cookies may impact your experience on our website and the services we are able to offer.

Click to enable/disable Google Analytics tracking code.
Click to enable/disable Google Fonts.
Click to enable/disable Google Maps.
Click to enable/disable video embeds.
Our website uses cookies, mainly from 3rd party services. Define your Privacy Preferences and/or agree to our use of cookies.