ORCID Global Participation Fund – Overview of Evaluation Rubric
An evaluation rubric is an important tool to ensure consistency and transparency related to the selection of proposals awarded funding. The best rubrics are instrumental for articulating what excellence is, what traits in a proposal are the most important, and to help to remove the potential for bias by making criteria more objective. We have created a detailed rubric which we will use to evaluate grant proposals. This document gives an overview of the seven criteria which our evaluations will be based on.
How will the Grant Proposal be Evaluated?
As with any grant program, we seek to identify and award proposals that are likely to have the most effective impact on the Fund’s objectives in the most efficient way. As a result, preference will be given to proposals with demonstrated ability to:
- Provide effective impact most efficiently.
- Deliver impact to multiple Fund objectives.
- Target communities that are less well represented in the ORCID membership/user base, i.e. those in the Focus Communities (see below)
The Fund’s Evaluation Group consists of ORCID staff and members of the ORCID community and will evaluate all proposals submitted by the submission deadline as outlined in the call for proposals. Each proposal will be read and evaluated by at least two people according to the set rubric based on the criteria outlined below. We expect to provide feedback on each proposal.
|Criterion||Explanation of criterion|
|Benefits the Focus Communities||Proposals will be evaluated on how they will benefit the Focus Communities, regardless of the geographical location of the organization that submits the proposal. Focus Communities are the set of countries with low- and lower-middle-income (LLMIC) economies (as designated by the World Bank), particularly in the Global South where ORCID participation to date has been low.|
|Supports local partners||Proposals will be evaluated on their plan to meaningfully engage with local partners in the Focus Communities based on already existing relationships or knowledge of how to build these relationships in order to receive support, feedback, input, and insight to contribute to the program objectives. The proposals must show how they will ultimately benefit the Focus Communities.|
|Program completeness/ justification||Proposals will be evaluated on how clearly they explain the problem statement and the approach in how they plan to address the specific needs of the community while feeding into the overall program objectives.|
|Feasibility||Proposals will be evaluated on how the proposed personnel, resources, proposed activities and the timeline tie in with the project description and outcomes. Specifically for the technical integration proposals, these will be evaluated on how the proposed tools and approaches are consistent with technical best practices and modern tooling. This will include the level of significant experience with APIs, technical infrastructure and DevOps, and understanding of the technology required to integrate ORCID with the target tool.|
|Relationship to the organization’s mission/goals||Proposals will be evaluated on their alignment with the potential grantee’s mission, vision, and goals as well as with that of the community it is designed to serve.|
|Use of resources/approach efficiency||Proposals will be evaluated on how well they fit with local contexts, and whether the project plan leverages or contributes to existing programs, infrastructure, capabilities, or precedents. The aspect of scalability and replicability will also be evaluated.|
|Sustainability||Proposals will be evaluated on how they plan to maintain impact locally beyond the grant period, with an inclination towards proposals that demonstrate how they will ensure continued or increased use of ORCID and/or support for any technical integration beyond the grant period.|