This site will experience a temporary service interruption sometime between Wed 18th & Thurs 19th due to server upgrades, this does not affect the ORCID Registry. Click for more info

Connecting Research and Researchers

You are here: Home / Documentation / Integration Guide / Working with bulk data

Working with bulk data

Contents
1. Download the public data file
2. Software to access the file
3. Process
3.1. Record Summary Files
3.2. Activities file
4. Using the public file

ORCID shares a Public Data File at least annually on the anniversary of our initial launch in October 2012. Sharing the annual public data file is one of our key principles. We release the file to ensure that all stakeholders, including organizations that are not members of ORCID, have broad access to what we hope becomes a vital part of the scholarly communication infrastructure.

Use of data in the file is governed by the data file terms of use and our Privacy Policy (excerpt below):

ORCID is releasing the Public Data File under a CC0 1.0 Public Domain Dedication developed by Creative Commons. Accordingly, ORCID will not impose restrictions or conditions (including those contained in the Terms and Conditions of Use and the Membership Agreement) on use of the Public Data File, but has posted recommended community norms for use.

Download the public data file

Visit the below links to download the annual public data file.

CC0

To the extent possible under law, ORCID, Inc has waived all copyright and related or neighboring rights to ORCID Public Data File. This work is published from: United States.

Software to access the file

  • Windows: A tool to unpack tar files such as Winrar or 7zip
  • Mac: No additional software needed
  • XML-JSON conversion: From 2018, the file is provided only in XML format. Read on to learn how to generate JSON versions of the file.

Process

  1. Download the file from the links above. Each year’s data file may include multiple tar.gz files. For example, the 2018 file includes one tar.gz archive for all ORCID records and one tar.gz archive for all record activities.
  2. Windows: Use the tool (Winrar or 7zip) that you downloaded to unzip the tar.gz file; this will result in a single .tar file (which may appear with no extension). You may be required to run the tool a second time on the .tar file to unpack it.
    Mac:     Double-click the tar.gz file to unzip it; this will result in a single .tar file (which may appear with no extension). Double-click the .tar file to unpack it.
  3. The output folder for each file will differ depending on the year that the file was generated and XSD version.
    1. 2013-2017: Inside the generated folder you will find multiple folders, for example json/ and xml/. Inside each folder is one file for each ORCID record in the specified format and XSD version.
    2. 2018+, records file: Inside the generated folder you will find one folder, summary/, which contains multiple folders containing individual ORCID records in XML format. The records are aggregated into subfolders based on a shared final three digits of the ORCID iD.
    3. 2018+, activity file: Inside the generated folder you will find multiple folders for each ORCID record. Each folder will include the full activities on each ORCID record in XML format, separated by activity subsection.

Record Summary Files

The summaries file is a tar file that contain the public record summaries for all existing ORCID records available at the time ORCID generated the file. The file is a tar file with a root folder ORCID_YYYY_MM_summaries.tar.gz.

The folder hierarchy will be defined by the last three digit of the ORCID iD as per the below image:

Below are examples of the folder structure of some ORCID iD’s:

ORCID iDPath inside dump file
0000-0000-0000-0001/ORCID_2020_10_summaries/001/0000-0000-0000-0001-summary.xml
0000-0000-0000-0002/ORCID_2020_10_summaries/002/0000-0000-0000-0002-summary.xml
0000-0000-0000-001X/ORCID_2020_10_summaries/01X/0000-0000-0000-001X-summary.xml
0000-0000-0001-001X/ORCID_2020_10_summaries/01X/0000-0000-0001-001X-summary.xml
0000-0000-0003-0001/ORCID_2020_10_summaries/001/0000-0000-0003-0001-summary.xml
0001-0000-0003-9991/ORCID_2020_10_summaries/991/0001-0000-0003-9991-summary.xml
0001-0000-0005-1234/ORCID_2020_10_summaries/234/0001-0000-0005-1234-summary.xml
9999-9999-9999-9991/ORCID_2020_10_summaries/991/9999-9999-9999-9991-summary.xml

Below are examples of how the folder hierarchy will look inside the dump file:

Activities file

The activities file is composed of eleven different compressed files, each one containing a subset of the public activities available at the time of generating the files.

Each compressed file will contain a subset of public activities based on the last 3 digits of the ORCID iD.

For example, there will be a file ORCID_YYYY_MM_activities.tar.gz containing the public activities for every ORCID record where the checksum digit is 0.

Using the public file

The file contains the public information associated with each user’s ORCID record. Each record is included as a separate file in both JSON and XML in the 2013-2017 files. In the 2018 file, each record is included as a separate file in XML, and each full activity section for each record is included as a separate file in XML. For those who prefer JSON, use the ORCID Conversion Library to convert the XML files to JSON.

For the XSD required to interpret the files, see the ORCID GitHub repository.

Please see Syncronizing with ORCID on ways you can develop your integration to enable you to keep track of researchers and their activities.