OBJECTIVES: Common data elements are a combination of a precisely defined question paired with a specified set of responses. Common data elements contribute to the National Institutes of Health-supported principle of Findable, Accessible, Interoperable, and Reusableness of research data. Routine use of Common data elements and standardized definitions within pediatric critical care research are likely to promote collaboration, improve quality, and consistency of data collection, improve overall efficiency of study or trial setup, and facilitate cross-study comparisons, meta-analysis, and merging of study cohorts. The purpose of this Pediatric Critical Care Medicine Perspective is to establish a road map for the development of multinational, multidisciplinary consensus-based common data elements that could be adapted for use within any pediatric critical care subject area. METHODS: We describe a multistep process for the creation of core domains of research (e.g. patient outcomes, health-related conditions, or aspects of health) and the development of common data elements within each core domain. We define a tiered approach to data collection based on relevance of each common data element to future studies and clinical practice within the field of interest. Additionally, we describe the use of the Delphi methods to achieve consensus of these common data element documents using an international, multidisciplinary panel of experts.

Electronic Health Record (EHR) systems typically define laboratory test results using the Laboratory Observation Identifier Names and Codes (LOINC) and can transmit them using Fast Healthcare Interoperability Resource (FHIR) standards. LOINC has not yet been semantically integrated with computational resources for phenotype analysis. Here, we provide a method for mapping LOINC-encoded laboratory test results transmitted in FHIR standards to Human Phenotype Ontology (HPO) terms. We annotated the medical implications of 2923 commonly used laboratory tests with HPO terms. Using these annotations, our software assesses laboratory test results and converts each result into an HPO term. We validated our approach with EHR data from 15,681 patients with respiratory complaints and identified known biomarkers for asthma. Finally, we provide a freely available SMART on FHIR application that can be used within EHR systems. Our approach allows readily available laboratory tests in EHR to be reused for deep phenotyping and exploits the hierarchical structure of HPO to integrate distinct tests that have comparable medical interpretations for association studies.

Translational research requires data at multiple scales of biological organization. Advancements in sequencing and multi-omics technologies have increased the availability of these data, but researchers face significant integration challenges. Knowledge graphs (KGs) are used to model complex phenomena, and methods exist to construct them automatically. However, tackling complex biomedical integration problems requires flexibility in the way knowledge is modeled. Moreover, existing KG construction methods provide robust tooling at the cost of fixed or limited choices among knowledge representation models. PheKnowLator (Phenotype Knowledge Translator) is a semantic ecosystem for automating the FAIR (Findable, Accessible, Interoperable, and Reusable) construction of ontologically grounded KGs with fully customizable knowledge representation. The ecosystem includes KG construction resources (e.g., data preparation APIs), analysis tools (e.g., SPARQL endpoint resources and abstraction algorithms), and benchmarks (e.g., prebuilt KGs). We evaluated the ecosystem by systematically comparing it to existing open-source KG construction methods and by analyzing its computational performance when used to construct 12 different large-scale KGs. With flexible knowledge representation, PheKnowLator enables fully customizable KGs without compromising performance or usability.

Prior criteria for organ dysfunction in critically ill children were based mainly on expert opinion. We convened the Pediatric Organ Dysfunction Information Update Mandate (PODIUM) expert panel to summarize data characterizing single and multiple organ dysfunction and to derive contemporary criteria for pediatric organ dysfunction. The panel was composed of 88 members representing 47 institutions and 7 countries. We conducted systematic reviews of the literature to derive evidence-based criteria for single organ dysfunction for neurologic, cardiovascular, respiratory, gastrointestinal, acute liver, renal, hematologic, coagulation, endocrine, endothelial, and immune system dysfunction. We searched PubMed and Embase from January 1992 to January 2020. Study identification was accomplished using a combination of medical subject headings terms and keywords related to concepts of pediatric organ dysfunction. Electronic searches were performed by medical librarians. Studies were eligible for inclusion if the authors reported original data collected in critically ill children; evaluated performance characteristics of scoring tools or clinical assessments for organ dysfunction; and assessed a patient-centered, clinically meaningful outcome. Data were abstracted from each included study into an electronic data extraction form. Risk of bias was assessed using the Quality in Prognosis Studies tool. Consensus was achieved for a final set of 43 criteria for pediatric organ dysfunction through iterative voting and discussion. Although the PODIUM criteria for organ dysfunction were limited by available evidence and will require validation, they provide a contemporary foundation for researchers to identify and study single and multiple organ dysfunction in critically ill children.

Objective

Coronavirus disease 2019 (COVID-19) poses societal challenges that require expeditious data and knowledge sharing. Though organizational clinical data are abundant, these are largely inaccessible to outside researchers. Statistical, machine learning, and causal analyses are most successful with large-scale data beyond what is available in any given organization. Here, we introduce the National COVID Cohort Collaborative (N3C), an open science community focused on analyzing patient-level data from many centers.

Materials and methods

The Clinical and Translational Science Award Program and scientific community created N3C to overcome technical, regulatory, policy, and governance barriers to sharing and harmonizing individual-level clinical data. We developed solutions to extract, aggregate, and harmonize data across organizations and data models, and created a secure data enclave to enable efficient, transparent, and reproducible collaborative analytics.

Results

Organized in inclusive workstreams, we created legal agreements and governance for organizations and researchers; data extraction scripts to identify and ingest positive, negative, and possible COVID-19 cases; a data quality assurance and harmonization pipeline to create a single harmonized dataset; population of the secure data enclave with data, machine learning, and statistical analytics tools; dissemination mechanisms; and a synthetic data pilot to democratize data access.

Conclusions

The N3C has demonstrated that a multisite collaborative learning health network can overcome barriers to rapidly build a scalable infrastructure incorporating multiorganizational clinical data for COVID-19 analytics. We expect this effort to save lives by enabling rapid collaboration among clinicians, researchers, and data scientists to identify treatments and specialized care and thereby reduce the immediate and long-term impacts of COVID-19.