Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

A New International Data Science Program

Published

Author(s)

Bonnie J. Dorr, Craig Greenberg, Peter Fontana, Mark A. Przybocki, Marion Le Bras, Cathryn A. Ploehn, Oleg Aulov, Wo L. Chang

Abstract

This article sets out to examine foundational issues in data science including current challenges, basic research questions, and expected advances, as the basis for a new Data Science Research Program and associated Data Science Evaluation (DSE) series, introduced by the National Institute of Standards and Technology (NIST) in the fall of 2015. The DSE series aims to address logistical and evaluation design challenges while providing rigorous measurement methods and an emphasis on generalizability rather than domain and application-specific approaches. Toward that end, each year the DSE will consist of multiple research tracks and will encourage the application of tasks that span multiple tracks. The evaluations are intended to facilitate research efforts, collaboration, leverage shared infrastructure, and effectively address cross-cutting challenges faced by diverse data science communities. Multiple research tracks will be championed by members of the data science community with the goal of enabling rigorous comparison of approaches through common tasks, datasets, metrics, and shared research challenges. The tracks will measure several different data science technologies in a wide range of fields will address computing infrastructure, standards for an interoperability framework, and domain-specific examples. This article also summarizes lessons learned from the Data Science Evaluation Series Pre-Pilot that was held in fall of 2015.
Citation
Journal of Database Management

Keywords

Data Science Evaluation Series, Data Science Standards, Data Science Metrics, Data Science Measurements

Citation

Dorr, B. , Greenberg, C. , Fontana, P. , Przybocki, M. , Le Bras, M. , Ploehn, C. , Aulov, O. and Chang, W. (2016), A New International Data Science Program, Journal of Database Management, [online], https://doi.org/10.1007/s41060-016-0016-z (Accessed December 1, 2021)
Created August 3, 2016, Updated October 12, 2021