The NIST Information Access Division (IAD) initiated a Data Science Research Program (DSRP) aimed to advance the measurement science for big data and data analytics. The goals of the DSRP are to accelerate the research progress on and the development of data analytic methods for greater and more accurate access and understanding of the information contained in multimodal heterogeneous data. Furthermore, the DSRP aims to advance measurement science of data analytics in a general setting, focusing on the use of data analytic algorithms across domains and applications.
The Multimodal Information Group (MIG) supports the DSRP by contributing to the test, evaluation, and benchmarking of emerging big data and data analytic approaches. This includes the development of necessary evaluation infrastructure such as software tools, datasets, metrics, evaluation paradigms, and analysis techniques. Part this evaluation infrastructure is the Data Science Evaluation Series (DSE), which is an evaluation series that provides a framework to evaluate data analytic algorithms in a generalized way.
DARPA XDATA. NIST is supporting the DARPA XDATA program, which aims to develop tools to handle the computational challenges of analyzing large and incomplete data sets. NIST's role in this project is to support XDATA's evaluation of software tools produced through the project. Previous NIST contributions were standardized reports of analytic accuracy and system benchmarking for inclusion in the software documentation. Many of the tools developed from the XDATA project are released through the DARPA Open Catalog.