Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Benchmarking Active Learning Strategies for Materials Optimization and Discovery

Published

Author(s)

Alex Wang, Haotong Liang, Austin McDannald, Ichiro Takeuchi, A. Gilad Kusne

Abstract

Autonomous physical science is revolutionizing materials science. In these systems, machine learning (ML) controls experiment design, execution and analysis in a closed loop. Active learning, the ML field of optimal experiment design, selects each subsequent experiment to maximize knowledge toward the user goal. Autonomous system performance can be further improved with the implementation of scientific ML, also known as inductive bias-engineered artificial intelligence, which folds prior knowledge of physical laws (e.g. Gibbs phase rule) into the algorithm. As the number, diversity and uses for active learning strategies grow, there is an associated growing necessity for real-world reference datasets to benchmark strategies. We present a reference dataset and demonstrate its use to benchmark active learning strategies in the form of various acquisition functions. Active learning strategies are used to rapidly identify materials with optimal physical properties within a compositional phase diagram mapping a ternary materials system. The data are from an actual Fe-Co-Ni thin-film library and include previously acquired experimental data for materials compositions, X-ray diffraction patterns and two functional properties of magnetic coercivity and the Kerr rotation. Popular active learning methods along with a recent scientific active learning method are benchmarked for their materials optimization performance. Among the acquisition functions benchmarked, Expected Improvement demonstrated the best overall performance. We discuss the relationship between algorithm performance, materials search space complexity and the incorporation of prior knowledge, and we encourage benchmarking more and novel active learning schemes.
Citation
npj Computational Materials

Keywords

machine learning, active learning, reference dataset

Citation

Wang, A. , Liang, H. , McDannald, A. , Takeuchi, I. and Kusne, A. (2022), Benchmarking Active Learning Strategies for Materials Optimization and Discovery, npj Computational Materials, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=934371 (Accessed June 21, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created July 9, 2022, Updated November 29, 2022