Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Influence of Data Analysis and Other Factors on the Short-term Stability of Vertical Scanning-Probe Microscope Calibration Measurements



H Edwards, J Jorgensen, John A. Dagata, Y Strausser, J Schneir


We report a study of a fundamental limit to the accuracy of vertical measurements made using scanning-probe microscopes (SPM): the short-term stability of a vertical calibration using a waffle-pattern artifact. To test the instrumental component of this stability, we acquired three data series, at different humidity levels. We compare the variations in waffle-pattern depth in these three data series with the differences in depth estimates using several different analysis methods. The three methods tested are: a histogram method, the scanning-probe image processor, and the polynomial step-function fit. To clarify the importance of the analysis method, a discussion of the different leveling, averaging, and depth-estimation aspects of the various methods is presented. To understand the true repeatability limit of SPM calibration, it is necessary to treat imaging artifacts such as tilt, nonlinearities, and image bow carefully. We find that, when such care is taken, the dependence of the average waffle-cell depth on algorithm is around 0.1%. This is less than the standard deviation of the step-height estimates of around 0.5%, which may be attributed to short-term instrumental variations in vertical SPM calibration. This is a far better stability than the 5%-10% variations observed under long-term aging of the piezo scanner. However, the histogram algorithm, which does not correct image bow, gives an average waffle-cell depth estimate which is nearly 1% higher than the others, indicating that careful image analysis is necessary if the measurement accuracy is to be comparable to the short-term stability of the piezo scanner.
Journal of Vacuum Science and Technology B


Edwards, H. , Jorgensen, J. , Dagata, J. , Strausser, Y. and Schneir, J. (1998), Influence of Data Analysis and Other Factors on the Short-term Stability of Vertical Scanning-Probe Microscope Calibration Measurements, Journal of Vacuum Science and Technology B (Accessed May 19, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created February 28, 1998, Updated October 12, 2021