Ye was born in Shanghai, China, and earned a bachelor's degree in physics at Shanghai Jiao Tong University. In 1989 he moved to the United States and later received his Ph.D. in physics from the University of Colorado, Boulder. He is a Fellow of both NIST and JILA, a joint institute of NIST and the University of Colorado, Boulder.