NIST logo

Publication Citation: Predicting Macroscopic Dynamics in Large Distributed Systems

NIST Authors in Bold

Author(s): Kevin L. Mills; James J. Filliben;
Title: Predicting Macroscopic Dynamics in Large Distributed Systems
Published: July 18, 2011
Abstract: In this paper, we outline an approach that can be used to predict macroscopic dynamics when new components are deployed in a large distributed system. Our approach combines two main methods: scale reduction and multidimensional data analysis techniques. Combining these methods, we can search a wide parameter space to identify factors likely to drive global system response and we can predict the resulting macroscopic dynamics of key system behaviors. We demonstrate our approach in the context of the Internet, where researchers, motivated by a desire to increase user performance, have proposed new algorithms to replace the standard congestion control mechanism. Previously, the proposed algorithms were studied in three ways: using analytical models of single data flows, using empirical measurements in test beds where a few data flows compete for bandwidth, and using simulations at modest scale with a few sequentially varied parameters. In contrast, by applying our approach, we simulated configurations covering four-tier network topologies, spanning continental and global distances,comprising routers operating at state-of-the-art speeds and transporting more than 105 simultaneous data flows with varying traffic patterns and temporary spatiotemporal congestion. Our findings identify the main factors influencing macroscopic dynamics of Internet congestion control, and define the specific combination of factors that must hold for users to realize improved performance. We also uncover potential for one proposed algorithm to cause widespread performance degradation. Previous engineering studies of the proposed congestion control algorithms were unable to reveal such essential information.
Conference: Symposium on Risk-Informed, Online Monitoring, Modeling and Operation of Aging Systems
Proceedings: Proceedings of ASME 2011 PVP
Location: Baltimore, MD
Dates: July 18-19, 2011
Keywords: complex systems, mathematical modeling
Research Areas: Modeling
PDF version: PDF Document Click here to retrieve PDF version of paper (1MB)