Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.


The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Reinforcement Learning-Based Control and Networking Co-design for Industrial Internet of Things



Hansong Xu, Xing Liu, Wei Yu, David W. Griffith, Nada T. Golmie


Industrial Internet-of-Things (I-IoT), also known as Industry 4.0, is the integration of Internet of Things (IoT) technology into the industrial manufacturing system so that the connectivity, efficiency, and intelligence of factories and plants can be largely improved. From a cyber physical system (CPS) perspective, there are several cyber systems that are synthesized into I-IoT systems interactively towards achieving the design goals, including control, networking, and computing systems. The interactions among different systems is a non- negligible factor that affects the I-IoT design and I-IoT requirements, such as automation, especially under dynamic industrial operations. In this paper, we leverage reinforcement learning techniques to automatically configure the control and networking systems under a dynamic industrial environment. We design three new policies based on the characteristics of industrial systems so that the reinforcement learning can converge rapidly. We implement and integrate the reinforcement learning-based co-design approach on a realistic wireless cyber- physical simulator to conduct extensive experiments. Our experimental results demonstrate that our approach can effectively reconfigure the control and networking systems automatically in a dynamic industrial environment.
IEEE Journal on Selected Areas in Communications
Created March 24, 2020, Updated June 1, 2020