Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Deep Reinforcement Learning for Edge Service Placement in Softwarized Industrial Cyber-Physical System



Hamid Gharavi


Future industrial cyber-physical system (CPS) devices are expected to request a large amount of delay-sensitive services that need to be processed at the edge of a network. Due to limited resources, service placement at the edge of the cloud has attracted significant attention. Although there are many methods of design schemes, the service placement problem in industrial CPS has not been well studied. Furthermore, none of existing schemes can optimize service placement, workload scheduling and resource allocation under uncertain service demands. To address these issues, we first formulate a joint optimization problem of service placement, workload scheduling, and resource allocation in order to minimize service response delay. We then propose an improved deep Q-network (DQN) based service placement (DSP) algorithm. The proposed algorithm can achieve an optimal resource allocation by means of convex optimization where the service placement and workload scheduling decisions are assisted by means of DQN technology. The experimental results verify that the proposed algorithm, compared with existing algorithms, can reduce the average service response time by 8%-10%.
IEEE Transactions on Industrial Informatics


Terms—Industrial Cyber-Physical system, Service placement, Edge cloud, Deep reinforcement learning


Gharavi, H. (2021), Deep Reinforcement Learning for Edge Service Placement in Softwarized Industrial Cyber-Physical System, IEEE Transactions on Industrial Informatics, [online],, (Accessed June 24, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created May 6, 2021, Updated July 14, 2022