A deep reinforcement learning-based algorithm for reliability-aware multi-domain service deployment in smart ecosystems
- PDF / 3,820,991 Bytes
- 23 Pages / 595.276 x 790.866 pts Page_size
- 5 Downloads / 245 Views
(0123456789().,-volV)(0123456789().,-volV)
S.I. : DEEP NEURO-FUZZY ANALYTICS IN SMART ECOSYSTEMS
A deep reinforcement learning-based algorithm for reliability-aware multi-domain service deployment in smart ecosystems Godfrey Kibalya1
•
Joan Serrat1 • Juan-Luis Gorricho1 • Dorothy Okello2 • Peiying Zhang3
Received: 1 July 2020 / Accepted: 18 September 2020 Springer-Verlag London Ltd., part of Springer Nature 2020
Abstract The transition towards full network virtualization will see services for smart ecosystems including smart metering, healthcare and transportation among others, being deployed as Service Function Chains (SFCs) comprised of an ordered set of virtual network functions. However, since such services are usually deployed in remote cloud networks, the SFCs may transcend multiple domains belonging to different Infrastructure Providers (InPs), possibly with differing policies regarding billing and Quality-of-service (QoS) guarantees. Therefore, efficiently allocating the exhaustible network resources to the different SFCs while meeting the stringent requirements of the services such as delay and QoS among others, remains a complex challenge, especially under limited information disclosure by the InPs. In this work, we formulate the SFC deployment problem across multiple domains focusing on delay constraints, and propose a framework for SFC orchestration which adheres to the privacy requirements of the InPs. Then, we propose a reinforcement learning (RL)-based algorithm for partitioning the SFC request across the different InPs while considering service reliability across the participating InPs. Such RL-based algorithms have the intelligence to infer undisclosed InP information from historical data obtained from past experiences. Simulation results, considering both online and offline scenarios, reveal that the proposed algorithm results in up to 10% improvement in terms of acceptance ratio and provisioning cost compared to the benchmark algorithms, with up to more than 90% saving in execution time for large networks. In addition, the paper proposes an enhancement to a state-of-the-art algorithm which results in up to 5% improvement in terms of provisioning cost. Keywords Multi-domain orchestration Service function chaining Service reliability QoS embedding Multi-attribute embedding
1 Introduction
& Godfrey Kibalya [email protected] & Peiying Zhang [email protected] 1
Department of Network Engineering, Universitat Politecnica de Catalunya, C/ Jordi Girona, 1-3 - Edif.C3 - Campus Nord, 08034 Barcelona, Spain
2
Department of Electrical and Computer Engineering, Makerere University, Kampala, Uganda
3
College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, People’s Republic of China
In traditional networks, network functions such as firewalls and proxies are implemented by middle-boxes coupled with the hardware [1, 2]. This limits the service delivery of those networks and inhibits the infrastructure providers from optima
Data Loading...
