Combining Spatial Optimization and Multi-Agent Temporal Difference Learning for Task Assignment in Uncertain Crowdsourci
- PDF / 4,931,790 Bytes
- 19 Pages / 595.224 x 790.955 pts Page_size
- 97 Downloads / 186 Views
Combining Spatial Optimization and Multi-Agent Temporal Difference Learning for Task Assignment in Uncertain Crowdsourcing Yong Sun1,2 · Wenan Tan1 © Springer Science+Business Media, LLC, part of Springer Nature 2019
Abstract In recent years, spatial crowdsourcing has emerged as an important new framework, in which each spatial task requires a set of right crowd-workers in the near vicinity to the target locations. Previous studies have focused on spatial task assignment in the static crowdsourcing environment. These algorithms may achieve local optimality by neglecting the uncertain features inherent in real-world crowdsourcing environments, where workers may join or leave during run time. Moreover, spatial task assignment is more complicated when large-scale crowd-workers exist in crowdsourcing environments. The large-scale nature of task assignments poses a significant challenge to uncertain spatial crowdsourcing. In this paper, we propose a novel algorithm combining spatial optimization and multi-agent temporal difference learning (SMATDL). The combination of grid-based optimization and multi-agent learning can achieve higher adaptability and maintain greater efficiency than traditional learning algorithms in the face of large-scale crowdsourcing problems. The SMATDL algorithm decomposes the uncertain crowdsourcing problem into numerous sub-problems by means of a grid-based optimization approach. In order to adapt to the change in the large-scale environment, each agent utilizes temporal difference learning to handle its own spatial region optimization in online crowdsourcing. As a result, multiple agents in SMATDL collaboratively learn to optimize their efforts in accomplishing the global assignment problems efficiently. Through extensive experiments, we illustrate the effectiveness and efficiency of our proposed algorithms on the experimental data sets. Keywords Dynamic task assignment · Online learning · Reinforcement learning · Spatial optimization · Crowdsourcing applications
1 Introduction With the advancing technology of smartphones and wireless networks (Xu et al. 2014; Li et al. 2015, 2018), spatial crowdsourcing has recently emerged as a novel framework in numerous intelligent systems (Xiong et al. 2017; Kazemi
Yong Sun
[email protected] Wenan Tan [email protected] 1
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 210016, China
2
Anhui Engineering Laboratory of Geoinformation Smart Sensing and Services, Chuzhou University, Chuzhou, Anhui 239000, China
et al. 2013; Deng et al. 2016). Spatial crowdsourcing employs crowd-workers in the act of performing spatial tasks (Tran et al. 2018). In typical spatial crowdsourcing, the goal is to assign a set of spatial tasks to a large group of crowd-workers located within their time zone (Deng et al. 2016). Assigning tasks in spatial crowdsourcing requires the consideration of many complicated factors in identifying a crowd of workers (Guo et al. 2018). The success of spatial crowdsourcing
Data Loading...
