Emotional computing based on cross-modal fusion and edge network data incentive

  • PDF / 932,631 Bytes
  • 10 Pages / 595.276 x 790.866 pts Page_size
  • 60 Downloads / 167 Views

DOWNLOAD

REPORT


ORIGINAL ARTICLE

Emotional computing based on cross-modal fusion and edge network data incentive Lei Ma 1 & Feng Ju 1 & Jing Wan 2 & Xiaoyan Shen 1 Received: 31 January 2019 / Accepted: 4 May 2019 # Springer-Verlag London Ltd., part of Springer Nature 2019

Abstract In large-scale emotional events and complex emotional recognition applications, how to improve the recognition accuracy, computing efficiency, and user experience quality becomes the first problem to be solved. Aiming at the above problems, this paper proposes an emotional computing algorithm based on cross-modal fusion and edge network data incentive. In order to improve the efficiency of emotional data collection and the accuracy of emotional recognition, deep cross-modal fusion can capture the semantic deviation between multi-modal and design fusion methods through non-linear cross-layer mapping. In this paper, a deep fusion cross-modal data fusion method is designed. In order to improve the computational efficiency and user experience quality, a data incentive algorithm for edge network is designed in this paper, based on the overlapping delay gaps and incentive weights of large data collection and error detection. Finally, the edge network is mapped to a finite data set space from the set of emotional data elements inspired by heterogeneous emotional events. In this space, all emotional events and emotional data elements are balanced. In this paper, an emotional computing algorithm based on cross-modal data fusion is designed. The results of simulation experiments and theoretical analysis show that the proposed algorithm is superior to the edge network data incentive algorithm and the cross-modal data fusion algorithm in recognition accuracy, complex emotion recognition efficiency, and computation efficiency and delay. Keywords Emotional computing . Cross-modal fusion . Edge network . Data incentive . Emotional recognition

1 Introduction Intelligent terminals and centralized servers are equipped with software and hardware devices [1, 2] that can observe, understand, and generate various emotional features and have the

* Xiaoyan Shen [email protected] Lei Ma [email protected] Feng Ju [email protected] Jing Wan [email protected] 1

School of Information Science and Technology, Nantong University, Nantong 226019, Jiangsu, China

2

Nantong Rail Transit Co. LTD, Nantong 226019, Jiangsu, China

ability of emotional computing [3]. By designing an emotional computing algorithm, we can create a system capable of edge perception, real-time recognition, and intelligent understanding [4] of emotions. The system can quickly make accurate, reliable, and friendly responses to dynamic and random emotional events. At present, the research [5] of emotional computing mainly includes emotional mechanism reasoning, emotional data collection, emotional recognition, emotional network modeling, and human-computer communication. However, the research on emotional computing mainly focuses on the acquisition and forwarding of emotional signals, ignoring the networked man