3D computational modeling and perceptual analysis of kinetic depth effects

  • PDF / 2,798,350 Bytes
  • 13 Pages / 612 x 808 pts Page_size
  • 72 Downloads / 197 Views

DOWNLOAD

REPORT


3D computational modeling and perceptual analysis of kinetic depth effects Meng-Yao Cui1 , Shao-Ping Lu1 ( ), Miao Wang2 , Yong-Liang Yang3 , Yu-Kun Lai4 , and Paul L. Rosin4 c The Author(s) 2020. 

Abstract Humans have the ability to perceive kinetic depth effects, i.e., to perceived 3D shapes from 2D projections of rotating 3D objects. This process is based on a variety of visual cues such as lighting and shading effects. However, when such cues are weak or missing, perception can become faulty, as demonstrated by the famous silhouette illusion example of the spinning dancer. Inspired by this, we establish objective and subjective evaluation models of rotated 3D objects by taking their projected 2D images as input. We investigate five different cues: ambient luminance, shading, rotation speed, perspective, and color difference between the objects and background. In the objective evaluation model, we first apply 3D reconstruction algorithms to obtain an objective reconstruction quality metric, and then use quadratic stepwise regression analysis to determine weights of depth cues to represent the reconstruction quality. In the subjective evaluation model, we use a comprehensive user study to reveal correlations with reaction time and accuracy, rotation speed, and perspective. The two evaluation models are generally consistent, and potentially of benefit to inter-disciplinary research into visual perception and 3D reconstruction.

1

Introduction

Mechanisms of human perception of the 3D world have long been studied. In the early 17th century, artists developed a whole system of stimuli of monocular depth perception based especially on shading and transparency [1]. Loss of stimuli related to depth perception leads to a variety of visual illusions, such as the Pulfrich effect [2]. Here, with a dark filter on the right eye, dots moving to the right seem to be closer to participants than dots moving to the left, even though all the dots are actually at the same distance. This is caused by slower human perception of darker objects. When a 3D object is rotating around a fixed axis, humans are capable of perceiving the shape of the object from its 2D projections. This is called the kinetic depth effect [4]. However, when there is no light above the object, humans can only perceive partial 3D information from the varying silhouette of the kinetic object over time, which easily leads to ambiguous understanding of the 3D object. One typical example of this phenomenon is the spinning dancer [3, 5] (see Fig. 1 for sample frames). The

Keywords kinetic depth effects; 3D reconstruction; perceptual factor analysis

1 TKLNDST, CS, Nankai University, Tianjin, China. E-mail: M.-Y. Cui, [email protected]; S.-P. Lu, [email protected] ( ). 2 State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China. 3 Department of Computer Science, University of Bath, UK. 4 School of Computer Science and Informatics, Cardiff University, Wales, UK. Manuscript received: 2020-04-01; accepted: 2020-05-08

Fig. 1 3 of 34 f