A Flexible Client-Driven 3DTV System for Real-Time Acquisition, Transmission, and Display of Dynamic Scenes
- PDF / 8,641,791 Bytes
- 15 Pages / 600.05 x 792 pts Page_size
- 69 Downloads / 157 Views
Research Article A Flexible Client-Driven 3DTV System for Real-Time Acquisition, Transmission, and Display of Dynamic Scenes Xun Cao,1, 2 Yebin Liu,1, 2 and Qionghai Dai1, 2 1 Broadband 2 Tsinghua
Networks & Digital Media Lab, Tsinghua University, Beijing 100084, China National Laboratory for Information Science and Technology (TNList), Beijing 100084, China
Correspondence should be addressed to Xun Cao, [email protected] Received 1 October 2007; Revised 4 February 2008; Accepted 19 May 2008 Recommended by G. Triantafyllidis 3D experience and free-viewpoint navigation are expected to be two essential features of next generation television. In this paper, we present a flexible 3DTV system in which multiview video streams are captured, compressed, transmitted, and finally converted to high-quality 3D video in real time. Our system consists of an 8 × 8 camera array, 16 producer PCs, a streaming server, multiple clients, and several autostereoscopic displays. The whole system is implemented over IP network to provide multiple users with interactive 2D/3D switching, viewpoint control, and synthesis for dynamic scenes. In our approach, multiple video streams are first captured by a synchronized camera array. Then, we adopt a lengthened-B-field and region of interest- (ROI-) based coding scheme to guarantee a seamless view switching for each user as well as saving per-user transmission bandwidth. Finally, a convenient rendering algorithm is used to synthesize a visually pleasing result by introducing a new metric called Clarity Degree (CD). Experiments on both synthetic and real-world data have verified the feasibility, flexibility, and good performance of our system. Copyright © 2009 Xun Cao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
1. Introduction Television has greatly changed our life since its invention as early as 1920s [1]. After the era of analog TV, digital TV has become more and more popular as a revolution because of its high-quality viewing experience. However, even with high-resolution digital TV services, the observers can only watch 2D video passively. Consequently, we believe the next generation TV must have two properties: 3D effect and the ability to control the viewpoint interactively (freeviewpoint). Although stereoscopic 3D viewing techniques are almost as old as their 2D counterparts, until recent years all the conditions have enabled researchers to implement a real-time practical 3DTV system, which includes capturing and representation of dynamic scenes, compression and transmission of the data, and rendering and display on 3D devices. Researches towards a 3DTV system started with the development of binocular stereo cameras and stereo TV just after the Tokyo Olympic Games [2]. NHK-STRL reported a stereoscopic 3D-HDTV system in 1999 [3], “sensation of reality” is mentioned by increasing spatial resolution and widening the
Data Loading...
