Adaptive Image Synthesis for Compressive Displays

Felix Heide Gordon Wetzstein Ramesh Raskar Wolfgang Heidrich

University of British Columbia - Imager Laboratory

MIT Media Lab - Camera Culture Group

SIGGRAPH 2013. ACM Transactions on Graphics 32(4).


Figure 1: Adaptive light field synthesis for a dual-layer compressive display. By combining sampling, rendering, and display-specific optimization into a single framework, the proposed algorithm facilitates light field synthesis with significantly reduced computational resources. Redundancy in the light field as well as limitations of display hardware are exploited to generate high-quality reconstructions (center left column) for a high-resolution target light field of 85x21 views with 840x525 pixels each (center). Our adaptive econstruction uses only 3.82% of the rays in the full target light field (left column), thus providing significant savings both during rendering and during the computation of the display parameters. The proposed framework allows for higher-resolution light fields, better 3D effects, and perceptually correct animations to be presented on emerging compressive displays (right columns).

Image credit: UBC, Imager Laboratory; MIT Media Lab, Camera Culture Group

Abstract

Recent years have seen proposals for exciting new computational display technologies that are compressive in the sense that they generate high resolution images or light fields with relatively few display parameters. Image synthesis for these types of displays involves two major tasks: sampling and rendering high-dimensional target imagery, such as light fields or time-varying light fields, as well as optimizing the display parameters to provide a good approximation of the target content. In this paper, we introduce an adaptive optimization framework for compressive displays that generates high quality images and light fields using only a fraction of the total plenoptic samples. We demonstrate the framework for a large set of display technologies, including several types of auto-stereoscopic displays, high dynamic range displays, and high-resolution displays. We achieve significant performance gains, and in some cases are able to process data that would be infeasible with existing methods.

Project Sites

Citation

F. Heide, G. Wetzstein, R. Raskar, W. Heidrich. Adaptive Image Synthesis for Compressive Displays. Proc. of SIGGRAPH 2013 (ACM Transactions on Graphics 32, 4), 2013.

BibTeX
@article{Heide:2013:AdaptiveImageSynthesis,
author = {F. Heide and G. Wetzstein and R. Raskar and W. Heidrich},
title = {{Adaptive Image Synthesis for Compressive Displays}},
journal = {ACM Trans. Graph. (Proc. SIGGRAPH)},
volume = {32},
number = {4},
year = {2013},
publisher = {ACM},
pages = {1--11},
address = {New York, NY, USA}
}