A method of displaying stereoscopic images without the use of special headgear or glasses
Comparison of parallax-barrier and lenticular autostereoscopic displays. Note: The figure is not to scale. Note also: Without optic nerves, the disembodied eyes in the figure would not perceive an image
Autostereoscopy is any method of displaying stereoscopic images (adding binocular perception of 3D depth) without the use of special headgear, glasses, something that affects vision, or anything for eyes on the part of the viewer. Because headgear is not required, it is also called "glasses-free 3D" or "glassesless 3D".
There are two broad approaches currently used to accommodate motion parallax and wider viewing angles: eye-tracking, and multiple views so that the display does not need to sense where the viewer's eyes are located.[1] Examples of autostereoscopic displays technology include lenticular lens, parallax barrier, and integral imaging. Volumetric and holographic displays are also autostereoscopic, as they produce a different image to each eye,[2] although some do make a distinction between those types of displays that create a vergence-accommodation conflict and those that do not.[3]
Autostereoscopic displays based on parallax barrier and lenticular methodologies have been known for about 100 years.[4]
Technology
Many organizations have developed autostereoscopic 3D displays, ranging from experimental displays in university departments to commercial products, and using a range of different technologies.[5]
The method of creating autostereoscopic flat panel video displays using lenses was mainly developed in 1985 by Reinhard Boerner at the Heinrich Hertz Institute (HHI) in Berlin.[6]
Prototypes of single-viewer displays were already being presented in the 1990s, by Sega AM3 (Floating Image System)[7] and the HHI. Nowadays, this technology has been developed further mainly by European and Japanese companies.
One of the best-known 3D displays developed by HHI was the Free2C, a display with very high resolution and very good comfort achieved by an eye tracking system and a seamless mechanical adjustment of the lenses.
Eye tracking has been used in a variety of systems in order to limit the number of displayed views to just two, or to enlarge the stereoscopic sweet spot. However, as this limits the display to a single viewer, it is not favored for consumer products.
Currently, most flat-panel displays employ lenticular lenses or parallax barriers that redirect imagery to several viewing regions; however, this manipulation requires reduced image resolutions. When the viewer's head is in a certain position, a different image is seen with each eye, giving a convincing illusion of 3D. Such displays can have multiple viewing zones, thereby allowing multiple users to view the image at the same time, though they may also exhibit dead zones where only a non-stereoscopic or pseudoscopic image can be seen, if at all.
Parallax barrier
The Nintendo 3DSvideo game console family uses a parallax barrier for 3D imagery. On a newer revision, the New Nintendo 3DS, this is combined with an eye tracking system to allow for wider viewing angles.
A parallax barrier is a device placed in front of an image source, such as a liquid crystal display, to allow it to show a stereoscopic image or multiscopic image without the need for the viewer to wear 3D glasses. The principle of the parallax barrier was independently invented by Auguste Berthier, who published first but produced no practical results,[8] and by Frederic E. Ives, who made and exhibited the first known functional autostereoscopic image in 1901.[9] About two years later, Ives began selling specimen images as novelties, the first known commercial use.
In the early 2000s, Sharp developed the electronic flat-panel application of this old technology to commercialization, briefly selling two laptops with the world's only 3D LCD screens.[10] These displays are no longer available from Sharp but are still being manufactured and further developed from other companies. Similarly, Hitachi has released the first 3D mobile phone for the Japanese market under distribution by KDDI.[11][12] In 2009, Fujifilm released the FinePix Real 3D W1 digital camera, which features a built-in autostereoscopic LCD measuring 2.8 in (71 mm) diagonal. The Nintendo 3DSvideo game console family uses a parallax barrier for 3D imagery. On a newer revision, the New Nintendo 3DS, this is combined with an eye tracking system to allow for wider viewing angles.
The principle of integral photography, which uses a two-dimensional (X–Y) array of many small lenses to capture a 3-D scene, was introduced by Gabriel Lippmann in 1908.[13][14] Integral photography is capable of creating window-like autostereoscopic displays that reproduce objects and scenes life-size, with full parallax and perspective shift and even the depth cue of accommodation, but the full realization of this potential requires a very large number of very small high-quality optical systems and very high bandwidth. Only relatively crude photographic and video implementations have yet been produced.
One-dimensional arrays of cylindrical lenses were patented by Walter Hess in 1912.[15] By replacing the line and space pairs in a simple parallax barrier with tiny cylindrical lenses, Hess avoided the light loss that dimmed images viewed by transmitted light and that made prints on paper unacceptably dark.[16] An additional benefit is that the position of the observer is less restricted, as the substitution of lenses is geometrically equivalent to narrowing the spaces in a line-and-space barrier.
Philips solved a significant problem with electronic displays in the mid-1990s by slanting the cylindrical lenses with respect to the underlying pixel grid.[17] Based on this idea, Philips produced its WOWvx line until 2009, running up to 2160p (a resolution of 3840×2160 pixels) with 46 viewing angles.[18]Lenny Lipton's company, StereoGraphics, produced displays based on the same idea, citing a much earlier patent for the slanted lenticulars. Magnetic3d and Zero Creative have also been involved.[19]
Compressive light field displays
With rapid advances in optical fabrication, digital processing power, and computational models for human perception, a new generation of display technology is emerging: compressive light field displays. These architectures explore the co-design of optical elements and compressive computation while taking particular characteristics of the human visual system into account. Compressive display designs include dual[20] and multilayer[21][22][23] devices that are driven by algorithms such as computed tomography and non-negative matrix factorization and non-negative tensor factorization.
Autostereoscopic content creation and conversion
Tools for the instant conversion of existing 3D movies to autostereoscopic were demonstrated by Dolby, Stereolabs and Viva3D.[24][25][26]
Other
Dimension Technologies released a range of commercially available 2D/3D switchable LCDs in 2002 using a combination of parallax barriers and lenticular lenses.[27][28]SeeReal Technologies has developed a holographic display based on eye tracking.[29] CubicVue exhibited a color filter pattern autostereoscopic display at the Consumer Electronics Association's i-Stage competition in 2009.[30][31]
There are a variety of other autostereo systems as well, such as volumetric display, in which the reconstructed light field occupies a true volume of space, and integral imaging, which uses a fly's-eye lens array.
The term automultiscopic display has been introduced as a shorter synonym for the lengthy "multi-view autostereoscopic 3D display",[32] as well as for the earlier, more specific "parallax panoramagram". The latter term originally indicated a continuous sampling along a horizontal line of viewpoints, e.g., image capture using a very large lens or a moving camera and a shifting barrier screen, but it later came to include synthesis from a relatively large number of discrete views.
Sunny Ocean Studios, located in Singapore, has been credited with developing an automultiscopic screen that can display autostereo 3D images from 64 different reference points.[33]
A fundamentally new approach to autostereoscopy called HR3D has been developed by researchers from MIT's Media Lab. It would consume half as much power, doubling the battery life if used with devices like the Nintendo 3DS, without compromising screen brightness or resolution; other advantages include a larger viewing angle and maintaining the 3D effect when the screen is rotated.[34]
Movement parallax: single view vs. multi-view systems
Movement parallax refers to the fact that the view of a scene changes with movement of the head. Thus, different images of the scene are seen as the head is moved from left to right, and from up to down.
Many autostereoscopic displays are single-view displays and are thus not capable of reproducing the sense of movement parallax, except for a single viewer in systems capable of eye tracking.
Some autostereoscopic displays, however, are multi-view displays, and are thus capable of providing the perception of left–right movement parallax.[35]
Eight and sixteen views are typical for such displays. While it is theoretically possible to simulate the perception of up–down movement parallax, no current display systems are known to do so, and the up–down effect is widely seen as less important than left–right movement parallax. One consequence of not including parallax about both axes becomes more evident as objects increasingly distant from the plane of the display are presented: as the viewer moves closer to or farther away from the display, such objects will more obviously exhibit the effects of perspective shift about one axis but not the other, appearing variously stretched or squashed to a viewer not positioned at the optimal distance from the display.[citation needed]
^Holliman, N. S., Dodgson, N. A., Favalora, G. E., & Pockett, L. (2011). Three-dimensional displays: a review and applications analysis. IEEE transactions on Broadcasting57(2), 362-371.
^Lippmann, G. (2 March 1908). "Épreuves réversibles. Photographies intégrales". Comptes Rendus de l'Académie des Sciences. 146 (9): 446–451. Bibcode:1908BSBA...13A.245D. Reprinted in Benton "Selected Papers on Three-Dimensional Displays"
^Frédo Durand; MIT CSAIL. "Reversible Prints. Integral Photographs"(PDF). Retrieved 17 February 2011. (This crude English translation of Lippmann's 1908 paper will be more comprehensible if the reader bears in mind that "dark room" and "darkroom" are the translator's mistaken renderings of "chambre noire", the French equivalent of the Latin "camera obscura", and should be read as "camera" in the thirteen places where this error occurs.)
^1128979, Hess, Walter, "Stereoscopic picture", published 1915, filed 1 June 1912, patented 16 February 1915. Hess filed several similar patent applications in Europe in 1911 and 1912, which resulted in several patents issued in 1912 and 1913.
^Benton, Stephen (2001). Selected Papers on Three-Dimensional Displays. Milestone Series. Vol. MS 162. SPIE Optical Engineering Press. p. xx-xxi.
^van Berkel, Cees (1997). Fisher, Scott S; Merritt, John O; Bolas, Mark T (eds.). "Characterisation and optimisation of 3D-LCD module design". Proc. SPIE. Stereoscopic Displays and Virtual Reality Systems IV. 3012: 179–186. Bibcode:1997SPIE.3012..179V. doi:10.1117/12.274456. S2CID62223285.
