360-degree video

Sample 360-degree video in 360x180 equirectangular format.

360-degree videos, also known as surround video,[1] or immersive videos[2] or spherical videos,[3] are video recordings where a view in every direction is recorded at the same time, shot using an omnidirectional camera or a collection of cameras. The term 360x180 can be used to indicate 360° of azimuth and 180° from nadir to zenith. During playback on normal flat display the viewer has control of the viewing direction like a panorama. It can also be played on a display or projectors arranged in a sphere or some part of a sphere.

Creation

Some omnidirectional cameras contain wide-angle lenses on the front and rear to facilitate the recording of 360-degree video.

360-degree video is typically recorded using either a special rig of multiple cameras, or using a dedicated camera that contains multiple camera lenses embedded into the device, and recording overlapping angles simultaneously.[4][5] Specialized omnidirectional cameras and rigs have been developed for the purpose of recording 360-degree video, including rigs such as GoPro's Omni and Odyssey (which consist of multiple action cameras installed within a frame), and contained cameras like the Nokia OZO. There have also been handheld dual-lens cameras such as the Ricoh Theta S, Samsung Gear 360, Garmin VIRB 360, and the Kogeto Dot 360—a panoramic camera lens accessory for smartphone cameras.[6][7][8]

This separate footage is stitched into one spherical video piece, and the color and contrast of each shot is calibrated to be consistent with the others.[4][5] This process is done either by the camera itself, or using specialized software that can analyze common visuals and audio to synchronize and link the different camera feeds together. Generally, the only area that cannot be viewed is the view toward the camera support.[9][10]

360-degree video is typically formatted in an equirectangular projection[11] and is either monoscopic, with one image directed to both eyes, or stereoscopic, viewed as two distinct images directed individually to each eye for a 3D effect.[9] Due to this projection and stitching, equirectangular video exhibits a lower quality in the middle of the image than at the top and bottom.[11] Spherical videos are frequently in curvilinear perspective with a fisheye effect. The heavy barrel distortion often requires rectilinear correction before applications in detection, tracking or navigation.[12]

Some storytellers refer to 360-degree video that uses professional cinematic production techniques such as lighting design, sound design, scenic design, and blocking techniques as cinematic virtual reality (or cine-VR for short).[13]

Playback

360-degree videos are typically viewed via personal computers, mobile devices such as smartphones, or dedicated head-mounted displays. Users can pan around the video by clicking and dragging. On smartphones, internal sensors such as the gyroscope can also be used to pan the video based on the orientation of the device. Taking advantage of this behavior, stereoscope-style enclosures for smartphones (such as Google Cardboard viewers and the Samsung Gear VR) can be used to view 360-degree videos in an immersive format similar to virtual reality. The phone display is viewed through lenses contained within the enclosure, as opposed to virtual reality headsets that contain their own dedicated displays.[14][15][16]

Publishing

A Google Cardboard viewer.

In March 2015, YouTube launched support for publishing and viewing 360-degree videos, with playback on its website and its Android mobile apps. Parent company Google also announced that it would collaborate with camera manufacturers to make it easier for creators to upload 360-degree content recorded with their products to YouTube.[14] However, in 2017, Google and YouTube began to promote an alternative monoscopic or stereoscopic video format known as VR180, which is limited to a 180-degree field of view, but is promoted as being more accessible to produce than 360-degree video, and allowing more depth to be maintained by not subjecting the video to equirectangular projection [11][17]

Facebook (parent company of VR headset maker Oculus VR) followed suit by adding 360-degree video support in September 2015, and subsequently unveiled reference designs for its own 360-degree camera systems known as Facebook Surround 360.[3] Facebook announced in March 2017 that more than 1 million 360-degree videos had been uploaded to Facebook to date.[18] Vimeo also launched 360-degree video support in March 2017.[19]

Google Cardboard, which is typically distributed in the form of do-it-yourself kits consisting of low-cost materials and components,[20] has been credited with helping virtual reality become more readily available to the general public, and helping boost the adoption of 360-degree video by publishers, such as mainstream journalists and media brands.[21]

The use of the term "virtual reality" to describe 360-degree video has been disputed, as VR typically refers to interactive experiences wherein the viewer's motions can be tracked to allow real-time interactions within a virtual environment, with orientation and position tracking. In 360-degree video, the locations of viewers are fixed, viewers are limited to the angles captured by the cameras, and cannot interact with the environment. The non-dynamic nature of video also means that rendering techniques cannot be used to reduce the risk of motion sickness.[22][23]

Variations

See also

References

  1. ^ Nielsen, Frank (2005). "Surround video: a multihead camera approach". The Visual Computer. 1 (1). Springer: 92–103. doi:10.1007/s00371-004-0273-z. S2CID 2000070.
  2. ^ "With Google's new immersive videos, you can feel what it's like to be a ballet dancer". Quartz. December 2015. Retrieved 12 July 2016.
  3. ^ a b Etherington, Darrell (March 25, 2015). "Facebook To Support Spherical Video In News Feed And Oculus". TechCrunch. Retrieved March 14, 2016.
  4. ^ a b Nielsen, Frank (2005-02-01). "Surround video: a multihead camera approach". The Visual Computer. 21 (1–2): 92–103. doi:10.1007/s00371-004-0273-z. ISSN 0178-2789. S2CID 2000070.
  5. ^ a b "Create Immersive Experiences". Rewind. Retrieved 2017-05-13.
  6. ^ "Ricoh Theta S review". CNET. CBS Interactive. Retrieved 12 July 2016.
  7. ^ Sam Byford (January 6, 2012). "Kogeto iCONIC panoramic video coming to Galaxy Nexus and more". The Verge. Retrieved February 24, 2016.
  8. ^ "360-degree cameras: The best VR cams, no matter your budget". Pocket-lint. Retrieved 12 July 2016.
  9. ^ a b "10 things I wish I knew before shooting 360 video". CNET. CBS Interactive. Retrieved 12 July 2016.
  10. ^ Maher, Michael (October 2, 2015). "How to Shoot, Edit, and Upload 360-Degree Videos". The Beat. Retrieved March 14, 2016.
  11. ^ a b c Strange, Adario. "YouTube's VR 180 and Daydream cameras bring immersive video to traditional creators". Mashable. Retrieved 2017-09-26.
  12. ^ Ran, Lingyan; Zhang, Yanning; Zhang, Qilin; Yang, Tao (2017-06-12). "Convolutional Neural Network-Based Robot Navigation Using Uncalibrated Spherical Images". Sensors. 17 (6): 1341. Bibcode:2017Senso..17.1341R. doi:10.3390/s17061341. PMC 5492478. PMID 28604624.
  13. ^ Williams, Eric R., Matt Love and Carrie Love. “Chapter #1: Cine-VR – A New Medium.” In Virtual Reality Cinema: Narrative Tips and Techniques. New York: Routledge, Taylor & Francis Group - 2021.
  14. ^ a b "You Can Now Watch and Upload 360-Degree Videos on YouTube". Wired. 2015-03-13. Retrieved 12 July 2016.
  15. ^ "How 360 degree videos are shot". elsevr.tv. Archived from the original on 19 July 2021. Retrieved 31 May 2018.
  16. ^ "Best VR headsets to buy in 2016, whatever your budget". Pocket-lint. Retrieved 12 July 2016.
  17. ^ "YouTube's "VR180" format cuts down on VR video's prohibitive requirements". Ars Technica. Retrieved 2017-09-26.
  18. ^ "Introducing Facebook 360 For Gear VR | Facebook Newsroom". Retrieved 2017-11-07.
  19. ^ "Vimeo now offers 4K video downloads, but streaming isn't available yet". The Verge. Retrieved 2017-09-26.
  20. ^ Fingas, Jon (February 29, 2016). "Google starts selling Cardboard VR viewers through its store". Engadget. AOL. Retrieved April 3, 2016.
  21. ^ Scott, Caroline (February 19, 2016). "How to get involved in the rise of 360-degree video". Journalism.co.uk. Retrieved March 14, 2016.
  22. ^ "Virtual reality doesn't mean what you think it means". CNET. Retrieved 2017-09-26.
  23. ^ Smith, Will. "Stop Calling Google Cardboard's 360-Degree Videos 'VR'". Wired.com. Retrieved 2017-09-26.