Versatile Video Coding

VVC / H.266 / MPEG-I Part 3

Versatile video coding
Status	In force
Year started	2017
First published	2020
Latest version	3rd Edition 29 September 2023
Organization	ITU-T, ISO, IEC
Committee	SG16 (Secretary: Simao Campos) (VCEG), MPEG
Base standards	H.261, H.262, H.263, H.264, H.265, ISO/IEC 14496-2, MPEG-1
Related standards	H.267
Domain	Video compression
License	RAND
Website	www.itu.int/rec/T-REC-H.266

Versatile Video Coding (VVC), also known as H.266,^[1] ISO/IEC 23090-3,^[2] and MPEG-I Part 3, is a video compression standard finalized on 6 July 2020, by the Joint Video Experts Team (JVET)^[3] of the VCEG working group of ITU-T Study Group 16 and the MPEG working group of ISO/IEC JTC 1/SC 29. It is the successor to High Efficiency Video Coding (HEVC, also known as ITU-T H.265 and MPEG-H Part 2). It was developed with two primary goals – improved compression performance and support for a very broad range of applications.^[4][5][6]

Concept

In October 2015, the MPEG and VCEG formed the Joint Video Exploration Team (JVET) to evaluate available compression technologies and study the requirements for a next-generation video compression standard. The new standard has about 50% better compression rate for the same perceptual quality compared to HEVC,^[7] with support for lossless and lossy compression. It supports resolutions ranging from very low resolution up to 4K and 16K as well as 360° videos. VVC supports YCbCr 4:4:4, 4:2:2 and 4:2:0 with 8–10 bits per component, BT.2100 wide color gamut and high dynamic range (HDR) of more than 16 stops (with peak brightness of 1,000, 4,000 and 10,000 nits), auxiliary channels (for depth, transparency, etc.), variable and fractional frame rates from 0 to 120 Hz and higher, scalable video coding for temporal (frame rate), spatial (resolution), SNR, color gamut and dynamic range differences, stereo/multiview coding, panoramic formats, and still-picture coding. Work on high bit depth support (12 to 16 bits per component) started in October 2020^[8] and was included in the second edition published in 2022. Encoding complexity of several times (up to ten times) that of HEVC is expected, depending on the quality of the encoding algorithm (which is outside the scope of the standard). The decoding complexity is about twice that of HEVC.

VVC development has been made using the VVC Test Model (VTM), a reference software codebase that was started with a minimal set of coding tools. Further coding tools have been added after being tested in Core Experiments (CEs). Its predecessor was the Joint Exploration Model (JEM), an experimental software codebase that was based on the reference software used for HEVC.

Like its predecessor, VVC uses motion-compensated DCT video coding. While HEVC supports integer discrete cosine transform (DCT) square block sizes between 4×4 and 32×32, VVC adds support for non-square DCT rectangular block sizes. VVC also introduces several intra-frame prediction modes based on these rectangular DCT blocks to provide improved motion compensation prediction.^[9]

History

JVET issued a final Call for Proposals in October 2017, and the standardization process officially began in April 2018 when the first working draft of the standard was produced.^[10][11]

At IBC 2018, a preliminary implementation based on VVC was demonstrated that was said to compress video 40% more efficiently than HEVC.^[12]

The content of the final standard was approved on 6 July 2020.^[7][13][14]

Schedule

• October 2017: Call for proposals
• April 2018: Evaluation of the proposals received and first draft of the standard^[15]
• July 2019: Ballot issued for committee draft
• October 2019: Ballot issued for draft international standard
• 6 July 2020: Completion of final standard

Licensing

To reduce the risk of the problems seen when licensing HEVC implementations, for VVC a new group called the Media Coding Industry Forum (MC-IF) was founded.^[16][17] However, MC-IF had no power over the standardization process, which was based on technical merit as determined by consensus decisions of JVET.^[18]

Four companies were initially vying to be patent pool administrators for VVC, in a situation similar to the previous AVC^[19] and HEVC^[20] codecs. Two companies later formed patent pools: Access Advance and MPEG LA (now known as Via-LA).^[21]

Access Advance published their licensing fee in April 2021.^[22] Via-LA published their licensing fee in January 2022.^[23]

Companies known not to be a part of the Access Advance or Via-LA patent pools as of November 2023 are: Apple, Canon, Ericsson, Fraunhofer, Google, Huawei, Humax, Intel, LG, Interdigital, Maxell, Microsoft, Oppo, Qualcomm, Samsung, Sharp and Sony.

Adoption

Content providers

• In 2021 MX Player^[24] was reported to deliver content in VVC to up to 20% of its mobile customers.^[25]

Software

Encoders/decoders

• Fraunhofer HHI released a source-available^{[Note 1]} encoder called VVenC^[26] and decoder called VVdeC^[27]
  • Fraunhofer Versatile Video Encoder (VVenC)
  • Fraunhofer Versatile Video Decoder (VVdeC)
• VVC VTM reference software
• Tencent Media Lab offers a real time decoder^[28] and the Tencent Cloud service offers transcoding and streaming in its cloud infrastructure.^[29]
• uvg266 open source encoder
• ffmpeg starting with version 7.0 supports experimental decoding.^[30] Version 7.1 elevated support to official status.^[31] Support for PALETTE^[32] is currently missing.^[33]
  • LAV Filters, ffmpeg based DirectShow splitter and decoders for Windows, supports demuxing and decoding starting with version 0.79.^[34]
• OpenVVC,^[35] an incomplete open-source VVC decoder library licensed under LGPLv2.1^[36]

Players

• Spin Digital sells a real time decoder and player for Linux and Windows devices.^[37]
• Elmedia Player added support in July, 2023.^[38]
• MPC-HC (clsid2's fork) starting with version 2.2.0.^[39]
• MPC-BE starting with version 1.7.0.^[40]
• Zoom Player Steam Edition starting with version v19 beta 6 with the help of LAV Filters v0.79.^[41]

Hardware

Company	Chip/architecture	Type	Throughput	Ref
Allegro DVT	AL-D320	Decoder IP core	8K@120	[42][43]
	AL-E320	Encoder IP core		[44][45]
Amlogic	S905X5	Set-top box SoC	2x 4K@60 10 bit	[46]
Intel	Xe2-LPG	GPU/iGPU		[47]
MediaTek	Pentonic 2000	SoC for TV sets	8K@120	[48]
	Pentonic 1000		4K@144	[49]
	Pentonic 800			[50]
	Pentonic 700			[51]
Realtek	RTD1319D	Set-top box SoC	4K@60	[52]
VeriSilicon	Hantro VC9000D	Decoder	8K@120	[53]
	Hantro VC9800D			[54]

Broadcast

The Brazilian SBTVD Forum will adopt the MPEG-I VVC codec in its forthcoming broadcast television system, TV 3.0, expected to launch in 2024. It will be used alongside MPEG-5 LCEVC as a video base layer encoder for broadcast and broadband delivery.^[55]

The European organization DVB Project, which governs digital television broadcasting standards, announced 24 February 2022 that VVC was now part of its tools for broadcasting.^[56] The DVB tuner specification used throughout Europe, Australia, and many other regions has been revised to support the VVC (H.266) video codec, the successor to HEVC.^[57]

See also

• AOMedia Video 1 (AV1)
• Scalable coding

Notes

1. License withholds patent rights and is not OSI-approved.

References

1. "H.266: Versatile video coding". International Telecommunication Union. Archived from the original on 21 June 2021. Retrieved 21 June 2021.
2. "Information technology — Coded representation of immersive media — Part 3: Versatile video coding". International Organization for Standardization (2nd ed.). September 2022. ISO/IEC 23090-3:2022. Retrieved 16 February 2021.
3. "JVET - Joint Video Experts Team". International Telecommunication Union. Retrieved 21 January 2019.
4. Bross, Benjamin; Chen, Jianle; Ohm, Jens-Rainer; Sullivan, Gary J.; Wang, Ye-Kui (September 2021). "Developments in International Video Coding Standardization After AVC, With an Overview of Versatile Video Coding (VVC)". Proceedings of the IEEE. 109 (9): 1463–1493. doi:10.1109/JPROC.2020.3043399. S2CID 234183758.
5. Bross, Benjamin; Wang, Ye-Kui; Ye, Yan; Liu, Shan; Sullivan, Gary J.; Ohm, Jens-Rainer (October 2021). "Overview of the Versatile Video Coding (VVC) Standard and its Applications". IEEE Trans. Circuits & Systs. For Video Technol. 31 (10): 3736–3764. doi:10.1109/TCSVT.2021.3101953. S2CID 238243504.
6. Boyce, Jill M.; Chen, Jianle; Liu, Shan; Ohm, Jens-Rainer; Sullivan, Gary J.; Wiegand, Thomas; Ye, Yan; Zhu, Wenwu (October 2021). "Guest Editorial Introduction to the Special Section on the VVC Standard". IEEE Trans. Circuits & Systs. For Video Technol. 31 (10): 3731–3735. doi:10.1109/TCSVT.2021.3111712. S2CID 238425004.
7. "Fraunhofer HHI is proud to present the new state-of-the-art in global video coding: H.266/VVC brings video transmission to new speeds". Fraunhofer Institute for Telecommunications. 6 July 2020. Retrieved 8 July 2020.
8. T. Ikai; T. Zhou; T. Hashimoto. "AHG12: VVC coding tool evaluation for high bit-depth coding". JVET document management system.
9. Bailey, Donald G. (14 August 2023). Design for Embedded Image Processing on FPGAs. John Wiley & Sons. p. 359. ISBN 978-1-119-81979-0.
10. "N17195, Joint Call for Proposals on Video Compression with Capability beyond HEVC". mpeg.chiariglione.org. Retrieved 21 January 2019.
11. "N17669, Working Draft 1 of Versatile Video Coding". mpeg.chiariglione.org. Retrieved 18 August 2019.
12. Richter, Thomas (12 September 2018). "Fraunhofer Institut zeigt 50% besseren HEVC Nachfolger VVC auf der // IBC 2018". slashCAM (in German). Archived from the original on 8 November 2018. Retrieved 21 January 2019.
13. "Versatile Video Coding | MPEG". mpeg.chiariglione.org. Retrieved 21 January 2019.
14. ITU (27 April 2018). "Beyond HEVC: Versatile Video Coding project starts strongly in Joint Video Experts Team". ITU News. Archived from the original on 21 June 2021. Retrieved 21 June 2021.
15. "JVET-J1001: Versatile Video Coding (Draft 1)". April 2018.
16. Ozer, Jan (13 January 2019). "A Video Codec Licensing Update". Streaming Media. Retrieved 21 January 2019.
17. "MC-IF". mc-if. Retrieved 21 January 2019.
18. Feldman, Christian (7 May 2019). "Video Engineering Summit East 2019 – AV1/VVC Update". New York. Archived from the original on 20 June 2019. Retrieved 20 June 2019. No change to the standardization has been done, so it could theoretically happen that the same thing with HEVC happens again. No measures have been done to prevent that, unfortunately. Also, JVET is not directly responsible; they are just a technical committee. (…) There is the Media Coding Industry Forum (…), but they don't have any real power.
19. Siglin, Timothy (12 February 2009). "The H.264 Licensing Labyrinth". Streaming Media. Retrieved 8 July 2020.
20. Ozer, Jan (17 January 2020). "Balance of Power Shifts Among HEVC Patent Pools". Streaming Media. Retrieved 8 July 2020.
21. Ozer, Jan (28 January 2021). "VVC Patent Pools: And Then There Were Two". Streaming Media. Retrieved 23 February 2021.
22. "access advance royalties".
23. "via-la licensing fees".
24. "MX Player cuts down video streaming data consumption by half; upgrades its video encoding and compression technology to H.266". businessinsider.in. 15 June 2021.
25. "How the H.266 video standard will help stream content way faster". The Next Web. 7 September 2021.
26. "Fraunhofer HHI has developed a software encoder that fully exploits the compression potential of VVC. Its source code is available on GitHub". hhi.fraunhofer.de. Retrieved 29 June 2021.
27. "Fraunhofer HHI has developed a resource efficient, multithreaded VVC software decoder that enables live decoding. Its source code is available on GitHub". hhi.fraunhofer.de. Retrieved 29 June 2021.
28. Tencent (22 June 2021). "High performance Real-time H.266/VVC decoder now available from Tencent Media Lab". Tencent. Archived from the original on 22 June 2021. Retrieved 22 June 2021.
29. Tencent (16 July 2021). "Tencent Cloud Becomes First Cloud Service Provider to Support H.266/VVC Standard".
30. "FFmpeg". ffmpeg.org. Retrieved 5 April 2024.
31. "git.videolan.org Git - ffmpeg.git/commitdiff". git.videolan.org. Retrieved 6 September 2024.
32. "Support PALETTE · Issue #8 · ffvvc/FFmpeg". GitHub. Retrieved 7 April 2024.
33. "git.ffmpeg.org Git - ffmpeg.git/commit". git.ffmpeg.org. Retrieved 3 January 2024.
34. "Release 0.79 · Nevcairiel/LAVFilters". GitHub. Retrieved 17 April 2024.
35. "Project". OpenVVC. Retrieved 25 August 2024.
36. OpenVVC/OpenVVC, OpenVVC, 27 July 2024, retrieved 25 August 2024
37. "Spin Digital – 8K VVC Media Player (Spin Player VVC)". Spin Digital. Retrieved 20 August 2021.
38. Rudd, Emilia. "Elmedia Player for Mac Version History | KB". Electronic Team, Inc. Retrieved 23 July 2023.
39. "Release 2.2.0 · clsid2/mpc-hc". GitHub. Retrieved 2 April 2024.
40. "Release MPC-BE 1.7.0 · Aleksoid1978/MPC-BE". GitHub.
41. "Steam :: Zoom Player Steam Edition :: Announcing Zoom Player v19 beta 6". store.steampowered.com. 12 April 2024. Retrieved 17 April 2024.
42. "IP Decoder AV1 8K IP Video Multiformats AV1 422 Scalable". Allegro DVT - Leading Video Compression Expertise. Retrieved 2 July 2021.
43. "First hardware VVC/H.266 video decoder IP core". 1 July 2021. Retrieved 2 July 2021.
44. "Allegro DVT Launches The Industry's First Real-Time VVC/H.266 Encoder IP". AFP.com. 17 April 2012. Retrieved 17 July 2024.
45. "Allegro DVT Launches The Industry's First Real-Time VVC/H.266 Encoder IP". www.allegrodvt.com. Retrieved 17 July 2024.
46. Aufranc (CNXSoft), Jean-Luc (18 September 2023). "Amlogic S905X5 Armv9 TV Box SoC supports AV1, H.266, Ai-SR - CNX Software". CNX Software - Embedded Systems News. Retrieved 29 October 2024.
47. Bonshor, Gavin. "Intel Unveils Lunar Lake Architecture: New P and E cores, Xe2-LPG Graphics, New NPU 4 Brings More AI Performance". www.anandtech.com. Retrieved 4 June 2024.
48. MediaTek. "MediaTek Announces New Pentonic Smart TV Family with New Pentonic 2000 for Flagship 8K 120Hz TVs". www.prnewswire.com (Press release). Retrieved 20 November 2021.
49. de Looper, Christian (10 November 2022). "MediaTek wants to power next-generation TVs and Chromebooks". BGR.
50. "MediaTek Kompanio 838 and Pentonic 800 chipsets announced". www.fonearena.com. Retrieved 5 June 2024.
51. Roy, Avik (20 August 2022). "MediaTek launches Pentonic 700 chip for 4K televisions". TechnoSports.
52. "Realtek Launches World's First 4K UHD Set-top Box SoC (RTD1319D) Supports VVC/H.266 Video Decoding, GPU with 10-bit Graphics, Multiple CAS, and HDMI 2.1a". Realtek. 29 August 2022. Retrieved 5 September 2022.
53. "VeriSilicon delivered multi-format hardware video decoder Hantro VC9000D supporting 8K@120FPS VVC/H.266 to customers". www.verisilicon.com. Retrieved 21 March 2023.
54. "Hantro VC9800D". www.verisilicon.com. Retrieved 9 January 2024.
55. "Brazilian SBTVD Forum Selects V-Nova LCEVC for Brazil's Upcoming TV 3.0". digitalmediaworld.tv. 13 January 2022.
56. "DVB adds the VVC (H.266) codec to its video standards, for 8K?". 24 February 2022.
57. "Next-gen video codec VVC (H.266) added to DVB tuner specification". 28 February 2022.

Further reading

• HoangVan, Xiem; NguyenQuang, Sang; Pereira, Fernando (23 November 2020). "Versatile Video Coding Based Quality Scalability With Joint Layer Reference" (PDF). IEEE Signal Processing Letters. 27: 2079–2083. Bibcode:2020ISPL...27.2079H. doi:10.1109/LSP.2020.3039729. S2CID 228091515. Archived (PDF) from the original on 14 December 2021 – via Institute of Electrical and Electronics Engineers.

External links

• VVC website at the Fraunhofer Heinrich Hertz Institute with source code of: VTM or VVdeC or VVenC
• Stand by for ITU H.266 compression
• MPEG - Versatile Video Coding
• Finalisation of VVC