IMMERSIVE MULTIMEDIA
CODEC
TECHNOLOGY
OVERVIEW
The Moving Picture Experts Group (MPEG) is a working group formed by ISO and IEC to set standards for audio and video compression and transmission. MPEG has grown to include members from various industries, universities, and research institutions. The Joint Video Experts Team (JVET)– a collaborative team formed by the ITU-T Study Group 16 Video Coding Experts Group and ISO/IEC JTC1 SC29/WG11 MPEG- has launched a project to develop a new video coding standard to be known as Versatile Video Coding (VVC). The primary objective of VVC is to provide a significant improvement in compression performance over the existing HEVC standard. VVC will aid the deployment of higher-quality video services and emerging applications such as 360° omnidirectional immersive multimedia and high-dynamic-range (HDR) video.
WILUS has actively participated in the standardization of MPEG-H 3D Audio and MPEG/JVET VVC standardization. WILUS proposed outstanding binaural solutions, which was adopted in the MPEG-H 3D Audio specification as the standard binaural technology. Also, we are actively participating in the VVC codec standardization which is expected to be completed in 2020. The new standard is expected to enable the delivery of UHD services at bit rates of that used to carry HDTV at this time.
MPEG-H 3D AUDIO
The MPEG-H is a set of video and audio standards required to transmit and play immersive multimedia contents such as 4K UHD video and 3D AUDIO, finalized in 2015. MPEG-H 3D Audio includes technology that realizes 3D AUDIO on headphones supporting the coding of audio as audio channels, audio objects, or higher order ambisonics (HOA). MPEG-H 3D Audio can support up to 64 loudspeaker channels and 128 codec core channels.
​
WILUS proposed binaural technology and was adopted by the MPEG committee after competing against other solutions from global tech giants. Global industry standardization efforts, which WILUS is actively driving and contributing to, are essential for the commercial success of Immersive audio.
​
-
Freedom to combine audio objects, channels and ambisonics in a single mix
-
Delivering the content with highest coding efficiency
-
Built-in real-time, low-latency binaural rendering capabilities
-
Ideal for Virtual Reality and other mobile applications
VOFF
Variable Order Frequency-band Filtering
QTDL
QMF domain Tapped Delay Line
Real-time binaural renderer
Efficient, lightweight implementation of binaural renderer
VVC (VERSATILE VIDEO CODING)
The VVC is a major new family of video compression standards from MPEG and the ITU-T SG 16’s VCEG combined to outperform the current HEVC standard. Rising consumption of more immersive video content with higher resolutions has pressured the industry into innovating ever more efficient video compression techniques. The VVC standard is expected to provide 50% bit rate reduction over HEVC when finalized by 2020.
​
WILUS has been actively contributing to VVC standardization in areas such as Intra prediction and multiple kernel based transform areas. We will continuously contribute to video coding technology innovations to the VVC standard so that it can fulfill the demanding challenge of the video industry in 2020.
​
-
Substantially higher compression capability than the existing HEVC
-
Support higher resolutions (8K) and bit depths (HDR)
-
Support Omnidirectional Video and projections
-
Moderate encoding and decoding complexity for feasible implementation
Multi-type tree structure
Flexible tree partitioning for efficient compression
Intra prediction
Fine-grained intra prediction
Affine inter prediction
For rotation, zoom based inter prediction
