Immersive Multimedia Codec Technology

Overview

The Moving Picture Experts Group (MPEG) is a working group formed by ISO and IEC to set standards for audio and video compression and transmission. MPEG has grown to include members from various industries, universities, and research institutions. The Joint Video Experts Team – a collaborative team formed by the ITU-T Study Group 16 Video Coding Experts Group and ISO/IEC JTC1 SC29/WG11 MPEG has launched a project to develop a new video coding standard to be known as Versatile Video Coding (VVC). The primary objective of VVC is to provide a significant improvement in compression performance over the existing HEVC standard. VVC will aid the deployment of higher-quality video services and emerging applications such as 360° omnidirectional immersive multimedia and high-dynamic-range (HDR) video.

WILUS have actively participated in the standardization of MPEG-H 3D Audio and MPEG-I VVC standardization. WILUS proposed outstanding binaural solutions, which was adopted in the MPEG-H 3D Audio specification as the standard binaural technology. Also, we are actively participating the VVC codec standardization which would is expected to be completed in 2020. The new standard is expected to enable the delivery of UHD services at bit rates that today are used to carry HDTV.

MPEG-H 3D Audio

The MPEG-H is a set of video and audio standards required for transmitting and playing the immersive multimedia contents such as 4K UHD video and 3D AUDIO, which are finalized in 2015. MPEG-H 3D Audio part includes technology that realizes 3D AUDIO on headphones supporting coding audio as audio channels, audio objects, or higher order ambisonics (HOA). MPEG-H 3D Audio can support up to 64 loudspeaker channels and 128 codec core channels.

WILUS proposed binaural technology and was adopted by MPEG committee after competing against other solutions from global tech giants. Global industry standardization efforts, which WILUS is actively driving and contributing to, are essential for the commercial success of Immersive audio.

  • Freedom to combine audio objects, channels and ambisonics in a single mix
  • Delivering the content with highest coding efficiency
  • Built-in real-time, low-latency binaural rendering capabilities
  • Ideal for Virtual Reality and other mobile applications

VOFF

Variable Order Frequency-band Filtering

QTDL

QMF domain Tapped Delay Line

Real-time binaural renderer

Efficient, lightweight implementation of binaural renderer

MPEG-I VVC (Versatile Video Coding)

The VVC is a major new family of video compression standards from MPEG and the ITU-T SG 16’s VCEG combined to outperform the current HEVC standard. Rising consumption of more immersive video content with higher resolutions has pressured the industry into innovating ever more efficient video compression techniques. The VVC standard is expected to provide 50% bit rate reduction over HEVC when finalized by 2020.

WILUS has been actively contributed to VVC standardization in areas such as Intra prediction and multiple kernel based transform areas. We will continuously contribute video coding technology innovations to the VVC standard, so that it can fulfill the demanding challenge of video industry in 2020.

  • Substantially higher compression capability than the existing HEVC
  • Support higher resolutions (8K) and bit depths (HDR)
  • Support Omnidirectional Video and projections
  • Moderate encoding and decoding complexity for feasible implementation

Multi-type tree structure

Flexible tree partitioning for efficient compression

Intra prediction

Fine-grained intra prediction

Affine inter prediction

For rotate, zoom based inter prediction