Bringing it all together for the FIFA World Cup Qatar 2022™
The MainConcept AVC SDK was chosen as the underlying video codec for Globo’s TV 2.5 FIFA World Cup trials. In addition to MainConcept, other companies were involved to make these live broadcasts a reality. The illustration below shows how it all comes together.
How technology is enabling Globo’s World Cup broadcasts
You can hear more about Globo’s innovation from their own Carlos Ribeiro, Specialist Technology Innovation, in this LinkedIn post. Now, let’s go deeper into just what role each technology plays in enabling Globo’s TV 2.5 compliant FIFA World Cup broadcasts.
MPEG-H, the audio standard introduced by Fraunhofer IIS, brings next-level immersion and dynamic audio attributes to consumers, regardless of the device. Through delivering audio spatially, MPEG-H provides more realism from above, below, and all around the listener. Here is how MPEG-H Audio fits into Globo’s TV 2.5 trials:
- Fraunhofer IIS installed their MPEG-H AMAU (Audio Monitoring and Authoring Unit) before the encoding. This device creates an additional control track instructing the MPEG-H encoder running within MainConcept Live Encoder on how to virtually organize the audio objects within the room, laying out the immersive audio experience.
- MPEG-H Audio enabled devices, like soundbars or set top boxes, play back the immersive sound.
- Devices that do not support MPEG-H Audio play back the AAC stereo track.
To learn more, check out this short video from Gabriel Thomazini, Audio Consultant at Fraunhofer IIS, where he visit’s Globo’s Innovation Lab and interviews Carlos Ribiero. It is in Portuguese, but the first half give a great behind the scenes tour of the facility.
InterDigital is the commercial distributor of Advanced HRD by Technicolor (a.k.a., SL-HDR). This video technology is designed to maximize the image quality of any HDR format, extending investments made by the industry and consumers in legacy infrastructure and devices. For TV 2.5, Advanced HDR by Technicolor does the following:
- Converts HDR input signal into backward-compatible SDR video with SL-HDR1 metadata.
- Uses the SL-HDR1 metadata on updated devices to upscale to Technicolor HDR on supported TVs.
- Carries the SL-HDR1 metadata through all encoding and transmission steps to the consumer device.
- Does not disrupt the operation of non-updated consumer devices, which continue working with SDR.
LCEVC (MPEG-5 part 2) adds an enhancement layer which, when combined with a base video encoded with a separate codec such as AVC, produces an enhanced video stream. V-Nova, LCEVC’s principal developer, played an integral part in the Brazilian trials. Here’s how:
- LCEVC enhancement technology is integrated into MainConcept Live Encoder.
- LCEVC converts the progressive 10-bit input signal into interlaced 8-bit 1080i video for backward compatibility on existing consumer devices.
- LCEVC adds the enhancement layer to playback at full 10-bit progressive 1080p into the AVC bitstream as a separate SEI message.
- Devices updated to support LCEVC use the SEI message to play back at progressive 10-bit 1080p.
All these technologies come together in the MainConcept Live Encoder, a commercial application designed so live workflows can ingest, prepare, and stream audio-visual content that is compatible with any type of consumer device. Live Encoder is responsible for capturing the SDI input signal, compressing the video (using the MainConcept AVC/H.264 Codec) and audio into the proper formats (LC AAC and MPEG-H), as well as keeping metadata messages for backward compatibility with existing devices. Live Encoder also uses the MainConcept MPEG Transport Stream muxer for packetizing all bitstreams for OTA broadcast transmission.
The result? Brazilian TV viewers with the software upgrade receive higher quality video and audio without the hassle and expense of upgrading the hardware! This benefits the environment as there are fewer TVs entering landfills, pushing off the upgrade decision until the next step in evolution, TV 3.0.
The transition from TV 2.0 to TV 3.0
TV 2.5 is transitory, in place as a bridge offering Brazilian TV viewers the ability to access higher quality broadcasts at home. On the other end of the bridge is TV 3.0, codified by the SBTVD Forum and expected to go live in 2025. TV 3.0 accounts for the innumerable changes over the past 20 years to how we view and listen to media, including personalized content, app-based experiences, 4K video quality, more audio channels along with richer audio signals, etc. It allows for where technology is today while building in headroom for those technologies not yet developed.
VVC/H.266 leads the future
Globo has a parallel TV 3.0 trial happing during FIFA World Cup. Many of the same participants are contributing their expertise here too. On the video side, the focus is on what is expected to be the next major codec, VVC/H.266. Like TV 3.0, VVC is geared towards the next wave of advancements, laser-focused on maximizing visual quality while delivering higher performance.
As with earlier codecs, MainConcept is ahead of the curve, releasing the software that will meet these development goals and more, leading to fully realized commercial installations in the coming years. To learn more about VVC, check out our most recent webinar, VVC: The Latest in Video Codec Technology.
To this end, the MainConcept VVC SDK and MainConcept VVC Plugin for FFmpeg have been released as beta software. Developers and end users interested in trying VVC and contributing to its future feature set are invited to apply for the VVC SDK and plugin beta.