Tech-invite3GPPspaceIETFspace
21222324252627282931323334353637384‑5x
Top   in Index   Prev   Next

TS 26.255
Codec for Immersive Voice and Audio Services (IVAS)
Error concealment of lost packets

V18.1.0 (PDF)2024/06  … p.
Rapporteur:
Mr. Norvell, Erik
Ericsson LM

Content for  TS 26.255  Word version:  18.0.0

Here   Top

 

1  Scopep. 6

The present document defines a frame loss concealment procedure, also termed frame substitution and muting procedure, which is executed by the Immersive Voice and Audio Services (IVAS) decoder when one or more frames (speech or audio or SID frames) are unavailable for decoding due to e.g. packet loss, corruption of a packet or late arrival of a packet.

2  Referencesp. 6

The following documents contain provisions which, through reference in this text, constitute provisions of the present document.
  • References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific.
  • For a specific reference, subsequent revisions do not apply.
  • For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP document (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document.
[1]
TR 21.905: "Vocabulary for 3GPP Specifications".
[2]
TS 26.445: "Codec for Enhanced Voice Services (EVS); Detailed Algorithmic Description".
[3]
TS 26.447: "Codec for Enhanced Voice Services (EVS); Error Concealment of Lost Packets".
[4]
TS 26.253: "Codec for Immersive Voice and Audio Services - Detailed Algorithmic Description incl. RTP payload format and SDP parameter definitions".
Up

3  Definitions of terms, symbols and abbreviationsp. 6

3.1  Termsp. 6

For the purposes of the present document, the terms given in TR 21.905 and the following apply. A term defined in the present document takes precedence over the definition of the same term, if any, in TR 21.905.
Further IVAS codec specific definitions are found in clause 3.1 of TS 26.253.
Up

3.2  Symbolsp. 6

Void

3.3  Abbreviationsp. 6

For the purposes of the present document, the abbreviations given in TR 21.905 and the following apply. An abbreviation defined in the present document takes precedence over the definition of the same abbreviation, if any, in TR 21.905.
BFI
Bad Frame Indicator
CPE
Channel Pair Element
DFT
Discrete Fourier Transform
ECU
Error Concealment Unit
EVS
Enhanced Voice Services
HQ MDCT
High Quality MDCT mode
IVAS
Immersive Voice and Audio Services
MASA
Metadata-Assisted Spatial Audio
MC
Multi-channel Audio
MCT
Multi-channel Coding Tool
MDCT
Modified Discrete Cosine Transform
OMASA
Objects and Metadata-Assisted Spatial Audio
OSBA
Objects and Scene-Based Audio
PLC
Packet Loss Concealment
SBA
Scene-Based Audio
SCE
Single Channel Element
Up

4  Generalp. 7

Packet loss concealment serves to ensure the availability of useful audio output when valid packets are unavailable to the decoder. These losses are typically a result of impaired channel conditions like transmission errors or network congestion. The aim is to synthesize a substitution of the decoded audio represented by the lost packet, to prepare for a potential future packet loss, and to handle the transition from the concealment operation back to the decoded audio. The latter is also referred to as recovery operation. An overview of the IVAS codec's decoder operation is given in clause 6.1 of TS 26.253, where Figure 6.1-1 shows the functional structure of the decoder. To complement the picture with the packet loss concealment functionality, Figure 1 below shows the packet loss concealment (PLC) operation of the decoder. A major part of the PLC resides in the core decoding tools, where the audio decoding is mainly handled by the core decoder based on EVS [2]. The Single Channel Elements (SCE) decoder comprises one core-decoder, the Channel Pair Elements (CPE) comprises one or two core-decoders and the Multichannel Coding Tool (MCT) comprises joint decoding using multiple core-decoders, all including associated PLC methods. For the Low Frequency Effect (LFE) channel of multichannel audio, an LFE decoder with associated PLC method is available. Spatial metadata including spatial coding parameters are reconstructed in the spatial parameter decoders or by the associated PLC methods of the respective spatial audio formats. Spatial audio output is finally generated by a scene decoder, upmixer and renderer based on the reconstructed transport channels and the reconstructed spatial metadata. In case of a missing or corrupted packet, a bad frame indicator (BFI) is input to the decoding tools, activating the PLC operation. Notably, scene decoding, upmixing and rendering processing are independent of a bad frame indicator.
Copy of original 3GPP image for 3GPP TS 26.255, Fig. 1: Overview of error concealment operation
Figure 1: Overview of error concealment operation
(⇒ copy of original 3GPP image)
Up

5  Error concealment in the core decoderp. 8

Since IVAS is based on the Codec for Enhanced Voice Services (EVS) [2], the main functionality of the core-codec is inherited from EVS. This includes the error concealment operations as described in TS 26.447, and for mono operation the functionality is implemented in a bit-exact manner. IVAS provides a few enhancements of the core-coder on top of EVS.
The following clauses in TS 26.253 describe the enhancements that have been made for the error concealment operation for the IVAS core-coder:
Up

6  Error concealment per audio formatp. 8

In addition to the mono operation with EVS compatibility, IVAS supports stereo, Independent Streams with metadata (ISM), multi-channel audio (MC), scene-based audio (Ambisonics or SBA), metadata assisted spatial audio (MASA) and combinations of objects with MASA (OMASA) and combination of objects with scene-based audio (OSBA). To handle the variation in audio formats across the supported range of input audio channels and bit rates, several dedicated encoding and decoding modules are employed. The general principle is that the parameters are recycled from the previously decoded frame, but there may also be further concealment operators performed on the parameters. The following clauses in TS 26.253 describe the error concealment operations within each of modules decoding the various audio formats.
Up

7  SID frame concealment operationp. 9

In the case of the loss of an SID frame, the comfort noise will be generated based on the last received SID frame.

$  Change historyp. 9


Up   Top