Internet Engineering Task Force (IETF) J. Skoglund Request for Comments: 8486 Google LLC Updates: 7845 M. Graczyk Category: Standards Track October 2018 ISSN: 2070-1721 Ambisonics in an Ogg Opus Container
AbstractThis document defines an extension to the Opus audio codec to encapsulate coded Ambisonics using the Ogg format. It also contains updates to RFC 7845 to reflect necessary changes in the description of channel mapping families. Status of This Memo This is an Internet Standards Track document. This document is a product of the Internet Engineering Task Force (IETF). It represents the consensus of the IETF community. It has received public review and has been approved for publication by the Internet Engineering Steering Group (IESG). Further information on Internet Standards is available in Section 2 of RFC 7841. Information about the current status of this document, any errata, and how to provide feedback on it may be obtained at https://www.rfc-editor.org/info/rfc8486. Copyright Notice Copyright (c) 2018 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License.
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 2. Terminology . . . . . . . . . . . . . . . . . . . . . . . . . 3 3. Ambisonics with Ogg Opus . . . . . . . . . . . . . . . . . . 3 3.1. Channel Mapping Family 2 . . . . . . . . . . . . . . . . 3 3.2. Channel Mapping Family 3 . . . . . . . . . . . . . . . . 4 3.3. Allowed Numbers of Channels . . . . . . . . . . . . . . . 5 4. Downmixing . . . . . . . . . . . . . . . . . . . . . . . . . 6 5. Updates to RFC 7845 . . . . . . . . . . . . . . . . . . . . . 7 5.1. Format of the Channel Mapping Table . . . . . . . . . . . 7 5.2. Unknown Mapping Families . . . . . . . . . . . . . . . . 8 6. Experimental Mapping Families . . . . . . . . . . . . . . . . 8 7. Security Considerations . . . . . . . . . . . . . . . . . . . 8 8. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 9 9. References . . . . . . . . . . . . . . . . . . . . . . . . . 9 9.1. Normative References . . . . . . . . . . . . . . . . . . 9 9.2. Informative References . . . . . . . . . . . . . . . . . 10 Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . 10 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 10 fellgett75] and [daniel04] for technical details on the Ambisonics format. For the purposes of the this document, Ambisonics can be considered a multichannel audio stream. A separate stereo stream can be used alongside the Ambisonics in a head-tracked virtual reality experience to provide so-called non- diegetic audio -- that is, audio that should remain unchanged by rotation of the listener's head, such as narration or stereo music. Ogg is a general-purpose container, supporting audio, video, and other media. It can be used to encapsulate audio streams coded using the Opus codec. See [RFC6716] and [RFC7845] for technical details on the Opus codec and its encapsulation in the Ogg container, respectively. This document extends the Ogg Opus format by defining two new channel mapping families for encoding Ambisonics. The Ogg Opus format is extended indirectly by adding items with values 2 and 3 to the "Opus Channel Mapping Families" IANA registry. When 2 or 3 are used as the Channel Mapping Family Number in an Ogg stream, the semantic meaning of the channels in the multichannel Opus stream is one of the Ambisonics layouts defined in this document. This mapping can also be used in other contexts that make use of the channel mappings defined by the "Opus Channel Mapping Families" registry.
Furthermore, mapping families 240 through 254 (inclusively) are reserved for experimental use. RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here. Sections 3.1 or 3.2, respectively. Figure 1) followed by two optional channels of non- diegetic stereo indexed (left, right). The terms "order" and "degree" are defined according to [ambix]. ACN = n * (n + 1) + m, for order n and degree m. Figure 1: Ambisonic Channel Number (ACN) For the Ambisonic channels, the ACN component corresponds to channel index as k = ACN. The reverse correspondence can also be computed for an Ambisonic channel with index k. order n = floor(sqrt(k)), degree m = k - n * (n + 1). Figure 2: Ambisonic Degree and Order from ACN Note that channel mapping family 2 allows for so-called mixed-order Ambisonic representation, in which only a subset of the full Ambisonic order number of channels is encoded. By specifying the full number in the channel count field, the inactive ACNs can then be indicated in the channel mapping field using the index 255.
Ambisonic channels are normalized with Schmidt Semi-Normalization (SN3D). The interpretation of the Ambisonics signal as well as detailed definitions of ACN channel ordering and SN3D normalization are described in [ambix], Section 2.1. Figure 3. / \ / \ / \ | S1 | | D11 D12 ... D1K | | X1 | | S2 | | D21 D22 ... D2K | | X2 | | ... | = | ... ... ... ... | | ... | | SC | | DC1 DC2 ... DCK | | XK | \ / \ / \ / Figure 3: Demixing in Channel Mapping Family 3 The matrix MUST be provided in the channel mapping table part of the identification header; see Section 5.1.1 of [RFC7845]. The matrix replaces the need for a channel mapping field; for channel mapping family 3, the mapping table has the following layout: 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+ | Stream Count | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Coupled Count | Demixing Matrix : +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Figure 4: Channel Mapping Table for Channel Mapping Family 3
The fields in the channel mapping table have the following meaning: 1. Stream Count "N" (8 bits, unsigned): This is the total number of streams encoded in each Ogg packet. 2. Coupled Stream Count "M" (8 bits, unsigned): This is the number of the N streams whose decoders are to be configured to produce two channels (stereo). 3. Demixing Matrix (16*K*C bits, signed): The coefficients of the demixing matrix stored in column-major order as 16-bit, signed, two's complement fixed-point values with 15 fractional bits (Q15), little endian. If needed, the output gain field can be used for a normalization scale. For mixed- order Ambisonic representations, the silent ACN channels are indicated by all zeros in the corresponding rows of the mixing matrix. This also allows for mixed order with non-diegetic stereo as the number of columns implies the presence of non- diegetic channels. Note that [RFC7845] specifies that the identification header cannot exceed one "page", which is 65,025 octets. This limits the Ambisonic order, which then MUST be lower than 12, if full order is utilized and the number of coded streams is the same as the Ambisonic order plus the two non-diegetic channels. The total output channel number, C, MUST be set in the third field of the identification header.
Figure 5 to implement downmixing from multichannel files using channel mapping families 2 and 3 when there is no non-diegetic stereo. The first and second Ambisonic channels are known as "W" and "Y", respectively. The omitted coefficients in the matrix in the figure have the value 0.0. / \ / \ / \ | L | | 0.5 0.5 0.0 ... | | W | | R | = | 0.5 -0.5 0.0 ... | | Y | \ / \ / | ... | \ / Figure 5: Stereo Downmixing Matrix for Channel Mapping Families 2 and 3 - Only Ambisonic Channels The first Ambisonic channel (W) is a mono audio stream that represents the average audio signal over all directions. Since W is not directional, Ogg Opus players MAY use W directly for mono playback. If a non-diegetic stereo track is present, the player MAY use the matrix in Figure 6 for downmixing. Ls and Rs denote the two non- diegetic stereo channels. / \ / \ / \ | L | | 0.25 0.25 0.0 ... 0.5 0.0 | | W | | R | = | 0.25 -0.25 0.0 ... 0.0 0.5 | | Y | \ / \ / | ... | | Ls | | Rs | \ / Figure 6: Stereo Downmixing Matrix for Channel Mapping Families 2 and 3 - Ambisonic Channels Plus a Non-Diegetic Stereo Stream
Section 5.1.1 of [RFC7845] (copied below) implies that the channel mapping table, when present, has a fixed format for all channel mapping families: The order and meaning of these channels are defined by a channel mapping, which consists of the 'channel mapping family' octet and, for channel mapping families other than family 0, a 'channel mapping table', as illustrated in Figure 3. This document updates [RFC7845] to clarify that the format of the channel mapping table may depend on the channel mapping family: The order and meaning of these channels are defined by a channel mapping, which consists of the 'channel mapping family' octet and for channel mapping families other than family 0, a 'channel mapping table'. The format of the channel mapping table depends on the channel mapping family. Unless the channel mapping family requires a custom format for its channel mapping table, the RECOMMENDED channel mapping table format for new mapping families is illustrated in Figure 3. The change above is not meant to change how families 1 and 255 currently work. To ensure that, the first paragraph of Section 188.8.131.52 is changed from: Allowed numbers of channels: 1...8. Vorbis channel order (see below). to: Allowed numbers of channels: 1...8, with the mapping specified according to Figure 3. Vorbis channel order (see below). Similarly, the first paragraph of Section 184.108.40.206 is changed from: Allowed numbers of channels: 1...255. No defined channel meaning. to: Allowed numbers of channels: 1...255, with the mapping specified according to Figure 3. No defined channel meaning.
Section 220.127.116.11 of [RFC7845] states: The remaining channel mapping families (2...254) are reserved. A demuxer implementation encountering a reserved 'channel mapping family' value SHOULD act as though the value is 255. This is changed to: The remaining channel mapping families (2...254) are reserved. A demuxer implementation encountering a 'channel mapping family' value that it does not recognize SHOULD NOT attempt to decode the packets and SHOULD NOT use any information except for the first 19 octets of the ID header packet (Figure 2) and the comment header (Figure 10). Section 8 of [RFC7845]. The extension defined in this document requires that semantic meaning be assigned to more channels than the existing Ogg format requires. Since more allocations will be required to encode and decode these semantically meaningful channels, care should be taken in any new allocation paths. Implementations MUST NOT overrun their allocated memory nor read from uninitialized memory when managing the Ambisonic channel mapping.
Section 18.104.22.168 of [RFC7845], | | | | Section 5 of this document | | | | | | 1 | 1-8 channel surround | Section 22.214.171.124 of [RFC7845], | | | | Section 5 of this document | | | | | | 2 | Ambisonics as | Section 3.1 of this document | | | individual channels | | | | | | | 3 | Ambisonics with | Section 3.2 of this document | | | demixing matrix | | | | | | | 240-254 | Experimental use | Section 6 of this document | | | | | | 255 | Discrete channels | Section 126.96.36.199 of [RFC7845], | | | | Section 5 of this document | +---------+----------------------+----------------------------------+ [ambix] Nachbar, C., Zotter, F., Deleflie, E., and A. Sontacchi, "AMBIX - A SUGGESTED AMBISONICS FORMAT", Ambisonics Symposium, June 2011, <http://iem.kug.ac.at/fileadmin/media/iem/projects/2011/ ambisonics11_nachbar_zotter_sontacchi_deleflie.pdf>. [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, <https://www.rfc-editor.org/info/rfc2119>. [RFC6716] Valin, JM., Vos, K., and T. Terriberry, "Definition of the Opus Audio Codec", RFC 6716, DOI 10.17487/RFC6716, September 2012, <https://www.rfc-editor.org/info/rfc6716>. [RFC7845] Terriberry, T., Lee, R., and R. Giles, "Ogg Encapsulation for the Opus Audio Codec", RFC 7845, DOI 10.17487/RFC7845, April 2016, <https://www.rfc-editor.org/info/rfc7845>.
[RFC8174] Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174, May 2017, <https://www.rfc-editor.org/info/rfc8174>. [daniel04] Daniel, J. and S. Moreau, "Further Study of Sound Field Coding with Higher Order Ambisonics", Audio Engineering Society Convention Paper, May 2004, <https://www.researchgate.net/publication/ 277841868_Further_Study_of_Sound_Field_Coding _with_Higher_Order_Ambisonics>. [fellgett75] Fellgett, P., "Ambisonics. Part one: General system description", Studio Sound vol. 17, no. 8, pp. 20-22, August 1975, <http://www.michaelgerzonphotos.org.uk/articles/ Ambisonics%201.pdf>.