Content for TR 26.854 Word version: 19.0.0
1 Scope
2 References
3 Definitions of terms, symbols and abbreviations
3.1 Terms
3.2 Abbreviations
...
...
1 Scope p. 7
The present technical report documents relevant use-cases, interoperability requirements, performance characteristics of haptics formats and codecs to enable haptics enhanced media streaming and communication services. This report documents the integration of haptics media in 3GPP media streaming and communication services to support the addition of a Haptics media type at the same level than audio and video in 3GPP media services.
- Clause 4 provides some background information on haptics systems as wells as a definition of haptics media and media pipeline.
- Clause 5 lists use cases illustrating the added value of haptics in 3GPP scenarios, identifies haptics characteristics and introduces interoperability considerations.
- Clause 6 presents the different types of haptics signals, the existing media formats and categorizes the different types of devices and their haptics specificities.
- Clause 7 documents the candidate technologies, in particular codecs, storage formats and transport protocols.
- Clause 8 focuses on the integration of haptics into 3GPP services and architectures including IMS, RTC, Messaging and XR device.
- Clause 9 summarizes the typical traffic characteristics of haptics media depending on the use cases and formats under consideration.
- Clause 10 addresses the QoS and QoE aspects.
- Clause 11 summarizes the identified characteristics, gaps and potential requirements
- Finally, clause 12 provides a conclusion and addresses the potential next steps.
2 References p. 7
The following documents contain provisions which, through reference in this text, constitute provisions of the present document.
- References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific.
- For a specific reference, subsequent revisions do not apply.
- For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP document (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document.
[1]
TR 21.905: "Vocabulary for 3GPP Specifications".
[2]
TR 22.847: "Study on supporting tactile and multi-modality communication services".
[3]
TR 26.813: "Study of Avatars in Real-Time Communication Services".
[4]
TR 22.856: "Study on Localized Mobile Metaverse Services".
[5]
Haptic editor for full-body immersive experiences, In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology 2018.
[6]
Khronos: "OpenXR 1.1.40 Specification (with all registered extensions)"
[7]
ISO/IEC 23090-31: "Information technology - Coded representation of immersive media Part 31: Haptics coding"
[8]
bHaptics Designer: https://docs.bhaptics.com/designer/ retrieved Sept 15th 2024.
[9]
Meta Haptics Studio: https://www.meta.com/experiences/meta-haptics-studio/6759764157450104/ retrieved Sept 15th 2024.
[10]
Interhaptics Haptic Composer: https://www.interhaptics.com/tech/haptic-composer retrieved Sept 15th 2024.
[11]
Meta Haptics SDK for Unity: https://developers.meta.com/horizon/documentation/unity/unity-haptics-sdk retrieved Sept 15th 2024.
[12]
Meta Haptics SDK for Unreal: https://developers.meta.com/horizon/documentation/unreal/unreal-haptics-sdk , retrieved Sept 15th 2024.
[13]
bHaptics SDK: https://docs.bhaptics.com/sdk/ , retrieved Sept 15th 2024.
[14]
Apple Core Haptics SDK: https://developer.apple.com/documentation/corehaptics , retrieved Sept 15th 2024.
[15]
Interhaptics Platform: https://www.interhaptics.com/platform-partner/ , retrieved Sept 15th 2024.
[16]
Qualcomm Snapdragon G3X gen2: https://docs.qualcomm.com/bundle/publicresource/87-69021-1_REV_A_Snapdragon_G3x_Gen_2_Gaming_Platform_Product_Brief.pdf , retrieved Sept 15th 2024.
[17]
SMPTE ST 2100-1:2017: "Definition and Representation of Haptic-Tactile Essence for Broadcast Production Applications".
[18]
Apple Haptic and Audio Pattern JSON format for Haptics https://developer.apple.com/documentation/corehaptics/representing_haptic_patterns_in_ahap_files , retrieved Sept. 2024.
[19]
Immersion: https://www.immersion.com/technology/ retrieved Sept. 15th. 2024.
[20]
I. M. Vogels, "Detection of temporal delays in visual-haptic interfaces" Human Factors, vol. 46, no. 1, pp. 118-134, 2004
[21]
https://dl.acm.org/doi/pdf/10.1145/3625468.3647626 ; "How do Users Experience Asynchrony between Visual and Haptic Information? " retrieved nov.11 2024.
[22]
TS 26.114: "IP Multimedia Subsystem (IMS); Multimedia telephony; Media handling and interaction".
[23]
TS 26.264: "IMS-based AR Real-Time Communication".
[24]
TS 26.565: "Split Rendering Media Service Enabler".
[25]
ISO/IEC 23090-32: "Information technology - Coded representation of immersive media - Part 32: Carriage of Haptics Data".
[26]
ISO/IEC 23090-37: "Information technology - Coded representation of immersive media - Part 37: Conformance and Reference Software for Carriage of Haptics Data".
[27]
IANA: https://www.iana.org/assignments/media-types/media-types.xhtml#haptics , "Media Types" retrieved Oct 24th.2024.
[28]
IETF: https://datatracker.ietf.org/doc/draft-ietf-mediaman-haptics/ , "The 'haptics' Top-level Media Type", retrieved Oct 24th, 2024.
[29]
IETF: https://datatracker.ietf.org/doc/html/draft-ietf-avtcore-rtp-haptics , "RTP Payload for Haptics" retrieved Oct 24th, 2024..
[30]
IEEE 1918.1.1-2024: "IEEE Standard for Haptic Codecs for the Tactile Internet"
[31]
ISO/IEC 23090-14: "Information technology - Coded representation of immersive media Part 14: Scene description"
[32]
TS 26.119: "Media Capabilities for Augmented Reality"
[33]
TS 26.501: "5G Media Streaming (5GMS); General description and architecture".
[34]
TS 26.506: "5G Real-time Media Communication Architecture".
[35]
TS 26.113: "Real-Time Media Communication; Protocols and APIs".
[36]
TS 26.143: "Messaging Media profiles".
[37]
TS 26.244: "Transparent end-to-end packet switched streaming service (PSS); 3GPP file format (3GP)".
[38]
TR 26.841: "Study on Media Messaging".
[39]
IETF More Instant Messaging Interoperability: https://datatracker.ietf.org/doc/draft-ietf-mimi-content/ "(MIMI) message content", retrieved Feb. 03 2025.
[40]
"Timestamp-independent Haptic-Visual Synchronization", https://arxiv.org/abs/2205.03684 , retrieved Jan 14th 2025.
[41]
TS 26.522: "5G Real-time Media Transport Protocol Configurations".
[42]
TS 29.514: "5G System; Policy Authorization Service; Stage 3".
[43]
ITU-R BS.1534-3: "Method for the subjective assessment of intermediate quality level of audio systems".
[44]
MPEG: S/N 24923 "Report on the MPEG Haptics Phase 1 Performances, Jan'25, Geneva".
[45]
ISO/IEC 23090-33: "Information technology - Coded representation of immersive media - Part 33: Conformance and reference software for haptics coding".
[46]
TS 23.501: "System architecture for the 5G System (5GS)".
[47]
TS 26.511: "5G Media Streaming (5GMS); Profiles, codecs and formats".
[48]
TS 26.567: "Split rendering over IMS".
[49]
TR 26.925: "Typical traffic characteristics of media services on 3GPP networks".
3 Definitions of terms, symbols and abbreviations p. 9
3.1 Terms p. 9
For the purposes of the present document, the terms given in TR 21.905 and the following apply. A term defined in the present document takes precedence over the definition of the same term, if any, in TR 21.905.
3.2 Abbreviations p. 9
For the purposes of the present document, the abbreviations given in TR 21.905 and the following apply. An abbreviation defined in the present document takes precedence over the definition of the same abbreviation, if any, in TR 21.905.
AI
Artificial Intelligence
AHAP
Apple Haptic and Audio Pattern
AVH
Audio Video Haptics
DASH
Dynamic Adaptive Streaming over HTTP
ERM
Eccentric Rotating Mass
HJIF
Haptic JSON Interchanged Format
HMD
Head Mounted Display
JSON
JavaScript Object Notation
LRA
Linear Resonant Actuators
MAF
Media Access Function
MIHS
MPEG-I Haptic Stream
MIMI
More Instant Messaging Interoperability
MMBP
multimedia messaging body part
MPD
Media Presentation Description
MRFP
Multimedia Resource Function Processor
MTSI
Multimedia Telephony Service for IMS
PCM
Pulse-Code Modulation
PDU
Protocol Data Unit
PSI
PDU Set Importance
SMPTE
Society of Motion Picture Television Experts
SRC
Split Rendering Client
SRS
Split rendering Server
RIFF
Resource Interchange File Format
WAV
Waveform Audio File format
XR
Extended Reality
