Tech-
invite
3GPP
space
IETF
space
◀
▶
21
22
23
24
25
26
27
28
29
31
32
33
34
35
36
37
38
4‑5x
Content for
TR 26.843
Word version: 16.0.0
0…
5…
5
Methods Description
5.1
Description
5.2
Signal Based Methods
5.3
Perceptually Based methods
6
Results
6.1
Experiment A
6.2
Experiment B
6.3
Experiment C
6.4
Experiment D
6.5
Experiment E
6.6
Experiment F
7
Conformance Process
8
Interoperability
9
Coverage Assessment
10
Conclusions
A
POLQA Considerations for Conformance Test
$
Change history
5
Methods Description
p. 8
5.1
Description
p. 8
5.2
Signal Based Methods
p. 8
5.2.1
General considerations
p. 8
5.2.2
SNR
p. 9
5.2.2.1
Methodology
p. 9
5.2.2.2
Thresholds and Criteria
p. 9
5.2.3
RMS error threshold
p. 10
5.2.3.1
Methodology
p. 10
5.2.3.2
Thresholds and Criteria
p. 10
5.2.4
Spectral Distortion
p. 10
5.2.4.1
Methodology
p. 10
5.2.4.2
Thresholds and Criteria
p. 11
5.2.5
Analysis Flow and Reporting
p. 11
5.2.6
List of Thresholds
p. 12
5.3
Perceptually Based methods
p. 13
5.3.1
General Consideration
p. 13
5.3.2
MOS-LQO Validation
p. 13
5.3.2.1
General Methodology
p. 13
5.3.2.2
Test Cases
p. 14
5.3.2.3
Scores Reporting and Analysis
p. 14
5.3.2.4
Thresholds and Criteria
p. 15
5.3.3
Maximum Loudness Difference
p. 18
5.3.3.1
General Methodology
p. 18
5.3.3.2
Proposed Encoder Conformance Test
p. 18
6
Results
p. 19
6.1
Experiment A
p. 19
6.1.1
Compiler Options
p. 19
6.1.2
MOS-LQO Results
p. 19
6.2
Experiment B
p. 23
6.2.1
Compiler Options
p. 23
6.2.2
Results
p. 23
6.2.3
Restricted Results
p. 26
6.3
Experiment C
p. 27
6.3.1
Compiler Options
p. 27
6.3.1.1
Introduction
p. 27
6.3.1.2
Icc Compiler on Atom Platform
p. 28
6.3.1.3
Gcc compiler on Xeon platform
p. 28
6.3.1.4
Gcc compiler on ARM platform
p. 28
6.3.2
Decoder Test Results
p. 28
6.3.3
Robustness Decoder Test Results
p. 30
6.4
Experiment D
p. 30
6.4.1
Delta-MOS-LQO Behaviour for Mixed-Music Signals
p. 30
6.4.2
Clean Speech Input Example
p. 32
6.4.3
MOS LQO evaluation
p. 33
6.4.4
Decoder test results
p. 35
6.5
Experiment E
p. 36
6.5.1
Delta-POLQA Limitations with Noisy Speech and Frame Erasures
p. 36
6.5.2
MOS-LQO Verification test
p. 37
6.5.3
Decoder Test
p. 39
6.6
Experiment F
p. 40
7
Conformance Process
p. 42
7.1
Description
p. 42
8
Interoperability
p. 43
8.1
Description
p. 43
8.2
Interoperability Testing
p. 43
8.3
Conclusion
p. 45
9
Coverage Assessment
p. 46
10
Conclusions
p. 46
A
POLQA Considerations for Conformance Test
p. 47
A.1
Specific Recommendation from ITU-T P.863.1 [9]
p. 47
A.2
Averaging of MOS-LQO Scores Over Long Inputs
p. 47
A.3
Concerns over the Suitability of Perceptually Based Methods
p. 48
$
Change history
p. 49