Tech-invite 3GPPspace IETFspace

21 22 23 24 25 26 27 28 29 31 32 33 34 35 36 37 38 4‑5x

Content for TS 26.077 Word version: 17.0.0

1… 5…

5 Requirements to be assessed by Objective Means p. 8

5.1 Bit Exactness of the Speech Encoder p. 8

5.2 Bit Exactness of the Speech Decoder p. 9

5.3 Impact on Speech Path Delay p. 9

5.4 Impact on Channel Activity p. 10

6 Requirements to be assessed by subjective tests p. 10

6.1 Impact on Speech Quality p. 10

6.1.1 Initial Convergence Time p. 10

6.1.2 No Degradation in Clean Speech p. 10

6.1.3 No degradation of Speech and no Undesirable Effects in Residual Noise in Conditions with Background Noise (residual noise = background noise after AMR/NS) p. 10

6.1.4 Quality Impact compared to AMR p. 11

7 Performance Objectives assessed by Objective Measures p. 11

7.1 Impact on Active Speech Level p. 11

7.2 Objective Speech Quality Measures p. 11

8 Interaction with supplementary services p. 12

8.1 General p. 12

8.2 Explicit Call Transfer (ECT) p. 12

8.3 Call wait/Call hold. p. 12

8.4 Multiparty p. 12

8.5 Service Announcements p. 12

9 Interaction with Alternate and Followed by services p. 12

10 Interaction with other speech services p. 12

11 Interaction with DTMF and other signalling tones p. 13

12 Interaction with Lawful Intercept p. 13

13 Interaction with TFO p. 13

A Method for generating Objective Performance Measures p. 14

A.1 Notations p. 14

A.2 Test material p. 15

A.3 Objective measures for characterization of NS algorithm effect p. 15

B (Normative) Methodology for Measuring Subjective SNR Improvement for CCR Experiments p. 20

C (Normative) Test Plan for Checking Conformance to Requirements p. 21

C.1 Introduction p. 21

C.2 Document Structure p. 21

C.3 References, Conventions, and Contacts p. 22

C.4 Key Acronyms p. 22

C.4.1 Contact Names p. 22

C.5 Roles and Responsibilities p. 23

C.6 Information relevant to all Experiments p. 23

C.6.1 General Technical Notes p. 23

C.6.2 Codec Adaptation and Error Conditions p. 23

C.6.3 Speech Material p. 23

C.6.3.1 Availability of Pre-recorded Speech Material p. 24

C.6.3.2 Recording Your Own Speech Databases p. 24

C.6.3.3 Format for Single Sentence Speech Samples p. 24

C.6.3.4 Format for Short Speech Samples p. 25

C.6.3.5 Format for Long Speech Samples p. 25

C.6.3.6 Processing of the Speech Files p. 25

C.6.4 Listening Environment p. 26

C.6.5 Experimental Procedure p. 26

C.6.6 Preliminary Conditions p. 27

C.6.7 Reference Conditions p. 27

C.6.8 Noise Material p. 27

C.7 Experiment 1: Degradation in Clean Speech (Pair Comparison Test) p. 27

C.7.1 Introduction p. 27

C.7.2 Test Factors and Conditions p. 28

C.7.3 Preliminary Conditions p. 29

C.7.4 Speech Material p. 29

C.7.5 Experimental Design p. 29

C.7.6 Processing p. 29

C.7.7 Randomizations p. 29

C.7.8 Duration of the PC Experiment p. 30

C.7.9 Votes Per Condition p. 30

C.7.10 Test Procedure p. 30

C.7.11 Opinion Scale p. 30

C.7.12 Statistical Analysis p. 30

C.7.13 Test Conditions for Experiment 1 p. 31

C.8 Experiments 2a, 2b & 2c: No degradation of Speech and no Undesirable Effects in Residual Noise in Conditions with Background Noise (ACR) p. 32

C.8.1 Introduction p. 32

C.8.2 Test Factors and Conditions p. 32

C.8.3 Preliminary Conditions p. 33

C.8.4 Speech Material p. 34

C.8.5 Experimental Design p. 34

C.8.6 Processing p. 34

C.8.7 Randomizations p. 34

C.8.8 Duration of the ACR Experiments 2a, 2b, and 2c p. 34

C.8.9 Votes Per Condition p. 35

C.8.10 Test Procedure p. 35

C.8.11 Opinion Scale p. 35

C.8.12 Test Conditions for Experiments 2a, 2b and 2c p. 36

C.8.13 Statistical Analysis p. 36

C.9 Experiments 3a & 3b: Performances in Background Noise Conditions (Mod-CCR) p. 37

C.9.1 Introduction p. 37

C.9.2 Test Factors and Conditions p. 37

C.9.3 Preliminary Conditions p. 39

C.9.4 Speech Material p. 39

C.9.5 Experimental Design p. 39

C.9.6 Processing p. 40

C.9.7 Randomizations p. 40

C.9.8 Duration of the CCR Experiments 3a and 3b p. 40

C.9.9 Votes Per Condition p. 40

C.9.10 Test Procedure p. 40

C.9.11 Opinion Scale p. 40

C.9.12 Test Conditions for Experiments 3a and 3b p. 41

C.9.13 Statistical Analysis p. 41

C.10 Experiments 4: Influence of Input Level, Voice Activity Detection and Discontinuous Transmission (CCR) p. 42

C.10.1 Introduction p. 42

C.10.2 Test Factors and Conditions p. 42

C.10.3 Preliminary Conditions p. 43

C.10.4 Speech Material p. 44

C.10.5 Experimental Design p. 44

C.10.6 Processing p. 44

C.10.7 Randomizations p. 44

C.10.8 Duration of the Experiment p. 44

C.10.9 Votes Per Condition p. 44

C.10.10 Test Procedure p. 45

C.10.11 Opinion Scale p. 45

C.10.12 Test Conditions for Experiment 4 p. 45

C.10.13 Statistical Analysis p. 46

C.11 Instructions to subjects and data collection p. 46

C.11.1 Example Instructions for Experiment 1 p. 47

C.11.2 Example Modified ACR Instructions for Experiment 2 p. 47

C.11.3 Example Instructions for Experiment 3 and 4 p. 48

C.12 Processing Tables p. 48

C.13 Presentation Orders p. 49

$ Change history p. 50