E-Book, Englisch, 253 Seiten
Chen / Zhou / Wang Robust Multimodal Cognitive Load Measurement
1. Auflage 2016
ISBN: 978-3-319-31700-7
Verlag: Springer Nature Switzerland
Format: PDF
Kopierschutz: 1 - PDF Watermark
E-Book, Englisch, 253 Seiten
Reihe: Human-Computer Interaction Series
ISBN: 978-3-319-31700-7
Verlag: Springer Nature Switzerland
Format: PDF
Kopierschutz: 1 - PDF Watermark
This book explores robust multimodal cognitive load measurement with physiological and behavioural modalities, which involve the eye, Galvanic Skin Response, speech, language, pen input, mouse movement and multimodality fusions. Factors including stress, trust, and environmental factors such as illumination are discussed regarding their implications for cognitive load measurement. Furthermore, dynamic workload adjustment and real-time cognitive load measurement with data streaming are presented in order to make cognitive load measurement accessible by more widespread applications and users. Finally, application examples are reviewed demonstrating the feasibility of multimodal cognitive load measurement in practical applications. This is the first book of its kind to systematically introduce various computational methods for automatic and real-time cognitive load measurement and by doing so moves the practical application of cognitive load measurement from the domain of the computer scientist and psychologist to more general end-users, ready for widespread implementation. Robust Multimodal Cognitive Load Measurement is intended for researchers and practitioners involved with cognitive load studies and communities within the computer, cognitive, and social sciences. The book will especially benefit researchers in areas like behaviour analysis, social analytics, human-computer interaction (HCI), intelligent information processing, and decision support systems.
Autoren/Hrsg.
Weitere Infos & Material
1;Preface;6
2;Acknowledgements;8
3;Contents;10
4;Part I: Preliminaries;16
4.1;Chapter 1: Introduction;17
4.1.1;1.1 What Is Cognitive Load;18
4.1.2;1.2 Background;19
4.1.3;1.3 Multimodal Cognitive Load Measurement;20
4.1.4;1.4 Structure of the Book;22
4.1.5;References;26
4.2;Chapter 2: The State-of-The-Art;27
4.2.1;2.1 Working Memory and Cognitive Load;27
4.2.2;2.2 Subjective Measures;29
4.2.3;2.3 Performance Measures;30
4.2.4;2.4 Physiological Measures;32
4.2.5;2.5 Behavioral Measures;33
4.2.6;2.6 Estimating Load from Interactive Behavior;37
4.2.7;2.7 Measuring Different Types of Cognitive Load;38
4.2.8;2.8 Differences in Cognitive Load;39
4.2.8.1;2.8.1 Gender Differences in Cognitive Load;39
4.2.8.2;2.8.2 Age Differences in Cognitive Load;39
4.2.8.3;2.8.3 Static Graphics Versus Animated Graphics in Cognitive Load;40
4.2.9;2.9 Summary;41
4.2.10;References;41
4.3;Chapter 3: Theoretical Aspects of Multimodal Cognitive Load Measures;47
4.3.1;3.1 Load? What Load? Mental? Or Cognitive? Why Not Effort?;48
4.3.2;3.2 Mental Load in Human Performance;48
4.3.2.1;3.2.1 Mental Workload: The Early Years;49
4.3.2.2;3.2.2 Subjective Mental Workload Scales and Curve;52
4.3.2.3;3.2.3 Cognitive Workload and Physical Workload Redlines;53
4.3.3;3.3 Cognitive Load in Human Learning;54
4.3.3.1;3.3.1 Three Stages of CLT: The Additivity Hypothesis;56
4.3.3.2;3.3.2 Schema Acquisition and First-in Method;57
4.3.3.3;3.3.3 Modality Principle in CTML;58
4.3.3.4;3.3.4 Has Measuring Cognitive Load Been a Means to Advancing Theory?;59
4.3.3.5;3.3.5 Bridging Mental Workload and Cognitive Load Constructs;63
4.3.3.6;3.3.6 CLT Continues to Evolve;64
4.3.4;3.4 Multimodal Interaction and Cognitive Load;65
4.3.4.1;3.4.1 Multimodal Interaction and Robustness;65
4.3.4.2;3.4.2 Cognitive Load in Human Centred Design;69
4.3.4.3;3.4.3 Dual Task Methodology for Inducing Load;69
4.3.4.4;3.4.4 Workload Measurement in a Test and Evaluation Environment;70
4.3.4.5;3.4.5 Working Memory´s Workload Capacity: Limited But Not Fixed;72
4.3.4.6;3.4.6 Load Effort Homeostasis (LEH) and Interpreting Cognitive Load;73
4.3.5;3.5 Multimodal Cognitive Load Measures (MCLM);77
4.3.5.1;3.5.1 Framework for MCLM;77
4.3.5.2;3.5.2 MCLM and Cognitive Modelling;79
4.3.5.3;3.5.3 MCLM and Decision Making;79
4.3.5.4;3.5.4 MCLM and Trust Studies;80
4.3.6;3.6 Summary;80
4.3.7;References;81
5;Part II: Physiological Measurement;86
5.1;Chapter 4: Eye-Based Measures;87
5.1.1;4.1 Pupillary Response for Cognitive Load Measurement;87
5.1.2;4.2 Cognitive Load Measurement Under Luminance Changes;89
5.1.2.1;4.2.1 Task Design;89
5.1.2.2;4.2.2 Participants and Apparatus;90
5.1.2.3;4.2.3 Subjective Ratings;90
5.1.3;4.3 Pupillary Response Features;91
5.1.4;4.4 Workload Classification;92
5.1.4.1;4.4.1 Feature Generation for Workload Classification;93
5.1.4.2;4.4.2 Feature Selection and Workload Classification;94
5.1.4.3;4.4.3 Results on Pupillary Response;96
5.1.5;4.5 Summary;96
5.1.6;References;97
5.2;Chapter 5: Galvanic Skin Response-Based Measures;98
5.2.1;5.1 Galvanic Skin Response for Cognitive Load Measurement;98
5.2.2;5.2 Cognitive Load Measurement in Arithmetic Tasks;99
5.2.2.1;5.2.1 Task Design;99
5.2.2.2;5.2.2 GSR Feature Extraction;100
5.2.2.2.1;5.2.2.1 Time Domain Features;100
5.2.2.2.2;5.2.2.2 Frequency Domain Features;101
5.2.2.3;5.2.3 Feature Analyses;102
5.2.3;5.3 Cognitive Load Measurement in Reading Tasks;104
5.2.3.1;5.3.1 Task Design;104
5.2.3.2;5.3.2 GSR Feature Extraction;105
5.2.3.3;5.3.3 Feature Analyses;105
5.2.4;5.4 Cognitive Load Classification in Arithmetic Tasks;106
5.2.4.1;5.4.1 Features for Workload Classification;106
5.2.4.2;5.4.2 Classification Results;107
5.2.5;5.5 Summary;108
5.2.6;References;109
6;Part III: Behavioural Measurement;111
6.1;Chapter 6: Linguistic Feature-Based Measures;112
6.1.1;6.1 Linguistics;112
6.1.2;6.2 Cognitive Load Measurement With Non-Word Linguistics;113
6.1.3;6.3 Cognitive Load Measurement with Words;115
6.1.3.1;6.3.1 Word Count and Words per Sentence;115
6.1.3.2;6.3.2 Long Words;115
6.1.3.3;6.3.3 Positive and Negative Emotion Words;115
6.1.3.4;6.3.4 Swear Words;116
6.1.3.5;6.3.5 Cognitive Words;116
6.1.3.6;6.3.6 Perceptual Words;116
6.1.3.7;6.3.7 Inclusive Words;116
6.1.3.8;6.3.8 Achievement Words;117
6.1.3.9;6.3.9 Agreement and Disagreement Words;117
6.1.3.10;6.3.10 Certainty and Uncertainty Words;117
6.1.3.11;6.3.11 Summary of Measurements;117
6.1.4;6.4 Cognitive Load Measurement Based on Personal Pronouns;119
6.1.5;6.5 Language Complexity as Indices of Cognitive Load;120
6.1.5.1;6.5.1 Lexical Density;120
6.1.5.2;6.5.2 Complex Word Ratio;120
6.1.5.3;6.5.3 Gunning Fog Index;121
6.1.5.4;6.5.4 Flesch-Kincaid Grade;121
6.1.5.5;6.5.5 SMOG Grade;121
6.1.5.6;6.5.6 Summary of Language Measurements;122
6.1.6;6.6 Summary;122
6.1.7;References;123
6.2;Chapter 7: Speech Signal Based Measures;124
6.2.1;7.1 Basics of Speech;125
6.2.2;7.2 Cognitive Load Experiments;125
6.2.2.1;7.2.1 Reading Comprehension Experiment;125
6.2.2.2;7.2.2 Stroop Test;127
6.2.2.3;7.2.3 Reading Span Experiment;127
6.2.2.4;7.2.4 Time Constraint;128
6.2.2.5;7.2.5 Experiment Validation;129
6.2.3;7.3 Speech Features and Cognitive Load;129
6.2.3.1;7.3.1 Source-Based Features;130
6.2.3.2;7.3.2 Filter-Based Features;130
6.2.4;7.4 A Comparison of Features for Cognitive Load Classification;132
6.2.4.1;7.4.1 Pitch and Intensity Features;132
6.2.4.2;7.4.2 EGG Features;133
6.2.4.3;7.4.3 Glottal Flow Features;135
6.2.5;7.5 Cognitive Load Classification System via Speech;138
6.2.6;7.6 Summary;138
6.2.7;References;139
6.3;Chapter 8: Pen Input Based Measures;141
6.3.1;8.1 Writing Based Measures;141
6.3.2;8.2 Datasets for Writing-Based Cognitive Load Examination;143
6.3.2.1;8.2.1 CLTex Dataset;144
6.3.2.2;8.2.2 CLSkt Dataset;145
6.3.2.3;8.2.3 CLDgt Dataset;146
6.3.3;8.3 Stroke-, Substroke- and Point-Level Features;147
6.3.4;8.4 Cognitive Load Implications on Writing Shapes;149
6.3.5;8.5 Cognitive Load Classification System;151
6.3.6;8.6 Summary;152
6.3.7;References;153
6.4;Chapter 9: Mouse Based Measures;154
6.4.1;9.1 User Mouse Activity;154
6.4.2;9.2 Mouse Features for Cognitive Load Change Detection;155
6.4.2.1;9.2.1 Temporal Features;155
6.4.2.2;9.2.2 Spatial Features;158
6.4.2.2.1;9.2.2.1 Spatial Features with Straight Lines;159
6.4.2.2.2;9.2.2.2 Straight Line Results;161
6.4.3;9.3 Limitations of Mouse Feature Measurements;162
6.4.4;9.4 Mouse Interactivity in Multimodal Measures;163
6.4.5;9.5 Summary;163
6.4.6;References;164
7;Part IV: Multimodal Measures and Affecting Factors;165
7.1;Chapter 10: Multimodal Measures and Data Fusion;166
7.1.1;10.1 Multimodal Measurement of Cognitive Load;166
7.1.2;10.2 An Abstract Model for Multimodal Assessment;167
7.1.3;10.3 Basketball Skills Training;169
7.1.4;10.4 Subjective Ratings and Performance Results;170
7.1.5;10.5 Individual Modalities;172
7.1.6;10.6 Multimodal Fusion;174
7.1.7;10.7 Summary;176
7.1.8;References;176
7.2;Chapter 11: Emotion and Cognitive Load;177
7.2.1;11.1 Emotional Arousal and Physiological Response;177
7.2.2;11.2 Cognitive Load Measurement with Emotional Arousal;178
7.2.2.1;11.2.1 Task Design;178
7.2.2.2;11.2.2 Pupillary Response Based Measurement;179
7.2.2.3;11.2.3 Skin Response Based Measurement;180
7.2.3;11.3 Cognitive Load Classification with Emotional Arousal;181
7.2.3.1;11.3.1 Cognitive Load Classification Based on Pupillary Response;182
7.2.3.2;11.3.2 Cognitive Load Classification Based on GSR;183
7.2.3.3;11.3.3 Cognitive Load Classification Based on the Fusion;184
7.2.4;11.4 Summary;186
7.2.5;References;186
7.3;Chapter 12: Stress and Cognitive Load;188
7.3.1;12.1 Stress and Galvanic Skin Response;188
7.3.2;12.2 Cognitive Load Measurement Under Stress Conditions;189
7.3.2.1;12.2.1 Task Design;189
7.3.2.2;12.2.2 Procedures;190
7.3.2.3;12.2.3 Subjective Ratings;191
7.3.3;12.3 GSR Features Under Stress Conditions;191
7.3.3.1;12.3.1 Mean GSR Under Stress Conditions;191
7.3.3.2;12.3.2 Peak Features Under Stress Conditions;193
7.3.4;12.4 Summary;196
7.3.5;References;197
7.4;Chapter 13: Trust and Cognitive Load;198
7.4.1;13.1 Definition of Trust;198
7.4.2;13.2 Related Work;199
7.4.2.1;13.2.1 Trust;199
7.4.2.2;13.2.2 Trust and Cognitive Load;200
7.4.3;13.3 Trust of Information and Cognitive Load;202
7.4.3.1;13.3.1 Task Design;202
7.4.3.2;13.3.2 Data Collection;204
7.4.3.2.1;13.3.2.1 Survey Responses;205
7.4.3.2.2;13.3.2.2 Behavioral Measures;205
7.4.3.2.3;13.3.2.3 Performance Measures;205
7.4.4;13.4 Data Analyses;206
7.4.5;13.5 Analysis Results;207
7.4.5.1;13.5.1 Subjective Ratings of Mental Effort;207
7.4.5.2;13.5.2 Linguistic Analysis of Think-Aloud Speech;207
7.4.5.2.1;13.5.2.1 Pause Analysis;208
7.4.5.2.2;13.5.2.2 Linguistic Category Analysis;210
7.4.5.2.3;13.5.2.3 Other Behavioral Features;213
7.4.6;13.6 Interpersonal Trust and Cognitive Load;214
7.4.6.1;13.6.1 Task Design;214
7.4.6.2;13.6.2 Results;214
7.4.7;13.7 Summary;215
7.4.8;References;216
8;Part V: Making Cognitive Load Measurement Accessible;218
8.1;Chapter 14: Dynamic Cognitive Load Adjustments in a Feedback Loop;219
8.1.1;14.1 Dynamic Cognitive Load Adjustments;219
8.1.2;14.2 Dynamic Workload Adaptation Feedback Loop;220
8.1.2.1;14.2.1 Task Design;220
8.1.2.2;14.2.2 Procedures;221
8.1.3;14.3 GSR Features;222
8.1.3.1;14.3.1 Signal Processing;222
8.1.3.2;14.3.2 Feature Extraction;223
8.1.4;14.4 Cognitive Load Classification;224
8.1.4.1;14.4.1 Offline Cognitive Load Classifications;224
8.1.4.2;14.4.2 Online Cognitive Load Classifications;225
8.1.5;14.5 Dynamic Workload Adjustment;227
8.1.5.1;14.5.1 Adaptation Models;227
8.1.5.2;14.5.2 Performance Evaluation of Adaptation Models;228
8.1.6;14.6 Summary;229
8.1.7;References;229
8.2;Chapter 15: Real-Time Cognitive Load Measurement: Data Streaming Approach;230
8.2.1;15.1 Sliding Window Implementation;231
8.2.2;15.2 Streaming Mouse Activity Features;232
8.2.3;15.3 Lessons Learnt;233
8.2.4;15.4 Summary;235
8.2.5;References;235
8.3;Chapter 16: Applications of Cognitive Load Measurement;236
8.3.1;16.1 User Interface Design;236
8.3.2;16.2 Emergency Management;239
8.3.3;16.3 Driving and Piloting;241
8.3.4;16.4 Education and Training;242
8.3.5;16.5 Other Applications;244
8.3.6;16.6 Future Applications;245
8.3.7;References;246
9;Part VI: Conclusions;249
9.1;Chapter 17: Cognitive Load Measurement in Perspective;250
9.1.1;References;253
