Bernsen / Dybkjær Multimodal Usability

1. Auflage 2009
ISBN: 978-1-84882-553-6
Verlag: Springer
Format: PDF
Kopierschutz: 1 - PDF Watermark

E-Book, Englisch, 431 Seiten

Reihe: Human-Computer Interaction Series

This preface tells the story of how Multimodal Usability responds to a special challenge. Chapter 1 describes the goals and structure of this book. The idea of describing how to make multimodal computer systems usable arose in the European Network of Excellence SIMILAR - 'Taskforce for cre- ing human-machine interfaces SIMILAR to human-human communication', 2003- 2007, www. similar. cc. SIMILAR brought together people from multimodal signal processing and usability with the aim of creating enabling technologies for new kinds of multimodal systems and demonstrating results in research prototypes. Most of our colleagues in the network were, in fact, busy extracting features and guring out how to demonstrate progress in working interactive systems, while claiming not to have too much of a notion of usability in system development and evaluation. It was proposed that the authors support the usability of the many multimodal pro- types underway by researching and presenting a methodology for building usable multimodal systems. We accepted the challenge, rst and foremost, no doubt, because the formidable team spirit in SIMILAR could make people accept outrageous things. Second, h- ing worked for nearly two decades on making multimodal systems usable, we were curious - curious at the opportunity to try to understand what happens to traditional usability work, that is, work in human-computer interaction centred around tra- tional graphical user interfaces (GUIs), when systems become as multimodal and as advanced in other ways as those we build in research today.

Autoren/Hrsg.

Bernsen, Niels Ole

Dybkjær, Laila

Inhaltsverzeichnis

1;Preface;6
2;Acknowledgements;8
3;Contents;9
4;1 Structure, Usability, Readership;17
4.1;1.1 Goals;17
4.2;1.2 How to Work on Usability Two Simple Models;18
4.2.1;1.2.1 Model 1: A Well-Stuffed Bag of Usability Information;18
4.2.2;1.2.2 Model 2: Usability in the Software Engineering Life Cycle;19
4.3;1.3 Structure and Scope of This Book;20
4.3.1;1.3.1 Concepts, Methods, Data Handling -- Overall Book Structure;20
4.3.2;1.3.2 Theory and Practice -- Hen and Egg;21
4.4;1.4 Box 1.1System vs. System Model;20
4.4.1;1.3.3 Intermezzo, Case, Example, Overview, Exercise, Nerdy Stuff;22
4.5;1.4 What Is Usability;23
4.5.1;1.4.1 What Is Usability -- The Short Answer;23
4.5.2;1.4.2 Usability in Perspective -- Systems and Other Artefacts;23
4.5.3;1.4.3 The Golden Age of HCI and After;25
4.5.4;1.4.4 Towards Multimodal Usability and Blending with People;26
4.6;1.5 Box 1.2Blending with People;23
4.6.1;1.4.5 Decomposing ''Usability'': The Terminology;27
4.6.2;1.4.6 Decomposing Usability: The Substance of Fitting;28
4.6.3;1.4.7 Implications -- Seven Questions;31
4.7;1.5 Usability Matters But How Much?;32
4.8;1.6 Readers Guide;33
4.9;1.7 Key Points;34
4.10;References;35
5;2 Intermezzo 1: Three Multimodal Cases;36
5.1;2.1 Contents and Origins;36
5.2;2.2 Whats Next?;37
5.3;References;38
6;3 Creating a Model of Use;39
6.1;3.1 AMITUDE A Model of System Use;40
6.1.1;3.1.1 Unpacking AMITUDE;40
6.1.2;3.1.2 AMITUDE Unexposed vs. AMITUDE Exposed;42
6.2;3.2 Application Type;45
6.2.1;3.2.1 The Notion of Application Type and Its Use;45
6.2.2;3.2.2 The Cases as Application Types;45
6.2.3;3.2.3 Classifications of Application Types;47
6.3;3.3 Users and People;47
6.3.1;3.3.1 Roles of Users and People in Development for Usability;48
6.4;3.4 Box 3.1Representative User Groups;47
6.4.1;3.3.2 People, A Global Tour;50
6.4.2;3.3.3 Layer 1, the Mind: Cognition, Conation and Emotion, Attention and Awareness;50
6.4.3;3.3.4 Layer 2, Adding the Body;52
6.4.4;3.3.5 Layer 3, History, Culture and Gender;53
6.4.5;3.3.6 User Profiles;54
6.4.6;3.3.7 Case User Profile Analyses;56
6.5;3.4 Tasks and Other Activities, Domain;57
6.5.1;3.4.1 Tasks, Other Activities, Domain;57
6.5.2;3.4.2 User Task Analysis: A Spoken Dialogue System Example;58
6.5.3;3.4.3 Generalisation: Task Model Scope, Structure and Sharing;60
6.6;Box 3.2 Literal Fitting;62
6.6.1;3.4.4 Other User Task Classifiers;63
6.6.2;3.4.5 Beyond Task Orientation: Domain-Oriented Systems;65
6.6.3;3.4.6 Case Task Analyses;65
6.6.4;3.4.7 Nerdy Stuff: Different Task Notions;67
6.7;3.5 Use Environment;67
6.7.1;3.5.1 Case Use Environment Analyses;68
6.7.2;3.5.2 Use Environment Factors Checklist;69
6.7.3;3.5.3 Physical and Social Use Environments;70
6.7.4;3.5.4 Environmental Responsibility;71
6.8;3.6 Interaction;72
6.8.1;3.6.1 Generalising Interaction: Information Presentation and Exchange;72
6.8.2;3.6.2 Generalising Two-Way Communication: Awareness, Initiative, Acts and Style;75
6.8.3;3.6.3 Case Interaction;77
6.9;3.7 Key Points;77
6.10;References;78
7;4 Modalities and Devices;80
7.1;4.1 What Is a Multimodal System?;80
7.1.1;4.1.1 Some Views Lead Nowhere;81
7.1.2;4.1.2 Sensor Systems, Carriers, Media, Thresholds;82
7.1.3;4.1.3 What Is a Modality? Modalities and Usability;83
7.1.4;4.1.4 Input and Output Modalities, Symmetry and Asymmetry;84
7.1.5;4.1.5 Unimodal and Multimodal Systems;85
7.2;4.2 Which Modalities Exist? Taxonomy of Unimodal Modalities;85
7.2.1;4.2.1 Taxonomy Structure;88
7.2.2;4.2.2 Nerdy Stuff: Origins of the Modality Taxonomy;89
7.2.3;4.2.3 Sharpening the Imagination;92
7.2.4;4.2.4 A Toolbox of Modalities Walk-Through;94
7.2.5;4.2.5 Information Channels;99
7.3;4.3 Practical Use of Modalities;100
7.3.1;4.3.1 Modality Description: The Classical Multimodal GUI;101
7.3.2;4.3.2 Modality Properties;102
7.4;4.4 Multimodal Representation;106
7.4.1;4.4.1 How to Choose Modality Candidates, Modality Aptitude;106
7.4.2;4.4.2 Relationships Among Modality Candidates;110
7.4.3;4.4.3 Modality Combinations of Established Usability;113
7.4.4;4.4.4 Combining Modalities -- Science or Alchemy?;114
7.4.5;4.4.5 Modality Analysis of the Cases;115
7.5;4.5 Input/Output Devices;119
7.5.1;4.5.1 Issues of Device Analysis;120
7.5.2;4.5.2 Device Analysis of the Cases;121
7.6;4.6 Key Points;123
7.7;References;123
8;5 Intermezzo 2: Status on Cases and Next Steps;125
8.1;5.1 Case AMITUDE Models of Use;125
8.2;5.2 Case Usability Goals, Requirements and Evaluation Criteria;125
8.3;5.3 Towards a Broader Perspective on Usability Work;131
9;6 Common Approaches, Methods, Planning;132
9.1;6.1 Common Usability Approaches;132
9.1.1;6.1.1 Thinking;133
9.1.2;6.1.2 Theory;134
9.1.3;6.1.3 Related Systems and Projects;136
9.1.4;6.1.4 Relevant Empirical Data, an ECA Example;136
9.1.5;6.1.5 Descriptive Project Sources;137
9.1.6;6.1.6 Experience;137
9.2;6.2 Methods for Usability;138
9.2.1;6.2.1 Usability Methods Are User-Centred;139
9.2.2;6.2.2 Usability Methods Presented in This Book;140
9.2.3;6.2.3 Method Group 1: Question-Answering Question-answering ;142
9.2.4;6.2.4 Method Group 2: Meetings with Discussion Meeting with discussion ;142
9.2.5;6.2.5 Method Group 3: Observation;144
9.2.6;6.2.6 Method Group 4: Imagination;145
9.2.7;6.2.7 Method Group 5: Interaction with System;145
9.2.8;6.2.8 Which and How Many Methods to Choose;145
9.2.9;6.2.9 Method Presentation Template;148
9.3;6.3 Writing a Usability Workplan;149
9.4;6.4 Writing a Usability Method Plan;150
9.5;Box 6.1 Do a Usability Method Plan Next Time?;151
9.5.1;6.4.1 Method Plan Overview;152
9.5.2;6.4.2 Data Collection Purpose;152
9.5.3;6.4.3 Getting the Right Data;153
9.5.4;6.4.4 Communication with Data Producers: Avoid Priming;153
9.6;Box 6.2 Priming Subjects;154
9.6.1;6.4.5 Subject Recruitment, Third Parties;155
9.6.2;6.4.6 Staff Roles and Responsibilities;155
9.6.3;6.4.7 Location, Equipment, Other Materials, Data, Results;155
9.6.4;6.4.8 Method Script;156
9.7;6.5 Key Points;157
9.8;References;157
10;7 Intermezzo 3: Case Usability Workplan, Design;159
10.1;7.1 Case Usability Workplans;159
10.2;7.2 Case Design;162
10.2.1;7.2.1 Sudoku;162
10.2.2;7.2.2 Treasure Hunt;165
10.2.3;7.2.3 Maths;166
10.3;References;169
11;8 Question-Answering;170
11.1;8.1 About Interviews;170
11.1.1;8.1.1 Purposes;171
11.1.2;8.1.2 Structured, Unstructured and Semi-Structured Interviews;171
11.1.3;8.1.3 Closed Versus Open Questions, Priming Issues;172
11.1.4;8.1.4 Running an Interview;173
11.1.5;8.1.5 Data;174
11.1.6;8.1.6 Advantages and Drawbacks;175
11.2;8.2 About Questionnaires;175
11.2.1;8.2.1 Purposes;175
11.2.2;8.2.2 How to Design a Questionnaire;176
11.2.3;8.2.3 How to Ask a Question;178
11.2.4;8.2.4 Getting Questionnaires Filled;179
11.2.5;8.2.5 Data;181
11.2.6;8.2.6 Advantages and Drawbacks;181
11.3;8.3 User Survey;182
11.4;8.4 Customer Interviews and Questionnaires;187
11.5;8.5 Expert Interviews and Questionnaires;189
11.6;8.6 Screening Interviews and Questionnaires;192
11.7;8.7 Pre-Test Interviews and Questionnaires;195
11.8;8.8 Post-Test Interviews and Questionnaires;199
11.9;References;204
12;9 Meetings with Discussion;205
12.1;9.1 Focus Group Meetings;205
12.2;9.2 Stakeholder Meetings;208
12.3;9.3 Workshops and Other Meetings with User Representatives;212
12.4;References;215
13;10 Observation of Users;217
13.1;10.1 Macro-Behavioural Field Methods;217
13.2;10.2 Micro-Behavioural Field Observation;222
13.3;10.3 Category Sorting;225
13.4;10.4 Observation of Users in Real Time;229
13.5;10.5 Human Data Collection in the Lab;233
13.6;10.6 Box 10.1 How Not to Do Human Data Collection;233
13.7;References;238
14;11 Imagination;240
14.1;11.1 Use Cases and Scenarios;240
14.2;11.2 Personas;244
14.3;11.3 Cognitive Walk-Through;249
14.4;11.4 Guideline-Based Usability Development and Evaluation;253
14.5;11.5 Usability Standards;262
14.5.1;11.5.1 ISO/IEC Usability Work Methodology;263
14.5.2;11.5.2 Comparison with This Book;267
14.6;References;268
15;12 Interaction with the System;270
15.1;12.1 Mock-Up;270
15.2;12.2 Wizard of Oz;274
15.3;12.3 Implemented Prototype Lab Test;278
15.4;12.4 Field Test;283
15.5;12.5 Think-Aloud;288
15.6;References;292
16;13 Lab Sessions with Subjects;294
16.1;13.1 Lab Test and Development Methods. Micro-Control;294
16.2;13.2 Session Preparation Subject Recruitment;295
16.2.1;13.2.1 How to Select Subjects;296
16.2.2;13.2.2 Number of Subjects;297
16.2.3;13.2.3 Where to Get Subjects;298
16.2.4;13.2.4 Information for Initial Subject Contact;298
16.2.5;13.2.5 Will All Subjects Show Up?;299
16.2.6;13.2.6 Remuneration of Subjects Remuneration of subjects ;300
16.3;13.3 Session Preparation Material and Equipment;300
16.3.1;13.3.1 Checklist for What to Do Before the Session;301
16.3.2;13.3.2 System Model, Software, Equipment;302
16.3.3;13.3.3 Presentation Material, Instructions, Instructions;302
16.3.4;13.3.4 Consent Forms and Other Permissions;303
16.3.5;13.3.5 Scenarios and Priming;304
16.3.6;13.3.6 Guides, Manuals, Other Written Support;308
16.3.7;13.3.7 Subject Debriefing Guide;309
16.4;13.4 During the Session;309
16.4.1;13.4.1 Subjects Arrive;309
16.4.2;13.4.2 Introduction and Instructions to Subjects, Subject Training;310
16.4.3;13.4.3 Carrying Out the Session;311
16.4.4;13.4.4 When and How to Help a Test Subject;312
16.4.5;13.4.5 What Not to Say When Subjects Ask Questions;312
16.4.6;13.4.6 When to Deviate from the Method Plan;313
16.4.7;13.4.7 The Experimenter;314
16.5;13.5 After the Session;314
16.5.1;13.5.1 Subject Debriefing;314
16.5.2;13.5.2 Data Handling;315
16.5.3;13.5.3 Post-Session Subject Contact Post-session Subject contact ;315
16.6;13.6 Key Points;315
16.7;References;315
17;14 Intermezzo 4: Case Usability Method Plan;316
17.1;14.1 Data Collection Purpose;316
17.2;14.2 Getting the Right Data;316
17.3;14.3 Communication with the Data Producers;316
17.4;14.4 Subject Recruitment, A Representative User Group;318
17.5;14.5 Staff Roles and Responsibilities;319
17.6;14.6 Location, Equipment, Other Materials, Data, Results;319
17.7;14.7 Method Script;320
18;15 Data Handling;322
18.1;15.1 The Data Handling Cycle;322
18.2;15.2 The Nature of Data, Corpora, Data Resources;324
18.3;15.3 Raw Data Files, Data Book-Keeping, Meta-Data;326
18.3.1;15.3.1 Raw Data Files;326
18.3.2;15.3.2 Data Book-Keeping;327
18.3.3;15.3.3 Meta-Data;328
18.4;15.4 Preparing to Use the Data;328
18.4.1;15.4.1 Raw Data Validation;329
18.5;Box 15.1 Data Collection Story--Speech for Consumer Devices;329
18.5.1;15.4.2 Raw Data Post-Processing;330
18.6;15.5 Raw Data Annotation;331
18.6.1;15.5.1 Bird Watching and Data Coding;333
18.7;Box 15.2 Bird Watching Story;333
18.7.1;15.5.2 Purposes of Corpus Annotation;336
18.7.2;15.5.3 Orthographic Transcription: An Example;337
18.7.3;15.5.4 Multimodal Annotation, Blending with People;339
18.7.4;15.5.5 Languages and Coding Schemes for Blending with People;342
18.7.5;15.5.6 Coding Tools;350
18.8;15.6 Coding Procedure and Coding Best Practice;353
18.9;15.7 Key Points;354
18.10;References;354
19;16 Usability Data Analysis and Evaluation;357
19.1;16.1 Data Analysis: Process and Issues;357
19.1.1;16.1.1 Context of Analysis;358
19.1.2;16.1.2 A General Model of Usability Data Analysis;359
19.1.3;16.1.3 Preliminary Analysis and Report;361
19.1.4;16.1.4 Data Analysis;361
19.1.5;16.1.5 Problem Analysis: Identify Implications and Priorities;364
19.2;16.2 Usability Evaluation;367
19.2.1;16.2.1 Usability Arguments, Requirements, Criteria;368
19.2.2;16.2.2 Usability Evaluation Criteria: The Evaluation Hierarchy;369
19.3;16.3 Types of Evaluation Results and Purposes, Semi-Nerdy Stuff;371
19.3.1;16.3.1 Technical Issues Versus Design Issues;372
19.3.2;16.3.2 Objective and Subjective Evaluation;372
19.3.3;16.3.3 Quantitative and Qualitative Evaluation;373
19.3.4;16.3.4 Five Different Evaluation Purposes;374
19.4;16.4 Types of Evaluation Criteria;376
19.4.1;16.4.1 Common Evaluation Criteria from ISO Usability Standards;376
19.4.2;16.4.2 Other Kinds and Sources of Criteria;379
19.5;16.5 Usability Evaluation in Practice;380
19.5.1;16.5.1 Sudoku and Other Evaluations;381
19.5.2;16.5.2 Task Success: An Example Usability Evaluation Criterion;382
19.6;16.6 Box 16.1 Task Success Rate;380
19.6.1;16.5.3 Sudoku Evaluation: General Points;384
19.7;16.6 Reporting the Results of Data Analysis;389
19.8;16.7 Key Points;390
19.9;References;390
20;17 Intermezzo 5: Sudoku Usability Evaluation;392
20.1;17.1 Data;392
20.1.1;17.1.1 Context of Data Analysis;393
20.1.2;17.1.2 Anomalies;393
20.1.3;17.1.3 Interview Questions: Three Issues;393
20.1.4;17.1.4 User Statistics;394
20.1.5;17.1.5 Game Statistics;395
20.1.6;17.1.6 Data Validation;396
20.2;17.2 Technical Issues;396
20.2.1;17.2.1 Robustness Robustness ;397
20.2.2;17.2.2 Speech and Pointing;397
20.2.3;17.2.3 Other Issues;400
20.3;17.3 Modality Appropriateness;400
20.3.1;17.3.1 Component Modality Appropriateness;401
20.3.2;17.3.2 Gameplay Using Speech, Pointing and Graphics;405
20.3.3;17.3.3 Information Appropriateness;407
20.4;17.4 Functional Issues;409
20.5;17.5 User Interviews: Closed Questions Overview;415
20.6;17.6 Conclusions;416
20.7;References;417
21;18 Multimodal Usability: Conclusions and Future Work;418
21.1;18.1 Simple to Grasp?;418
21.2;18.2 Nerdy Stuff: Generalisations of HCI Made in This Book;418
21.2.1;18.2.1 Generalised Scope of Contents for Multimodal HCI Multimodal HCI See HCI ;419
21.2.2;18.2.2 Generalised Methodology for Multimodal HCI;420
21.2.3;18.2.3 Generalised Framework and Theory of Multimodal HCI;421
21.3;18.3 Future Work;423
22;Abbreviations;425
23;Index;427