Quantitative User Studies

Übung Mensch-Maschine-Interaktion 1, Wintersemester 2008/09

 

Topics Today

Results of a Quantitative User Study

How To Conduct a User Study

Think
    • Literature Research
    • Discuss Theory
    • Conduct Pre-studies
Design
    • State Hypothesis
    • Create Prototype
    • Plan Experiment
Measure
    • Conduct Experiment
    • Collect Data
    • Document Test Conditions
Analyze & Publish
    • Review collected data
    • Apply Significance Tests
    • Interprete Results
    • Document Study and Results


Example:


Research Questions

Hypothesis

Specification


Internal vs. External Validity

Variables


Variables

Randomization / Counterbalancing

Experimental Method

pro contra
within subjects fewer participants required (n),
variance across conditions should be the same
learning/interference effects
between subjects learning/interference effects avoided more participants required (n * [# conditions]),
usually harder to show significance

Latin Squares

A B C
B C A
C A B
A B C D
B C D A
C D A B
D A B C
A B C D
B D A C
D C B A
C A D B
3x3 Latin Square 4x4 Latin Square 4x4 balanced Latin Square



One-of vs. Comparative Research Questions

Finito