Experiment Design

#Conference HCI International

ICCM

Demos

Experiment Design

#Graph Popularity

1. New York Times: Manufacturing costs rose from 2004 to 2014 in most of the top 25 exporting countries

2. Github Git

3. Business Insider: Apple no longer dominates the tablet market it created

4. Minimum wage since 1938

Questions

Point reading: Is A larger than certain amout in one year

Comparison: Is A larger than B

Trend Question: The trend of A over time

Which plot is better in certain circumstance?

How do eye movement patterns(cog strategy) depend on the data?

Assumption

If the participant spends more time on fixation of one object, he spends more time understanding it.

Goal

1. Investigate the congnitive process of reading graphs on the internet

2. Evaluate the benefits and shortcomes of different graphs based on cognitive findings

Validate the opinions or not?

1. Associate the legend -> Find dimension -> Find associated datapoint -> Get datapoint value

2. Line graph represents the trend fairly well, with grouped charts it can be difficult to tell the difference between totals in each group however it’s ideal to compare between each element in categories.

Participants

Results

Line Graph point reading

Person 1:

(1) Legend -> X axis -> Line -> Y axis -> Line -> X axis

(2) Legend -> X axis -> Line -> Y axis -> Line -> X axis -> Legend -> Y axis -> Line

(3) Legend -> X axis -> Line -> Legend -> Y axis

Person 2:

(1) X axis -> Legend -> Line -> X axis -> Line -> Y axis

(2) X axis -> Legend -> Line -> Y axis -> X axis -> Line -> Y axis

(3) X axis -> Legend -> Line -> X axis -> Line -> Y axis -> X axis

Person 3:

(1) Legend -> X axis -> Line -> Y axis

(2) not clear

(3) Legend -> X axis -> Line -> Y axis -> Line

Bar Graph point reading

Person 1:

(1) Legend -> X axis -> Bar -> Legend -> Bar -> Y axis

(2) Legend -> X axis -> Legend -> Bar -> Y axis

(3) Legend -> X axis -> Legend -> Bar -> Y axis

Person 2:

(1) Legend -> X axis -> Bar -> Y axis -> Bar -> Y axis -> Bar -> Legend -> Bar -> Y axis

(2) Legend -> X axis -> Bar -> Y axis -> Bar -> Y axis -> Bar

(3) X axis -> Legend -> Bar -> X axis -> Bar -> Y axis -> Bar -> X axis -> Bar -> Legend -> Bar

Person 3:

(1) not clear

(2) Legend -> X axis -> Bar , not clear

(3) Legend -> X axis -> Y axis , not clear

Discoveries

starting gaze point

For person 1: starting gaze point is always legend: 20/20

For person 2: starting gaze point is 10/20, exactly half.

For person 3: starting gaze point is unclear because the experiment data is not reliable.

Software Tools

Eye Movement Classification Software From Oleg Komogortsev

jetty Websocket

d3

Bootstrap

Result

ACT-R

Line graph

Point reading: Is A larger than certain amout in one year

3.095S, 3.580S, 4.015S

Comparison: Is A larger than B

3.015

Trend Question: The trend of A over time

3.670

Bar graph

Line graph

Point reading: Is A larger than certain amout in one year

3.095S,

Comparison: Is A larger than B

3.015

Trend Question: The trend of A over time

3.670, 3.385

#person 1

1 2.3 ——————– 2 4.23333333333 ——————– 3 4.03333333333 ——————– 4 4.0 ——————– 5 5.6 ——————– 6 3.8 ——————– 7 4.26666666667 ——————– 8 3.23333333333 ——————– 9 6.53333333333 ——————– 10 3.3 ——————– 11 4.7 ——————– 12 5.4 ——————– 13 5.96666666667 ——————– 14 5.93333333333 ——————– 15 5.23333333333 ——————– 16 4.0 ——————– 17 3.43333333333 ——————– 18 3.33333333333 ——————– 19 4.36666666667 ——————– 20 5.1 ——————–

#person 2

1 10.7 ——————– 2 10.2333333333 ——————– 3 4.93333333333 ——————– 4 7.56666666667 ——————– 5 6.96666666667 ——————– 6 5.2 ——————– 7 4.66666666667 ——————– 8 6.1 ——————– 9 4.33333333333 ——————– 10 4.26666666667 ——————– 11 9.46666666667 ——————– 12 6.36666666667 ——————– 13 6.56666666667 ——————– 14 6.63333333333 ——————– 15 4.8 ——————– 16 20.2666666667 ——————– 17 6.96666666667 ——————– 18 4.66666666667 ——————– 19 3.4 ——————– 20 4.76666666667 ——————–

#person 3

1 7.5 ——————– 2 16.5 ——————– 3 4.06666666667 ——————– 4 4.33333333333 ——————– 5 8.0 ——————– 6 5.96666666667 ——————– 7 5.3 ——————– 8 5.36666666667 ——————– 9 9.03333333333 ——————– 10 5.06666666667 ——————– 11 5.46666666667 ——————– 12 6.06666666667 ——————– 13 4.36666666667 ——————– 14 6.53333333333 ——————– 15 4.83333333333 ——————– 16 4.7 ——————– 17 5.66666666667 ——————– 18 7.1 ——————– 19 3.9 ——————– 20 16.4666666667 ——————–