CPSC 412/612 Eye Tracking Methodology and Applications
Fall 2015

12:30-13:45TTH McAdams 110B

Schedule

DateL#Topic
Thu. Aug.1801 Introduction; course overview; review of past years' published papers:
Published papers from pervious years: Supplemental materials:
Tue. Aug.2302 Gazepoint demo (McAdams 110B)
Thu. Aug.2503 Experimental design—Part I

Supplemental materials:

Tue. Aug.3004 Team/Project selections (preliminary)

Experimental design—Part II

Supplemental files:
  1. Makefile
  2. excel2csv.py
  3. speed.R
  4. wpm.R
  5. excel/EntryTimes.csv
  6. excel/WPM.csv
Or, whole thing as zip file:
  1. R.zip

Thu. Sep.0105 Team selections due

Gaze Analytics Pipeline

Relevant papers:
  1. Andrew T. Duchowski, Sabarish V. Babu, Jeff Bertrand, and Krzysztof Krejtz, ``Gaze Analytics Pipeline for Unity 3D Integration: Signal Filtering and Analysis'', in Proceedings of the 2nd International Workshop on Eye Tracking for Spatial Research (ET4S), September 23, 2014, Vienna, Austira.

  2. Andrew D. Ouzts and Andrew T. Duchowski. 2012. Comparison of eye movement metrics recorded at different sampling rates. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '12), Stephen N. Spencer (Ed.). ACM, New York, NY, USA, 321-324. DOI=10.1145/2168556.2168626

Relevant texts:
  1. Recursive Digital Filters: A Concise Guide

Supplemental files:
  1. Makefile
  2. bw.py
  3. filter.py
  4. fixation.py
  5. graph.py
  6. grid.py
  7. plotter.py
  8. point.py
  9. scanpath.py
  10. sg.py
  11. xmlpp.py
Supplemental materials:

Tue. Sep.0606 Gazepoint demo with focus on R and ANOVA

Supplemental materials:

Thu. Sep.0807 CPSC 412 case study
Tue. Sep.1308 Pre-proposals due

  1. Chp.04: Taxonomy of Eye Movements
  2. Chp.12: Eye Movement Analysis

Pre-proposal in-class feedback (Teams 2–4)

Thu. Sep.1509 Pre-proposal in-class feedback (Teams 1,5–9)
Tue. Sep.20
10 SIGCHI '90, '99 Papers:
  1. Starker, India, and Bolt, Richard A., A Gaze-Responsive Self-Disclosing Display, in CHI'90 Proceedings, ACM, New York, NY, 1990.
  2. Jacob, Robert J. K., What You Look At Is What You Get: Eye Movement-Based Interaction Techniques, in CHI'90 Proceedings, ACM, New York, NY, 1990.
  3. Vertegaal, Roel, The GAZE Groupware System: Mediating Joint Attention in Multiparty Communication and Collaboration, in CHI'99 Proceedings, ACM, New York, NY, 1999.
  4. Zhai, S., Morimoto, C., and Ihde, Steven, Manual and Gaze Input Cascaded (MAGIC) Pointing, in CHI'99 Proceedings, ACM, New York, NY, 1999.
  5. Byrne, Michael D., Anderson, John R., Douglass, Scott, and Matessa, Michael, Eye Tracking the Visual Search of Click-Down Menus, in CHI'99 Proceedings, ACM, New York, NY, 1999.
Thu. Sep.22
11 IRB materials due

CHI '07 Papers:

  1. Cutrell, E. and Guan, Z. What are you looking for?: an eye-tracking study of information usage in web search. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI '07). 2007, ACM, New York, NY, 407-416.
ETRA '00, ETRA '02, ETRA '04 Papers:
  1. Jeff B. Pelz, Roxanne Canosa, Jason Babcock, Extended Tasks Elicit Complex Eye Movement Patterns in Proceedings of the Eye Tracking Research & Applications Symposium (ETRA), ACM, New York, NY, 2000.
  2. Paivi Majaranta and Kari-Jouko Raiha, Twenty Years of Eye Typing: Systems and Design Issues, in Proceedings of the Eye Tracking Research & Applications Symposium (ETRA), New Orleans, LA, 2002, ACM.
  3. David S. Wooding, Fixation Maps: Quantifying Eye-Movement Traces, in Proceedings of the Eye Tracking Research & Applications Symposium (ETRA), New Orleans, LA, 2002, ACM.
  4. Benjamin Law, M. Stell Atkins, A. E., Kirkpatrick, Alan J. Lomax, and Christine L. Mackenzie, Eye Gaze Patterns Differentiate Novice and Experts in a Virtual Laparaoscopic Surgery Training Environment, in Proceedings of the Eye Tracking Research & Applications Symposium (ETRA), San Antonio, TX, 2004, ACM.
Tue. Sep.2712 Quiz on SIGCHI '90, '99, ETRA '00, '02, '04 papers

Papers:

  1. Valuch et al., 2015, Using eye tracking to tet for individual differences in attention to attractive faces, Frontiers in Psychology.
  2. Schoenenberg et al., 2015, Facial Affect Recognition in Violent and Nonviolent Antisocial Behavior Subtypes, Journal of Personality Disorders.
  3. Ho, G., Scialfa, C. T., Caird, J. K., Graw, T., Visual search for traffic signs: the effects of clutter, luminance, and aging. Human Factors: The Journal of the Human Factors and Ergonomics Society 02/2001, 43(2):194-207.
Thu. Sep.2913 Proposal due (paper in conference format, everything prior to results)

Papers:

  1. Triesch, et al. 2003, What you see is what you need, Journal of Vision.
  2. Camilli et al., 2008, ASTEF: A simple tool for examining fixations, Behavior Research Methods.
  3. Rayner, K., 2009, Eye Movements in Reading: Models and Data, Journal of Eye Movement Research.
Talks:
  1. Krejtz, I., 2010, Perceptual span analysis in reading, Eye Tracking Seminar, Barcelona.
Tue. Oct.0414 MIDTERM: Day 1 Teams: 6, 1, 8, 3 (randomly generated order, thanks to random.org)
Thu. Oct.0615 MIDTERM: Day 2 Teams: 7, 2, 4, 9, 5 (randomly generated order, thanks to random.org)
Tue. Oct.11
16 Start running experiments

Lab day: Python data analysis setup

Thu. Oct.13
17 Mystery papers:
  1. paper1.pdf
  2. paper2.pdf
  3. paper3.pdf
  4. paper4.pdf
Tue. Oct.18
18 Book chapters/sections:
  1. Chp.01: Visual Attention—Part I
  2. Chp.01: Visual Attention—Part II
Thu. Oct.20
19 Final Exam handed out

Book chapters/sections:

  1. Chp.02: Neurological Substrate of the HVS (The Eye)
  2. Chp.02: Neurological Substrate of the HVS (The Retina, The Optic Tract; The Occipital Cortex; Visual Pathways)
  3. Chp.03: Visual Psychophysics (Spatial Vision; Temporal Vision; Color Vision)
Review of text chapters/technical papers
Tue. Oct.25
Dr. D. away: Lund
20 Guest Lecture: Matias Volonte
Thu. Oct.27
Dr. D. away: Lund
21 Guest Lecture: Matias Volonte
Tue. Nov.01
22 Book chapters/sections:
  • Sections 17.4—17.9
  • Sections 18.1—18.4
  • Sections 20.1—20.3
Topics:
  1. Reading: importance of eye movements in reading (vs. tachistoscopic studies)
  2. Scene perception: compare and contrast scene perception vs. reading
  3. Visual search: what is the consensus view of visual search, e.g., how does vision work in this task? Is performance task-dependent?
  4. Natural tasks: in what kinds of tasks have eye movements been recorded? What has been learned?
  5. Aviation: Where do pilots look? Why is it important?
  6. Driving: Where do drivers look?
  7. Visual inspection: what are the important eye movement metrics to record in this task?
  8. HCI: What's the difference between diganostic and interactive uses of eye trackers, i.e., how differently must the system respond?
  9. Gaze-Contingent Displays: What's the difference between the two different approaches (screen-based and model-based)?
chp16-notes.pdf

Thu. Nov.03
23 Vsevolod Peysakhovich's PhD Defense: Study of pupil diameter and eye movements to enhance flight safety
Tue. Nov.08-- Fall Break
Thu. Nov.1024 SIGCHI '16 papers (Eye Traacking Applications):
  1. Bastian Pfleging, Drea K. Fekety, Albrecht Schmidt, and Andrew L. Kun. 2016. A Model Relating Pupil Diameter to Mental Workload and Lighting Conditions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5776-5788.
  2. Baris Serim and Giulio Jacucci. 2016. Pointing while Looking Elsewhere: Designing for Varying Degrees of Visual Guidance during Manual Input. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5789-5800.
  3. Shahram Jalaliniya and Diako Mardanbegi. 2016. EyeGrip: Detecting Targets in a Series of Uni-directional Moving Objects Using Optokinetic Nystagmus Eye Movements. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5801-5811.
  4. Thomas Templier, Kenan Bektas, and Richard H.R. Hahnloser. 2016. Eye-Trace: Segmentation of Volumetric Microscopy Images with Eyegaze. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5812-5823.
Tue. Nov.15
25 SIGCHI '16 papers (Eye Gaze):
  1. Michael Xuelin Huang, Tiffany C.K. Kwok, Grace Ngai, Stephen C.F. Chan, and Hong Va Leong. 2016. Building a Personalized, Auto-Calibrating Eye Tracker from User Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5169-5179.
  2. Keita Higuch, Ryo Yonetani, and Yoichi Sato. 2016. Can Eye Help You?: Effects of Visualizing Eye Fixations on Remote Collaboration Scenarios for Physical Tasks. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5180-5190.
  3. Michael Mauderer, David R. Flatla, and Miguel A. Nacenta. 2016. Gaze-Contingent Manipulation of Color Perception. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5191-5202.
  4. Byungjoo Lee, Olli Savisaari, and Antti Oulasvirta. 2016. Spotlights: Attention-Optimized Highlights for Skim Reading. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5203-5214.
Thu. Nov.17
26 Topics:
  1. Heatmap rendering
  2. Heatmap similarity via entropy, Nearest Neighbor Index
Takumi Bolte's notes Topics:
  1. Parallelization of scripts on Palmetto via MPI (and PBS)
  2. Parallelization of heatmap rendering (OpenCL)
Takumi Bolte's notes
Tue. Nov.2227 Final Exam Due (meet in class to drop off)

Student Evaluations (online)

Thu. Nov.24-- Thanksgiving
Tue. Nov.2928 Return final exams.
Thu. Dec.0129 Final Paper Due
Wed. Dec.730 FINAL EXAM: Project Presentations 3:00-5:30

Animals and Humans

  1. Team 1: Animal Vibrancy and Eye Size
  2. Team 3: Differential Viewing Strategies towards Faces
Text and Games
  1. Team 7: Effect of Font Type
  2. Team 8: Linear Letter Combinations
  3. Team 4: Effects of Time Pressure on Find and Seek
Shopping and Searching
  1. Team 5: Search Time in Online Shopping
  2. Team 9: Location of Expiration Dates
  3. Team 2: Search Efficiency of Patient Order Records
  4. Team 6: Bicyclist Conspicuity