CPSC 8810 Eye Tracking II: Gaze Sensing Interaction In XR
Syllabus

Description: Participants pursue collaborative (Psychology, IE and CPSC) research involving the use of an eye tracker in physical reality (a.k.a. mobile eye tracking), Virtual Reality (VR), and Augmented Reality (AR), or collectively known as eXtended Reality (XR). The course is team-based relying on use of limited resources, e.g., a single HTC Vive Pro Eye Head-Mounted Display (HMD), a single Microsoft HoloLens 2, a single Pupil Labs Core eye tracker, a single Ergoneers Dikablis Eye Tracker, or a single Tobii Glasses 2 eye tracker (the latter three being mobile eye trackers).
Prerequisites: CPSC 2120.

Prior knowledge of human factors, experimental design and C/C++/C#, Python, Computer Vision (e.g., OpenCV), Computer Graphics (e.g., OpenGL, OpenVR) and/or VR (e.g., Unity 3D) would be most helpful.

Required texts: None.
Recommended texts: None.
Supplemental notes: None.
Professor: Dr. Andrew Duchowski
Office: McAdams 309, 656-7677, duchowski@clemson.edu
Office hours: By appointment.
Objectives: To gain a basic understanding of eye tracking in physical and extended realities.
Laboratory content: This is not a lab course.
Evaluation:
%Grade
90-100A
80-89B
70-79C
60-69D
Research Log35%
Midterm Report20%
Class Participation10%
Term paper35%
Assignments: Unless otherwise specified, these are individual assignments, and must be strictly your own work and are not to be shown to anyone else.
Attendance: Roll will be taken for the first one or two weeks while the class roll fluctuates. However, attendance is not required. Absence, excused or not, does not change the responsibility for assigned work. Tests missed due to excused absences will normally result in the test not being counted in the average grade (i.e., there will normally be no makeup tests). An unexcused absence from a test will normally result in a grade of zero for that test. Students are expected to give at least one week advance notice for excused absences.
Academic dishonesty: The University policies on academic dishonesty apply. Publicly-available code or other material may be freely used if appropriately attributed. Each student is responsible for protecting his or her files from access by others. Work that is essentially the same and submitted without proper attribution is considered to be a violation of academic dishonesty policy by all those submitting the work, regardless of who actually did the work.

Plagiarism will not be tolerated. All work must include a list of hs cited and consulted sources, if appropriate. If you must use the work of others verbatim (assuming it is a significant statement) you must quote (block quote for more than one sentence) and reference the source directly after the quote. Otherwise use your own words. The idea hs behind any college level work is to do research and synthesize what you learn into a personal description of your understanding. Only non-copyrighted images may be used for assignments.

Class cancelation: Students are expected to wait for 15 minutes after the class beginning time before leaving if the instructor is late.
Assignment late policy: Late assignments will be accepted but points will be deducted according to the formula (3n)3 where n is the number of days late. Example: assuming assignments are due on Wednesday, the point deduction is as follows:
Max points possible Day received Days late
100Wed.0 (due date)
73Thu.1 day late
0Fri.2 days late

Late assignments will receive lowest priority for grading and returning.

Topical outline:
  • Gazepoint GP3 real-time eye tracking on the desktop
    • Python
    • networking
    • OpenGL
    • FIR filtering for event detection
  • HTC Vive Pro Eye real-time eye tracking in VR
    • C#
    • Unity 3D
    • SRAnipal SDK
    • 3D gaze intersection
  • Holo Lens 2 real-time eye tracking in AR
    • C#
    • Unity 3D
    • Microsoft MRTK
  • Pupil Labs off-line mobile eye tracking
    • Python
    • OpenGL
    • OpenCV
  • Tobii Glasses 2 off-line mobile eye tracking
    • Python
    • OpenGL
    • OpenCV
  • Ergoneers Dikablis off-line mobile eye tracking
    • Python
    • OpenGL
    • OpenCV