Gaze-contingency paradigm

Within computer technology, the gaze-contingency paradigm is a general term for techniques allowing a computer screen display to change in function depending on where the viewer is looking. Gaze-contingent techniques are part of the eye movement field of study in psychology.

From a system analysis point of view, eye-tracking applications should be distinguished from diagnostic or interactive system. In diagnostic mode, the eye tracker provides data about the observer's visual search and attention processes. In interactive mode, the eye-tracker is used as an input device. From a general point of view, an interactive system responds to the observer's actions and interacts with them. Because the display updates in response to the observer's eye movements, the gaze-contingency paradigm can be classified an interactive eye-tracking application.^[1]

Background

Over the past century, the way the eyes move in human activities as diverse as playing sport, viewing works of art, piloting aircraft, exploring visual scenes, recognizing face or facial expressions,^[2][3] reading language, and sight-reading of music,^[4] has revealed some of the ocular and psychological mechanisms involved in the visual system. The gaze-contingent techniques aim to overcome limitations inherent to simple eye-movement recording. Indeed, due to an imperfect coupling between overt and covert attention,^[5][6][7] it is not possible to exactly know which visual information the viewer is processing based on the fixation locations. By controlling precisely the information projected in different parts of the visual field, the gaze-contingent techniques permit to disentangle what is fixated and what is processed.

The technical principle of the paradigm involves a computer interfaced with both an eye-movement tracking system (eye-tracker) and a display of the visual stimulus. Successful gaze-contingency requires a fast computer, a display with a high refresh rate, and an eye tracker with low latency.^[8][9] In gaze-contingent displays, the stimulus is continuously updated as a function of the observers' current gaze position; for instance, in the moving window paradigm,^[10][11][12] observers can see the scene only through a central hole, giving the sensation of seeing through a telescope.

Therefore, the gaze-contingent technique is a powerful method to control for the visual information feeding the visual system and to isolate information use.

Techniques

The gaze-contingent technique is the basis of various experimental paradigms, each of them allowing to investigate specific cognitive processes. In the moving window paradigm^[13][14] only the part of the visual field around the gaze location (foveal information) is displayed normally, the surrounding part of the visual field (extrafoveal and peripheral information) being altered (removed for visual scenes or replaced by chains of X in reading). The moving mask paradigm^[15] is a reverse technique in comparison with the moving window paradigm. It dynamically obscures central vision (or replaces letters with X in reading), permitting only extrafoveal information use. In the boundary paradigm,^[16][17][18] an extrafoveal prime (a homophone in reading for example) is replaced by the target stimulus when the eyes cross an invisible boundary around the target area. In a related technique, the display can be updated when the gaze moves at a speed higher than a specified velocity threshold, ensuring that the display updates during a saccade.^[19][20] This velocity thresholding technique is used to prevent the observer from noticing the changes made to the display, because saccadic suppression blocks visual processing during saccades.^[21] The parafoveal magnification paradigm^[22] compensates for how visual acuity drops off as a function of retinal eccentricity. On each fixation and in real time, parafoveal text is magnified to equalize its perceptual impact with that of concurrent foveal text.

Parafoveal magnification paradigm: Graphical depiction of the parafoveal magnification paradigm (Miellet et al., 2009). The location of each fixation is indicated with an arrow and the corresponding display for that fixation is represented. Consecutive lines represent the chronological order of fixations.

In the language domain, this method has been successfully used in natural reading. The study of eye movements in reading allowed researchers to map out the perceptual span (moving window paradigm^[23][24]), the nature of the extrafoveal information extracted during a fixation, for instance orthographic and phonological information (boundary paradigm)^[25][26][27] or the relative influence of attention versus visual acuity drop-off in the perceptual span (parafoveal magnification paradigm^[28]).

Gaze-contingent techniques can also be used to ensure compliance with other aspects of a task. For example, some researchers have required that observers look at a specific location and press a button before the task begins,^[29][30] and others have made the entire task display disappear whenever the observers look away from a specific task-relevant area.^[31]

Applications

The gaze-contingent technique has been adapted in other tasks than reading. The moving window paradigm has been used to study the effect of culture in face recognition for example.^[32] The moving mask paradigm has been used in visual learning ^[33] or visual search of animals in natural visual scenes.^[34]

The various gaze-contingent techniques has given eye-movement researchers the ability to observe the processing of visual input in much greater detail (particularly its temporal characteristics), the perceptual span, and the nature of central versus peripheral processing in reading.

See also

• Eye movement
• Eye tracking
• Eye movement in language reading
• Eye movement in music reading
• Foveated imaging
• Attention

References

1. Duchowski, AT (2007). Eye Tracking Methodology: Theory and Practice (2nd ed.). Springer.
2. Melissa H. Black; Nigel T.M. Chen; Kartik K. Iyer; Ottmar V. Lipp; Sven Bölte; Marita Falkmer; Tele Tan; Sonya J. Girdler (2017). "Mechanisms of facial emotion recognition in autism spectrum disorders: Insights from eye tracking and electroencephalography". Neuroscience & Biobehavioral Reviews. 80: 488–515. doi:10.1016/j.neubiorev.2017.06.016. PMID 28698082.
3. Falck-Ytter, Terje; Bölte, Sven; Gredebäck, Gustaf (2013). "Eye tracking in early autism research". Journal of Neurodevelopmental Disorders. 5 (1): 28. doi:10.1186/1866-1955-5-28. PMC 3849191. PMID 24069955.
4. Pollatsek, A; Rayner, K (1990). "Eye movements, the eye–hand span, and the perceptual span in sight-reading of music". Current Directions in Psychological Science: 49–53.
5. Murthy, A.; Thompson, K. G.; Schall, J. D. (2001). "Dynamic dissociation of visual selection from saccade programming in frontal eye field". Journal of Neurophysiology. 86 (5): 2634–2637. doi:10.1152/jn.2001.86.5.2634. PMID 11698551. S2CID 653798.
6. Posner, M. I. (1980). "Orienting of attention". Quarterly Journal of Experimental Psychology. 32 (1): 3–25. doi:10.1080/00335558008248231. PMID 7367577. S2CID 2842391.
7. Klein, R; Farrell, M (1989). "Search performance without eye movements". Perception & Psychophysics. 46 (5): 476–482. doi:10.3758/BF03210863. PMID 2813033.
8. Veneri, G; Federighi, P; Rosini, F; Federico, A; Rufa, A (2010). "Influences of data filtering on human-computer interaction by gaze-contingent display and eye-tracking applications". Computers in Human Behavior. 26 (6): 1555–1563. doi:10.1016/j.chb.2010.05.030.
9. Duchowski, AT (2007). Eye Tracking Methodology: Theory and Practice (2nd ed.). Springer.
10. Pomplun, M; Reingold, E. M; Shen, J (2001). "Peripheral and parafoveal cueing and masking effects on saccadic selectivity in a gaze-contingent window paradigm". Vision Research. 41 (21): 2757–69. doi:10.1016/S0042-6989(01)00145-6. PMID 11587725. S2CID 18233786.
11. Reder, S.M. (1973). "On-line monitoring of eye position signals in contingent and noncontingent paradigms". Behavior Research Methods & Instrumentation. 5 (2): 218–28. doi:10.3758/BF03200168.
12. McConkie, G.W; Rayner, K (1975). "The span of the effective stimulus during a fixation in reading". Perception & Psychophysics. 17 (6): 578–86. doi:10.3758/BF03203972.
13. Reder, S.M. (1973). "On-line monitoring of eye position signals in contingent and noncontingent paradigms". Behavior Research Methods & Instrumentation. 5 (2): 218–28. doi:10.3758/BF03200168.
14. McConkie, G.W; Rayner, K (1975). "The span of the effective stimulus during a fixation in reading". Perception & Psychophysics. 17 (6): 578–86. doi:10.3758/BF03203972.
15. Rayner, K; Bertera, JH (1979). "Reading without a fovea". Science. 206 (4417): 468–469. Bibcode:1979Sci...206..468R. doi:10.1126/science.504987. PMID 504987.
16. Rayner, Keith (1975). "The perceptual span and peripheral cues in reading". Cognitive Psychology. 7: 65–81. doi:10.1016/0010-0285(75)90005-5. S2CID 54366006.
17. Balota, David A; Pollatsek, Alexander; Rayner, Keith (1985). "The interaction of contextual constraints and parafoveal visual information in reading". Cognitive Psychology. 17 (3): 364–390. doi:10.1016/0010-0285(85)90013-1. PMID 4053565. S2CID 8237394.
18. Miellet, Sébastien; Sparrow, Laurent (2004). "Phonological codes are assembled before word fixation: Evidence from boundary paradigm in sentence reading". Brain and Language. 90 (1–3): 299–310. CiteSeerX 10.1.1.608.3108. doi:10.1016/S0093-934X(03)00442-5. PMID 15172547. S2CID 9708305.
19. Kennedy, A; Heller, D.; Pynte, J.; Radach, Ralph (2000). Reading as a Perceptual Process (1st ed.). Elsevier. pp. 119–145. ISBN 9780080436425.
20. Alexander, R. G.; Schmidt, J.; Zelinsky, G. J. (2014). "Are summary statistics enough? Evidence for the importance of shape in guiding visual search". Visual Cognition. 22 (3–4): 595–609. doi:10.1080/13506285.2014.890989. PMC 4500174. PMID 26180505.
21. Bridgeman, G.; Hendry, D.; Stark, L. (1975). "Failure to detect displacement of visual world during saccadic eye movements". Vision Research. 15 (6): 719–722. doi:10.1016/0042-6989(75)90290-4. PMID 1138489. S2CID 11541038.
22. Miellet, S; O'Donnell, PJ; Sereno, SC (2009). "Parafoveal Magnification: Visual Acuity Does Not Modulate the Perceptual Span in Reading". Psychological Science. 20 (6): 721–728. doi:10.1111/j.1467-9280.2009.02364.x. PMID 19470124. S2CID 8476978.
23. Reder, S.M. (1973). "On-line monitoring of eye position signals in contingent and noncontingent paradigms". Behavior Research Methods & Instrumentation. 5 (2): 218–28. doi:10.3758/BF03200168.
24. McConkie, G.W; Rayner, K (1975). "The span of the effective stimulus during a fixation in reading". Perception & Psychophysics. 17 (6): 578–86. doi:10.3758/BF03203972.
25. Rayner, Keith (1975). "The perceptual span and peripheral cues in reading". Cognitive Psychology. 7: 65–81. doi:10.1016/0010-0285(75)90005-5. S2CID 54366006.
26. Balota, David A; Pollatsek, Alexander; Rayner, Keith (1985). "The interaction of contextual constraints and parafoveal visual information in reading". Cognitive Psychology. 17 (3): 364–390. doi:10.1016/0010-0285(85)90013-1. PMID 4053565. S2CID 8237394.
27. Miellet, Sébastien; Sparrow, Laurent (2004). "Phonological codes are assembled before word fixation: Evidence from boundary paradigm in sentence reading". Brain and Language. 90 (1–3): 299–310. CiteSeerX 10.1.1.608.3108. doi:10.1016/S0093-934X(03)00442-5. PMID 15172547. S2CID 9708305.
28. Miellet, S; O'Donnell, PJ; Sereno, SC (2009). "Parafoveal Magnification: Visual Acuity Does Not Modulate the Perceptual Span in Reading". Psychological Science. 20 (6): 721–728. doi:10.1111/j.1467-9280.2009.02364.x. PMID 19470124. S2CID 8476978.
29. Alexander, R. G; Zelinsky, G. J (2011). "Visual similarity effects in categorical search". Journal of Vision. 11 (8): 9. doi:10.1167/11.8.9. PMC 8409006. PMID 21757505.
30. Arizpe, Joseph; Kravitz, Dwight J; Walsh, Vincent; Yovel, Galit; Baker, Chris I (2016). "Differences in Looking at Own- and Other-Race Faces Are Subtle and Analysis-Dependent: An Account of Discrepant Reports". PLOS ONE. 11 (2): e0148253. Bibcode:2016PLoSO..1148253A. doi:10.1371/journal.pone.0148253. PMC 4744017. PMID 26849447.
31. Wilcockson, T.D.W; Pothos, E.M (2015). "Measuring inhibitory processes for alcohol-related attentional biases: Introducing a novel attentional bias measure" (PDF). Addictive Behaviors. 44: 88–93. doi:10.1016/j.addbeh.2014.12.015. PMID 25583563.
32. Caldara, Roberto; Zhou, Xinyue; Miellet, Sébastien (2010). "Putting Culture Under the 'Spotlight' Reveals Universal Information Use for Face Recognition". PLOS ONE. 5 (3): e9708. Bibcode:2010PLoSO...5.9708C. doi:10.1371/journal.pone.0009708. PMC 2841167. PMID 20305776.
33. Castelhano, Monica S; Henderson, John M (2008). "Stable individual differences across images in human saccadic eye movements". Canadian Journal of Experimental Psychology. 62 (1): 1–14. doi:10.1037/1196-1961.62.1.1. PMID 18473624. S2CID 915709.
34. Miellet, S; Zhou, X; He, L; Rodger, H; Caldara, R (2010). "Investigating cultural diversity for extrafoveal information use in visual scenes". Journal of Vision. 10 (6): 21. doi:10.1167/10.6.21. PMID 20884570.