EmojiGrid

The EmojiGrid is an affective self-report tool consisting of a rectangular grid that is labelled with emojis. It is trademark of Kikkoman. The facial expressions of the emoji labels vary from disliking via neutral to liking along the x-axis, and gradually increase in intensity along the y-axis. To report their affective appraisal of a given stimulus, users mark the location inside the grid that best represents their impression. The EmojiGrid can either be used as a paper or computer-based response tool. The images needed to implement the EmojiGrid are freely available from the OSF repository.

The EmojiGrid: an emoji-labelled Valence (horizontal axis) × Arousal (vertical axis) self-report tool.

Applications

The EmojiGrid was inspired by Russell's Affect Grid^[1] and was originally developed and validated for the affective appraisal of food stimuli,^[2] since conventional affective self-report tools (e.g., the Self-Assessment Manikin) are frequently misunderstood in that context.^[2][3] It has since been used and validated for the affective appraisal of a wide range of affective stimuli such as images,^[4][5] audio and video clips,^[6] 360 VR videos,^[7] touch events,^[8] food,^[9] and odors.^[10][11][12] It has also been used for the affective analysis of architectural spaces ^[13] to assess affective experience of trail racing,^[14] and to assess the emotional face evaluation capability of people with early dementia.^[15] Since it is intuitive and language independent, the EmojiGrid is also suitable for cross-cultural research.^[3][16]

Implementation

In a computer-based response paradigm, only the image area inside the horizontal and vertical grid borders should be responsive (clickable), so that users can report their affective response by pointing and/or clicking inside the grid.  In practice, this may be achieved by superimposing (1) a clickable image of the unlabeled grid area on top of (2) a larger image showing the grid area together with the emoji labels. The images needed to implement the EmojiGrid are freely available from the OSF repository. An implementation of the EmojiGrid rating task in the Gorilla experiment builder is freely available from the Gorilla Open Materials platform.

See also

• Affect measures
• Emotion classification
• Self-report inventory
• PAD emotional state model
• Valence (psychology)
• Arousal

Further reading

• Kuppens, Peter; et al. (2013). "The relation between valence and arousal in subjective experience". Psychological Bulletin. 139 (4): 917–940. doi:10.1037/a0030811. PMID 23231533.
• Mattek, Alison M.; et al. (2017). "A Mathematical Model Captures the Structure of Subjective Affect". Perspectives on Psychological Science. 12 (3): 508–526. doi:10.1177/1745691616685863. PMC 5445940. PMID 28544868.
• Van Der Burg, Erik; et al. (2021). "Sequential dependency for affective appraisal of food images". Humanities and Social Sciences Communications. 8. doi:10.1057/s41599-021-00909-4.
• Van Der Burg, Erik; et al. (2021). "Serial Dependence of Emotion within and Between Stimulus Sensory Modalities". Multisensory Research. 35 (2): 151–172. doi:10.1163/22134808-bja10064. hdl:11245.1/24134b17-9e07-48aa-9756-1fd1cc78aa10. PMID 34592713.

References

1. Russell, James A.; Weiss, Anna; Mendelsohn, Gerald A. (1989). "Affect Grid: A single-item scale of pleasure and arousal". Journal of Personality and Social Psychology. 57 (3): 493–502. doi:10.1037/0022-3514.57.3.493. ISSN 1939-1315. S2CID 4837807.
2. Toet, Alexander; Kaneko, Daisuke; Ushiama, Shota; Hoving, Sofie; de Kruijf, Inge; Brouwer, Anne-Marie; Kallen, Victor; van Erp, Jan B. F. (2018). "EmojiGrid: A 2D Pictorial Scale for the Assessment of Food Elicited Emotions". Frontiers in Psychology. 9: 2396. doi:10.3389/fpsyg.2018.02396. ISSN 1664-1078. PMC 6279862. PMID 30546339.
3. Kaneko, Daisuke; Toet, Alexander; Ushiama, Shota; Brouwer, Anne-Marie; Kallen, Victor; van Erp, Jan B.F. (2019). "EmojiGrid: A 2D pictorial scale for cross-cultural emotion assessment of negatively and positively valenced food". Food Research International. 115: 541–551. doi:10.1016/j.foodres.2018.09.049. PMID 30599977. S2CID 58653600.
4. Toet; van Erp (2019). "The EmojiGrid as a Tool to Assess Experienced and Perceived Emotions". Psych. 1 (1): 469–481. doi:10.3390/psych1010036. ISSN 2624-8611.
5. Brouwer, Anne-Marie; van Beers, Jasper J.; Sabu, Priya; Stuldreher, Ivo V.; Zech, Hilmar G.; Kaneko, Daisuke (2021-06-22). "Measuring Implicit Approach–Avoidance Tendencies towards Food Using a Mobile Phone outside the Lab". Foods. 10 (7): 1440. doi:10.3390/foods10071440. ISSN 2304-8158. PMC 8305314. PMID 34206278.
6. Toet, Alexander; van Erp, Jan B. F. (2020). "Affective rating of audio and video clips using the EmojiGrid". F1000Research. 9: 970. doi:10.12688/f1000research.25088.1. ISSN 2046-1402. PMC 8080979. PMID 33968373.
7. Toet, Alexander; Heijn, Fabienne; Brouwer, Anne-Marie; Mioch, Tina; van Erp, Jan B. F. (2019). "The EmojiGrid as an Immersive Self-report Tool for the Affective Assessment of 360 VR Videos". In Bourdot, Patrick; Interrante, Victoria; Nedel, Luciana; Magnenat-Thalmann, Nadia (eds.). Virtual Reality and Augmented Reality. Lecture Notes in Computer Science. Vol. 11883. Cham: Springer International Publishing. pp. 330–335. doi:10.1007/978-3-030-31908-3_24. ISBN 978-3-030-31907-6. S2CID 203847617. Retrieved 2021-11-28.
8. Toet, Alexander; van Erp, Jan B. F. (2020). Scilingo, Enzo Pasquale (ed.). "The EmojiGrid as a rating tool for the affective appraisal of touch". PLOS ONE. 15 (9): e0237873. Bibcode:2020PLoSO..1537873T. doi:10.1371/journal.pone.0237873. ISSN 1932-6203. PMC 7467219. PMID 32877409.
9. de Wijk, Rene A.; Ushiama, Shota; Ummels, Meeke J.; Zimmerman, Patrick H.; Kaneko, Daisuke; Vingerhoeds, Monique H. (2021-05-13). "Effect of Branding and Familiarity of Soy Sauces on Valence and Arousal as Determined by Facial Expressions, Physiological Measures, Emojis, and Ratings". Frontiers in Neuroergonomics. 2: 651682. doi:10.3389/fnrgo.2021.651682. ISSN 2673-6195. PMC 10790916. PMID 38235247.
10. Liu, Yingxuan; Toet, Alexander; Krone, Tanja; van Stokkum, Robin; Eijsman, Sophia; van Erp, Jan B. F. (2020). Greco, Alberto (ed.). "A network model of affective odor perception". PLOS ONE. 15 (7): e0236468. Bibcode:2020PLoSO..1536468L. doi:10.1371/journal.pone.0236468. ISSN 1932-6203. PMC 7392242. PMID 32730278.
11. Toet, Alexander; Eijsman, Sophia; Liu, Yingxuan; Donker, Stella; Kaneko, Daisuke; Brouwer, Anne-Marie; van Erp, Jan B.F. (2020). "The Relation Between Valence and Arousal in Subjective Odor Experience". Chemosensory Perception. 13 (2): 141–151. doi:10.1007/s12078-019-09275-7. ISSN 1936-5802. S2CID 208302660.
12. Van der Burg, Erik; Toet, Alexander; Brouwer, Anne-Marie; van Erp, Jan B. F. (2021). "Sequential Effects in Odor Perception". Chemosensory Perception. 15: 19–25. doi:10.1007/s12078-021-09290-7. ISSN 1936-5802. S2CID 235650532.
13. Sanatani, R.P. (2020). User-specific predictive affective modeling for enclosure analysis and design assistance", Imaginable Futures: Design Thinking, and the Scientific Method. 54th International Conference of the Architectural Science Association 2020. Auckland, New Zealand: Architectural Science Association (ANZAScA). pp. 1341–1350.
14. Aitken, John A.; Kaplan, Seth A.; Pagan, Olivia; Wong, Carol M.; Sikorski, Eric; Helton, William (2021-10-02). "Affective Forecasts for the Experience Itself: An Investigation of the Impact Bias during an Affective Experience". Current Psychology. 42 (13): 10581–10587. doi:10.1007/s12144-021-02337-8. ISSN 1046-1310. S2CID 244197232.
15. Rutkowski, Tomasz M.; Abe, Masato S.; Koculak, Marcin; Otake-Matsuura, Mihoko (July 2020). "Classifying Mild Cognitive Impairment from Behavioral Responses in Emotional Arousal and Valence Evaluation Task – AI Approach for Early Dementia Biomarker in Aging Societies". 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). Vol. 2020. Montreal, QC, Canada: IEEE. pp. 5537–5543. doi:10.1109/EMBC44109.2020.9175805. ISBN 978-1-7281-1990-8. PMID 33019233. S2CID 221385462.
16. Kaneko, Daisuke; Stuldreher, Ivo; Reuten, Anne J. C.; Toet, Alexander; van Erp, Jan B. F.; Brouwer, Anne-Marie (2021). "Comparing Explicit and Implicit Measures for Assessing Cross-Cultural Food Experience". Frontiers in Neuroergonomics. 2: 646280. doi:10.3389/fnrgo.2021.646280. ISSN 2673-6195. PMC 10790875. PMID 38235219.