KIAM Main page Web Library  •  Publication Searh   
Publication

Conference material: "Proceedings of the International Conference on Computer Graphics and Vision Graphicon, CEUR"
Authors: Ryabinin K., Belousov K., Chumakov R.
Visual Analytics Tools for Polycode Stimuli Eye Gaze Tracking in Virtual Reality
Abstract:
This paper is devoted to extending the previously created unified pipeline for conducting eye-tracking- based experiments in a virtual reality environment. In the previous work, we proposed using SciVi semantic data mining platform, Unreal Engine and HTC Vive Pro Eye head-mounted display to study reading process in the immersive virtual reality. The currently proposed extension enables to handle so-called polycode stimuli: compound visual objects, which consist of individual parts carrying different semantics for the viewer. To segment polycode stimuli extracting areas of interest (areas, where the informants eye gaze is being tracked) we adopt Creative Maps Studio vector graphics editor. To integrate Creative Maps Studio into the existing pipeline we created plugins for SciVi platform to load and handle the segmented stimuli, place them in the virtual reality scenes, collect corresponding eye gaze tracking data and perform visual analysis of the data collected. To analyze the eye gaze tracks, we utilize a circular graph that allows comprehensive visualization of hierarchical areas of interest (mapping them to color- coded graph nodes grouped into the hierarchy with a help of multilevel circular scale) and corresponding eye movements (mapped to the graph edges). We tested our pipeline on two different stimuli: the advertising poster and the painting The Appearance of Christ Before the People by A. Ivanov (1857).
Keywords:
Eye Gaze Tracking, Virtual Reality, Visual Analytics, Image Segmentation, Polycode Stimulus
Publication language: english,  pages: 12 (p. 211-222)
English source text:
Export link to publication in format:   RIS    BibTeX
About authors:
  • Ryabinin Konstantin,  orcid.org/0000-0002-8353-7641,  Saint Petersburg State University; Perm State University
  • Belousov Konstantin,  orcid.org/0000-0003-4447-1288,  Saint Petersburg State University; Perm State University
  • Chumakov Roman,  orcid.org/0000-0002-6860-1932,  Perm State University