The paper deals with the problem of visual perception discomfort inherent in mixed reality systems, more precisely, the determination of the lighting parameters of the objects of the virtual world, corresponding to the lighting conditions of the real world, into which the virtual objects are embedded. The paper proposes an effective solution to the problem of reconstructing the coordinates of a light source from an RGBD image of the real world. A detailed description of the algorithm and the results of a numerical experiment on reconstructing the coordinates of light sources in a model scene are given. The accuracy of coordinate recovery is analyzed and the limitations of the method are considered, associated with the inaccuracy of determining the boundaries of objects and their shadows, as well as the lack of interconnected areas of the boundaries of objects and their shadows in the RGBD image of the scene.

Mixed reality, Luminance distribution, Wide dynamic range image, RGBD image, 3D scene, Augmented reality, Lighting recovery, Direct illumination, Point light source

Mathematical modelling in actual problems of science and technics

Lemeshev Andrew Fedorovich,  ,  orcid.org/0000-0001-5121-4357,  ITMO University

Zhdanov Dmitry Dmitrievich,  ,  orcid.org/0000-0001-7346-8155,  ITMO University

Barladyan Boris Khaimovich,  ,  orcid.org/0000-0002-2391-2067,  KIAM RAS