-
1.发明公开公开(公告)号：US20240171869A1
公开(公告)日：2024-05-23
申请号：US17991384
申请日：2022-11-21
发明人： Mikko Ollila
IPC分类号： H04N23/959 , G06T5/00 , G06T5/50 , H04N7/18 , H04N23/67
CPC分类号： H04N23/959 , G06T5/001 , G06T5/50 , H04N7/181 , H04N23/675 , G06T2207/20221
摘要： A system including server(s) configured to: receive, from N client devices, information indicating optical depths at which N users are gazing; send, to imaging device including left camera and right camera, information indicating N optical depths; and in each cycle of N consecutive pairs of left images and right images, for M ranging from 1 to N: receive Mth left image captured by focusing left camera at Mth optical depth; select such image for user(s) gazing within focusing range; generate extended depth-of-field (EDOF)-corrected Mth left images; receive Mth right image captured by focusing right camera according to another optical depth; select such image for other user(s) gazing within another focusing range; generate EDOF-corrected Mth right images; and send Mth left image, EDOF-corrected Mth left images, Mth right image, EDOF-corrected Mth right images to client device(s) of user(s), users other than user(s), other user(s), users other than other user(s), respectively.
-
公开(公告)号：US11030720B2
公开(公告)日：2021-06-08
申请号：US16431335
申请日：2019-06-04
发明人： Klaus Melakari , Mikko Ollila
IPC分类号： G06T3/40 , G06T5/00 , H04N13/383 , H04N13/239 , H04N13/344
摘要： A direct retinal projection apparatus including means for detecting a gaze direction of a user, a projector, a first optical element, an actuator and a processor. The first optical element includes different optical portions having different optical properties with respect to magnification. The processor is configured to render a warped image having a spatially-uniform angular resolution via the projector, whilst adjusting an orientation of the first optical element via the actuator, based on the detected gaze direction, to direct a projection of the warped image from the first optical element towards a retina of a user's eye. Projections of different portions of the warped image are differently magnified by the different optical portions of the first optical element to produce on the retina of the user's eye a de-warped image having a spatially-variable angular resolution.
-
公开(公告)号：US10939034B2
公开(公告)日：2021-03-02
申请号：US16505640
申请日：2019-07-08
发明人： Ville Timonen , Mikko Ollila
摘要： An imaging system for producing images for a display apparatus. The imaging system includes at least one camera, and processor communicably coupled to the at least one camera. The processor is configured to: obtain, from display apparatus, information indicative of current gaze direction of a user; determine, based on current gaze direction of the user, an object of interest within at least one display image, wherein the at least one display image is representative of a current view presented to user via display apparatus; adjust, based on a plurality of object attributes of the object of interest, a plurality of camera attributes of the at least one camera for capturing a given image of a given real-world scene; and generate from the given image a view to be presented to user via display apparatus.
-
4.发明授权公开(公告)号：US10565797B2
公开(公告)日：2020-02-18
申请号：US15898448
申请日：2018-02-17
发明人： Joonas Nissinen , Mikko Ollila
摘要： A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.
-
公开(公告)号：US10564429B2
公开(公告)日：2020-02-18
申请号：US15885984
申请日：2018-02-01
摘要： A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes a plurality of illuminators for emitting light pulses to illuminate a user's eye when the head-mounted display apparatus is worn by the user, the illuminators including at least a first illuminator and a second illuminator; at least one lens positioned on an optical path of reflections of the light pulses from the user's eye, the at least one lens having no chromatic-aberration correction; at least one camera for capturing an image of the reflections of the light pulses; and a processor coupled with illuminators and the at least one camera, the processor being configured to control operations of the illuminators and the at least one camera, and to process the captured image to detect a gaze direction of the user.
-
公开(公告)号：US20180157910A1
公开(公告)日：2018-06-07
申请号：US15886040
申请日：2018-02-01
摘要： A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes: at least one first optical element comprising particles of a phosphorescent or fluorescent material dispersed therein, the particles of the phosphorescent or fluorescent material being dispersed in a manner that when excited by electromagnetic radiation incident thereupon, the particles produce structured light of a given wavelength, wherein the produced structured light illuminates a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form of the reflections and a position of the reflections on an image plane of the at least one camera; and a processor coupled in communication with the at least one camera, wherein the processor is configured to process the captured image to detect a gaze direction of the user.
-
公开(公告)号：US09989774B1
公开(公告)日：2018-06-05
申请号：US15650807
申请日：2017-07-14
CPC分类号： G02B27/1066 , G02B27/0172 , G02B27/0176 , G02B27/145 , G02B2027/013 , G02B2027/0147 , G02B2027/0159 , G02B2027/0187 , G06T11/60
摘要： A display apparatus and method of displaying, via the display apparatus. The display apparatus includes context image renderer for rendering context image; focus image renderer for rendering focus image; exit optical element; and optical combiner for optically combining projection of the rendered context image with projection of the rendered focus image to create visual scene. The optical combiner includes first semi-transparent reflective element; and a second semi-transparent reflective element. The context image renderer is arranged in a manner that the projection of rendered context image passes through first semi-transparent reflective element towards exit optical element. The focus image renderer is arranged in a manner that projection of the rendered focus image passes through the first semi-transparent reflective element towards the second semi-transparent reflective element, and reflected therefrom towards the first semi-transparent reflective element, and is then reflected from the first semi-transparent reflective element towards the exit optical element.
-
公开(公告)号：US20240205553A1
公开(公告)日：2024-06-20
申请号：US18067362
申请日：2022-12-16
发明人： Mikko Ollila , Kai Inha
IPC分类号： H04N23/959 , H04N7/18 , H04N23/56 , H04N23/67
CPC分类号： H04N23/959 , H04N7/183 , H04N23/56 , H04N23/675 , H04N23/63
摘要： An imaging apparatus includes: a left camera and right camera; and processor(s) configured to: control the left and right cameras to capture pairs of left and right images, respectively, wherein a left image of one of two consecutive pairs and a right image of another of two consecutive pairs are captured using one of small aperture size(s) and large aperture size(s), whilst a right image of one of two consecutive pairs and a left image of another of two consecutive pairs are captured using any one of: (i) another of small aperture size(s) and large aperture size(s), (ii) one of small aperture size(s) and medium aperture size(s) and another of small aperture size(s) and medium aperture size(s), respectively, (iii) one of large aperture size(s) and medium aperture size(s) and another of large aperture size(s) and medium aperture size(s), respectively; and send the captured images to client device(s) or server(s).
-
公开(公告)号：US20240169496A1
公开(公告)日：2024-05-23
申请号：US17991594
申请日：2022-11-21
发明人： Mikko Ollila , Mikko Strandborg
摘要： A method includes obtaining 3D model of real-world environment; receiving image captured using camera, and pose information indicative of camera pose from which image is captured; utilising 3D model to generate reconstructed image from a perspective of camera pose; identifying group(s) of neighbouring pixels in image that is/are out of focus; determining point spread function for group(s) of neighbouring pixels, based on correlation between group(s) of neighbouring pixels and corresponding group of neighbouring pixels in reconstructed image; and applying extended depth-of-field correction to group(s) of neighbouring pixels in image, by using point spread function.
-
公开(公告)号：US20240056564A1
公开(公告)日：2024-02-15
申请号：US17886715
申请日：2022-08-12
发明人： Mikko Ollila
IPC分类号： H04N13/383 , G06T5/00 , G06T5/50 , G06T7/55
CPC分类号： H04N13/383 , G06T5/003 , G06T5/002 , G06T5/50 , G06T7/55
摘要： An imaging system including a first camera and a second camera corresponding to a first eye and a second eye of a user, respectively; and at least one processor. The at least one processor is configured to control the first camera and the second camera to capture a sequence of first images and a sequence of second images of a real-world environment, respectively; and apply a first extended depth-of-field correction to one of a given first image and a given second image, whilst applying at least one of: defocus blur correction, image sharpening, contrast enhancement, edge enhancement to another of the given first image and the given second image.
-
-
-
-
-
-
-
-
-
搜索结果
88 条记录 (耗时 0.023 秒)
