公开(公告)号：US20240233098A1

公开(公告)日：2024-07-11

申请号：US18360683

申请日：2023-07-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingen Xiong ,  Christopher A. Peri

IPC: G06T5/00 ,  G06T3/00 ,  G06T19/00 ,  G06V10/56

CPC classification number: G06T5/006 ,  G06T3/0093 ,  G06T19/006 ,  G06V10/56 ,  G06T2207/10024

Abstract: A method includes obtaining an image captured by a see-through camera of a video see-through (VST) augmented reality (AR) device. The method also includes identifying a first distortion created by at least one see-through camera lens and identifying a second distortion created by at least one display lens of the VST AR device. The method further includes determining a combined distortion based on the first distortion and the second distortion. The method also includes pre-warping the image to offset the combined distortion such that the image is not distorted when the pre-warped image is viewed by a user through the at least one display lens of the VST AR device. In addition, the method includes presenting the pre-warped image to the user on at least one display of the VST AR device.

公开(公告)号：US11741671B2

公开(公告)日：2023-08-29

申请号：US17500817

申请日：2021-10-13

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Yingen Xiong ,  Christopher A. Peri

IPC: G06T17/20 ,  G06N20/00 ,  G06T3/40 ,  G06T7/55 ,  G06T19/00 ,  G06T19/20

CPC classification number: G06T17/20 ,  G06N20/00 ,  G06T3/4053 ,  G06T7/55 ,  G06T19/006 ,  G06T19/20 ,  G06T2207/10024

Abstract: Generating a 3D scene reconstruction using depth fusion can include creating a high-resolution sparse depth map by mapping sensor depths from a low-resolution depth map to points corresponding to pixels of a high-resolution color image of a scene. The high-resolution sparse depth map can have the same resolution as the high-resolution color image. A fused sparse depth map can be produced by combining the high-resolution sparse depth map with sparse depths reconstructed from the high-resolution color image. The high-resolution dense depth map can be generated based on fused sparse depths of the fused sparse depth map.

公开(公告)号：US20230215075A1

公开(公告)日：2023-07-06

申请号：US18048352

申请日：2022-10-20

Applicant: Samsung Electronics Co., Ltd.

Inventor： Christopher A. Peri ,  Eric Ho Ching Yip

IPC: G06T15/00 ,  G06T19/00 ,  H04L65/613

CPC classification number: G06T15/005 ,  G06T19/006 ,  H04L65/613

Abstract: A method for deferred rendering on an extended reality (XR) device includes establishing a transport session for content on the XR device with a server. The method also includes performing a loop configuration for the content based on the transport session between the XR device and the server. The method further includes providing pose information based on parameters of the loop configuration to the server. The method also includes receiving pre-rendered content based on the pose information from the server. In addition, the method includes processing and displaying the pre-rendered content on the XR device.

公开(公告)号：US20230137199A1

公开(公告)日：2023-05-04

申请号：US17696729

申请日：2022-03-16

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingen Xiong ,  Christopher A. Peri

IPC: G09G3/20

Abstract: A system and method for display distortion calibration are configured to capture distortion with image patterns and calibrate distortion with ray tracing for an optical pipeline with lenses. The system includes an image sensor and a processor to perform the method for display distortion calibration. The method includes generating an image pattern to encode display image pixels by encoding display distortion associated with a plurality of image patterns. The method also includes determining a distortion of the image pattern resulting from a lens on a head-mounted display (HMD) and decoding the distorted image patterns to obtain distortion of pixels on a display. A lookup table is created of angular distortion of all the pixels on the display. The method further includes providing a compensation factor for the distortion by creating distortion correction based on the lookup table of angular distortion.

公开(公告)号：US11062474B2

公开(公告)日：2021-07-13

申请号：US16392563

申请日：2019-04-23

Applicant: Samsung Electronics Co., Ltd.

Inventor： Christopher A. Peri

IPC: G06T7/73 ,  G06K9/00 ,  G06T7/246 ,  G06T7/11 ,  G06T7/579 ,  G06T7/70 ,  G01P15/18 ,  G06F3/01 ,  G06T7/20

Abstract: A method, electronic device, and non-transitory computer readable medium for optical tracking are provided. The method includes identifying at least one object within an environment, from received image data. The method also includes assigning a volatility rating to the identified object. Additionally, the method includes determining one or more tracking points associated with the identified object. The method also includes determining a priority rating for the each of the one or more tracking points associated with the identified object based on the assigned volatility rating of the identified object. The method also includes selecting the one or more tracking points for optical tracking based on the priority rating.

公开(公告)号：US10565724B2

公开(公告)日：2020-02-18

申请号：US15854620

申请日：2017-12-26

Applicant: Samsung Electronics Co., Ltd.

Inventor： Christopher A. Peri

IPC: G06K9/00 ,  G06T7/73 ,  G06T7/246 ,  G06T7/11 ,  G06T7/579 ,  G06T7/70 ,  G01P15/18 ,  G06F3/01 ,  G06T7/20

Abstract: A method for tracking a position of a device is provided, wherein the method includes capturing, at a first positional resolution, based on information from a first sensor, a first position of the device within an optical tracking zone of the first sensor. The method also includes determining, based on information from the first sensor, that the device exits the optical tracking zone of the first sensor. Further, the method includes responsive to determining that the device exits the optical tracking zone of the first sensor, capturing, at a second positional resolution, a second position of the device based on acceleration information from a second sensor, wherein the second positional resolution corresponds to a minimum threshold value for the acceleration information from the second sensor.

公开(公告)号：US20190251704A1

公开(公告)日：2019-08-15

申请号：US16392563

申请日：2019-04-23

Applicant: Samsung Electronics Co., Ltd.

Inventor： Christopher A. Peri

IPC: G06T7/73 ,  G06K9/00 ,  G06T7/11 ,  G06T7/246 ,  G01P15/18 ,  G06T7/20 ,  G06F3/01 ,  G06T7/70

CPC classification number: G06T7/73 ,  G01P15/18 ,  G06F3/011 ,  G06K9/00624 ,  G06T7/11 ,  G06T7/20 ,  G06T7/246 ,  G06T7/70 ,  G06T2207/30244

Abstract: A method, electronic device, and non-transitory computer readable medium for optical tracking are provided. The method includes identifying at least one object within an environment, from received image data. The method also includes assigning a volatility rating to the identified object. Additionally, the method includes determining one or more tracking points associated with the identified object. The method also includes determining a priority rating for the each of the one or more tracking points associated with the identified object based on the assigned volatility rating of the identified object. The method also includes selecting the one or more tracking points for optical tracking based on the priority rating.

公开(公告)号：US11741676B2

公开(公告)日：2023-08-29

申请号：US17346105

申请日：2021-06-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Christopher A. Peri ,  Yingen Xiong ,  Haihui Guan

IPC: G06T19/00 ,  G06T7/50 ,  G06T7/60 ,  G06V20/00

CPC classification number: G06T19/006 ,  G06T7/50 ,  G06T7/60 ,  G06V20/00 ,  G06T2207/10028 ,  G06T2219/008

Abstract: A method includes obtaining scene data, wherein the scene data includes image data of a scene and depth data of the scene, and the depth data includes depth measurement values of points of a point cloud. The method further includes defining a first detection area, wherein the first detection area includes a spatially defined subset of the scene data, defining a plane model based on points of the point cloud within the first detection area, and defining a plane based on the plane model. The method includes determining at least one value of a usable size of the plane based on points of the point cloud, comparing at least one value of a characteristic size of a digital object to the at least one value of the usable size of the plane, and generating a display including the digital object positioned upon the plane based on the plane model.

公开(公告)号：US20230245396A1

公开(公告)日：2023-08-03

申请号：US17811012

申请日：2022-07-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingen Xiong ,  Christopher A. Peri

IPC: G06T19/00 ,  G06T7/70 ,  G06T7/50 ,  G06T17/20 ,  G06V10/26 ,  G06V20/20 ,  G06V10/25 ,  G06V10/77 ,  G01B11/22 ,  G01C21/16

CPC classification number: G06T19/006 ,  G01B11/22 ,  G01C21/1656 ,  G06T7/50 ,  G06T7/70 ,  G06T17/20 ,  G06V10/25 ,  G06V10/26 ,  G06V10/7715 ,  G06V20/20 ,  G06T2207/30244

Abstract: A method includes receiving depth data of a real-world scene from a depth sensor, receiving image data of the scene from an image sensor, receiving movement data of the depth and image sensors from an IMU, and determining an initial 6DOF pose of an apparatus based on the depth data, image data, and/or movement data. The method also includes passing the 6DOF pose to a back end to obtain an optimized pose and generating, based on the optimized pose, image data, and depth data, a three-dimensional reconstruction of the scene. The reconstruction includes a dense depth map, a dense surface mesh, and/or one or more semantically segmented objects. The method further includes passing the reconstruction to a front end and rendering, at the front end, an XR frame. The XR frame includes a three-dimensional XR object projected on one or more surfaces of the scene.

公开(公告)号：US20230088963A1

公开(公告)日：2023-03-23

申请号：US17696746

申请日：2022-03-16

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingen Xiong ,  Christopher A. Peri

IPC: G06T17/20 ,  G06T7/12 ,  G06T19/00

Abstract: A system and method for 3D reconstruction with plane and surface reconstruction, scene parsing, depth reconstruction with depth fusion from different sources. The system includes display and a processor to perform the method for 3D reconstruction with plane and surface reconstruction. The method includes dividing a scene of an image frame into one or more plane regions and one or more surface regions. The method also includes generating reconstructed planes by performing plane reconstruction based on the one or more plane regions. The method also includes generating reconstructed surfaces by performing surface reconstruction based on the one or more surface regions. The method further includes creating the 3D scene reconstruction by integrating the reconstructed planes and the reconstructed surfaces.