公开(公告)号：US20220012903A1

公开(公告)日：2022-01-13

申请号：US16946956

申请日：2020-07-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kushal K. Vyas ,  Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Hamid R. Sheikh ,  Youngjun Yoo ,  Michael O. Polley

IPC: G06T7/50 ,  G06T3/40 ,  G06T5/00 ,  G06T7/70

Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.

公开(公告)号：US11195259B2

公开(公告)日：2021-12-07

申请号：US16703712

申请日：2019-12-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Youngjun Yoo

IPC: G06T5/00 ,  G06T5/50 ,  G06T7/55 ,  G06T7/73 ,  G06T3/00 ,  G06T5/40 ,  G06T7/593

Abstract: A method includes obtaining, using first and second image sensors of an electronic device, first and second images, respectively, of a scene. The method also includes obtaining, using an image depth sensor of the electronic device, a third image and a first depth map of the scene, the first depth map having a resolution lower than a resolution of the first and second images. The method further includes undistorting the first and second images using the third image and the first depth map. The method also includes rectifying the first and second images using the third image and the first depth map. The method further includes generating a disparity map using the first and second images that have been undistorted and rectified. In addition, the method includes generating a second depth map using the disparity map and the first depth map, where the second depth map has a resolution that is higher than the resolution of the first depth map.

公开(公告)号：US20210281813A1

公开(公告)日：2021-09-09

申请号：US16811585

申请日：2020-03-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kushal K. Vyas ,  Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Hamid R. Sheikh ,  Youngjun Yoo ,  Michael O. Polley

IPC: H04N13/128 ,  G06T3/40 ,  G06T5/00 ,  G06T5/50

Abstract: A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

公开(公告)号：US11094041B2

公开(公告)日：2021-08-17

申请号：US16699371

申请日：2019-11-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： George Q. Chen

IPC: G06T5/00 ,  H04N5/232 ,  G06T7/50 ,  G06T5/50

Abstract: A method includes determining, using at least one processor, a depth of range of focus for a scene. The method also includes determining, using the at least one processor, multiple layers associated with the scene based on the depth of focus range, where each layer is associated with image data having a different range of disparity values. The method further includes blending, using the at least one processor, the layers to produce an image having a Bokeh effect in a foreground and a background, and focused image data within the depth of focus range. The multiple layers include at least a first layer associated with the foreground, a second layer associated with the depth of focus range, and a third layer associated with the background.

公开(公告)号：US11503266B2

公开(公告)日：2022-11-15

申请号：US16811585

申请日：2020-03-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kushal Kardam Vyas ,  Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Hamid R. Sheikh ,  Youngjun Yoo ,  Michael O. Polley

IPC: H04N13/128 ,  G06T3/40 ,  G06T5/00 ,  G06T5/50 ,  H04N13/00

Abstract: A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

公开(公告)号：US09892552B2

公开(公告)日：2018-02-13

申请号：US14970142

申请日：2015-12-15

Applicant: Samsung Electronics Co., Ltd.

Inventor： George Q. Chen ,  Frank Brill

IPC: G06T17/00 ,  G06T3/20 ,  G06T3/60 ,  G06T7/00 ,  H04N1/00 ,  G06T15/20

CPC classification number: G06T17/00 ,  G06T3/20 ,  G06T3/60 ,  G06T7/0065 ,  G06T7/55 ,  G06T15/205 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/30244 ,  H04N1/00827

Abstract: A method for 3-Dimensional scanning includes generating a plurality of depth images when a depth sensor rotates around an object. The method further includes, for each depth image: estimating a rotation (R) and a translation (T) for each depth image, using data of a Truncated Signed Distance Function (TSDF) volume; and fusing each depth image accumulatively into the TSDF volume based on the estimated R and T. An apparatus for 3-Dimensional scanning includes a depth sensor configured to generate a plurality of depth images when rotating around an object. The apparatus further includes a processor configured to, for each depth image: estimate a rotation (R) and a translation (T) for each depth image, using data of a Truncated Signed Distance Function (TSDF) volume; and fuse each depth image accumulatively into the TSDF volume based on the estimated R and T.

公开(公告)号：US11132772B2

公开(公告)日：2021-09-28

申请号：US16712882

申请日：2019-12-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  Yingmao Li ,  Youngjun Yoo ,  George Q. Chen ,  Kaimo Lin ,  David D. Liu ,  Gyeongmin Choe

IPC: G06T5/00 ,  G06T7/80 ,  H04N13/128

Abstract: A method includes obtaining a first image of a scene using a first image sensor of an electronic device and a second image of the scene using a second image sensor of the electronic device. The method also includes generating a first feature map from the first image and a second feature map from the second image. The method further includes generating a third feature map based on the first feature map, the second feature map, and an asymmetric search window. The method additionally includes generating a depth map by restoring spatial resolution to the third feature map.

公开(公告)号：US20210166353A1

公开(公告)日：2021-06-03

申请号：US16699371

申请日：2019-11-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： George Q. Chen

IPC: G06T5/00 ,  G06T5/50 ,  G06T7/50 ,  H04N5/232

Abstract: A method includes determining, using at least one processor, a depth of range of focus for a scene. The method also includes determining, using the at least one processor, multiple layers associated with the scene based on the depth of focus range, where each layer is associated with image data having a different range of disparity values. The method further includes blending, using the at least one processor, the layers to produce an image having a Bokeh effect in a foreground and a background, and focused image data within the depth of focus range. The multiple layers include at least a first layer associated with the foreground, a second layer associated with the depth of focus range, and a third layer associated with the background.

公开(公告)号：US20170169603A1

公开(公告)日：2017-06-15

申请号：US14970142

申请日：2015-12-15

Applicant: Samsung Electronics Co., Ltd.

Inventor： George Q. Chen ,  Frank Brill

IPC: G06T17/00 ,  G06T7/00 ,  G06T3/60 ,  H04N1/00 ,  G06T3/20

CPC classification number: G06T17/00 ,  G06T3/20 ,  G06T3/60 ,  G06T7/0065 ,  G06T7/55 ,  G06T15/205 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/30244 ,  H04N1/00827

Abstract: A method for 3-Dimensional scanning includes generating a plurality of depth images when a depth sensor rotates around an object. The method further includes, for each depth image: estimating a rotation (R) and a translation (T) for each depth image, using data of a Truncated Signed Distance Function (TSDF) volume; and fusing each depth image accumulatively into the TSDF volume based on the estimated R and T. An apparatus for 3-Dimensional scanning includes a depth sensor configured to generate a plurality of depth images when rotating around an object. The apparatus further includes a processor configured to, for each depth image: estimate a rotation (R) and a translation (T) for each depth image, using data of a Truncated Signed Distance Function (TSDF) volume; and fuse each depth image accumulatively into the TSDF volume based on the estimated R and T.

公开(公告)号：US11532091B2

公开(公告)日：2022-12-20

申请号：US16946956

申请日：2020-07-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kushal Kardam Vyas ,  Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Hamid R. Sheikh ,  Youngjun Yoo ,  Michael O. Polley

IPC: G06T7/00 ,  G06T7/50 ,  G06T3/40 ,  G06T7/70 ,  G06T5/00

Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.