公开(公告)号：US20250113097A1

公开(公告)日：2025-04-03

申请号：US18477293

申请日：2023-09-28

Applicant: Samsung Electronics Co., Ltd.

Inventor： Jinhan Hu ,  Jing Li ,  Chengyu Wang ,  Pavan C. Madhusudanarao ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: H04N23/60 ,  G06T7/32 ,  H04N23/68 ,  H04N23/951

Abstract: A method includes obtaining, using at least one under display camera, one or more first image frames associated with a first diffraction pattern and one or more second image frames associated with a second diffraction pattern. The first diffraction pattern and the second diffraction pattern are related through a transformation. The method also includes generating a first deblurred image using the one or more first image frames and a second deblurred image using the one or more second image frames. The method further includes combining the first and second deblurred images while exploiting complementary types of image artifacts created by the first and second diffraction patterns to generate an image of a scene.

公开(公告)号：US20250106416A1

公开(公告)日：2025-03-27

申请号：US18816846

申请日：2024-08-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Molin Zhang ,  Soumendu Majee ,  Chengyu Wang ,  John Seokjun Lee ,  Hamid Rahim Sheikh

IPC: H04N19/42 ,  H04N9/64 ,  H04N19/172 ,  H04N19/184

Abstract: A method includes obtaining a raw image and mapping, using a raw image encoder, the raw image to a compressed domain. The raw image is represented using latent variables in the compressed domain. The method also includes performing one or more image signal processing operations on the latent variables, where (i) each of the one or more image signal processing operations is configured to operate in the compressed domain and (ii) the one or more image signal processing operations generate processed latent variables. The method further includes mapping, using an output image decoder, the processed latent variables to an output image in an output color space.

公开(公告)号：US20250045867A1

公开(公告)日：2025-02-06

申请号：US18363596

申请日：2023-08-01

Applicant: Samsung Electronics Co., Ltd.

Inventor： Abhiram Gnanasambandam ,  John W. Glotzbach ,  John Seokjun Lee ,  Hamid R. Sheikh

IPC: G06T3/40 ,  G06T5/00 ,  H04N23/84

Abstract: A method includes obtaining a ground truth image and generating multiple image frames using the ground truth image, a modeled optical blur, and a modeled global motion. The method also includes generating multiple mosaic image frames using the image frames and a color filter array and generating multiple raw input image frames using the mosaic image frames and a noise model associated with at least one imaging sensor. The method further includes providing the raw input image frames to a multi-frame processing pipeline in order to generate synthetic training data. In addition, the method includes training a machine learning-based image processing engine using the ground truth image and the synthetic training data.

公开(公告)号：US20240257325A1

公开(公告)日：2024-08-01

申请号：US18485970

申请日：2023-10-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Abhiram Gnanasambandam ,  John W. Glotzbach ,  Zeeshan Nadir ,  Gunawath Dilshan Godaliyadda ,  John Seokjun Lee ,  Hamid R. Sheikh

IPC: G06T5/00 ,  G06T3/40 ,  G06T15/50

CPC classification number: G06T5/94 ,  G06T3/4015 ,  G06T15/506

Abstract: A method includes obtaining multiple image frames captured using at least one imaging sensor. The method also includes generating a local tone map, a global tone map look-up table (LUT), and one or more contrast enhancement LUTs based on at least one of the image frames and one or more parameters of the at least one imaging sensor. The method further includes generating a blended and demosaiced image based on the image frames and generating a local tone mapped image based on the blended and demosaiced image and the local tone map. The method also includes adjusting color saturation based on the local tone mapped image to generate a corrected image. In addition, the method includes generating an output image based on the corrected image, the global tone map LUT, and the one or more contrast enhancement LUTs.

公开(公告)号：US20240233319A9

公开(公告)日：2024-07-11

申请号：US18049213

申请日：2022-10-24

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Weidi Liu ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: G06V10/70 ,  G06T5/00 ,  G06V10/60

CPC classification number: G06V10/70 ,  G06T5/003 ,  G06V10/60

Abstract: A method includes obtaining an under-display camera (UDC) image captured using a camera located under a display. The method also includes processing, using at least one processing device of an electronic device, the UDC image based on a machine learning model to restore the UDC image. The method further includes displaying or storing the restored image corresponding to the UDC image. The machine learning model is trained using (i) a ground truth image and (ii) a synthetic image generated using the ground truth image and a point spread function that is based on an optical transmission model of the display.

公开(公告)号：US20240119570A1

公开(公告)日：2024-04-11

申请号：US18045696

申请日：2022-10-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Weidi Liu ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: G06T5/00 ,  G06T5/20 ,  G06T5/50

CPC classification number: G06T5/003 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/20081 ,  H04N23/50

Abstract: A method includes identifying, using at least one processing device of an electronic device, a spatially-variant point spread function associated with an under-display camera. The spatially-variant point spread function is based on an optical transmission model and a layout of a display associated with the under-display camera. The method also includes generating, using the at least one processing device, a ground truth image. The method further includes performing, using the at least one processing device, a convolution of the ground truth image based on the spatially-variant point spread function in order to generate a synthetic sensor image. The synthetic sensor image represents a simulated image captured by the under-display camera. In addition, the method includes providing, using the at least one processing device, the synthetic sensor image and the ground truth image as an image pair to train a machine learning model to perform under-display camera point spread function inversion.

公开(公告)号：US20230245328A1

公开(公告)日：2023-08-03

申请号：US17590998

申请日：2022-02-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingmao Li ,  Chenchi Luo ,  Gyeongmin Choe ,  John Seokjun Lee

IPC: G06T7/269

CPC classification number: G06T7/269 ,  G06T2207/10016 ,  G06T2207/20081

Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.

公开(公告)号：US20230091909A1

公开(公告)日：2023-03-23

申请号：US17588024

申请日：2022-01-28

Applicant: Samsung Electronics Co., Ltd.

Inventor： Pavan Chennagiri ,  John Seokjun Lee ,  Hamid R. Sheikh

IPC: G06T11/00 ,  G06T19/20 ,  G06T7/90 ,  G06T5/00 ,  G06T17/00 ,  G06N20/00

Abstract: An apparatus includes at least one memory configured to store an AI network and at least one processor. The at least one processor is configured to generate a dead leaves model. The at least one processor is also configured to capture a ground truth frame from the dead leaves. The at least one processor is further configured to apply a mathematical noise model to the ground truth frame to produce a noisy frame. In addition, the at least one processor is configured to train the AI network using the ground truth frame and the noisy frame.

公开(公告)号：US11593637B2

公开(公告)日：2023-02-28

申请号：US16399928

申请日：2019-04-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  Yuming Zhu ,  Hyejung Kim ,  John Seokjun Lee ,  Manish Goel

IPC: G06N3/08 ,  G06N20/10 ,  G06N7/04

Abstract: A method, an electronic device, and computer readable medium are provided. The method includes receiving an input into a neural network that includes a kernel. The method also includes generating, during a convolution operation of the neural network, multiple panel matrices based on different portions of the input. The method additionally includes successively combining each of the multiple panel matrices with the kernel to generate an output. Generating the multiple panel matrices can include mapping elements within a moving window of the input onto columns of an indexing matrix, where a size of the window corresponds to the size of the kernel.