公开(公告)号：US20240221130A1

公开(公告)日：2024-07-04

申请号：US18149714

申请日：2023-01-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Tyler Luu ,  Hamid R. Sheikh

IPC: G06T5/00 ,  G06T3/00 ,  G06T5/50

CPC classification number: G06T5/002 ,  G06T3/0093 ,  G06T5/006 ,  G06T5/50 ,  G06T2207/20212

Abstract: A method includes generating alignment maps for a first image frame having a first exposure level and a second image frame having a second exposure level different than the first exposure level. The method also includes generating, for the second image frame and a third image frame having a third exposure level different than the first and second exposure levels, shadow maps, saturation maps, and multi-exposure (ME) motion maps based on the alignment maps. The method further includes determining, based on the shadow maps, saturation maps, and ME motion maps, whether to perform machine learning-based denoising and, if so, on which image frame(s) to perform the machine learning-based denoising. In addition, the method includes updating at least one saturation map and at least one ME motion map for at least one of the second and third image frames depending on the image frame(s) on which the denoising is to be performed.

公开(公告)号：US20250117894A1

公开(公告)日：2025-04-10

申请号：US18480829

申请日：2023-10-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Madhuri Suthar ,  Nguyen Thang Long Le ,  Tyler Luu ,  Hamid R. Sheikh

IPC: G06T5/00

Abstract: A method includes obtaining multiple input image frames and generating bad pixel maps associated with different ones of the input image frames. Each bad pixel map is generated using first and second adaptive thresholds that are based on statistical properties of image data contained in a specified operation window within the associated input image frame. The method also includes generating at least one refined bad pixel map using the bad pixel maps associated with two or more of the input image frames. The method further includes using one or more coordinates of one or more bad pixels identified in the at least one refined bad pixel map to update one or more pixel values of at least one of the input image frames.

公开(公告)号：US20230047764A1

公开(公告)日：2023-02-16

申请号：US17665054

申请日：2022-02-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Tyler Luu ,  John William Glotzbach ,  Hamid Rahim Sheikh

IPC: G06T3/40 ,  G06T11/00 ,  G06T7/20

Abstract: The present disclosure describes devices and methods for generating RGB images from Bayer filter images using adaptive sub-pixel spatiotemporal interpolation. An electronic device includes a processor configured to estimate green values at red and blue pixel locations of an input Bayer frame based on green values at green pixel locations of the input Bayer frame and a kernel for green pixels, generate a green channel of a joint demosaiced-warped output RGB pixel from the input Bayer frame based on the green values at the green pixel locations, the kernel for green pixels, and an alignment vector map, and generate red and blue channels of the joint demosaiced-warped output RGB pixel from the input Bayer frame based on the estimated green values at the red and blue pixel locations, kernels for red and blue pixels, and the alignment vector map.

公开(公告)号：US20240202874A1

公开(公告)日：2024-06-20

申请号：US18068916

申请日：2022-12-20

Applicant: Samsung Electronics Co., Ltd.

Inventor： Madhuri Suthar ,  Tyler Luu ,  Nguyen Thang Long Le ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06T5/30 ,  G06T3/40 ,  G06T5/50

CPC classification number: G06T5/30 ,  G06T3/4015 ,  G06T5/50 ,  G06T2207/20024 ,  G06T2207/20036 ,  G06T2207/20212

Abstract: A method includes obtaining input image frames, including at least two captured using different capture conditions. The method also includes separating color channels of each image frame and generating at least one bad pixel map for each color channel of each image frame. Each bad pixel map is generated by identifying one or more outliers in pixel values in the color channel based on an intensity distribution of pixel values in an operation window within the color channel. The operation window has a window size based on the capture condition and/or local image content in the corresponding image frame. The method further includes combining the bad pixel maps and performing a morphological operation to refine the combined bad pixel map. In addition, the method includes using one or more coordinates of one or more bad pixels in the refined bad pixel map to update one or more pixel values of at least one image frame.

公开(公告)号：US11869169B2

公开(公告)日：2024-01-09

申请号：US17665054

申请日：2022-02-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Tyler Luu ,  John William Glotzbach ,  Hamid Rahim Sheikh

IPC: G06T3/40 ,  G06T7/20 ,  G06T11/00

CPC classification number: G06T3/4015 ,  G06T7/20 ,  G06T11/001 ,  G06T2207/10024

Abstract: The present disclosure describes devices and methods for generating RGB images from Bayer filter images using adaptive sub-pixel spatiotemporal interpolation. An electronic device includes a processor configured to estimate green values at red and blue pixel locations of an input Bayer frame based on green values at green pixel locations of the input Bayer frame and a kernel for green pixels, generate a green channel of a joint demosaiced-warped output RGB pixel from the input Bayer frame based on the green values at the green pixel locations, the kernel for green pixels, and an alignment vector map, and generate red and blue channels of the joint demosaiced-warped output RGB pixel from the input Bayer frame based on the estimated green values at the red and blue pixel locations, kernels for red and blue pixels, and the alignment vector map.

公开(公告)号：US20250037250A1

公开(公告)日：2025-01-30

申请号：US18490505

申请日：2023-10-19

Applicant: Samsung Electronics Co., Ltd.

Inventor： Gunawath Dilshan Godaliyadda ,  Tyler Luu ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06T5/00

Abstract: A method includes obtaining, using at least one processing device of an electronic device, an input image containing blur. The method also includes generating, using the at least one processing device, an edge enhancement mask and a gain mask based on the input image. The method further includes generating, using the at least one processing device, a halo-suppressed edge mask based on the edge enhancement mask and the gain mask. In addition, the method includes generating, using the at least one processing device, a sharpened image based on the input image and the halo-suppressed edge mask.

公开(公告)号：US12141939B2

公开(公告)日：2024-11-12

申请号：US18494285

申请日：2023-10-25

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Tyler Luu ,  John William Glotzbach ,  Hamid Rahim Sheikh

IPC: G06T3/4015 ,  G06T7/20 ,  G06T11/00

Abstract: An electronic device includes a processor configured to estimate green values at red and blue pixel locations of an input Bayer frame based on green values at green pixel locations of the input Bayer frame. The processor is also configured to generate red, green, and blue channels of joint demosaiced-warped output RGB pixels from the input Bayer frame based on the green values at the green pixel locations, the estimated green values at the red and blue pixel locations, an alignment vector map, and kernels for red, green, and blue pixels.

公开(公告)号：US20240257324A1

公开(公告)日：2024-08-01

申请号：US18454247

申请日：2023-08-23

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Tyler Luu ,  Hamid R. Sheikh

IPC: G06T5/00 ,  G06T5/50

CPC classification number: G06T5/92 ,  G06T5/50 ,  G06T5/70 ,  G06T2207/20192 ,  G06T2207/20208 ,  G06T2207/20221

Abstract: A method includes obtaining multiple input image frames and generating a high dynamic range (HDR) blended image based on the input image frames, where the HIDR blended image has a higher dynamic range than individual ones of the input image frames. The method also includes performing a tone fusion operation on the HIDR blended image based on a semantic delta-weight map to generate a fused image. Performing the tone fusion operation includes synthesizing multiple low dynamic range (LDR) images based on the HIDR blended image and generating initial weight maps based on the LDR images. Performing the tone fusion operation also includes generating filtered weight maps based on the initial weight maps, the semantic delta-weight map, and a guided filter. Performing the tone fusion operation further includes generating the fused image based on the filtered weight maps and decomposed versions of the LDR images.

公开(公告)号：US20240070807A1

公开(公告)日：2024-02-29

申请号：US18494285

申请日：2023-10-25

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Tyler Luu ,  John William Glotzbach ,  Hamid Rahim Sheikh

IPC: G06T3/40 ,  G06T7/20 ,  G06T11/00

CPC classification number: G06T3/4015 ,  G06T7/20 ,  G06T11/001 ,  G06T2207/10024

Abstract: An electronic device includes a processor configured to estimate green values at red and blue pixel locations of an input Bayer frame based on green values at green pixel locations of the input Bayer frame. The processor is also configured to generate red, green, and blue channels of joint demosaiced-warped output RGB pixels from the input Bayer frame based on the green values at the green pixel locations, the estimated green values at the red and blue pixel locations, an alignment vector map, and kernels for red, green, and blue pixels.

公开(公告)号：US20230252770A1

公开(公告)日：2023-08-10

申请号：US18045558

申请日：2022-10-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Tyler Luu ,  John W. Glotzbach ,  Hamid R. Sheikh ,  John Seokjun Lee ,  Youngmin Kim ,  Jun Ki Cho ,  Seung-Chul Jeon

IPC: G06V10/774 ,  G06T5/00 ,  G06T5/50 ,  G06V10/24

CPC classification number: G06V10/7747 ,  G06T5/002 ,  G06T5/006 ,  G06T5/50 ,  G06V10/24 ,  G06T2207/10144 ,  G06T2207/20081 ,  G06T2207/20221

Abstract: A method for training data generation includes obtaining a first set of image frames of a scene and a second set of image frames of the scene using multiple exposure settings. The method also includes generating an alignment map, a blending map, and an input image using the first set of image frames. The method further includes generating a ground truth image using the alignment map, the blending map, and the second set of image frames. In addition, the method includes using the ground truth image and the input image as an image pair in a training dataset when training a machine learning model to reduce image distortion and noise.