-
公开(公告)号：US12079971B2
公开(公告)日：2024-09-03
申请号：US17666166
申请日：2022-02-07
Applicant: Samsung Electronics Co., Ltd.
Inventor： Yingmao Li , Hamid R. Sheikh , John Seokjun Lee , Youngmin Kim , Jun Ki Cho , Seung-Chul Jeon
CPC classification number: G06T5/77 , G06T2207/10144 , G06T2207/20081 , G06T2207/20084
Abstract: A method includes obtaining, using a stationary sensor of an electronic device, multiple image frames including first and second image frames. The method also includes generating, using multiple previously generated motion vectors, a first motion-distorted image frame using the first image frame and a second motion-distorted image frame using the second image frame. The method further includes adding noise to the motion-distorted image frames to generate first and second noisy motion-distorted image frames. The method also includes performing (i) a first multi-frame processing (MFP) operation to generate a ground truth image using the motion-distorted image frames and (ii) a second MFP operation to generate an input image using the noisy motion-distorted image frames. In addition, the method includes storing the ground truth and input images as an image pair for training an artificial intelligence/machine learning (AI/ML)-based image processing operation for removing image distortions caused by handheld image capture.
-
公开(公告)号：US20240185431A1
公开(公告)日：2024-06-06
申请号：US18073376
申请日：2022-12-01
Applicant: Samsung Electronics Co., Ltd.
Inventor： Yufang Sun , Akira Osamoto , John Seokjun Lee , Hamid R. Sheikh
CPC classification number: G06T7/194 , G06T3/0093 , G06T7/174 , G06T7/337 , G06T2207/20084 , G06T2207/20221
Abstract: A method includes obtaining a reference frame from among multiple image frames of a scene. The method also includes generating a segmentation mask using the reference frame, where the segmentation mask contains information for separation of foreground and background in the scene. The method further includes applying the segmentation mask to each of the multiple image frames to generate foreground image frames and background image frames. The method also includes performing multi-frame registration on each of the foreground image frames to generate registered foreground image frames. The method further includes performing multi-frame registration on each of the background image frames to generate registered background image frames. In addition, the method includes combining the registered foreground image frames and the registered background image frames to generate a combined registered multi-frame image of the scene.
-
公开(公告)号：US11412136B2
公开(公告)日：2022-08-09
申请号：US16704982
申请日：2019-12-05
Applicant: Samsung Electronics Co., Ltd.
Inventor： Hamid R. Sheikh , Youngjun Yoo , John Seokjun Lee , Michael O. Polley
Abstract: A method includes, in a first mode, positioning first and second tiltable image sensor modules of an image sensor array of an electronic device so that a first optical axis of the first tiltable image sensor module and a second optical axis of the second tiltable image sensor module are substantially perpendicular to a surface of the electronic device, and the first and second tiltable image sensor modules are within a thickness profile of the electronic device. The method also includes, in a second mode, tilting the first and second tiltable image sensor modules so that the first optical axis of the first tiltable image sensor module and the second optical axis of the second tiltable image sensor module are not perpendicular to the surface of the electronic device, and at least part of the first and second tiltable image sensor modules are no longer within the thickness profile of the electronic device.
-
14.发明申请公开(公告)号：US20210390375A1
公开(公告)日：2021-12-16
申请号：US17135573
申请日：2020-12-28
Applicant: Samsung Electronics Co., Ltd.
Inventor： Chenchi Luo , Gyeongmin Choe , Yingmao Li , Zeeshan Nadir , Hamid R. Sheikh , John Seokjun Lee , Youngjun Yoo
Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple calibration parameters associated with multiple sensors of a selected mobile device. The method also includes obtaining, using the at least one processor, an identification of multiple imaging tasks. The method further includes obtaining, using the at least one processor, multiple synthetically-generated scene images. In addition, the method includes generating, using the at least one processor, multiple training images and corresponding meta information based on the calibration parameters, the identification of the imaging tasks, and the scene images. The training images and corresponding meta information are generated concurrently, different ones of the training images correspond to different ones of the sensors, and different pieces of the meta information correspond to different ones of the imaging tasks.
-
公开(公告)号：US20250166129A1
公开(公告)日：2025-05-22
申请号：US18516277
申请日：2023-11-21
Applicant: Samsung Electronics Co., Ltd.
Inventor： Gunawath Dilshan Godaliyadda , Abhiram Gnanasambandam , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: G06T5/50 , G06T7/00 , H04N5/265 , H04N23/667 , H04N23/80
Abstract: A method includes obtaining, using a multi-mode image sensor, first image frames and second image frames. The first image frames include image data having a first bit depth, and the second image frames include image data having a second bit depth smaller than the first bit depth. The first image frames are captured using two or more exposure times, and the second image frames are captured using at least one exposure time shorter than the two or more exposure times. At least one of the second image frames is captured in between each consecutive pair of the first image frames. The method also includes providing at least the first image frames to a multi-frame processing (MFP) pipeline and processing at least the first image frames using the MFP pipeline to generate an output image.
-
Patent Agency Ranking
16.发明授权公开(公告)号：US12272032B2
公开(公告)日：2025-04-08
申请号：US17820795
申请日：2022-08-18
Applicant: Samsung Electronics Co., Ltd.
Inventor： Devendra K. Jangid , John Seokjun Lee , Hamid R. Sheikh
IPC: G06T5/70
Abstract: A method includes obtaining an input image that contains blur. The method also includes providing the input image to a trained machine learning model, where the trained machine learning model includes (i) a shallow feature extractor configured to extract one or more feature maps from the input image and (ii) a deep feature extractor configured to extract deep features from the one or more feature maps. The method further includes using the trained machine learning model to generate a sharpened output image. The trained machine learning model is trained using ground truth training images and input training images, where the input training images include versions of the ground truth training images with blur created using demosaic and noise filtering operations.
-
公开(公告)号：US12148175B2
公开(公告)日：2024-11-19
申请号：US17590998
申请日：2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor： Yingmao Li , Chenchi Luo , Gyeongmin Choe , John Seokjun Lee
IPC: G06T7/269
Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.
-
公开(公告)号：US20220337747A1
公开(公告)日：2022-10-20
申请号：US17810213
申请日：2022-06-30
Applicant: Samsung Electronics Co., Ltd.
Inventor： Hamid R. Sheikh , Youngjun Yoo , John Seokjun Lee , Michael O. Polley
Abstract: A method for operating an electronic device includes capturing, by an image sensor module, a stream from a pixel array. The method also includes processing, by the image sensor module, the stream to generate a preview stream and a full frame stream. The method further includes compressing, by the image sensor module, the preview stream using a first compression and the full frame stream using a second compression. In addition, the method includes outputting, by the image sensor module, the compressed preview stream and the compressed full frame stream.
-
公开(公告)号：US20220303495A1
公开(公告)日：2022-09-22
申请号：US17591040
申请日：2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor： Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.
-
公开(公告)号：US20200349426A1
公开(公告)日：2020-11-05
申请号：US16399928
申请日：2019-04-30
Applicant: Samsung Electronics Co., Ltd.
Inventor： Chenchi Luo , Yuming Zhu , Hyejung Kim , John Seokjun Lee , Manish Goel
Abstract: A method, an electronic device, and computer readable medium are provided. The method includes receiving an input into a neural network that includes a kernel. The method also includes generating, during a convolution operation of the neural network, multiple panel matrices based on different portions of the input. The method additionally includes successively combining each of the multiple panel matrices with the kernel to generate an output. Generating the multiple panel matrices can include mapping elements within a moving window of the input onto columns of an indexing matrix, where a size of the window corresponds to the size of the kernel.
-
-
-
-
-
-
-
-
-
Search Results
29
records
(took 0.02 seconds)
