-
公开(公告)号:US10187587B2
公开(公告)日:2019-01-22
申请号:US15097687
申请日:2016-04-13
Applicant: Google LLC
Inventor: Samuel William Hasinoff , Jiawen Chen
Abstract: An image sensor of an image capture device may capture an image. The captured image may be stored in a buffer of two or more previously-captured images. An oldest image of the two or more previously-captured images may be removed from the buffer. An aggregate image of the images in the buffer may be updated. This updating may involve subtracting a representation of the oldest image from the aggregate image, and adding a representation of the captured image to the aggregate image. A viewfinder of the image capture device may display a representation of the aggregate image.
-
公开(公告)号:US20240320808A1
公开(公告)日:2024-09-26
申请号:US18734000
申请日:2024-06-05
Applicant: Google LLC
Inventor: Yicheng Wu , Qiurui He , Tianfan Xue , Rahul Garg , Jiawen Chen , Jonathan T. Barron
CPC classification number: G06T5/80 , G06T3/40 , G06T5/10 , G06T5/20 , G06T7/80 , G06T2207/20081 , G06T2207/20084
Abstract: A method includes obtaining an input image that contains a particular representation of lens flare, and processing the input image by a machine learning model to generate a de-flared image that includes the input image with at least part of the particular representation of lens flare removed. The machine learning (ML) model may be trained by generating training images that combine respective baseline images with corresponding lens flare images. For each respective training image, a modified image may be determined by processing the respective training image by the ML model, and a loss value may be determined based on a loss function comparing the modified image to a corresponding baseline image used to generate the respective training image. Parameters of the ML model may be adjusted based on the loss value determined for each respective training image and the loss function.
-
公开(公告)号:US20220375045A1
公开(公告)日:2022-11-24
申请号:US17625994
申请日:2020-11-09
Applicant: Google LLC
Inventor: Yicheng Wu , Qiurui He , Tianfan Xue , Rahul Garg , Jiawen Chen , Jonathan T. Barron
Abstract: A method includes obtaining an input image that contains a particular representation of lens flare, and processing the input image by a machine learning model to generate a de-flared image that includes the input image with at least part of the particular representation of lens flare removed. The machine learning (ML) model may be trained by generating training images that combine respective baseline images with corresponding lens flare images. For each respective training image, a modified image may be determined by processing the respective training image by the ML model, and a loss value may be determined based on a loss function comparing the modified image to a corresponding baseline image used to generate the respective training image. Parameters of the ML model may be adjusted based on the loss value determined for each respective training image and the loss function.
-
公开(公告)号:US20220375042A1
公开(公告)日:2022-11-24
申请号:US17626069
申请日:2020-11-13
Applicant: Google LLC
Inventor: Rahul Garg , Neal Wadhwa , Pratul Preeti Srinivasan , Tianfan Xue , Jiawen Chen , Shumian Xin , Jonathan T. Barron
Abstract: A method includes obtaining dual-pixel image data that includes a first sub-image and a second sub-image, and generating an in-focus image, a first kernel corresponding to the first sub-image, and a second kernel corresponding to the second sub-image. A loss value may be determined using a loss function that determines a difference between (i) a convolution of the first sub-image with the second kernel and (ii) a convolution of the second sub-image with the first kernel, and/or a sum of (i) a difference between the first sub-image and a convolution of the in-focus image with the first kernel and (ii) a difference between the second sub-image and a convolution of the in-focus image with the second kernel. Based on the loss value and the loss function, the in-focus image, the first kernel, and/or the second kernel, may be updated and displayed.
-
公开(公告)号:US11490070B2
公开(公告)日:2022-11-01
申请号:US17322216
申请日:2021-05-17
Applicant: Google LLC
Inventor: Tianfan Xue , Jian Wang , Jiawen Chen , Jonathan Barron
IPC: H04N13/25 , H04N13/254 , H04N5/235
Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.
-
公开(公告)号:US11320655B2
公开(公告)日:2022-05-03
申请号:US15799404
申请日:2017-10-31
Applicant: Google LLC
Inventor: Changyin Zhou , Roman Lewkow , Marc Stewart Levoy , Jiawen Chen
IPC: G02B27/02 , G06F3/0354 , G06F3/0488 , G06F3/0346 , G06F3/01 , G02B27/01
Abstract: Imaging systems can often gather higher quality information about a field of view than the unaided human eye. For example, telescopes may magnify very distant objects, microscopes may magnify very small objects, and high frame-rate cameras may capture fast motion. The present disclosure includes devices and methods that provide real-time vision enhancement without the delay of replaying from storage media. The disclosed devices and methods may include a live view user interface with two or more interactive features or effects that may be controllable in real-time. Specifically, the disclosed devices and methods may include a live view display and image and other information enhancements, which utilize in-line computation and constant control.
-
公开(公告)号:US20210274151A1
公开(公告)日:2021-09-02
申请号:US17322216
申请日:2021-05-17
Applicant: Google LLC
Inventor: Tianfan Xue , Jian Wang , Jiawen Chen , Jonathan Barron
IPC: H04N13/25 , H04N13/254 , H04N5/235
Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.
-
公开(公告)号:US20200077076A1
公开(公告)日:2020-03-05
申请号:US16120666
申请日:2018-09-04
Applicant: Google LLC
Inventor: Tianfan Xue , Jian Wang , Jiawen Chen , Jonathan Barron
IPC: H04N13/25 , H04N13/254 , H04N5/235
Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.
-
公开(公告)号:US10579908B2
公开(公告)日:2020-03-03
申请号:US15843345
申请日:2017-12-15
Applicant: Google LLC
Inventor: Jiawen Chen , Samuel Hasinoff , Michael Gharbi , Jonathan Barron
Abstract: Systems and methods described herein may relate to image transformation utilizing a plurality of deep neural networks. An example method includes receiving, at a mobile device, a plurality of image processing parameters. The method also includes causing an image sensor of the mobile device to capture an initial image and receiving, at a coefficient prediction neural network at the mobile device, an input image based on the initial image. The method further includes determining, using the coefficient prediction neural network, an image transformation model based on the input image and at least a portion of the plurality of image processing parameters. The method additionally includes receiving, at a rendering neural network at the mobile device, the initial image and the image transformation model. Yet further, the method includes generating, by the rendering neural network, a rendered image based on the initial image, according to the image transformation model.
-
公开(公告)号:US20190116304A1
公开(公告)日:2019-04-18
申请号:US16217704
申请日:2018-12-12
Applicant: Google LLC
Inventor: Samuel William Hasinoff , Jiawen Chen
CPC classification number: H04N5/2353 , H04N1/2137 , H04N5/23216 , H04N5/23293 , H04N5/2355 , H04N5/35581
Abstract: An image sensor of an image capture device may capture an image. The captured image may be stored in a buffer of two or more previously-captured images. An oldest image of the two or more previously-captured images may be removed from the buffer. An aggregate image of the images in the buffer may be updated. This updating may involve subtracting a representation of the oldest image from the aggregate image, and adding a representation of the captured image to the aggregate image. A viewfinder of the image capture device may display a representation of the aggregate image.
-
-
-
-
-
-
-
-
-