公开(公告)号：US20220375042A1

公开(公告)日：2022-11-24

申请号：US17626069

申请日：2020-11-13

Applicant: Google LLC

Inventor： Rahul Garg ,  Neal Wadhwa ,  Pratul Preeti Srinivasan ,  Tianfan Xue ,  Jiawen Chen ,  Shumian Xin ,  Jonathan T. Barron

IPC: G06T5/00 ,  G06T5/50 ,  G06T7/50

Abstract: A method includes obtaining dual-pixel image data that includes a first sub-image and a second sub-image, and generating an in-focus image, a first kernel corresponding to the first sub-image, and a second kernel corresponding to the second sub-image. A loss value may be determined using a loss function that determines a difference between (i) a convolution of the first sub-image with the second kernel and (ii) a convolution of the second sub-image with the first kernel, and/or a sum of (i) a difference between the first sub-image and a convolution of the in-focus image with the first kernel and (ii) a difference between the second sub-image and a convolution of the in-focus image with the second kernel. Based on the loss value and the loss function, the in-focus image, the first kernel, and/or the second kernel, may be updated and displayed.

公开(公告)号：US11490070B2

公开(公告)日：2022-11-01

申请号：US17322216

申请日：2021-05-17

Applicant: Google LLC

Inventor： Tianfan Xue ,  Jian Wang ,  Jiawen Chen ,  Jonathan Barron

IPC: H04N13/25 ,  H04N13/254 ,  H04N5/235

Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.

公开(公告)号：US20210274151A1

公开(公告)日：2021-09-02

申请号：US17322216

申请日：2021-05-17

Applicant: Google LLC

Inventor： Tianfan Xue ,  Jian Wang ,  Jiawen Chen ,  Jonathan Barron

IPC: H04N13/25 ,  H04N13/254 ,  H04N5/235

Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.

公开(公告)号：US20200077076A1

公开(公告)日：2020-03-05

申请号：US16120666

申请日：2018-09-04

Applicant: Google LLC

Inventor： Tianfan Xue ,  Jian Wang ,  Jiawen Chen ,  Jonathan Barron

IPC: H04N13/25 ,  H04N13/254 ,  H04N5/235

Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.