公开(公告)号：US20220383467A1

公开(公告)日：2022-12-01

申请号：US17883602

申请日：2022-08-09

Applicant: Snap Inc.

Inventor： Sagi KATZ ,  David Ben Ezra

IPC: G06T5/50 ,  G06T7/90 ,  G06T7/593 ,  G06T5/10 ,  G06T7/00 ,  H04N13/128 ,  H04N13/332 ,  H04N13/239

Abstract: Systems and method for correcting images including artifacts due to dirty camera lenses of electronic device are disclosed. Correction of images by the systems and methods includes obtaining a first raw pixel image of a scene captured with a first camera, obtaining a second raw image of the scene captured with a second camera separate from the first camera in a camera baseline direction, rectifying the first and second raw pixel images to create respective first and second rectified pixel images, determining disparity correspondence between corresponding image pixel pairs of the first and second rectified images in the camera baseline direction, mapping first and second rectified images into the same domain using the determined disparity, detect image artifact regions within each domain mapped image by comparing corresponding regions of the domain mapped images, determining correction factors for each detected image artifact region, and correcting the rectified first and second images by applying the determined correction factors.

公开(公告)号：US20220109820A1

公开(公告)日：2022-04-07

申请号：US17553287

申请日：2021-12-16

Applicant: Snap Inc.

Inventor： Dmitry Ryuma ,  David Ben Ezra ,  Dunxu Hu ,  Patrick Timothy McSweeney Simons

IPC: H04N13/246 ,  H04N13/239 ,  H04N13/344 ,  G06T7/80 ,  G02B27/01

Abstract: Camera compensation methods and systems that compensate for misalignment of sensors/camera in stereoscopic camera systems. The compensation includes identifying a pitch angle offset between a first camera and a second camera, determining misalignment of the first and second cameras from the identified pitch angle offset, determining a relative compensation delay responsive to the determined misalignment, introducing the relative compensation delay to image streams produced by the cameras, and producing a stereoscopic image on a display from the first and second image streams with the introduced delay.

公开(公告)号：US12073536B2

公开(公告)日：2024-08-27

申请号：US17883602

申请日：2022-08-09

Applicant: Snap Inc.

Inventor： Sagi Katz ,  David Ben Ezra

IPC: H04N13/239 ,  G06T5/10 ,  G06T5/50 ,  G06T7/00 ,  G06T7/593 ,  G06T7/90 ,  H04N13/00 ,  H04N13/128 ,  H04N13/332

CPC classification number: G06T5/50 ,  G06T5/10 ,  G06T7/0002 ,  G06T7/593 ,  G06T7/90 ,  G06T7/97 ,  H04N13/128 ,  H04N13/239 ,  H04N13/332 ,  G06T2207/30168 ,  H04N2013/0077 ,  H04N2013/0081

Abstract: Systems and method for correcting images including artifacts due to dirty camera lenses of electronic device are disclosed. Correction of images by the systems and methods includes obtaining a first raw pixel image of a scene captured with a first camera, obtaining a second raw image of the scene captured with a second camera separate from the first camera in a camera baseline direction, rectifying the first and second raw pixel images to create respective first and second rectified pixel images, determining disparity correspondence between corresponding image pixel pairs of the first and second rectified images in the camera baseline direction, mapping first and second rectified images into the same domain using the determined disparity, detect image artifact regions within each domain mapped image by comparing corresponding regions of the domain mapped images, determining correction factors for each detected image artifact region, and correcting the rectified first and second images by applying the determined correction factors.

公开(公告)号：US12002232B2

公开(公告)日：2024-06-04

申请号：US18196940

申请日：2023-05-12

Applicant: Snap Inc.

Inventor： David Ben Ezra ,  Eyal Zak ,  Ozi Egri

IPC: G06T7/579 ,  G06T7/20 ,  G06T7/246 ,  G06T7/70 ,  G06T7/73

CPC classification number: G06T7/579 ,  G06T7/20 ,  G06T7/246 ,  G06T7/70 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/30241 ,  G06T2207/30244

Abstract: Various embodiments provide systems, methods, devices, and instructions for performing simultaneous localization and mapping (SLAM) that involve initializing a SLAM process using images from as few as two different poses of a camera within a physical environment. Some embodiments may achieve this by disregarding errors in matching corresponding features depicted in image frames captured by an image sensor of a mobile computing device, and by updating the SLAM process in a way that causes the minimization process to converge to global minima rather than fall into a local minimum.

公开(公告)号：US20230281851A1

公开(公告)日：2023-09-07

申请号：US18196940

申请日：2023-05-12

Applicant: Snap Inc.

Inventor： David Ben Ezra ,  Eyal Zak ,  Ozi Egri

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/73 ,  G06T7/70 ,  G06T7/20

CPC classification number: G06T7/579 ,  G06T7/246 ,  G06T7/73 ,  G06T7/70 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/30241 ,  G06T2207/30244

Abstract: Various embodiments provide systems, methods, devices, and instructions for performing simultaneous localization and mapping (SLAM) that involve initializing a SLAM process using images from as few as two different poses of a camera within a physical environment. Some embodiments may achieve this by disregarding errors in matching corresponding features depicted in image frames captured by an image sensor of a mobile computing device, and by updating the SLAM process in a way that causes the minimization process to converge to global minima rather than fall into a local minimum.

公开(公告)号：US20230142438A1

公开(公告)日：2023-05-11

申请号：US18150041

申请日：2023-01-04

Applicant: Snap Inc.

Inventor： Ozi Egri ,  David Ben Ezra ,  Andrew James McPhee ,  Qi Pan ,  Eyal Zak

IPC: G06T19/00 ,  G06F3/04815 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06F3/04815 ,  G06T19/20 ,  G06T2219/2004

Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.

公开(公告)号：US11580700B2

公开(公告)日：2023-02-14

申请号：US16790322

申请日：2020-02-13

Applicant: Snap Inc.

Inventor： Ozi Egri ,  David Ben Ezra ,  Andrew James McPhee ,  Qi Pan ,  Eyal Zak

IPC: G06T19/20 ,  G06T19/00 ,  G06F3/0481 ,  G06F3/04815

Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.

公开(公告)号：US11461883B1

公开(公告)日：2022-10-04

申请号：US17145963

申请日：2021-01-11

Applicant: Snap Inc.

Inventor： Sagi Katz ,  David Ben Ezra

IPC: H04N13/239 ,  H04N13/00 ,  G06T5/50 ,  G06T7/00 ,  G06T7/90 ,  G06T7/593 ,  H04N13/332 ,  G06T5/10 ,  H04N13/128

Abstract: Systems and method for correcting images including artifacts due to dirty camera lenses of electronic device are disclosed. Correction of images by the systems and methods includes obtaining a first raw pixel image of a scene captured with a first camera, obtaining a second raw image of the scene captured with a second camera separate from the first camera in a camera baseline direction, rectifying the first and second raw pixel images to create respective first and second rectified pixel images, determining disparity correspondence between corresponding image pixel pairs of the first and second rectified images in the camera baseline direction, mapping first and second rectified images into the same domain using the determined disparity, detect image artifact regions within each domain mapped image by comparing corresponding regions of the domain mapped images, determining correction factors for each detected image artifact region, and correcting the rectified first and second images by applying the determined correction factors.

公开(公告)号：US11259008B2

公开(公告)日：2022-02-22

申请号：US17180249

申请日：2021-02-19

Applicant: Snap Inc.

Inventor： Dmitry Ryuma ,  David Ben Ezra ,  Dunxu Hu ,  Patrick Timothy McSweeney Simons

IPC: H04N13/246 ,  H04N13/239 ,  H04N13/344 ,  G06T7/80 ,  G02B27/01

Abstract: Camera compensation methods and systems that compensate for misalignment of sensors/camera in stereoscopic camera systems. The compensation includes identifying a pitch angle offset between a first camera and a second camera, determining misalignment of the first and second cameras from the identified pitch angle offset, determining a relative compensation delay responsive to the determined misalignment, introducing the relative compensation delay to image streams produced by the cameras, and producing a stereoscopic image on a display from the first and second image streams with the introduced delay.

公开(公告)号：US20200184731A1

公开(公告)日：2020-06-11

申请号：US16790322

申请日：2020-02-13

Applicant: Snap Inc.

Inventor： Ozi Egri ,  David Ben Ezra ,  Andrew James McPhee ,  Qi Pan ,  Eyal Zak

IPC: G06T19/00 ,  G06F3/0481 ,  G06T19/20

Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.