知搜-全球专利检索

  1. Login
  2. Sign Up

Search Results

21 records (took 0.022 seconds)

    Taking photos through visual obstructions
    11.
    发明授权
    Taking photos through visual obstructions 有权

    公开(公告)号：US10412316B2

    公开(公告)日：2019-09-10

    申请号：US15392452

    申请日：2016-12-28

    Applicant: Google LLC

    Inventor： Michael Rubinstein ,  William Freeman ,  Ce Liu

    IPC: H04N5/262 ,  H04N5/222 ,  H04N5/232 ,  G06T7/30 ,  G06T7/90 ,  G06T5/00 ,  G06T5/20 ,  G06T5/50

    Abstract: The present disclosure relates to systems and methods for image capture. Namely, an image capture system may include a camera configured to capture images of a field of view, a display, and a controller. An initial image of the field of view from an initial camera pose may be captured. An obstruction may be determined to be observable in the field of view. Based on the obstruction, at least one desired camera pose may be determined. The at least one desired camera pose includes at least one desired position of the camera. A capture interface may be displayed, which may include instructions for moving the camera to the at least one desired camera pose. At least one further image of the field of view from the at least one desired camera pose may be captured. Captured images may be processed to remove the obstruction from a background image.

    Re-timing objects in video via layered neural rendering
    15.
    发明授权
    Re-timing objects in video via layered neural rendering 有权

    公开(公告)号：US12243145B2

    公开(公告)日：2025-03-04

    申请号：US17927101

    申请日：2020-05-22

    Applicant: Google LLC

    Inventor： Forrester H. Cole ,  Erika Lu ,  Tali Dekel ,  William T. Freeman ,  David Henry Salesin ,  Michael Rubinstein

    IPC: G06T13/80 ,  G06V10/44 ,  G06V10/82 ,  G06V20/40 ,  G11B27/00 ,  G11B27/031

    Abstract: A computer-implemented method for decomposing videos into multiple layers (212, 213) that can be re-combined with modified relative timings includes obtaining video data including a plurality of image frames (201) depicting one or more objects. For each of the plurality of frames, the computer-implemented method includes generating one or more object maps descriptive of a respective location of at least one object of the one or more objects within the image frame. For each of the plurality of frames, the computer-implemented method includes inputting the image frame and the one or more object maps into a machine-learned layer Tenderer model. (220) For each of the plurality of frames, the computer-implemented method includes receiving, as output from the machine-learned layer Tenderer model, a background layer illustrative of a background of the video data and one or more object layers respectively associated with one of the one or more object maps. The object layers include image data illustrative of the at least one object and one or more trace effects at least partially attributable to the at least one object such that the one or more object layers and the background layer can be re-combined with modified relative timings.

    AUDIO-VISUAL SPEECH SEPARATION
    18.
    发明申请
    AUDIO-VISUAL SPEECH SEPARATION 有权

    公开(公告)号：US20230122905A1

    公开(公告)日：2023-04-20

    申请号：US17951002

    申请日：2022-09-22

    Applicant: Google LLC

    Inventor： Inbar Mosseri ,  Michael Rubinstein ,  Ariel Ephrat ,  William Freeman ,  Oran Lang ,  Kevin William Wilson ,  Tali Dekel ,  Avinatan Hassidim

    IPC: G10L21/10 ,  G10L15/16 ,  G10L21/18 ,  G06V20/40 ,  G06V40/16 ,  G10L15/25 ,  G06F18/214

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio-visual speech separation. A method includes: obtaining, for each frame in a stream of frames from a video in which faces of one or more speakers have been detected, a respective per-frame face embedding of the face of each speaker; processing, for each speaker, the per-frame face embeddings of the face of the speaker to generate visual features for the face of the speaker; obtaining a spectrogram of an audio soundtrack for the video; processing the spectrogram to generate an audio embedding for the audio soundtrack; combining the visual features for the one or more speakers and the audio embedding for the audio soundtrack to generate an audio-visual embedding for the video; determining a respective spectrogram mask for each of the one or more speakers; and determining a respective isolated speech spectrogram for each speaker.

    Taking photos through visual obstructions
    20.
    发明授权
    Taking photos through visual obstructions 有权

    公开(公告)号：US11050948B2

    公开(公告)日：2021-06-29

    申请号：US16526343

    申请日：2019-10-21

    Applicant: Google LLC

    Inventor： Michael Rubinstein ,  William Freeman ,  Ce Liu

    IPC: H04N5/262 ,  G06T5/00 ,  H04N5/222 ,  H04N5/232 ,  G06T5/50 ,  G06T7/30 ,  G06T7/90 ,  G06T5/20

    Abstract: The present disclosure relates to systems and methods for image capture. Namely, an image capture system may include a camera configured to capture images of a field of view, a display, and a controller. An initial image of the field of view from an initial camera pose may be captured. An obstruction may be determined to be observable in the field of view. Based on the obstruction, at least one desired camera pose may be determined. The at least one desired camera pose includes at least one desired position of the camera. A capture interface may be displayed, which may include instructions for moving the camera to the at least one desired camera pose. At least one further image of the field of view from the at least one desired camera pose may be captured. Captured images may be processed to remove the obstruction from a background image.

Patent Agency Ranking