知搜-全球专利检索

  1. Login
  2. Sign Up

Search Results

24 records (took 0.015 seconds)

    METHODS, SYSTEMS, AND MEDIA FOR RELIGHTING IMAGES USING PREDICTED DEEP REFLECTANCE FIELDS
    12.
    发明申请
    METHODS, SYSTEMS, AND MEDIA FOR RELIGHTING IMAGES USING PREDICTED DEEP REFLECTANCE FIELDS 审中-公开

    公开(公告)号：US20200372284A1

    公开(公告)日：2020-11-26

    申请号：US16616235

    申请日：2019-10-16

    Applicant: Google LLC

    Inventor： Christoph Rhemann ,  Abhimitra Meka ,  Matthew Whalen ,  Jessica Lynn Busch ,  Sofien Bouaziz ,  Geoffrey Douglas Harvey ,  Andrea Tagliasacchi ,  Jonathan Taylor ,  Paul Debevec ,  Peter Joseph Denny ,  Sean Ryan Francesco Fanello ,  Graham Fyffe ,  Jason Angelo Dourgarian ,  Xueming Yu ,  Adarsh Prakash Murthy Kowdle ,  Julien Pascal Christophe Valentin ,  Peter Christopher Lincoln ,  Rohit Kumar Pandey ,  Christian Häne ,  Shahram Izadi

    IPC: G06K9/46 ,  G06T15/50 ,  G06K9/62 ,  G06N3/08 ,  G06T15/20

    Abstract: Methods, systems, and media for relighting images using predicted deep reflectance fields are provided. In some embodiments, the method comprises: identifying a group of training samples, wherein each training sample includes (i) a group of one-light-at-a-time (OLAT) images that have each been captured when one light of a plurality of lights arranged on a lighting structure has been activated, (ii) a group of spherical color gradient images that have each been captured when the plurality of lights arranged on the lighting structure have been activated to each emit a particular color, and (iii) a lighting direction, wherein each image in the group of OLAT images and each of the spherical color gradient images are an image of a subject, and wherein the lighting direction indicates a relative orientation of a light to the subject; training a convolutional neural network using the group of training samples, wherein training the convolutional neural network comprises: for each training iteration in a series of training iterations and for each training sample in the group of training samples: generating an output predicted image, wherein the output predicted image is a representation of the subject associated with the training sample with lighting from the lighting direction associated with the training sample; identifying a ground-truth OLAT image included in the group of OLAT images for the training sample that corresponds to the lighting direction for the training sample; calculating a loss that indicates a perceptual difference between the output predicted image and the identified ground-truth OLAT image; and updating parameters of the convolutional neural network based on the calculated loss; identifying a test sample that includes a second group of spherical color gradient images and a second lighting direction; and generating a relit image of the subject included in each of the second group of spherical color gradient images with lighting from the second lighting direction using the trained convolutional neural network.

    Nonlinear Peri-Codec Optimization For Image And Video Coding
    13.
    发明申请
    Nonlinear Peri-Codec Optimization For Image And Video Coding 有权

    公开(公告)号：US20250045968A1

    公开(公告)日：2025-02-06

    申请号：US18570562

    申请日：2021-06-16

    Applicant: Google LLC

    Inventor： Onur G. Guleryuz ,  Ruofei Du ,  Hugues H. Hoppe ,  Sean Ryan Francesco Fanello ,  Philip Andrew Chou ,  Danhang Tang ,  Philip Davidson

    IPC: G06T9/00 ,  G06V10/82

    Abstract: Nonlinear peri-codec optimization for image and video coding includes obtaining a source image including pixel values expressed in a first defined image sample space, generating a neuralized image representing the source image, the neuralized image including pixel values that are expressed as neural latent space values, encoding the input image wherein the neural latent space values are used as pixel values in a second defined image sample space and the input image is in an operative image format of the encoder, such that a decoder decodes the encoded image to obtain a reconstructed image in the second defined image sample space, wherein the reconstructed image is a reconstructed neuralized image including reconstructed neural latent space values, such that a deneuralized reconstructed image corresponding to the source image is obtained by a nonlinear post-codec image processor in the first defined image sample space.

    Object observation prediction in images using encoder-decoder models
    17.
    发明授权
    Object observation prediction in images using encoder-decoder models 有权

    公开(公告)号：US12254406B2

    公开(公告)日：2025-03-18

    申请号：US17304505

    申请日：2021-06-22

    Applicant: Google LLC

    Inventor： Onur G. Guleryuz ,  Sean Ryan Francesco Fanello

    IPC: G06F3/01 ,  G06N3/045 ,  G06N3/08 ,  G06V40/19

    Abstract: A method including, in a training phase, training a gaze prediction model including a first model and a second model, the first model and the second model being configured in conjunction to predict segmentation data based on training data, training a third model together with the first model and the second model, the third model being configured to predict a training characteristic using an output of the first model based on the training data, and in an operational phase, receiving operational data and predicting an operational characteristic using the trained first model and the trained third model.

Patent Agency Ranking