-
公开(公告)号:US12254685B2
公开(公告)日:2025-03-18
申请号:US18094933
申请日:2023-01-09
Applicant: Google LLC
Inventor: Dmitry Lagun , Junfeng He , Pingmei Xu
IPC: G06V10/82 , G06F3/01 , G06F18/211 , G06F18/214 , G06F18/2413 , G06T7/73 , G06T7/80 , G06V10/764 , G06V40/16 , G06V40/19
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
-
公开(公告)号:US11551377B2
公开(公告)日:2023-01-10
申请号:US17102337
申请日:2020-11-23
Applicant: Google LLC
Inventor: Dmitry Lagun , Junfeng He , Pingmei Xu
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
-
公开(公告)号:US20210150759A1
公开(公告)日:2021-05-20
申请号:US17102337
申请日:2020-11-23
Applicant: Google LLC
Inventor: Dmitry Lagun , Junfeng He , Pingmei Xu
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
-
公开(公告)号:US20190080474A1
公开(公告)日:2019-03-14
申请号:US16188255
申请日:2018-11-12
Applicant: Google LLC
Inventor: Dmitry Lagun , Junfeng He , Pingmei Xu
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
-
公开(公告)号:US20230032705A1
公开(公告)日:2023-02-02
申请号:US17863186
申请日:2022-07-12
Applicant: Google LLC
Inventor: Vidhya Navalpakkam , Pasin Manurangsi , Nachiappan Valliappan , Kai Kohlhoff , Junfeng He , Badih Ghazi , Shanmugasundaram Ravikumar
IPC: G06F21/62
Abstract: Improved methods are provided for generating heatmaps or other summary map data from multiple users' data (e.g., probability distributions) in a manner that preserves the privacy of the users' data while also generating heatmaps that are visually similar to the ‘true’ heatmap. These methods include decomposing the average of the users' data (the ‘true’ heatmap) into multiple different spatial scales, injecting random noise into the data at the multiple different spatial scales, and then reconstructing the privacy-preserving heatmap based on the noisy multi-scale representations. The magnitude of the noise injected at each spatial scale is selected to ensure preservation of privacy while also resulting in heatmaps that are visually similar to the ‘true’ heatmap.
-
公开(公告)号:US20230274537A1
公开(公告)日:2023-08-31
申请号:US18094933
申请日:2023-01-09
Applicant: Google LLC
Inventor: Dmitry Lagun , Junfeng He , Pingmei Xu
IPC: G06V10/82 , G06T7/73 , G06T7/80 , G06F3/01 , G06V40/19 , G06F18/211 , G06F18/2413 , G06V10/764
CPC classification number: G06V10/82 , G06F3/013 , G06F18/211 , G06F18/24133 , G06T7/74 , G06T7/80 , G06V10/764 , G06V40/19 , G06T2207/20081 , G06T2207/20084 , G06T2207/30201 , G06V40/161
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
-
公开(公告)号:US20230015117A1
公开(公告)日:2023-01-19
申请号:US17856370
申请日:2022-07-01
Applicant: Google LLC
Inventor: Kfir Aberman , David Edward Jacobs , Kai Jochen Kohlhoff , Michael Rubinstein , Yossi Gandelsman , Junfeng He , Inbar Mosseri , Yael Pritch Knaan
Abstract: Techniques for tuning an image editing operator for reducing a distractor in raw image data are presented herein. The image editing operator can access the raw image data and a mask. The mask can indicate a region of interest associated with the raw image data. The image editing operator can process the raw image data and the mask to generate processed image data. Additionally, a trained saliency model can process at least the processed image data within the region of interest to generate a saliency map that provides saliency values. Moreover, a saliency loss function can compare the saliency values provided by the saliency map for the processed image data within the region of interest to one or more target saliency values. Subsequently, the one or more parameter values of the image editing operator can be modified based at least in part on the saliency loss function.
-
-
-
-
-
-