公开(公告)号：US20230118361A1

公开(公告)日：2023-04-20

申请号：US17968645

申请日：2022-10-18

Applicant: Google LLC

Inventor： Orly LIBA ,  Navin SARMA ,  Yael Pritch KNAAN ,  Alexander SCHIFFHAUER ,  Longqi CAI ,  David JACOBS ,  Huizhong CHEN ,  Siyang LI ,  Bryan FELDMAN

IPC: G06T3/40 ,  G06T7/11 ,  G06T5/00

Abstract: A media application receives user input that indicates one or more objects to be erased from a media item. The media application translates the user input to a bounding box. The media application provides a crop of the media item based on the bounding box to a segmentation machine-learning model. The segmentation machine-learning model outputs a segmentation mask for one or more segmented objects in the crop of the media item and a corresponding segmentation score that indicates a quality of the segmentation mask.

公开(公告)号：US20240346631A1

公开(公告)日：2024-10-17

申请号：US18293678

申请日：2022-06-30

Applicant: Google LLC

Inventor： Orly LIBA ,  Pedro VELEZ ,  Siyang LI ,  Huizhong CHEN ,  Marcel PUYAT ,  Yanan BAO

IPC: G06T5/77 ,  G06T5/60 ,  G06T7/11 ,  G06T7/136 ,  G06T7/194

CPC classification number: G06T5/77 ,  G06T5/60 ,  G06T7/11 ,  G06T7/136 ,  G06T7/194 ,  G06T2207/20021 ,  G06T2207/20081 ,  G06T2207/30196 ,  G06T2210/12

Abstract: A media application detects a bystander in an initial image. The media application generates a bystander box that includes the bystander, wherein all pixels for the bystander are within the bystander box. The media application generates localizer boxes that encompass the bystander and one or more objects that are attached to the bystander. The media application aggregates the bystander box and one or more of the localizer boxes to form an aggregated box. The media application applies a segmenter to the initial image, based on the aggregated box, to segment the bystander and the one or more objects from the initial image to generate a bystander mask, wherein the bystander mask includes a subset of pixels within the aggregated box. The media application generates an inpainted image that replaces all pixels within the bystander mask with pixels that match a background in the initial image.