公开(公告)号：US10586356B2

公开(公告)日：2020-03-10

申请号：US15962269

申请日：2018-04-25

Applicant: ADOBE INC.

Inventor： Paul John Asente ,  Stephen Schiller ,  Jakub Fiser

IPC: G06T11/20 ,  G06T3/40 ,  G06T3/60 ,  G06F3/0484 ,  G06T3/00 ,  G06F3/0488 ,  G06T7/12

Abstract: Embodiments of the present invention are directed to beautifying freeform input paths in accordance with paths existing in the drawing (i.e., resolved paths). In some embodiments of the present invention, freeform input paths of a curved format can be modified or replaced to more precisely illustrate a path desired by a user. As such, a user can provide a freeform input path that resembles a path of interest by the user, but is not as precise as desired. Based on existing paths in the electronic drawing, a path suggestion(s) can be generated to rectify, modify, or replace the input path with a more precise path. In some cases, a user can then select a desired path suggestion, and the selected path then replaces the initially provided freeform input path.

公开(公告)号：US11748928B2

公开(公告)日：2023-09-05

申请号：US17094093

申请日：2020-11-10

Applicant: Adobe Inc.

Inventor： Yang Yang ,  Zhixin Shu ,  Shabnam Ghadar ,  Jingwan Lu ,  Jakub Fiser ,  Elya Schechtman ,  Cameron Y. Smith ,  Baldo Antonio Faieta ,  Alex Charles Filipkowski

IPC: G06T11/60 ,  G06F21/62 ,  G06F16/56 ,  G06F16/532

CPC classification number: G06T11/60 ,  G06F16/532 ,  G06F16/56 ,  G06F21/6254 ,  G06T2200/24

Abstract: Face anonymization techniques are described that overcome conventional challenges to generate an anonymized face. In one example, a digital object editing system is configured to generate an anonymized face based on a target face and a reference face. As part of this, the digital object editing system employs an encoder as part of machine learning to extract a target encoding of the target face image and a reference encoding of the reference face. The digital object editing system then generates a mixed encoding from the target and reference encodings. The mixed encoding is employed by a machine-learning model of the digital object editing system to generate a mixed face. An object replacement module is used by the digital object editing system to replace the target face in the target digital image with the mixed face.

公开(公告)号：US10783691B2

公开(公告)日：2020-09-22

申请号：US16681218

申请日：2019-11-12

Applicant: Adobe Inc. ,  CZECH TECHNICAL UNIVERSITY IN PRAGUE

Inventor： David Simons ,  Michal Lukac ,  Daniel Sykora ,  Elya Shechtman ,  Paul Asente ,  Jingwan Lu ,  Jakub Fiser ,  Ondrej Jamriska

IPC: G06T11/00 ,  G06T13/40 ,  G06K9/00 ,  G06T15/04 ,  G06T7/194 ,  G06T7/11 ,  G06T7/73 ,  G06T7/90 ,  G06T3/00 ,  G06T5/00 ,  G06T5/50 ,  G06T13/80 ,  G06T7/60 ,  G06T15/02

Abstract: Certain embodiments involve generating one or more of appearance guide and a positional guide and using one or more of the guides to synthesize a stylized image or animation. For example, a system obtains data indicating a target image and a style exemplar image. The system generates an appearance guide, a positional guide, or both from the target image and the style exemplar image. The system uses one or more of the guides to transfer a texture or style from the style exemplar image to the target image.

公开(公告)号：US11907839B2

公开(公告)日：2024-02-20

申请号：US17468511

申请日：2021-09-07

Applicant: Adobe Inc.

Inventor： Ratheesh Kalarot ,  Kevin Wampler ,  Jingwan Lu ,  Jakub Fiser ,  Elya Shechtman ,  Aliakbar Darabi ,  Alexandru Vasile Costin

IPC: G06N3/08 ,  G06F3/04845 ,  G06T11/60 ,  G06T3/40 ,  G06T3/00 ,  G06F3/04847 ,  G06N20/20 ,  G06T5/00 ,  G06T5/20 ,  G06T11/00 ,  G06F18/40 ,  G06F18/211 ,  G06F18/214 ,  G06F18/21 ,  G06N3/045

CPC classification number: G06N3/08 ,  G06F3/04845 ,  G06F3/04847 ,  G06F18/211 ,  G06F18/214 ,  G06F18/2163 ,  G06F18/40 ,  G06N3/045 ,  G06N20/20 ,  G06T3/0006 ,  G06T3/0093 ,  G06T3/40 ,  G06T3/4038 ,  G06T3/4046 ,  G06T5/005 ,  G06T5/20 ,  G06T11/001 ,  G06T11/60 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2210/22

Abstract: Systems and methods combine an input image with an edited image generated using a generator neural network to preserve detail from the original image. A computing system provides an input image to a machine learning model to generate a latent space representation of the input image. The system provides the latent space representation to a generator neural network to generate a generated image. The system generates multiple scale representations of the input image, as well as multiple scale representations of the generated image. The system generates a first combined image based on first scale representations of the images and a first value. The system generates a second combined image based on second scale representations of the images and a second value. The system blends the first combined image with the second combined image to generate an output image.

公开(公告)号：US20230360299A1

公开(公告)日：2023-11-09

申请号：US18224916

申请日：2023-07-21

Applicant: Adobe Inc.

Inventor： Yang Yang ,  Zhixin Shu ,  Shabnam Ghadar ,  Jingwan Lu ,  Jakub Fiser ,  Elya Schechtman ,  Cameron Y. Smith ,  Baldo Antonio Faieta ,  Alex Charles Filipkowski

IPC: G06T11/60 ,  G06F21/62 ,  G06F16/56 ,  G06F16/532

CPC classification number: G06T11/60 ,  G06F21/6254 ,  G06F16/56 ,  G06F16/532 ,  G06T2200/24

Abstract: Face anonymization techniques are described that overcome conventional challenges to generate an anonymized face. In one example, a digital object editing system is configured to generate an anonymized face based on a target face and a reference face. As part of this, the digital object editing system employs an encoder as part of machine learning to extract a target encoding of the target face image and a reference encoding of the reference face. The digital object editing system then generates a mixed encoding from the target and reference encodings. The mixed encoding is employed by a machine-learning model of the digital object editing system to generate a mixed face. An object replacement module is used by the digital object editing system to replace the target face in the target digital image with the mixed face.

公开(公告)号：US20230110680A1

公开(公告)日：2023-04-13

申请号：US17496231

申请日：2021-10-07

Applicant: Adobe Inc.

Inventor： Jakub Fiser ,  Ankit Phogat ,  Vineet Batra

IPC: G06T11/40 ,  G06T7/90 ,  G06K9/20 ,  G06T11/00 ,  G06K9/62 ,  G06T7/11

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing ray-tracing and mesh generation to illuminate two-dimensional digital vector images. In response to inserting a light source into a two-dimensional digital vector image including one or more vector elements, the disclosed system embeds the vector element(s) into a polygonal mesh generated for a region of the digital vector image. The disclosed system samples a plurality of rays at a plurality of points within the region and detect intersections of the rays with the vector element(s) or a bounding shape surrounding the region. Additionally, the disclosed system determines color values for mesh points in the polygonal mesh based on the intersections of the rays by interpolating color values associated with the intersected points. Furthermore, in some embodiments, the disclosed system subdivides the polygonal mesh according to a priority queue based on error scores associated with the determined color values.

公开(公告)号：US20220148243A1

公开(公告)日：2022-05-12

申请号：US17094093

申请日：2020-11-10

Applicant: Adobe Inc.

Inventor： Yang Yang ,  Zhixin Shu ,  Shabnam Ghadar ,  Jingwan Lu ,  Jakub Fiser ,  Elya Schechtman ,  Cameron Y. Smith ,  Baldo Antonio Faieta ,  Alex Charles Filipkowski

IPC: G06T11/60 ,  G06T9/00 ,  G06F3/0484 ,  G06F16/532 ,  G06F21/62 ,  G06F16/56 ,  G06N20/00

Abstract: Face anonymization techniques are described that overcome conventional challenges to generate an anonymized face. In one example, a digital object editing system is configured to generate an anonymized face based on a target face and a reference face. As part of this, the digital object editing system employs an encoder as part of machine learning to extract a target encoding of the target face image and a reference encoding of the reference face. The digital object editing system then generates a mixed encoding from the target and reference encodings. The mixed encoding is employed by a machine-learning model of the digital object editing system to generate a mixed face. An object replacement module is used by the digital object editing system to replace the target face in the target digital image with the mixed face.

公开(公告)号：US20220122307A1

公开(公告)日：2022-04-21

申请号：US17468511

申请日：2021-09-07

Applicant: Adobe Inc.

Inventor： Ratheesh Kalarot ,  Kevin Wampler ,  Jingwan Lu ,  Jakub Fiser ,  Elya Shechtman ,  Aliakbar Darabi ,  Alexandru Vasile Costin

IPC: G06T11/60 ,  G06T3/00 ,  G06T3/40

Abstract: Systems and methods combine an input image with an edited image generated using a generator neural network to preserve detail from the original image. A computing system provides an input image to a machine learning model to generate a latent space representation of the input image. The system provides the latent space representation to a generator neural network to generate a generated image. The system generates multiple scale representations of the input image, as well as multiple scale representations of the generated image. The system generates a first combined image based on first scale representations of the images and a first value. The system generates a second combined image based on second scale representations of the images and a second value. The system blends the first combined image with the second combined image to generate an output image.

公开(公告)号：US10825224B2

公开(公告)日：2020-11-03

申请号：US16196680

申请日：2018-11-20

Applicant: Adobe Inc.

Inventor： Geoffrey Heller ,  Jakub Fiser ,  David P. Simons

IPC: G06K9/00 ,  G06T13/40

Abstract: Certain embodiments involve automatically detecting video frames that depict visemes and that are usable for generating an animatable puppet. For example, a computing device accesses video frames depicting a person performing gestures usable for generating a layered puppet, including a viseme gesture corresponding to a target sound or phoneme. The computing device determines that audio data including the target sound or phoneme aligns with a particular video frame from the video frames that depicts the person performing the viseme gesture. The computing device creates, from the video frames, a puppet animation of the gestures, including an animation of the viseme corresponding to the target sound or phoneme that is generated from the particular video frame. The computing device outputs the puppet animation to a presentation device.

公开(公告)号：US20200160581A1

公开(公告)日：2020-05-21

申请号：US16196680

申请日：2018-11-20

Applicant: Adobe Inc.

Inventor： Geoffrey Heller ,  Jakub Fiser ,  David P. Simons

IPC: G06T13/40 ,  G06K9/00 ,  G10L25/57

Abstract: Certain embodiments involve automatically detecting video frames that depict visemes and that are usable for generating an animatable puppet. For example, a computing device accesses video frames depicting a person performing gestures usable for generating a layered puppet, including a viseme gesture corresponding to a target sound or phoneme. The computing device determines that audio data including the target sound or phoneme aligns with a particular video frame from the video frames that depicts the person performing the viseme gesture. The computing device creates, from the video frames, a puppet animation of the gestures, including an animation of the viseme corresponding to the target sound or phoneme that is generated from the particular video frame. The computing device outputs the puppet animation to a presentation device.