公开(公告)号：US10991085B2

公开(公告)日：2021-04-27

申请号：US16372202

申请日：2019-04-01

Applicant: ADOBE INC.

Inventor： Qi Sun ,  Li-Yi Wei ,  Joon-Young Lee ,  Jonathan Eisenmann ,  Jinwoong Jung ,  Byungmoon Kim

IPC: G06K9/62 ,  G06T7/00 ,  G06N3/04

Abstract: Embodiments herein describe a framework for classifying images. In some embodiments, it is determined whether an image includes synthetic image content. If it does, characteristics of the image are analyzed to determine if the image includes characteristics particular to panoramic images (e.g., possess a threshold equivalency of pixel values among the top and/or bottom boundaries of the image, or a difference between summed pixel values of the pixels comprising the right vertical boundary of the image and summed pixel values of the pixels comprising the left vertical boundary of the image being less than or equal to a threshold value). If the image includes characteristics particular to panoramic images, the image is classified as a synthetic panoramic image. If the image is determined to not include synthetic image content, a neural network is applied to the image and the image is classified as one of non-synthetic panoramic or non-synthetic non-panoramic.

公开(公告)号：US20210090305A1

公开(公告)日：2021-03-25

申请号：US17111903

申请日：2020-12-04

Applicant: Adobe Inc.

Inventor： Byungmoon Kim ,  Jinyi Kwon

IPC: G06T11/00 ,  G06F3/0488 ,  G06F3/0482 ,  G06T11/20 ,  G06T11/40 ,  G06T11/60 ,  G06F3/0354 ,  G06T11/80

Abstract: Certain embodiments involve a graphics manipulation application using brushstroke parameters that include a maximum alpha-deposition parameter and a fractional alpha-deposition parameter. For instance, the graphics manipulation application uses an alpha flow increment computed from the maximum alpha-deposition parameter and the fractional alpha-deposition parameter to compute an output canvas color. In some embodiments, if the current canvas opacity exceeds or equals the maximum alpha-deposition parameter, the current canvas opacity is selected as the output canvas opacity. Otherwise, the graphics manipulation application computes the output canvas opacity by increasing the current canvas opacity based on the alpha flow increment. The graphics manipulation application updates a canvas portion affected by a brushstroke input to include the output canvas opacity and the output canvas color.

公开(公告)号：US20210056408A1

公开(公告)日：2021-02-25

申请号：US16549072

申请日：2019-08-23

Applicant: Adobe Inc.

Inventor： Jonathan Brandt ,  Chen Fang ,  Byungmoon Kim ,  Biao Jia

IPC: G06N3/08 ,  G06N3/04 ,  G09G5/37

Abstract: The technology described herein is directed to a reinforcement learning based framework for training a natural media agent to learn a rendering policy without human supervision or labeled datasets. The reinforcement learning based framework feeds the natural media agent a training dataset to implicitly learn the rendering policy by exploring a canvas and minimizing a loss function. Once trained, the natural media agent can be applied to any reference image to generate a series (or sequence) of continuous-valued primitive graphic actions, e.g., sequence of painting strokes, that when rendered by a synthetic rendering environment on a canvas, reproduce an identical or transformed version of the reference image subject to limitations of an action space and the learned rendering policy.

公开(公告)号：US20200311901A1

公开(公告)日：2020-10-01

申请号：US16372202

申请日：2019-04-01

Applicant: ADOBE INC.

Inventor： Qi Sun ,  Li-Yi Wei ,  Joon-Young Lee ,  Jonathan Eisenmann ,  Jinwoong Jung ,  Byungmoon Kim

IPC: G06T7/00 ,  G06N3/04 ,  G06K9/62

Abstract: Embodiments herein describe a framework for classifying images. In some embodiments, it is determined whether an image includes synthetic image content. If it does, characteristics of the image are analyzed to determine if the image includes characteristics particular to panoramic images (e.g., possess a threshold equivalency of pixel values among the top and/or bottom boundaries of the image, or a difference between summed pixel values of the pixels comprising the right vertical boundary of the image and summed pixel values of the pixels comprising the left vertical boundary of the image being less than or equal to a threshold value). If the image includes characteristics particular to panoramic images, the image is classified as a synthetic panoramic image. If the image is determined to not include synthetic image content, a neural network is applied to the image and the image is classified as one of non-synthetic panoramic or non-synthetic non-panoramic.

公开(公告)号：US10698588B2

公开(公告)日：2020-06-30

申请号：US14469910

申请日：2014-08-27

Applicant: Adobe Inc.

Inventor： Brian L. Price ,  Byungmoon Kim

IPC: G06F3/0484 ,  G06F3/0482

Abstract: Combined selection tool techniques are described in which selection of portions within an image is enabled via a tool configured to selectively switch between a coarse selection mode and a refinement selection mode. In one or more implementations, an image is exposed for editing in a user interface and input is obtained to select portions of the image using the tool. The selection mode is automatically toggled between the coarse selection mode and refinement selection mode based on characteristics of the input, such as position and velocity of the input or gestures mapped to the input. Then, selection boundaries defining the selection of portions of the image are modified in accordance with the input. In one approach, the coarse selection mode corresponds to a graph cut mechanism and the refinement selection mode corresponds to a level set mechanism.

公开(公告)号：US10514842B2

公开(公告)日：2019-12-24

申请号：US16169877

申请日：2018-10-24

Applicant: Adobe Inc.

Inventor： Byungmoon Kim ,  Jihyun Lee ,  Eunyee Koh

IPC: G09G5/00 ,  G06F3/0488 ,  G02B27/01 ,  G06F3/01 ,  G06F3/023

Abstract: Systems and methods for detecting a user interaction by identifying a touch gesture on a touch interface on a virtual reality headset. The touch gestures are received on a front surface that is on the opposite side of the headset's inner display screen so that correspondence between the touch location and displayed content is intuitive to the user. The techniques of the invention display a cursor and enable the user to move the cursor by one type of input and make selections with the cursor using a second type of input. In this way, the user is able to intuitively control a displayed cursor by moving a finger around (e.g., dragging) on the opposite side of the display in the cursor's approximate location. The user then uses another type of touch input to make a selection at the cursor's current location.

公开(公告)号：US20220230388A1

公开(公告)日：2022-07-21

申请号：US17658589

申请日：2022-04-08

Applicant: Adobe Inc.

Inventor： Byungmoon Kim ,  Yeojin Kim ,  Daichi Ito

IPC: G06T17/00 ,  G06T19/20 ,  G06T15/20 ,  G06T15/02

Abstract: Systems, methods, and non-transitory computer-readable media are disclosed for modifying voxel-based 3D representations using 3D digital brush tools and/or resolution filters. For example, the disclosed systems can utilize 3D digital brush tools (e.g., a digital blur brush tool, a digital smudge brush tool, and/or a digital melt brush tool) to identify and modify one or more voxels within a 3D representation using multiple buffers of visual properties. Additionally, the disclosed systems can modify one or more voxels within a 3D representation by rendering the one or more voxels at varying levels of detail using an octree (e.g., a mosaic filter tool). In particular, the disclosed systems can identify one or more voxels within an octree that are smaller than a target voxel size. Moreover, the disclosed systems can combine the identified one or more voxels within the octree to render the 3D representation at varying levels of detail.

公开(公告)号：US11113578B1

公开(公告)日：2021-09-07

申请号：US16847270

申请日：2020-04-13

Applicant: Adobe Inc.

Inventor： Jonathan Brandt ,  Radomir Mech ,  Ning Xu ,  Byungmoon Kim ,  Biao Jia

IPC: G06K9/62 ,  G06N3/08

Abstract: A non-photorealistic image rendering system and related techniques are described herein that train and implement machine learning models to reproduce digital images in accordance with various painting styles and constraints. The image rendering system can include a machine learning system that utilizes actor-critic based reinforcement learning techniques to train painting agents (e.g., models that include one or more neural networks) how to transform images into various artistic styles with minimal loss between the original images and the transformed images. The image rendering system can generate constrained painting agents, which correspond to painting agents that are further trained to reproduce images in accordance with one or more constraints. The constraints may include limitations of the color, width, size, and/or position of brushstrokes within reproduced images. These constrained painting agents may provide users with robust, flexible, and customizable non-photorealistic painting systems.

公开(公告)号：US11048335B2

公开(公告)日：2021-06-29

申请号：US16846895

申请日：2020-04-13

Applicant: Adobe Inc.

Inventor： Jingwan Lu ,  Stephen J. DiVerdi ,  Byungmoon Kim ,  Jun Xing

IPC: G06T19/00 ,  G06F3/01 ,  G06T17/30 ,  G06F3/0346 ,  G06F3/0488 ,  G06T11/20 ,  G06T15/02

Abstract: Stroke operation prediction techniques and systems for three-dimensional digital content are described. In one example, stroke operation data is received that describes a stroke operation input via a user interface as part of the three-dimensional digital content. A cycle is generated that defines a closed path within the three-dimensional digital content based on the input stroke operation and at least one other stroke operation in the user interface. A surface is constructed based on the generated cycle. A predicted stroke operation is generated based at least in part on the constructed surface. The predicted stroke operation is then output in real time in the user interface as part of the three-dimensional digital content as the stroke operation data is received.

公开(公告)号：US10685479B2

公开(公告)日：2020-06-16

申请号：US16200400

申请日：2018-11-26

Applicant: Adobe Inc.

Inventor： Jose Ignacio Echevarria Vallespi ,  Byungmoon Kim

IPC: G06T17/00 ,  G06T7/11

Abstract: Methods and systems for reconstructing surfaces of an object using regional level sets (RLS) are disclosed. A scanning system scans an object and generates a point cloud. An RLS is iteratively determined as solution to a differential equation constrained by the point cloud. The RLS is a 2-tuple, where the first component corresponds to a region identification and the second component corresponds to the solution of the differential equation. The space around the point cloud is iteratively segmented into a plurality of regions. A single solution to the differential equation is applied, encompassing all the regions. The solution in regions of the space corresponding to the finer structures within the point cloud are modeled similar to the coarser regions. The solution in a particular region is iteratively based on the solution in the neighboring regions. An RLS is enabled to reconstruct thinner or smaller structures or surfaces of the object.