-
公开(公告)号:US11636270B2
公开(公告)日:2023-04-25
申请号:US16775697
申请日:2020-01-29
Applicant: ADOBE INC.
Inventor: Zhe Lin , Walter W. Chang , Scott Cohen , Khoi Viet Pham , Jonathan Brandt , Franck Dernoncourt
IPC: G06F40/30 , G06F16/532 , G06F16/55 , G06F40/205 , G06F40/295 , G06N5/02 , G06N5/04 , G06N20/00 , G06V10/40 , G06V30/10
Abstract: Embodiments of the present invention provide systems, methods, and non-transitory computer storage media for parsing a given input referring expression into a parse structure and generating a semantic computation graph to identify semantic relationships among and between objects. At a high level, when embodiments of the preset invention receive a referring expression, a parse tree is created and mapped into a hierarchical subject, predicate, object graph structure that labeled noun objects in the referring expression, the attributes of the labeled noun objects, and predicate relationships (e.g., verb actions or spatial propositions) between the labeled objects. Embodiments of the present invention then transform the subject, predicate, object graph structure into a semantic computation graph that may be recursively traversed and interpreted to determine how noun objects, their attributes and modifiers, and interrelationships are provided to downstream image editing, searching, or caption indexing tasks.
-
公开(公告)号:US20210232770A1
公开(公告)日:2021-07-29
申请号:US16775697
申请日:2020-01-29
Applicant: ADOBE INC.
Inventor: Zhe Lin , Walter W. Chang , Scott Cohen , Khoi Viet Pham , Jonathan Brandt , Franck Dernoncourt
IPC: G06F40/30 , G06F16/532 , G06F16/55 , G06N5/02 , G06N20/00 , G06N5/04 , G06K9/46 , G06F40/205 , G06F40/295
Abstract: Embodiments of the present invention provide systems, methods, and non-transitory computer storage media for parsing a given input referring expression into a parse structure and generating a semantic computation graph to identify semantic relationships among and between objects. At a high level, when embodiments of the preset invention receive a referring expression, a parse tree is created and mapped into a hierarchical subject, predicate, object graph structure that labeled noun objects in the referring expression, the attributes of the labeled noun objects, and predicate relationships (e.g., verb actions or spatial propositions) between the labeled objects. Embodiments of the present invention then transform the subject, predicate, object graph structure into a semantic computation graph that may be recursively traversed and interpreted to determine how noun objects, their attributes and modifiers, and interrelationships are provided to downstream image editing, searching, or caption indexing tasks.
-
公开(公告)号:US10769738B2
公开(公告)日:2020-09-08
申请号:US15925259
申请日:2018-03-19
Applicant: Adobe Inc.
Inventor: Walter W. Chang , Zhihong Ding , Lubomira A. Dontcheva , Gregg D. Wilensky , Darshan D. Prasad , Claudia Veronica Roberts
Abstract: A tutorial for a given application may be leveraged to generate executable code that can then be executed within a native instruction service of the application. In this way, a software application may thus provide an integrated, interactive learning experience for a user, in a manner that extends beyond the instructional content included in the native instruction service, i.e., that includes at least a portion of the instructional content of the tutorial.
-
公开(公告)号:US20200004873A1
公开(公告)日:2020-01-02
申请号:US16020328
申请日:2018-06-27
Applicant: Adobe Inc.
Inventor: Walter W. Chang , Jonathan Brandt , Doo Soon Kim
IPC: G06F17/30
Abstract: Techniques of directing a user to content based on a semantic interpretation of a query input by the user involves generating links to specific content in a collection of documents in response to user string query, the links being generated based on an answer suggestion lookahead index. The answer suggestion lookahead index references a mapping between a plurality of groups of semantically equivalent terms and a respective link to specific content of the collection of documents. These techniques are useful for the generalized task of natural language question answering.
-
公开(公告)号:US20190287197A1
公开(公告)日:2019-09-19
申请号:US15925259
申请日:2018-03-19
Applicant: Adobe Inc.
Inventor: Walter W. Chang , Zhihong Ding , Lubomira A. Dontcheva , Gregg D. Wilensky , Darshan D. Prasad , Claudia Veronica Roberts
Abstract: A tutorial for a given application may be leveraged to generate executable code that can then be executed within a native instruction service of the application. In this way, a software application may thus provide an integrated, interactive learning experience for a user, in a manner that extends beyond the instructional content included in the native instruction service, i.e., that includes at least a portion of the instructional content of the tutorial.
-
公开(公告)号:US20190278844A1
公开(公告)日:2019-09-12
申请号:US15913064
申请日:2018-03-06
Applicant: Adobe Inc.
Inventor: Jacqueline Brixey , Walter W. Chang , Trung Bui , Doo Soon Kim , Ramesh Radhakrishna Manuvinakurike
IPC: G06F17/27 , G06F3/0484 , G06F17/24
Abstract: A framework for annotating image edit requests includes a structure for identifying natural language request as either comments or image edit requests and for identifying the text of a request that maps to an executable action in an image editing program, as well as to identify other entities from the text related to the action. The annotation framework can be used to aid in the creation of artificial intelligence networks that carry out the requested action. An example method includes displaying a test image, displaying a natural language input with selectable text, and providing a plurality of selectable action tag controls and entity tag controls. The method may also include receiving selection of the text, receiving selection of an action tag control for the selected text, generating a labeled pair, and storing the labeled pair with the natural language input as an annotated natural language image edit request.
-
-
-
-
-