Structured knowledge modeling, extraction and localization from images

    公开(公告)号:US10460033B2

    公开(公告)日:2019-10-29

    申请号:US14978421

    申请日:2015-12-22

    申请人: Adobe Inc.

    IPC分类号: G06F17/27 G06K9/46 G06K9/62

    摘要: Techniques and systems are described to model and extract knowledge from images. A digital medium environment is configured to learn and use a model to compute a descriptive summarization of an input image automatically and without user intervention. Training data is obtained to train a model using machine learning in order to generate a structured image representation that serves as the descriptive summarization of an input image. The images and associated text are processed to extract structured semantic knowledge from the text, which is then associated with the images. The structured semantic knowledge is processed along with corresponding images to train a model using machine learning such that the model describes a relationship between text features within the structured semantic knowledge. Once the model is learned, the model is usable to process input images to generate a structured image representation of the image.

    Structured knowledge modeling and extraction from images

    公开(公告)号:US11514244B2

    公开(公告)日:2022-11-29

    申请号:US14978350

    申请日:2015-12-22

    申请人: Adobe Inc.

    摘要: Techniques and systems are described to model and extract knowledge from images. A digital medium environment is configured to learn and use a model to compute a descriptive summarization of an input image automatically and without user intervention. Training data is obtained to train a model using machine learning in order to generate a structured image representation that serves as the descriptive summarization of an input image. The images and associated text are processed to extract structured semantic knowledge from the text, which is then associated with the images. The structured semantic knowledge is processed along with corresponding images to train a model using machine learning such that the model describes a relationship between text features within the structured semantic knowledge. Once the model is learned, the model is usable to process input images to generate a structured image representation of the image.

    Stereo Correspondence and Depth Sensors
    3.
    发明申请

    公开(公告)号:US20200007855A1

    公开(公告)日:2020-01-02

    申请号:US16552883

    申请日:2019-08-27

    申请人: Adobe Inc.

    摘要: Stereo correspondence and depth sensor techniques are described. In one or more implementations, a depth map generated by a depth sensor is leveraged as part of processing of stereo images to assist in identifying which parts of stereo images correspond to each other. The depth map, for instance, may be utilized to assist in identifying depth discontinuities in the stereo images. Additionally, techniques may be employed to align the depth discontinuities identified from the depth map to image edges identified from the stereo images. Techniques may also be employed to suppress image edges that do not correspond to the depth discontinuities of the depth map in comparison with image edges that do correspond to the depth discontinuities as part of the identification.

    Stereo correspondence and depth sensors

    公开(公告)号:US10455219B2

    公开(公告)日:2019-10-22

    申请号:US13690724

    申请日:2012-11-30

    申请人: Adobe Inc.

    摘要: Stereo correspondence and depth sensor techniques are described. In one or more implementations, a depth map generated by a depth sensor is leveraged as part of processing of stereo images to assist in identifying which parts of stereo images correspond to each other. The depth map, for instance, may be utilized to assist in identifying depth discontinuities in the stereo images. Additionally, techniques may be employed to align the depth discontinuities identified from the depth map to image edges identified from the stereo images. Techniques may also be employed to suppress image edges that do not correspond to the depth discontinuities of the depth map in comparison with image edges that do correspond to the depth discontinuities as part of the identification.

    Image recoloring for color consistency in a digital medium environment

    公开(公告)号:US10430973B2

    公开(公告)日:2019-10-01

    申请号:US15342041

    申请日:2016-11-02

    申请人: Adobe Inc.

    IPC分类号: G06T7/90 G06T11/00

    摘要: Techniques and systems are described to recolor a group of images for color consistency. Techniques include extracting color palettes for images of the group of images and generating a group theme color palette based on the color palettes for the images. Image color palettes are then mapped to the group theme color palette and the images are modified in response to the mapping. In some examples, the mapping includes discouraging multiple colors of a single color palette from mapping to a single color of the group theme color palette. Additionally, or alternatively, the mapping includes discouraging a forced mapping of a dissimilar color of an image color palette from mapping to the group theme color palette.

    Stereo correspondence model fitting

    公开(公告)号:US10249052B2

    公开(公告)日:2019-04-02

    申请号:US13720316

    申请日:2012-12-19

    申请人: Adobe Inc.

    IPC分类号: G06T7/593 G06T17/10 G06T17/00

    摘要: Stereo correspondence model fitting techniques are described. In one or more implementations, a model may be fit to a region in at least one of a plurality of stereoscopic images of an image scene. The model may then be used as part of a stereo correspondence calculation, which may include computing disparities for the region based at least in part on correspondence to the model.

    Digital Image Processing for Element Removal and/or Replacement

    公开(公告)号:US20190087549A1

    公开(公告)日:2019-03-21

    申请号:US16192328

    申请日:2018-11-15

    申请人: Adobe Inc.

    摘要: Techniques and systems are described to support digital image processing through use of an image repository, e.g., a stock image database or other storage. In one example, a plurality of candidate digital images are obtained from an image repository based on a target digital image. A plurality of transformations are generated to be applied to the target digital image, each transformation based on a respective candidate digital image. Semantic information is employed as part of the transformations, e.g., blending, filtering, or alignment. A plurality of transformed target digital images are generated based at least in part through application of the plurality of transformations to the target image.

    Image search using emotions
    8.
    发明授权

    公开(公告)号:US10783431B2

    公开(公告)日:2020-09-22

    申请号:US14938752

    申请日:2015-11-11

    申请人: Adobe Inc.

    摘要: Image search techniques and systems involving emotions are described. In one or more implementations, a digital medium environment of a content sharing service is described for image search result configuration and control based on a search request that indicates an emotion. The search request is received that includes one or more keywords and specifies an emotion. Images are located that are available for licensing by matching one or more tags associated with the image with the one or more keywords and as corresponding to the emotion. The emotion of the images is identified using one or more models that are trained using machine learning based at least in part on training images having tagged emotions. Output is controlled of a search result having one or more representations of the images that are selectable to license respective images from the content sharing service.

    Image Recoloring for Color Consistency in a Digital Medium Environment

    公开(公告)号:US20190236808A1

    公开(公告)日:2019-08-01

    申请号:US16380903

    申请日:2019-04-10

    申请人: Adobe Inc.

    IPC分类号: G06T7/90 G06T11/00

    摘要: Techniques and systems are described to recolor a group of images for color consistency. Techniques include extracting color palettes for images of the group of images and generating a group theme color palette based on the color palettes for the images. Image color palettes are then mapped to the group theme color palette and the images are modified in response to the mapping. In some examples, the mapping includes discouraging multiple colors of a single color palette from mapping to a single color of the group theme color palette. Additionally, or alternatively, the mapping includes discouraging a forced mapping of a dissimilar color of an image color palette from mapping to the group theme color palette.

    Image depth inference from semantic labels

    公开(公告)号:US10346996B2

    公开(公告)日:2019-07-09

    申请号:US14832328

    申请日:2015-08-21

    申请人: Adobe Inc.

    IPC分类号: G06K9/62 G06T7/536

    摘要: Image depth inference techniques and systems from semantic labels are described. In one or more implementations, a digital medium environment includes one or more computing devices to control a determination of depth within an image. Regions of the image are semantically labeled by the one or more computing devices. At least one of the semantically labeled regions is decomposed into a plurality of segments formed as planes generally perpendicular to a ground plane of the image. Depth of one or more of the plurality of segments is then inferred based on relationships of respective segments with respective locations of the ground plane of the image. A depth map is formed that describes depth for the at least one semantically labeled region based at least in part on the inferred depths for the one or more of the plurality of segments.