Predicting video edits from text-based conversations using neural networks

    公开(公告)号:US12238451B2

    公开(公告)日:2025-02-25

    申请号:US18055301

    申请日:2022-11-14

    Applicant: Adobe Inc.

    Abstract: Embodiments are disclosed for predicting, using neural networks, editing operations for application to a video sequence based on processing conversational messages by a video editing system. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input including a video sequence and text sentences, the text sentences describing a modification to the video sequence, mapping, by a first neural network content of the text sentences describing the modification to the video sequence to a candidate editing operation, processing, by a second neural network, the video sequence to predict parameter values for the candidate editing operation, and generating a modified video sequence by applying the candidate editing operation with the predicted parameter values to the video sequence.

    Robust content fingerprinting for image attribution

    公开(公告)号:US12147495B2

    公开(公告)日:2024-11-19

    申请号:US17142030

    申请日:2021-01-05

    Applicant: ADOBE INC.

    Abstract: A visual search system facilitates retrieval of provenance information using a machine learning model to generate content fingerprints that are invariant to benign transformations while being sensitive to manipulations. The machine learning model is trained on a training image dataset that includes original images, benign transformed variants of the original images, and manipulated variants of the original images. A loss function is used to train the machine learning model to minimize distances in an embedding space between benign transformed variants and their corresponding original images and increase distances between the manipulated variants and their corresponding original images.

    OPEN-DOMAIN TRENDING HASHTAG RECOMMENDATIONS

    公开(公告)号:US20240037149A1

    公开(公告)日:2024-02-01

    申请号:US17877469

    申请日:2022-07-29

    Applicant: Adobe Inc.

    CPC classification number: G06F16/9024 G06N3/0454 G06Q50/01

    Abstract: Techniques for recommending hashtags, including trending hashtags, are disclosed. An example method includes accessing a graph. The graph includes video nodes representing videos, historical hashtag nodes representing historical hashtags, and edges indicating associations among the video nodes and the historical hashtag nodes. A trending hashtag is identified. An edge is added to the graph between a historical hashtag node representing a historical hashtag and a trending hashtag node representing the trending hashtag, based on a semantic similarity between the historical hashtag and the trending hashtag. A new video node representing a new video is added to the video nodes of the graph. A graph neural network (GNN) is applied to the graph, and the GNN predicts a new edge between the trending hashtag node and the new video node. The trending hashtag is recommended for the new video based on prediction of the new edge.

    TECHNIQUES FOR CUSTOMIZED TOPIC DETERMINATION FOR HIGH-VOLUME DOCUMENT COLLECTIONS

    公开(公告)号:US20230409621A1

    公开(公告)日:2023-12-21

    申请号:US17845437

    申请日:2022-06-21

    Applicant: Adobe Inc.

    CPC classification number: G06F16/35 G06F40/279

    Abstract: A topic mapping system generates customized mapping schemas for multiple topic sets. The topic mapping system generates document clusters that represent groups of digital documents. The topic mapping system also generates, for each topic set, a document-topic mapping data object (“DTM data object”) that describes a customized mapping schema of the document clusters to labels in the topic set. The topic mapping system identifies customized groups of documents for responding to multiple requests that have a particular keyword. For each request, the topic mapping system identifies a particular topic set and DTM data object associated with a computing system that provided the request. Based on the keyword, the topic mapping system identifies documents that are categorized according to the customized mapping schema in the DTM data object. The topic mapping system can provide customized groups of documents to respective computing systems that provided the multiple requests.

    GENERATING MULTI-PASS-COMPRESSED-TEXTURE IMAGES FOR FAST DELIVERY

    公开(公告)号:US20230291917A1

    公开(公告)日:2023-09-14

    申请号:US18318953

    申请日:2023-05-17

    Applicant: Adobe Inc.

    CPC classification number: H04N19/192 H04N19/176 H04N19/186

    Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media to enhance texture image delivery and processing at a client device. For example, the disclosed systems can utilize a server-side compression combination that includes, in sequential order, a first compression pass, a decompression pass, and a second compression pass. By applying this compression combination to a texture image at the server-side, the disclosed systems can leverage both GPU-friendly and network-friendly image formats. For example, at a client device, the disclosed system can instruct the client device to execute a combination of decompression-compression passes on a GPU-network-friendly image delivered over a network connection to the client device. In so doing, client device can generate a tri-pass-compressed-texture from a decompressed image comprising texels with color palettes based on previously reduced color palettes from the first compression pass at the server-side, which reduces computational overhead and increases performance speed.

    SYSTEMS AND METHODS FOR CONTENT DISTRIBUTION WITHOUT TRACKING

    公开(公告)号:US20230281642A1

    公开(公告)日:2023-09-07

    申请号:US17653157

    申请日:2022-03-02

    Applicant: ADOBE INC.

    CPC classification number: G06Q30/0201

    Abstract: A system and method for content distribution without tracking is described. The system and method includes determining that device identifiers are not available for a first digital content channel; identifying a first cluster of users and a second cluster of users based on the determination that device identifiers are not available; providing first content and second content via the first digital content channel; monitoring user interactions on the first digital content channel to obtain a first conversion rate for users in the first cluster that receive the first content and a second conversion rate for users in the second cluster that receive the second content; computing a cross-cluster treatment effect based on the first conversion rate and the second conversion rate; computing a treatment effect for the first content based on the cross-cluster treatment effect; and providing the first content to a subsequent user based on the treatment effect.

    System for combining sensor data to determine a relative position

    公开(公告)号:US11722845B2

    公开(公告)日:2023-08-08

    申请号:US17176982

    申请日:2021-02-16

    Applicant: ADOBE INC.

    CPC classification number: H04W4/029 G06T19/006

    Abstract: A first device determines relative position data representative of a position of one or more other user devices relative to the first device. To determine relative position data between the first device and a second device, the first device determines a distance between the first device and the second device at a plurality of timestamps. Additionally, the first device determines movement data at each timestamp from one or more device sensors. The movement data at each corresponding timestamp may reflect movement of the first device and/or the second device between a prior timestamp and the corresponding timestamp. The first device computes relative position data for the second device by combining the distance measurements and movement data over the plurality of timestamps, for instance, through a process of sensor fusion. By computing the relative position data, the first device may determine a transformation that can be used to convert between a coordinate system of the second device and the coordinate system of the first device.

    Codebook generation for cloud-based video applications

    公开(公告)号:US11638007B2

    公开(公告)日:2023-04-25

    申请号:US17446862

    申请日:2021-09-03

    Applicant: Adobe Inc.

    Abstract: Techniques are disclosed for the improvement of vector quantization (VQ) codebook generation. The improved codebooks may be used for compression in cloud-based video applications. VQ achieves compression by vectorizing input video streams, matching those vectors to codebook vector entries, and replacing them with indexes of the matched codebook vectors along with residual vectors to represent the difference between the input stream vector and the codebook vector. The combination of index and residual is generally smaller than the input stream vector which they collectively encode, thus providing compression. The improved codebook may be generated from training video streams by grouping together similar types of data (e.g., image data, motion data, control data) from the video stream to generate longer vectors having higher dimensions and greater structure. This improves the ability of VQ to remove redundancy and thus increase compression efficiency. Storage space is thus reduced and video transmission may be faster.

Patent Agency Ranking