-
公开(公告)号:US20220075820A1
公开(公告)日:2022-03-10
申请号:US17017370
申请日:2020-09-10
Applicant: ADOBE INC.
Inventor: Seth Walker , Joy Oakyung Kim , Morgan Nicole Evans , Najika Skyler Halsema Yoo , Aseem Agarwala , Joel R. Brandt , Jovan Popovic , Lubomira Dontcheva , Dingzeyu Li , Hijung Shin , Xue Bai
IPC: G06F16/738 , G06T13/80 , G06F3/0482 , G06F3/0484 , G06F16/74 , G06F16/735 , G06F16/75
Abstract: Embodiments are directed to techniques for interacting with a hierarchical video segmentation by performing a metadata search. Generally, various types of metadata can be extracted from a video, such as a transcript of audio, keywords from the transcript, content or action tags visually extracted from video frames, and log event tags extracted from an associated temporal log. The extracted metadata is segmented into metadata segments and associated with corresponding video segments defined by a hierarchical video segmentation. As such, a metadata search can be performed to identify matching metadata segments and corresponding matching video segments defined by a particular level of the hierarchical segmentation. Matching metadata segments are emphasized in a composite list of the extracted metadata, and matching video segments are emphasized on the video timeline. Navigating to a different level of the hierarchy transforms the search results into corresponding coarser or finer segments defined by the level.
-
公开(公告)号:US20210295527A1
公开(公告)日:2021-09-23
申请号:US16825583
申请日:2020-03-20
Applicant: Adobe Inc.
Inventor: Hijung Shin , Holger Winnemoeller , Wilmot Li
Abstract: Introduced here are computer programs and associated computer-implemented techniques for finding the correspondence between sets of graphical elements that share a similar structure. In contrast to conventional approaches, this approach can leverage the similar structure to discover how two sets of graphical elements are related to one another without the relationship needing to be explicitly specified. To accomplish this, a graphics editing platform can employ one or more algorithms designed to encode the structure of graphical elements using a directed graph and then compute element-to-element correspondence between different sets of graphical elements that share a similar structure.
-
公开(公告)号:US12299401B2
公开(公告)日:2025-05-13
申请号:US17967562
申请日:2022-10-17
Applicant: Adobe Inc.
Inventor: Hanieh Deilamsalehy , Aseem Omprakash Agarwala , Haoran Cai , Hijung Shin , Joel Richard Brandt , Lubomira Assenova Dontcheva
Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for segmenting a transcript into paragraphs. In an example embodiment, a transcript is segmented to start a new paragraph whenever there is a change in speaker and/or a long pause in speech. If any remaining paragraphs are longer than a designated length or duration (e.g., 50 or 100 words), each of those paragraphs is segmented using dynamic programming to minimize a cost function that penalizes candidate paragraphs based on divergence from a target paragraph length and/or that rewards candidate paragraphs that group semantically similar sentences. As such, the transcript is visualized, segmented at the identified paragraphs.
-
-
公开(公告)号:US12033669B2
公开(公告)日:2024-07-09
申请号:US17330702
申请日:2021-05-26
Applicant: ADOBE INC.
Inventor: Seth Walker , Hijung Shin , Cristin Ailidh Fraser , Aseem Agarwala , Lubomira Dontcheva , Joel Richard Brandt , Jovan Popović , Joy Oakyung Kim , Justin Salamon , Jui-hsien Wang , Timothy Jeewun Ganter , Xue Bai , Dingzeyu Li
IPC: G11B27/00 , G06F3/0482 , G06F3/0486 , G11B27/02 , G11B27/036 , G11B27/10 , G11B27/031 , G11B27/36
CPC classification number: G11B27/036 , G06F3/0482 , G06F3/0486
Abstract: Embodiments are directed to a snap point segmentation that defines the locations of selection snap points for a selection of video segments. Candidate snap points are determined from boundaries of feature ranges of the video indicating when instances of detected features are present in the video. In some embodiments, candidate snap point separations are penalized for being separated by less than a minimum duration corresponding to a minimum pixel separation between consecutive snap points on a video timeline. The snap point segmentation is computed by solving a shortest path problem through a graph that models different snap point locations and separations. When a user clicks or taps on the video timeline and drags, a selection snaps to the snap points defined by the snap point segmentation. In some embodiments, the snap points are displayed during a drag operation and disappear when the drag operation is released.
-
公开(公告)号:US11899917B2
公开(公告)日:2024-02-13
申请号:US17969536
申请日:2022-10-19
Applicant: Adobe Inc.
Inventor: Seth Walker , Joy O Kim , Aseem Agarwala , Joel Richard Brandt , Jovan Popovic , Lubomira Dontcheva , Dingzeyu Li , Hijung Shin , Xue Bai
IPC: G06F3/04847 , G06F3/0485 , G06F3/04845
CPC classification number: G06F3/04847 , G06F3/0485 , G06F3/04845 , G06F2203/04806
Abstract: Embodiments are directed to techniques for interacting with a hierarchical video segmentation using a video timeline. In some embodiments, the finest level of a hierarchical segmentation identifies the smallest interaction unit of a video—semantically defined video segments of unequal duration called clip atoms, and higher levels cluster the clip atoms into coarser sets of video segments. A presented video timeline is segmented based on one of the levels, and one or more segments are selected through interactions with the video timeline. For example, a click or tap on a video segment or a drag operation dragging along the timeline snaps selection boundaries to corresponding segment boundaries defined by the level. Navigating to a different level of the hierarchy transforms the selection into coarser or finer video segments defined by the level. Any operation can be performed on selected video segments, including playing back, trimming, or editing.
-
公开(公告)号:US11887629B2
公开(公告)日:2024-01-30
申请号:US17330689
申请日:2021-05-26
Applicant: ADOBE INC.
Inventor: Seth Walker , Hijung Shin , Cristin Ailidh Fraser , Aseem Agarwala , Lubomira Dontcheva , Joel Richard Brandt , Jovan Popović , Joy Oakyung Kim , Justin Salamon , Jui-hsien Wang , Timothy Jeewun Ganter , Xue Bai , Dingzeyu Li
IPC: G11B27/00 , G11B27/036 , G06F3/0486 , G06F3/0482 , G11B27/02
CPC classification number: G11B27/036 , G06F3/0482 , G06F3/0486
Abstract: Embodiments are directed to interactive tiles that represent video segments of a segmentation of a video. In some embodiments, each interactive tile represents a different video segment from a particular video segmentation (e.g., a default video segmentation). Each interactive tile includes a thumbnail (e.g., the first frame of the video segment represented by the tile), some transcript from the beginning of the video segment, a visualization of detected faces in the video segment, and one or more faceted timelines that visualize a category of detected features (e.g., a visualization of detected visual scenes, audio classifications, visual artifacts). In some embodiments, interacting with a particular interactive tile navigates to a corresponding portion of the video, adds a corresponding video segment to a selection, and/or scrubs through tile thumbnails.
-
公开(公告)号:US20220301179A1
公开(公告)日:2022-09-22
申请号:US17805907
申请日:2022-06-08
Applicant: ADOBE INC.
Inventor: Hijung Shin , Cristin Ailidh Fraser , Aseem Agarwala , Lubomira Dontcheva , Joel Richard Brandt , Jovan Popovic
Abstract: Embodiments are directed to video segmentation based on detected video features. More specifically, a segmentation of a video is computed by determining candidate boundaries from detected feature boundaries from one or more feature tracks; modeling different segmentation options by constructing a graph with nodes that represent candidate boundaries, edges that represent candidate segments, and edge weights that represent cut costs; and computing the video segmentation by solving a shortest path problem to find the path through the edges (segmentation) that minimizes the sum of edge weights along the path (cut costs). A representation of the video segmentation is presented, for example, using interactive tiles or a video timeline that represent(s) the video segments in the segmentation.
-
19.
公开(公告)号:US20220237836A1
公开(公告)日:2022-07-28
申请号:US17158866
申请日:2021-01-26
Applicant: Adobe Inc.
Inventor: Kazi Rubaiat Habib , John Chung , Li-Yi Wei , Hijung Shin
IPC: G06T11/20 , G06F3/14 , G06F3/0484 , H04L29/06
Abstract: The present disclosure relates to method, systems, and non-transitory computer-readable media for generating and configuring a digital stream of video content from a stream-transmitting computing device to include interactive graphical elements that are adjustable by viewer computing devices participating in the digital stream. For example, in one or more embodiments, the disclosed systems receive user input from the stream-transmitting computing device that identifies visual attributes of a graphical element that are adjustable via viewer inputs. In one or more embodiments, the disclosed systems provide the graphical elements within the video content and collect the viewer inputs that adjust the graphical element in accordance with the identified visual attributes. Further, the disclosed systems aggregate and visualize the collected viewer inputs in a graphical presentation.
-
公开(公告)号:US20220076024A1
公开(公告)日:2022-03-10
申请号:US17017353
申请日:2020-09-10
Applicant: ADOBE INC.
Inventor: Seth Walker , Joy Oakyung Kim , Hijung Shin , Aseem Agarwala , Joel R. Brandt , Jovan Popovic , Lubomira Dontcheva , Dingzeyu Li , Xue Bai
Abstract: Embodiments are directed to techniques for interacting with a hierarchical video segmentation using a metadata panel with a composite list of video metadata. The composite list is segmented into selectable metadata segments at locations corresponding to boundaries of video segments defined by a hierarchical segmentation. In some embodiments, the finest level of a hierarchical segmentation identifies the smallest interaction unit of a video—semantically defined video segments of unequal duration called clip atoms, and higher levels cluster the clip atoms into coarser sets of video segments. One or more metadata segments can be selected in various ways, such as by clicking or tapping on a metadata segment or by performing a metadata search. When a metadata segment is selected, a corresponding video segment is emphasized on the video timeline, a playback cursor is moved to the first video frame of the video segment, and the first video frame is presented.
-
-
-
-
-
-
-
-
-