-
公开(公告)号:US20220261573A1
公开(公告)日:2022-08-18
申请号:US17175441
申请日:2021-02-12
Applicant: Adobe Inc.
Inventor: Jimei YANG , Deepali ANEJA , Dingzeyu LI , Jun SAITO , Yang ZHOU
IPC: G06K9/00 , H04N21/845 , H04N21/8547 , G06T7/215 , H04N5/06
Abstract: Embodiments are disclosed for re-timing a video sequence to an audio sequence based on the detection of motion beats in the video sequence and audio beats in the audio sequence. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a first input, the first input including a video sequence, detecting motion beats in the video sequence, receiving a second input, the second input including an audio sequence, detecting audio beats in the audio sequence, modifying the video sequence by matching the detected motions beats in the video sequence to the detected audio beats in the audio sequence, and outputting the modified video sequence.
-
公开(公告)号:US20250140292A1
公开(公告)日:2025-05-01
申请号:US18431103
申请日:2024-02-02
Applicant: ADOBE INC.
Inventor: Anh Lan TRUONG , Deepali ANEJA , Hijung SHIN , Rubaiat HABIB , Jakub FISER , Kishore RADHAKRISHNA , Joel Richard BRANDT , Matthew David FISHER , Zeyu JIN , Kim Pascal PIMMEL , Wilmot LI , Lubomira Assenova DONTCHEVA
IPC: G11B27/036 , G06V20/40 , G06V40/16 , H04N5/262
Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for cutting down a user's larger input video into an edited video comprising the most important video segments and applying corresponding video effects. Some embodiments of the present invention are directed to adding face-aware scale magnification to the trimmed video (e.g., applying scale magnification to simulate a camera zoom effect that hides shot cuts with respect to the subject's face). For example, as the trimmed video transitions from one video segment to the next video segment, a scale magnification may be applied that zooms in on a detected face at a boundary between the video segments to smooth the transition between video segments.
-
公开(公告)号:US20250078380A1
公开(公告)日:2025-03-06
申请号:US18241155
申请日:2023-08-31
Applicant: Adobe Inc.
Inventor: Yining CAO , Stefano PETRANGELI , Li-Yi WEI , Rubaiat HABIB , Deepali ANEJA , Balaji Vasan SRINIVASAN , Haijun XIA
IPC: G06T13/80 , G06F40/56 , G06V40/20 , H04N21/2187 , H04N21/431
Abstract: In various examples, a video effect is displayed in a live video stream in response to determining a portion of an audio stream of the live video stream corresponds to a text segment of a script associated with the video effect and detecting performance of a gesture. For example, during presentation of the script, the audio stream is obtained to determine if a portion of the audio stream corresponds to the text segment. In response to the portion of the audio stream corresponding to the text segment, detecting performance of a gestures and causing the video effect to be displayed.
-
公开(公告)号:US20250168442A1
公开(公告)日:2025-05-22
申请号:US19033062
申请日:2025-01-21
Applicant: Adobe Inc.
Inventor: Kim Pascal PIMMEL , Stephen Joseph DIVERDI , Jiaju MA , Rubaiat HABIB , LI-Yi WEI , Hijung SHIN , Deepali ANEJA , John G. NELSON , Wilmot LI , Dingzeyu LI , Lubomira Assenova DONTCHEVA , Joel Richard BRANDT
IPC: H04N21/431 , G06F3/04812 , G06F3/0482 , H04N21/4402
Abstract: Embodiments of the present disclosure provide, a method, a system, and a computer storage media that provide mechanisms for multimedia effect addition and editing support for text-based video editing tools. The method includes generating a user interface (UI) displaying a transcript of an audio track of a video and receiving, via the UI, input identifying selection of a text segment from the transcript. The method also includes in response to receiving, via the UI, input identifying selection of a particular type of text stylization or layout for application to the text segment. The method further includes identifying a video effect corresponding to the particular type of text stylization or layout, applying the video effect to a video segment corresponding to the text segment, and applying the particular type of text stylization or layout to the text segment to visually represent the video effect in the transcript.
-
公开(公告)号:US20240161335A1
公开(公告)日:2024-05-16
申请号:US18055310
申请日:2022-11-14
Applicant: Adobe Inc.
Inventor: Yang ZHOU , Jimei YANG , Jun SAITO , Dingzeyu LI , Deepali ANEJA
IPC: G06T7/73 , G06F16/683 , G06F40/242 , G06T7/207
CPC classification number: G06T7/73 , G06F16/685 , G06F40/242 , G06T7/207
Abstract: Embodiments are disclosed for generating a gesture reenactment video sequence corresponding to a target audio sequence using a trained network based on a video motion graph generated from a reference speech video. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a first input including a reference speech video and generating a video motion graph representing the reference speech video, where each node is associated with a frame of the reference video sequence and reference audio features of the reference audio sequence. The disclosed systems and methods further comprise receiving a second input including a target audio sequence, generating target audio features, identifying a node path through the video motion graph based on the target audio features and the reference audio features, and generating an output media sequence based on the identified node path through the video motion graph paired with the target audio sequence.
-
公开(公告)号:US20240244287A1
公开(公告)日:2024-07-18
申请号:US18154412
申请日:2023-01-13
Applicant: Adobe Inc.
Inventor: Kim Pascal PIMMEL , Stephen Joseph DIVERDI , Jiaju MA , Rubaiat HABIB , Li-Yi WEI , Hijung SHIN , Deepali ANEJA , John G. NELSON , Wilmot LI , Dingzeyu LI , Lubomira Assenova DONTCHEVA , Joel Richard BRANDT
IPC: H04N21/431 , G06F3/04812 , G06F3/0482 , H04N21/4402
CPC classification number: H04N21/4312 , G06F3/04812 , G06F3/0482 , H04N21/440236
Abstract: Embodiments of the present disclosure provide, a method, a system, and a computer storage media that provide mechanisms for multimedia effect addition and editing support for text-based video editing tools. The method includes generating a user interface (UI) displaying a transcript of an audio track of a video and receiving, via the UI, input identifying selection of a text segment from the transcript. The method also includes in response to receiving, via the UI, input identifying selection of a particular type of text stylization or layout for application to the text segment. The method further includes identifying a video effect corresponding to the particular type of text stylization or layout, applying the video effect to a video segment corresponding to the text segment, and applying the particular type of text stylization or layout to the text segment to visually represent the video effect in the transcript.
-
公开(公告)号:US20230131321A1
公开(公告)日:2023-04-27
申请号:US17452217
申请日:2021-10-25
Applicant: Adobe Inc.
Inventor: Matthew David FISHER , Vineet BATRA , Sumit DHINGRA , Praveen Kumar DHANUKA , Deepali ANEJA , Ankit PHOGAT
Abstract: A computer-implemented method including receiving an input image at a first image stage and receiving a request to generate a plurality of variations of the input image at a second image stage. The method including generating, using an auto-regressive generative deep learning model, the plurality of variations of the input image at the second image stage and outputting the plurality of variations of the input image at the second image stage.
-
公开(公告)号:US20250139161A1
公开(公告)日:2025-05-01
申请号:US18431134
申请日:2024-02-02
Applicant: ADOBE INC.
Inventor: Deepali ANEJA , Zeyu JIN , Hijung SHIN , Anh Lan TRUONG , Dingzeyu LI , Hanieh DEILAMSALEHY , Rubaiat HABIB , Matthew David FISHER , Kim Pascal PIMMEL , Wilmot LI , Lubomira Assenova DONTCHEVA
IPC: G06F16/783 , G06F16/738 , G06V20/40 , G06V40/16
Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for cutting down a user's larger input video into an edited video comprising the most important video segments and applying corresponding video effects. Some embodiments of the present invention are directed to adding captioning video effects to the trimmed video (e.g., applying face-aware and non-face-aware captioning to emphasize extracted video segment headings, important sentences, quotes, words of interest, extracted lists, etc.). For example, a prompt is provided to a generative language model to identify portions of a transcript (e.g., extracted scene summaries, important sentences, lists of items discussed in the video, etc.) to apply to corresponding video segments as captions depending on the type of caption (e.g., an extracted heading may be captioned at the start of a corresponding video segment, important sentences and/or extracted list items may be captioned when they are spoken).
-
公开(公告)号:US20250006226A1
公开(公告)日:2025-01-02
申请号:US18346051
申请日:2023-06-30
Applicant: ADOBE INC.
Inventor: Deepali ANEJA , Rubaiat HABIB , Li-Yi WEI , Wilmot Wei-Mau LI , Stephen Joseph DIVERDI
Abstract: In various examples, a video effect is displayed in a live video stream in response to determining a portion of an audio stream of the live video stream that corresponds to a text segment of a script associated with the video effect. For example, during presentation of the script, the audio stream is obtained to determine if a portion of the audio stream corresponds to the text segment.
-
公开(公告)号:US20240005585A1
公开(公告)日:2024-01-04
申请号:US17829120
申请日:2022-05-31
Applicant: Adobe Inc. , University of Massachusetts
Inventor: Matthew David FISHER , Zhan XU , Yang ZHOU , Deepali ANEJA , Evangelos KALOGERAKIS
IPC: G06T13/80 , G06V10/774 , G06V10/77 , G06V10/762 , G06T13/40 , G06T7/246
CPC classification number: G06T13/80 , G06V10/7747 , G06T7/251 , G06V10/762 , G06T13/40 , G06V10/7715
Abstract: Embodiments are disclosed for articulated part extraction using images of animated characters from sprite sheets by a digital design system. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input including a plurality of images depicting an animated character in different poses. The disclosed systems and methods further comprise, for each pair of images in the plurality of images, determining, by a first machine learning model, pixel correspondences between pixels of the pair of images, and determining, by a second machine learning model, pixel clusters representing the animated character, each pixel cluster corresponding to a different structural segment of the animated character. The disclosed systems and methods further comprise selecting a subset of clusters that reconstructs the different poses of the animated character. The disclosed systems and methods further comprise creating a rigged animated character based on the selected subset of clusters.
-
-
-
-
-
-
-
-
-