-
公开(公告)号:US10554908B2
公开(公告)日:2020-02-04
申请号:US15369506
申请日:2016-12-05
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
Abstract: Exemplary embodiments relate to the application of media effects, such as visual overlays, sound effects, etc. to a video conversation. A media effect may be applied as a reaction to an occurrence in the conversation, such as in response to an emotional reaction detected by emotion analysis of information associated with the video. Effect application may be controlled through gestures, such as applying different effects with different gestures, or canceling automatic effect application using a gesture. Effects may also be applied in group settings, and may affect multiple users. A real-time data channel may synchronize effect application across multiple participants. When broadcasting a video stream that includes effects, the three channels may be sent to an intermediate server, which stitches the three channels together into a single video stream; the single video stream may then be sent to a broadcast server for distribution to the broadcast recipients.
-
公开(公告)号:US10122965B2
公开(公告)日:2018-11-06
申请号:US15364191
申请日:2016-11-29
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
Abstract: Exemplary embodiments relate to uses of face detection for modifying the background of a video. By detecting the portion of the video shot that corresponds to a face, it can also determined which portion of the shot do not correspond to the face (e.g., the background of the video). The thus-detected background may be replaced with a movie, event, or other material. Different types of materials may be targeted at different users based on user affinities or preferences. In some embodiments, a user may manually select and apply a background during a video call. When applying a custom background, the system can transmit a control signal and the background. The client recognizes the control signal and, in response, applies the background.
-
公开(公告)号:US20180152667A1
公开(公告)日:2018-05-31
申请号:US15364191
申请日:2016-11-29
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
CPC classification number: H04N7/147 , G06K9/00228 , G06K9/00281 , G06T7/0028 , G06T7/0081 , G06T7/11 , G06T7/33 , G06T2207/10016 , G06T2207/30201 , G06T2210/12 , G06T2210/22 , H04N7/15
Abstract: Exemplary embodiments relate to uses of face detection for modifying the background of a video. By detecting the portion of the video shot that corresponds to a face, it can also determined which portion of the shot do not correspond to the face (e.g., the background of the video). The thus-detected background may be replaced with a movie, event, or other material. Different types of materials may be targeted at different users based on user affinities or preferences. In some embodiments, a user may manually select and apply a background during a video call. When applying a custom background, the system can transmit a control signal and the background. The client recognizes the control signal and, in response, applies the background.
-
公开(公告)号:US20180152666A1
公开(公告)日:2018-05-31
申请号:US15364188
申请日:2016-11-29
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
CPC classification number: G06K9/00281 , G06K9/00228 , G06T5/002 , G06T7/337 , G06T7/74 , G06T2207/10016 , G06T2207/30201 , G06T2210/12 , G06T2210/22 , H04N7/15
Abstract: Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).
-
公开(公告)号:US11019284B1
公开(公告)日:2021-05-25
申请号:US16726374
申请日:2019-12-24
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
Abstract: Exemplary embodiments relate to the application of media effects, such as visual overlays, sound effects, etc. to a video conversation. A media effect may be applied as a reaction to an occurrence in the conversation, such as in response to an emotional reaction detected by emotion analysis of information associated with the video. Effect application may be controlled through gestures, such as applying different effects with different gestures, or canceling automatic effect application using a gesture. Effects may also be applied in group settings, and may affect multiple users. A real-time data channel may synchronize effect application across multiple participants. When broadcasting a video stream that includes effects, the three channels may be sent to an intermediate server, which stitches the three channels together into a single video stream; the single video stream may then be sent to a broadcast server for distribution to the broadcast recipients.
-
公开(公告)号:US10303928B2
公开(公告)日:2019-05-28
申请号:US15364188
申请日:2016-11-29
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
Abstract: Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).
-
公开(公告)号:US09807732B1
公开(公告)日:2017-10-31
申请号:US15233857
申请日:2016-08-10
Applicant: Facebook, Inc.
Inventor: Jason Clark , Jiawei Ou , Stephane Taine
Abstract: Techniques for using user input to tune calls include receiving communication data from a first client device, at a server, directed to a second client device during a call between the first client device and the second client device; forwarding the communication data to the second device; receiving from one of the first client device or the second client device, first user input data; using the first user input data as an input to a call-tuning model; and modifying a call parameter of the call according to output from the call-tuning model in response to the first user input. Other embodiments are described and claimed.
-
公开(公告)号:US10410678B2
公开(公告)日:2019-09-10
申请号:US15356017
申请日:2016-11-18
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
IPC: G11B27/22 , G11B27/10 , G11B27/036 , G11B27/34 , H04N7/15
Abstract: Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common “watch together” experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.
-
公开(公告)号:US20180144775A1
公开(公告)日:2018-05-24
申请号:US15356017
申请日:2016-11-18
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
IPC: G11B27/22 , G11B27/10 , G11B27/036 , G11B27/34 , H04N7/15
CPC classification number: G11B27/22 , G11B27/036 , G11B27/102 , G11B27/34 , H04N7/152 , H04N7/155
Abstract: Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common “watch together” experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.
-
公开(公告)号:US10950275B2
公开(公告)日:2021-03-16
申请号:US15356017
申请日:2016-11-18
Applicant: Facebook, Inc.
Inventor: Stephane Taine , Brendan Benjamin Aronoff , Jason Clark
IPC: G11B27/22 , G11B27/10 , G11B27/036 , G11B27/34 , H04N7/15
Abstract: Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common “watch together” experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.
-
-
-
-
-
-
-
-
-