Media effect application
    1.
    发明授权

    公开(公告)号:US10554908B2

    公开(公告)日:2020-02-04

    申请号:US15369506

    申请日:2016-12-05

    Applicant: Facebook, Inc.

    Abstract: Exemplary embodiments relate to the application of media effects, such as visual overlays, sound effects, etc. to a video conversation. A media effect may be applied as a reaction to an occurrence in the conversation, such as in response to an emotional reaction detected by emotion analysis of information associated with the video. Effect application may be controlled through gestures, such as applying different effects with different gestures, or canceling automatic effect application using a gesture. Effects may also be applied in group settings, and may affect multiple users. A real-time data channel may synchronize effect application across multiple participants. When broadcasting a video stream that includes effects, the three channels may be sent to an intermediate server, which stitches the three channels together into a single video stream; the single video stream may then be sent to a broadcast server for distribution to the broadcast recipients.

    Face detection for background management

    公开(公告)号:US10122965B2

    公开(公告)日:2018-11-06

    申请号:US15364191

    申请日:2016-11-29

    Applicant: Facebook, Inc.

    Abstract: Exemplary embodiments relate to uses of face detection for modifying the background of a video. By detecting the portion of the video shot that corresponds to a face, it can also determined which portion of the shot do not correspond to the face (e.g., the background of the video). The thus-detected background may be replaced with a movie, event, or other material. Different types of materials may be targeted at different users based on user affinities or preferences. In some embodiments, a user may manually select and apply a background during a video call. When applying a custom background, the system can transmit a control signal and the background. The client recognizes the control signal and, in response, applies the background.

    Media effect application
    5.
    发明授权

    公开(公告)号:US11019284B1

    公开(公告)日:2021-05-25

    申请号:US16726374

    申请日:2019-12-24

    Applicant: Facebook, Inc.

    Abstract: Exemplary embodiments relate to the application of media effects, such as visual overlays, sound effects, etc. to a video conversation. A media effect may be applied as a reaction to an occurrence in the conversation, such as in response to an emotional reaction detected by emotion analysis of information associated with the video. Effect application may be controlled through gestures, such as applying different effects with different gestures, or canceling automatic effect application using a gesture. Effects may also be applied in group settings, and may affect multiple users. A real-time data channel may synchronize effect application across multiple participants. When broadcasting a video stream that includes effects, the three channels may be sent to an intermediate server, which stitches the three channels together into a single video stream; the single video stream may then be sent to a broadcast server for distribution to the broadcast recipients.

    Face detection for video calls
    6.
    发明授权

    公开(公告)号:US10303928B2

    公开(公告)日:2019-05-28

    申请号:US15364188

    申请日:2016-11-29

    Applicant: Facebook, Inc.

    Abstract: Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).

    Techniques for tuning calls with user input

    公开(公告)号:US09807732B1

    公开(公告)日:2017-10-31

    申请号:US15233857

    申请日:2016-08-10

    Applicant: Facebook, Inc.

    CPC classification number: H04W24/08 H04W4/12

    Abstract: Techniques for using user input to tune calls include receiving communication data from a first client device, at a server, directed to a second client device during a call between the first client device and the second client device; forwarding the communication data to the second device; receiving from one of the first client device or the second client device, first user input data; using the first user input data as an input to a call-tuning model; and modifying a call parameter of the call according to output from the call-tuning model in response to the first user input. Other embodiments are described and claimed.

    Methods and systems for tracking media effects in a media effect index

    公开(公告)号:US10410678B2

    公开(公告)日:2019-09-10

    申请号:US15356017

    申请日:2016-11-18

    Applicant: Facebook, Inc.

    Abstract: Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common “watch together” experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.

    Methods and Systems for Tracking Media Effects in a Media Effect Index

    公开(公告)号:US20180144775A1

    公开(公告)日:2018-05-24

    申请号:US15356017

    申请日:2016-11-18

    Applicant: Facebook, Inc.

    Abstract: Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common “watch together” experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.

    Methods and systems for tracking media effects in a media effect index

    公开(公告)号:US10950275B2

    公开(公告)日:2021-03-16

    申请号:US15356017

    申请日:2016-11-18

    Applicant: Facebook, Inc.

    Abstract: Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common “watch together” experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.

Patent Agency Ranking