公开(公告)号：US20180039702A1

公开(公告)日：2018-02-08

申请号：US15229054

申请日：2016-08-04

Applicant: Facebook, Inc.

Inventor： Michael Charles Bailey ,  Alexander Peysakhovich ,  Virot Chiraphadhanakul

IPC: G06F17/30 ,  G06N99/00

CPC classification number: G06F16/9535 ,  G06F16/252 ,  G06N20/00

Abstract: Systems, methods, and non-transitory computer readable media are configured to select a first content item and a second content item to display to each user of a plurality of users in pairwise comparison in a survey associated with a content feed of the user. A selection by each user of the plurality of users of one of the first content item and the second content item can be obtained via a user interface. A ranking model configured to assign a score indicative of quality of each content item of a plurality of content items associated with content feeds based at least in part on the selections by the plurality of users can be determined.

公开(公告)号：US20170161277A1

公开(公告)日：2017-06-08

申请号：US14960181

申请日：2015-12-04

Applicant: Facebook, Inc.

Inventor： Max Christian Eulenstein ,  Lauren Elizabeth Scissors ,  Alexander Peysakhovich ,  Lars Seren Backstrom ,  Lu Wang ,  Virot Chiraphadhanakul

IPC: G06F17/30

CPC classification number: G06F16/9535 ,  G06Q30/0282 ,  G06Q50/01

Abstract: A social networking system builds a quality controlled and desired population-representative pool of human raters to provide ratings on content items to improve a feed ranking model used for providing its users with more relevant content. The system identifies a pool of candidate human raters for providing ratings on a feed of content items. For each candidate human rater of the pool of candidate human raters, the system presents a feed of content items based on a feed ranking model, obtains ratings on the feed of content items, and determines a score representing the consistency of the obtained ratings, the representativeness of the pool of human raters, or the relevance of the content provided by the ranking model. The system uses the computed scores to modify the ranking model used to present content to its users for improving the relevance of the presented content.