METHOD AND SYSTEM FOR AUTOMATIC DETECTION AND PREVENTION OF QUALITY ISSUES IN ONLINE EXPERIMENTS

    公开(公告)号:US20180158082A1

    公开(公告)日:2018-06-07

    申请号:US15370697

    申请日:2016-12-06

    Applicant: Yahoo! Inc.

    CPC classification number: G06Q30/0203 G06Q50/01

    Abstract: The present teaching relates to managing online experiments. In one example, a plurality of experiment layers is created with respect to a plurality of online users. Each experiment layer includes at least one experiment each of which includes one or more buckets associated with respective features to be experimented on. Each of the plurality of online users is assigned to a corresponding bucket in each experiment layer, such that the user is simultaneously associated with multiple experiments in different layers. User event data related to the plurality of experiment layers are collected from the plurality of online users. One or more contaminated buckets are automatically detected based on the user event data.

Patent Agency Ranking