-
公开(公告)号:US10936955B1
公开(公告)日:2021-03-02
申请号:US15406282
申请日:2017-01-13
Applicant: Amazon Technologies, Inc.
Inventor: Pramod Muralidharan , Ray Chen , Donald Kane , Vignesh Kannappan , Hancao Li , Ajay Kant Singh , Robert Andrew Kreek , Richard Bargreen , Rui Chen , Michael Luis Collado , Kevin Donald Kelly , Shen Li , Sameer Rajendra Rajyaguru , Serguei B. Stepaniants , Murali Brahmadesam
IPC: G06N5/02
Abstract: Technologies are disclosed for determining network-accessible content changes based on computed models and providing a long term forecast of user interaction at a network accessible site based upon a short term experiment at the site. A forecast model for a period of time is generated based upon historical data of user interactions at the site. An experiment is run for a short term at the site based upon a potential change at the site. Based upon data obtained during the experiment, scores are generated for a control group (no change) and a treatment group (potential change) and compared. If there are statistically significant differences between the control group and the treatment group scores, the long term forecast may be used to forecast what the long term impact of the experiment would be based upon the short term experiment.
-
公开(公告)号:US10152458B1
公开(公告)日:2018-12-11
申请号:US14661981
申请日:2015-03-18
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Serguei B. Stepaniants , Kyle Leon Battisti , Rui Chen , Michael Luis Collado , Kevin Donald Kelly , Sebastian Kohlmeier , Kevin McAlister , Daniel Parshall
Abstract: Described are techniques for determining long-term effects of an experimental change to a user experience after the end of the experiment. A control state and a treatment state of a statistical hypothesis experiment may be assigned to first and second client devices, respectively, during an experiment time period. Subsequent to the end of the experiment, presentation of the control state may be discontinued. Result data corresponding to the treatment state may be determined during the experiment time period and for a length of time subsequent to the experiment time period. Result data corresponding to the control state may be determined during the experiment time period, and for a length of time prior to assignment of the control state to the first client device.
-
公开(公告)号:US12154021B1
公开(公告)日:2024-11-26
申请号:US17578753
申请日:2022-01-19
Applicant: Amazon Technologies, Inc.
Inventor: Josh Sternberg , Akshad Viswanathan , Xiaopeng Zhang , Ethan Alexander Smith , Lenworth Richard Rose , Joyce Huan Fu , Mengyun Lv , Rui Chen , Alexandru Indrei , Reece Dano , Saeed Salahi , Anqi Liang
IPC: G06F16/2458 , G06F3/04817 , G06F3/0482 , G06F3/0485 , G06F16/532 , G06F16/538 , G06F16/58 , G06F18/24 , G06N3/045 , G06N3/0464 , G06N3/08 , G06N20/20 , G06Q30/0601 , G06N5/02
Abstract: Devices and techniques are generally described for providing a graphical user interface. In some examples, first image data may be sent to a computing device, that when rendered is effective to display a first combination of items disposed together in a first environment and a first selectable control. In some examples, first data may be received indicating a selection of the first selectable control. In various examples, a first computing device may determine first feature data representing the first image data. In some examples, the first computing device may determine second image data using the first feature data. In some examples, the second image data may be sent to a second computing device. The second image data, when rendered, may be effective to display a second combination of items disposed together in a second environment.
-
公开(公告)号:US10936662B1
公开(公告)日:2021-03-02
申请号:US15585019
申请日:2017-05-02
Applicant: Amazon Technologies, Inc.
Inventor: Daniel R. Parshall , Rui Chen , Serguei B. Stepaniants
IPC: G06F16/9032 , G06F3/0482 , G06F16/9535
Abstract: A computer-facilitated service selects, in response to a request to access user interface, an interaction element that can be presented via the user interface. The computer-facilitated service records information involving user interactions with the interaction element presented via the user interface. A model is applied to the recorded information to determine a classification of the user from a set of classifications that comprises human users and automated agents. The computer-facilitated service records an association between the user and the classification.
-
公开(公告)号:US10541890B1
公开(公告)日:2020-01-21
申请号:US15386388
申请日:2016-12-21
Applicant: Amazon Technologies, Inc.
Inventor: Rui Chen , Geoffrey Ryan Dworkin , Douglas R. Hains , Brent Russell Smith , Serguei B. Stepaniants , Sen Zhao
Abstract: Described herein is a system and method for processing analytics data in a windowed manner. In some embodiments, each user of a number of users is assigned to a group (e.g., a treatment group or a control group). The system may monitor each user to obtain metric data associated with each of the users over the course of an experiment. In some embodiments, the system may identify an indication of a trigger event with respect to each user. For example, the indication of the trigger event may comprise a time at which an event occurred for that user. The system may identify and compile data from the metric data for each of the users with respect to the trigger event. In some embodiments the metric data may be aggregated for each of the users with respect to a window or timespan positioned relative to the identified trigger event.
-
公开(公告)号:US10185970B1
公开(公告)日:2019-01-22
申请号:US15494318
申请日:2017-04-21
Applicant: Amazon Technologies, Inc.
Inventor: Rui Chen , Jeff Brooks , Siwei Jia , Mia Kilborn , Zhen Liu , Serguei B. Stepaniants
Abstract: Technologies are disclosed for determining a runtime length for an A/B experiment, where the experiment evaluates the desirability of a potential change at a website. The experiment is run for an initial period of time and based upon initial data from the initial period of time, an equation is iteratively solved until a minimal amount of time is determined that that indicates when a statistically significant change will be observed in the data. The experiment is then run for the minimal amount of time.
-
7.
公开(公告)号:US10951503B1
公开(公告)日:2021-03-16
申请号:US15494328
申请日:2017-04-21
Applicant: Amazon Technologies, Inc.
Inventor: Rui Chen , Siwei Jia , Tae Yeon Kim , Mengyun Lv , Serguei B. Stepaniants
Abstract: Technologies are disclosed for determining validity of data obtained from an A/B experiment, where the experiment evaluates the desirability of a potential change at a website. The experiment is run for a period of time and based upon an expected allocation of users into the A group (control group) and the B group (e.g., treatment group), along with an actual number of users directed into the two groups, it is determined if a minimal detectable error of allocation has been exceeded and, if it has, the data is deemed to be invalid. If not, the data is deemed to be valid.
-
公开(公告)号:US09854029B1
公开(公告)日:2017-12-26
申请号:US14533023
申请日:2014-11-04
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Sebastian Kohlmeier , Rusli Ciandy , Rui Chen , Sameer Rajendra Rajyaguru
Abstract: Described are techniques for performing statistical hypothesis experiments and determining user responses that do not match an assigned treatment. One of multiple experiment states may be assigned to a set of client devices. Response data that includes indications of the experiment state that was executed may be compared to the assigned experiment state to determine allocation matches and allocation mismatches. The allocation mismatches may be separated based on the assigned and executed experiment states to determine mismatches caused by preexisting content stored on a client device and mismatches caused by other experiment parameters.
-
-
-
-
-
-
-