-
公开(公告)号:US20250013899A1
公开(公告)日:2025-01-09
申请号:US18888047
申请日:2024-09-17
Applicant: Amazon Technologies, Inc.
Inventor: Giovanni Zappella , Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Philippe Archambeau , Matthias Seeger
Abstract: Hyperparameters for tuning a machine learning system may be optimized using Bayesian optimization with constraints. The hyperparameter optimization may be performed for a received training set and received constraints. Respective probabilistic models for the machine learning system and constraint functions may be initialized, then hyperparameter optimization may include iteratively identifying respective values for hyperparameters using analysis of the respective models performed using an acquisition function implementing entropy search on the respective models, training the machine learning system using the identified values to determine measures of accuracy and constraint metrics, and updating the respective models using the determined measures.
-
公开(公告)号:US10162868B1
公开(公告)日:2018-12-25
申请号:US14657915
申请日:2015-03-13
Applicant: Amazon Technologies, Inc.
Inventor: Giovanni Zappella
IPC: G06F17/30
Abstract: Data mining systems and methods are disclosed for evaluating pairwise substitutability relationships among items. For example, a pairwise similarity measure may correspond to a value quantifying the extent to which an item A is favored over an item B by a population of users. Given a base item selected by a user, the system may select a candidate item from a set of potential substitute items for the base item based on current estimates of corresponding pairwise similarities. The system may then present the candidate item to the user in a context of comparison against the base item and obtain an indication of user preference between the two. The system may then update corresponding pairwise similarities based on the indication of preference.
-
公开(公告)号:US11586965B1
公开(公告)日:2023-02-21
申请号:US16858241
申请日:2020-04-24
Applicant: Amazon Technologies, Inc.
Inventor: Giuseppe Di Benedetto , Vito Bellini , Giovanni Zappella
IPC: G06N20/00 , G06N7/00 , G06F16/635 , G06F16/2457 , G06N5/04 , G06F16/9535
Abstract: Techniques are described herein for generating adaptive recommendations in response to a content request. The system herein detects abrupt changes and leverages the seasonality of a reward function. A collection of contextual models are utilized, each one learning about one of the unique reward stationary states. A short-term memory model is used to detect reward shifts toward stationary periods that have not occurred in the past. In this case, a new base bandit instance is initialized. In order to perform the change point detection, at each step every model gets assigned a score indicating how likely the last observation is to come from a corresponding stationary period represented by a respective model. A model is selected based on the scores. The model provides a recommendation and the system can monitor clickstream data to identify the reward for providing the recommendation.
-
公开(公告)号:US10977149B1
公开(公告)日:2021-04-13
申请号:US15925607
申请日:2018-03-19
Applicant: Amazon Technologies, Inc.
Inventor: Giovanni Zappella , Cédric Philippe Charles Jean Ghislain Archambeau , Edward Thomas Banti , Michael Brueckner , Borys Marchenko , Martin Milicic , Jurgen Ommen , Dmitrij Scsadej
IPC: G06F11/34 , G06F16/957
Abstract: A testing environment in which offline simulations can be run to identify policies and/or prediction models that result in more valuable content being included in content pages is described herein. For example, the offline simulations can be run in an application executed by an experiment device using data gathered by a production content delivery system. The simulation application can test any number of different policies and/or prediction models without impacting users that use a production content delivery system to request content.
-
公开(公告)号:US12165082B1
公开(公告)日:2024-12-10
申请号:US16915610
申请日:2020-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Giovanni Zappella , Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Philippe Archambeau , Matthias Seeger
Abstract: Hyperparameters for tuning a machine learning system may be optimized using Bayesian optimization with constraints. The hyperparameter optimization may be performed for a received training set and received constraints. Respective probabilistic models for the machine learning system and constraint functions may be initialized, then hyperparameter optimization may include iteratively identifying respective values for hyperparameters using analysis of the respective models performed using an acquisition function implementing entropy search on the respective models, training the machine learning system using the identified values to determine measures of accuracy and constraint metrics, and updating the respective models using the determined measures.
-
公开(公告)号:US11164093B1
公开(公告)日:2021-11-02
申请号:US16054817
申请日:2018-08-03
Applicant: Amazon Technologies, Inc.
Inventor: Giovanni Zappella
Abstract: Computer systems and associated methods are disclosed to implement a model executor that dynamically selects machine learning models for choosing sequential actions. In embodiments, the model executor executes and updates an active model to choose sequential actions. The model executor periodically initiates a recent model and updates the recent model along with the active model based on recently chosen actions and results of the active model. The model executor periodically compares respective confidence sets of the two models' parameters. If the two confidence sets are sufficiently divergent, a replacement model is selected to replace the active model. In embodiments, the replacement model may be selected from a library of past models based on their similarity with the recent model. In embodiments, past models that exceed a certain age or have not been recently used as the active model are removed from the library.
-
7.
公开(公告)号:US10909604B1
公开(公告)日:2021-02-02
申请号:US15914923
申请日:2018-03-07
Applicant: Amazon Technologies, Inc.
Inventor: Giovanni Zappella
Abstract: A set of informational content elements pertaining to an item for presentation to one or more potential item consumers is identified at an artificial intelligence service. A plurality of optimization iterations are implemented. In a particular iteration, a set of content elements to be presented to a target audience in accordance with a set of presentation constraints indicated by a content source associated with the item is identified using a machine learning model, and metrics indicating the effectiveness of the content elements are analyzed.
-
公开(公告)号:US11599822B1
公开(公告)日:2023-03-07
申请号:US16443477
申请日:2019-06-17
Applicant: Amazon Technologies, Inc.
Inventor: Giovanni Zappella
IPC: G06N20/00 , G06F16/951 , H04L67/10
Abstract: A computer system and process extract information from a literary work regarding relationships between entities (e.g., characters, locations, etc.) described or represented in the literary work, and generate a graph representing these relationships. The graph data is parsed into sub-graphs, and the subgraphs are used to generate a signature of the literary work. The respective signatures of different literary works may be compared for purposes of generating literary work recommendations for users.
-
公开(公告)号:US10366343B1
公开(公告)日:2019-07-30
申请号:US14657931
申请日:2015-03-13
Applicant: Amazon Technologies, Inc.
Inventor: Giovanni Zappella
IPC: G06N20/00 , H04L29/08 , G06F16/951
Abstract: A system ranks and/or recommends literary works based on information extracted from the text of the literary works. For example, the system may use information extracted from the text of a literary work to generate a graph representing the relationships of entities in the literary work. The system may identify sub-graphs in the graph, and generate a signature based on the values associated with the various sub-graphs. The system may generate signatures of a plurality of literary works. The system may then retrieve the signature of a literary work that was highly rated by a user, and compare the retrieved signature with other generated signatures using machine-learning algorithms to select literary works to recommend to the user.
-
公开(公告)号:US10242381B1
公开(公告)日:2019-03-26
申请号:US14661996
申请日:2015-03-18
Applicant: Amazon Technologies, Inc.
IPC: G06Q30/00 , G06Q30/02 , H04L12/58 , G06F17/30 , G05B19/418
Abstract: Technologies for optimized selection of content for delivery to a user that both optimizes the expected return from the delivery of the content to the user and that enables exploration of delivery of new content to users are disclosed. Content is selected for delivery to a user based on an exploitation score that defines an estimate of the feedback expected from the delivery of the content to the user and an exploration score that varies inversely with the number of times that the content has been transmitted to all users. The use of the exploration score enables the exploration of delivery of new content to users. The content might be delivered via e-mail messages, a web site, or using another mechanism.
-
-
-
-
-
-
-
-
-