PERSONALIZED HYPERPARAMETER TUNING WITH CONTEXTUAL MULTI-ARM BANDIT AND REINFORCEMENT LEARNING

    公开(公告)号:US20250053853A1

    公开(公告)日:2025-02-13

    申请号:US18232468

    申请日:2023-08-10

    Applicant: ROKU, INC.

    Abstract: Disclosed are system, method and/or computer program product embodiments for improving the performance of a machine learning based algorithm used to provide a user experience to a user via a media device. An embodiment selects a first set of hyperparameter values, implements a first iteration of the algorithm based on the first set of hyperparameter values, utilizes the first iteration of the algorithm to provide a first user experience to the user, determines a response of the user to the first user experience, selects, by a hyperparameter tuning ML model implemented as a contextual multi-arm bandit model or a reinforcement learning model and based on at least the response of the user, a second set of hyperparameter values, implements a second iteration of the algorithm based on the second set of hyperparameter values, and utilizes the second iteration of the algorithm to provide a second user experience to the user.

    CANDIDATE RANKING FOR CONTENT RECOMMENDATION

    公开(公告)号:US20240129565A1

    公开(公告)日:2024-04-18

    申请号:US17965176

    申请日:2022-10-13

    Applicant: ROKU, INC.

    CPC classification number: H04N21/251

    Abstract: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for candidate ranking for content recommendation. An embodiment operates by receiving category candidates over a network, wherein each of the category candidates comprises content candidates associated with one or more applications operating on media devices. The embodiment then ranks the category candidates based on a machine model trained using a learning algorithm based on the time series data, and ranks the content candidates in the each of category candidates based on the time series data. The embodiment then causes the ranked category candidates and the ranked content candidates to be outputted for display.

    CONTENT DISPLAY AND CLUSTERING SYSTEM
    4.
    发明公开

    公开(公告)号:US20240086466A1

    公开(公告)日:2024-03-14

    申请号:US17943526

    申请日:2022-09-13

    Applicant: ROKU, INC.

    CPC classification number: G06F16/906

    Abstract: Disclosed herein are various embodiments, for a content display and clustering system. An example embodiment operates by receiving a request to display the plurality of content items. At each of multiple levels different pairs of content items are identified and a similarity score is computed for each pair. A subset of pairs for which their similarity score exceeds a similarity threshold for the respective level are identified and clustered. This process is repeated for one or more iterations at the same level, and then the process is repeated for each of the multiple levels. A final clustered subset is identified, and output for display, responsive to the request to display the plurality of content items.

    RECOMMENDATION SYSTEM WITH REDUCED BIAS BASED ON A VIEW HISTORY

    公开(公告)号:US20240064354A1

    公开(公告)日:2024-02-22

    申请号:US17890491

    申请日:2022-08-18

    Applicant: ROKU, INC.

    CPC classification number: H04N21/252 H04N21/25891

    Abstract: Disclosed are mechanisms for selecting a recommended item for a current item being viewed by a user account based on a view history of the user account with reduced bias. For a current item being viewed by the user account represented by a current node of a co-watch graph, embodiments can select a recommended item represented by an associated node in the co-watch graph likely being viewed by the user account, and determine a probability of the recommended item likely being viewed. The co-watch graph can be generated based on a view history of the user account. An edge between a first node and a second node of the co-watch graph can have a weight representing a number of co-occurrence times when the first item represented by the first node and the second item represented by the second node are viewed in sequence within a predetermined time interval.

Patent Agency Ranking