Distributed hyperparameter tuning and load balancing for mathematical models

    公开(公告)号:US11928584B2

    公开(公告)日:2024-03-12

    申请号:US16778587

    申请日:2020-01-31

    CPC classification number: G06N3/08 H04L67/1001

    Abstract: Methods, systems, and devices for distributed hyperparameter tuning and load balancing are described. A device (e.g., an application server) may generate a first set of combinations of hyperparameter values associated with training a mathematical model. The mathematical model may include a machine learning model, an optimization model, or any combination. The device may identify a subset of combinations from the first set of combinations that are associated with a computational runtime that exceeds a first threshold and may distribute the subset of combinations across a set of machines. The device may then test each of the first set of combinations in a parallel processing operation to generate a first set of validation error values and may test a second set of combinations of hyperparameter values using an objective function that is based on the first set of validation error values.

Patent Agency Ranking