FRAMEWORK FOR MULTI-TENANT DATA SCIENCE EXPERIMENTS AT-SCALE

    公开(公告)号:US20200250587A1

    公开(公告)日:2020-08-06

    申请号:US16263927

    申请日:2019-01-31

    Abstract: The system and methods of the disclosed subject matter provide an experimentation framework to allow a user to perform machine learning experiments on tenant data within a multi-tenant database system. The system may provide an experimental interface to allow modification of machine learning algorithms, machine learning parameters, and tenant data fields. The user may be prohibited from viewing any of the tenant data or may be permitted to view only a portion of the tenant data. Upon generating an experimental model using the experimental interface, the user may view results comparing the performance of the experimental model with a current production model.

    Identification and application of hyperparameters for machine learning

    公开(公告)号:US11526799B2

    公开(公告)日:2022-12-13

    申请号:US16264583

    申请日:2019-01-31

    Abstract: Methods and systems are provided to determine suitable hyperparameters for a machine learning model and/or feature engineering process. A suitable machine learning model and associated hyperparameters are determined by analyzing a dataset. Suitable hyperparameter values for compatible machine learning models having one or more hyperparameters in common and a compatible dataset schema are identified. Hyperparameters may be ranked according to each of their respective influences on a model performance metrics, and hyperparameter values identified as having greater influence may be more aggressively searched.

    IDENTIFICATION AND APPLICATION OF HYPERPARAMETERS FOR MACHINE LEARNING

    公开(公告)号:US20200057958A1

    公开(公告)日:2020-02-20

    申请号:US16264583

    申请日:2019-01-31

    Abstract: Methods and systems are provided to determine suitable hyperparameters for a machine learning model and/or feature engineering process. A suitable machine learning model and associated hyperparameters are determined by analyzing a dataset. Suitable hyperparameter values for compatible machine learning models having one or more hyperparameters in common and a compatible dataset schema are identified. Hyperparameters may be ranked according to each of their respective influences on a model performance metrics, and hyperparameter values identified as having greater influence may be more aggressively searched.

    Framework for multi-tenant data science experiments at-scale

    公开(公告)号:US11720825B2

    公开(公告)日:2023-08-08

    申请号:US16263927

    申请日:2019-01-31

    CPC classification number: G06N20/20 G06F11/3466 G06N5/043

    Abstract: The system and methods of the disclosed subject matter provide an experimentation framework to allow a user to perform machine learning experiments on tenant data within a multi-tenant database system. The system may provide an experimental interface to allow modification of machine learning algorithms, machine learning parameters, and tenant data fields. The user may be prohibited from viewing any of the tenant data or may be permitted to view only a portion of the tenant data. Upon generating an experimental model using the experimental interface, the user may view results comparing the performance of the experimental model with a current production model.

    Recognition of biases in data and models

    公开(公告)号:US10984283B2

    公开(公告)日:2021-04-20

    申请号:US16565922

    申请日:2019-09-10

    Abstract: A method of training a predictive model to predict a likely field value for one or more user selected fields within an application. The method comprises providing a user interface for user selection of the one or more user selected fields within the application; analyzing a pre-existing, user provided data set of objects; training, based on the analysis, the predictive model; determining, for each user selected field based on the analysis, a confidence function for the predictive model that identifies the percentage of cases predicted correctly at different applied confidence levels, the percentage of cases predicted incorrectly at different applied confidence levels, and the percentage of cases in which the prediction model could not provide a prediction at different applied confidence levels; and providing a user interface for user review of the confidence functions for user selection of confidence threshold levels to be used with the predictive model.

    RECOGNITION OF BIASES IN DATA AND MODELS

    公开(公告)号:US20210073579A1

    公开(公告)日:2021-03-11

    申请号:US16565922

    申请日:2019-09-10

    Abstract: A method of training a predictive model to predict a likely field value for one or more user selected fields within an application. The method comprises providing a user interface for user selection of the one or more user selected fields within the application; analyzing a pre-existing, user provided data set of objects; training, based on the analysis, the predictive model; determining, for each user selected field based on the analysis, a confidence function for the predictive model that identifies the percentage of cases predicted correctly at different applied confidence levels, the percentage of cases predicted incorrectly at different applied confidence levels, and the percentage of cases in which the prediction model could not provide a prediction at different applied confidence levels; and providing a user interface for user review of the confidence functions for user selection of confidence threshold levels to be used with the predictive model.

Patent Agency Ranking