BLOCKCHAIN-BASED MODEL GOVERNANCE AND AUDITABLE MONITORING OF MACHINE LEARNING MODELS

    公开(公告)号:US20240267239A1

    公开(公告)日:2024-08-08

    申请号:US18164483

    申请日:2023-02-03

    IPC分类号: H04L9/00 G06N3/045 G06N3/08

    CPC分类号: H04L9/50 G06N3/045 G06N3/08

    摘要: A method includes determining, by a trained machine learning model, a score based at least on one or more latent features. The method also includes monitoring the determining of the score by the trained machine learning model. The monitoring includes determining one or more production statistics associated with the one or more latent features, derived variables and input data elements, and accessing one or more reference assets persisted on a model governance blockchain. The one or more reference assets includes one or more reference statistics and a threshold indicating a deviation between the one or more production statistics and the one or more reference statistics. The method also includes generating an alert based on the one or more production statistics associated with the one or more latent features meeting the threshold. Related methods and articles of manufacture are also disclosed.

    EXPLANATORY DROPOUT FOR MACHINE LEARNING MODELS

    公开(公告)号:US20240232683A9

    公开(公告)日:2024-07-11

    申请号:US17972510

    申请日:2022-10-24

    IPC分类号: G06N20/00 G06K9/62

    CPC分类号: G06N20/00 G06K9/6262

    摘要: Explanatory dropout systems and methods for improving a computer implemented machine learning model are provided using on-manifold/on-distribution evaluation of dropout of key features to explain model outputs. The machine learning model is trained using a plurality of input examples, including input records with explicit dropout operators applied effectuating the removal of influence of features associated with an explanation reason class. One or more dropout operators may be stochastically applied to one or more input examples. The procedure includes on-manifold/on-distribution evaluation of the machine learning model under conditions of absence or presence of the one or more dropout operators for reliable calculation of numerical statistics associated with reason classes to yield model explanations. The training and evaluation procedures present advantages over traditional off-manifold or off-distribution perturbative explanation procedures.

    AUTO-ENCODER ENHANCED SELF-DIAGNOSTIC COMPONENTS FOR MODEL MONITORING

    公开(公告)号:US20240086944A1

    公开(公告)日:2024-03-14

    申请号:US18509249

    申请日:2023-11-14

    摘要: A diagnostic system for model governance is presented. The diagnostic system includes an auto-encoder to monitor model suitability for both supervised and unsupervised models. When applied to unsupervised models, the diagnostic system can provide a reliable indication on model degradation and recommendation on model rebuild. When applied to supervised models, the diagnostic system can determine the most appropriate model for the client based on a reconstruction error of a trained auto-encoder for each associated model. An auto-encoder can determine outliers among subpopulations of consumers, as well as support model go-live inspections.

    Overly optimistic data patterns and learned adversarial latent features

    公开(公告)号:US11818147B2

    公开(公告)日:2023-11-14

    申请号:US17102295

    申请日:2020-11-23

    IPC分类号: H04L9/40 G06N3/04 G06N3/08

    CPC分类号: H04L63/1416 G06N3/04 G06N3/08

    摘要: Systems, methods and computer program products for improving security of artificial intelligence systems. The system comprising processors for monitoring one or more transactions received by a machine learning decision model to determine a first score associated with a first transaction. The first transaction may be identified as likely adversarial, in response to the first score being lower than a certain score threshold and the first transaction having a low occurrence likelihood. A second score may be generated in association with the first transaction based on one or more adversarial latent features associated with the first transaction. At least one adversarial latent feature may be detected as being exploited by the first transaction, in response to determining that the second score falls above the certain score threshold. Accordingly, an abnormal volume of activations of adversarial latent features spanning across a plurality of transactions scored may be detected and blocked.

    Assessing the Presence of Selective Omission via Collaborative Counterfactual Interventions

    公开(公告)号:US20230162277A1

    公开(公告)日:2023-05-25

    申请号:US17531709

    申请日:2021-11-19

    IPC分类号: G06Q40/02 G06F40/194

    CPC分类号: G06Q40/025 G06F40/194

    摘要: Systems, methods, and products for detection of selective omissions in an open data sharing computing platform comprises monitoring a plurality of events associated with a first digital record stored in a database of digital records, the first digital record uniquely identifying a first entity; associating a first detected event with a first set of words at least partially descriptive of the first detected event; associating a second detected event with a second set of words at least partially descriptive of the second detected event, the first event and the second event being detected, in response to digital records associated with the first event and the second event being shared over an open data sharing computing platform with express authorization provided by the first entity.

    Efficient parallelized computation of global behavior profiles in real-time transaction scoring systems

    公开(公告)号:US11636485B2

    公开(公告)日:2023-04-25

    申请号:US15947717

    申请日:2018-04-06

    IPC分类号: G06Q20/40 G06Q20/38

    摘要: Parallelized computation by a real-time transaction scoring system that incorporates global behavior profiling of transacting entities includes dividing a global profile computing component of a transaction scoring model of a real-time behavioral analytics transaction scoring system into a plurality of global profile component instances. The transaction scoring model uses a plurality of global profile variables, each of the plurality of global profile component instances using its own global profile partition that contains the estimate of global profile variables and being configured for update by a dedicated thread of execution of the real-time transaction scoring system, each dedicated thread being configured for receiving and scoring a portion of input transactions. The method further includes partitioning, based on one or more transaction routing shuffling algorithms, the input transactions for receipt across the plurality of global profile component instances, and updating each of the plurality of global profile partitions by the corresponding global profile component running in the dedicated thread according to the scoring algorithm.