CONSTRAINED MASKING FOR SPARSIFICATION IN MACHINE LEARNING

    公开(公告)号:US20240095504A1

    公开(公告)日:2024-03-21

    申请号:US17932941

    申请日:2022-09-16

    CPC classification number: G06N3/0481 G06N3/063 G06N3/08 G06N5/04

    Abstract: Certain aspects of the present disclosure provide techniques and apparatus for feature masking. A feature tensor is accessed in a neural network, and a feature mask is generated by processing the feature tensor using a masking subnetwork, where the masking subnetwork was trained based at least in part on a polarization constraint and an activation constraint to generate feature masks. A masked feature tensor is generated based on the feature tensor and the feature mask, and an output inference is generated using the neural network based at least in part on the masked feature tensor.

    ROBUST TEST-TIME ADAPTATION WITHOUT ERROR ACCUMULATION

    公开(公告)号:US20240303497A1

    公开(公告)日:2024-09-12

    申请号:US18360712

    申请日:2023-07-27

    CPC classification number: G06N3/091 G06N3/045

    Abstract: A processor-implemented method for adapting an artificial neural network (ANN) at test-time includes receiving by a first ANN model and a second ANN model, a test data set. The test data set includes unlabeled data samples. The first ANN model is pretrained using a training data set and the test data set. The first ANN model generates first estimated labels for the test data set. The second ANN model generates second estimated labels for the test data set. Samples of the test data set are selected based on a confidence difference between the first estimated labels and the second estimated labels. The second ANN model is retrained based on the selected samples.

Patent Agency Ranking