MASKED MODEL TRAINING OF A PREDICTION NETWORK

    公开(公告)号:US20240137620A1

    公开(公告)日:2024-04-25

    申请号:US18402643

    申请日:2024-01-02

    申请人: HULU, LLC

    摘要: In some embodiments, a method receives a first sequence of inputs for processing via a sub-model of a plurality of sub-model. The plurality of sub-models are part of a main model. An input in the sequence of inputs is masked with a masked value to generate a second sequence of inputs. The method processes the second sequence of inputs using the sub-model to generate a sequence of features that correspond to the second sequence of inputs and processes the sequence of features to generate a first output. The first output is processed to generate a second output of the main model. The sub-model is trained based on a feature in the sequence of features that corresponds to the masked input and the second output.

    Reweighting network for subsidiary features in a prediction network

    公开(公告)号:US11880376B2

    公开(公告)日:2024-01-23

    申请号:US17392928

    申请日:2021-08-03

    申请人: HULU, LLC

    摘要: In some embodiments, a method receives a sequence of subsidiary features that are associated with a sequence of main features. A subsidiary feature provides subsidiary information for a main feature. A sequence of first weights for the sequence of subsidiary features is generates where a first weight in the sequence of first weights is generated based on a respective subsidiary feature. The method processes the sequence of first weights to generate a sequence of second weights. The processing uses relationships in the sequence of first weights to generate values of the second weights. The method uses the sequence of second weights to process the sequence of main features to generate an output for the sequence of main features.