KINEMATIC INTERACTION SYSTEM WITH IMPROVED POSE TRACKING

    公开(公告)号:US20230154092A1

    公开(公告)日:2023-05-18

    申请号:US17914314

    申请日:2020-04-23

    Abstract: Techniques are disclosed for providing improved pose tracking of a subject using a 2D camera and generating a 3D image that recreates the pose of the subject. A 3D skeleton map is estimated from a 2D skeleton map of the subject using, for example, a neural network. A template 3D skeleton map is accessed or generated having bone segments that have lengths set using, for instance, anthropometry statistics based on a given height of the template 3D skeleton map. An improved 3D skeleton map is then produced by at least retargeting one or more of the plurality of bone segments of the estimated 3D skeleton map to more closely match the corresponding template bone segments of the template 3D skeleton map. The improved 3D skeleton map can then be animated in various ways (e.g., using various skins or graphics) to track corresponding movements of the subject.

    APPARATUS AND METHOD OF GUIDED NEURAL NETWORK MODEL FOR IMAGE PROCESSING

    公开(公告)号:US20220207678A1

    公开(公告)日:2022-06-30

    申请号:US17482998

    申请日:2021-09-23

    Abstract: The present disclosure provides an apparatus and method of guided neural network model for image processing. An apparatus may comprise a guidance map generator, a synthesis network and an accelerator. The guidance map generator may receive a first image as a content image and a second image as a style image, and generate a first plurality of guidance maps and a second plurality of guidance maps, respectively from the first image and the second image. The synthesis network may synthesize the first plurality of guidance maps and the second plurality of guidance maps to determine guidance information. The accelerator may generate an output image by applying the style of the second image to the first image based on the guidance information.

    AUTOMATIC MACHINE LEARNING POLICY NETWORK FOR PARAMETRIC BINARY NEURAL NETWORKS

    公开(公告)号:US20220164669A1

    公开(公告)日:2022-05-26

    申请号:US17442111

    申请日:2019-06-05

    Abstract: Systems, methods, apparatuses, and computer program products to receive a plurality of binary weight values for a binary neural network sampled from a policy neural network comprising a posterior distribution conditioned on a theta value. An error of a forward propagation of the binary neural network may be determined based on a training data and the received plurality of binary weight values. A respective gradient value may be computed for the plurality of binary weight values based on a backward propagation of the binary neural network. The theta value for the posterior distribution may be updated using reward values computed based on the gradient values, the plurality of binary weight values, and a scaling factor.

    JOINT TRAINING OF NEURAL NETWORKS USING MULTI-SCALE HARD EXAMPLE MINING

    公开(公告)号:US20220114825A1

    公开(公告)日:2022-04-14

    申请号:US17408094

    申请日:2021-08-20

    Abstract: An example apparatus for mining multi-scale hard examples includes a convolutional neural network to receive a mini-batch of sample candidates and generate basic feature maps. The apparatus also includes a feature extractor and combiner to generate concatenated feature maps based on the basic feature maps and extract the concatenated feature maps for each of a plurality of received candidate boxes. The apparatus further includes a sample scorer and miner to score the candidate samples with multi-task loss scores and select candidate samples with multi-task loss scores exceeding a threshold score.

    Joint training of neural networks using multi scale hard example mining

    公开(公告)号:US11120314B2

    公开(公告)日:2021-09-14

    申请号:US16491735

    申请日:2017-04-07

    Abstract: An example apparatus for mining multi-scale hard examples includes a convolutional neural network to receive a mini-batch of sample candidates and generate basic feature maps. The apparatus also includes a feature extractor and combiner to generate concatenated feature maps based on the basic feature maps and extract the concatenated feature maps for each of a plurality of received candidate boxes. The apparatus further includes a sample scorer and miner to score the candidate samples with multi-task loss scores and select candidate samples with multi-task loss scores exceeding a threshold score.

    Methods and apparatus for multi-task recognition using neural networks

    公开(公告)号:US11106896B2

    公开(公告)日:2021-08-31

    申请号:US16958542

    申请日:2018-03-26

    Abstract: Methods and apparatus for multi-task recognition using neural networks are disclosed. An example apparatus includes a filter engine to generate a facial identifier feature map based on image data, the facial identifier feature map to identify a face within the image data. The example apparatus also includes a sibling semantic engine to process the facial identifier feature map to generate an attribute feature map associated with a facial attribute. The example apparatus also includes a task loss engine to calculate a probability factor for the attribute, the probability factor identifying the facial attribute. The example apparatus also includes a report generator to generate a report indicative of a classification of the facial attribute.

    Composite Binary Decomposition Network

    公开(公告)号:US20210248459A1

    公开(公告)日:2021-08-12

    申请号:US16973608

    申请日:2018-09-27

    Abstract: Embodiments are directed to a composite binary decomposition network. An embodiment of a computer-readable storage medium includes executable computer program instructions for transforming a pre-trained first neural network into a binary neural network by processing layers of the first neural network in a composite binary decomposition process, where the first neural network having floating point values representing weights of various layers of the first neural network. The composite binary decomposition process includes a composite operation to expand real matrices or tensors into a plurality of binary matrices or tensors, and a decompose operation to decompose one or more binary matrices or tensors of the plurality of binary matrices or tensors into multiple lower rank binary matrices or tensors.

    METHODS AND APPARATUS FOR MULTI-TASK RECOGNITION USING NEURAL NETWORKS

    公开(公告)号:US20210004572A1

    公开(公告)日:2021-01-07

    申请号:US16958542

    申请日:2018-03-26

    Abstract: Methods and apparatus for multi-task recognition using neural networks are disclosed. An example apparatus includes a filter engine to generate a facial identifier feature map based on image data, the facial identifier feature map to identify a face within the image data. The example apparatus also includes a sibling semantic engine to process the facial identifier feature map to generate an attribute feature map associated with a facial attribute. The example apparatus also includes a task loss engine to calculate a probability factor for the attribute, the probability factor identifying the facial attribute. The example apparatus also includes a report generator to generate a report indicative of a classification of the facial attribute.

Patent Agency Ranking