-
公开(公告)号:US11568247B2
公开(公告)日:2023-01-31
申请号:US16819513
申请日:2020-03-16
Applicant: NEC Laboratories America, Inc.
Inventor: Asim Kadav , Iain Melvin , Hans Peter Graf , Meera Hahn
Abstract: A computer-implemented method executed by at least one processor for performing mini-batching in deep learning by improving cache utilization is presented. The method includes temporally localizing a candidate clip in a video stream based on a natural language query, encoding a state, via a state processing module, into a joint visual and linguistic representation, feeding the joint visual and linguistic representation into a policy learning module, wherein the policy learning module employs a deep learning network to selectively extract features for select frames for video-text analysis and includes a fully connected linear layer and a long short-term memory (LSTM), outputting a value function from the LSTM, generating an action policy based on the encoded state, wherein the action policy is a probabilistic distribution over a plurality of possible actions given the encoded state, and rewarding policy actions that return clips matching the natural language query.
-
公开(公告)号:US20220327489A1
公开(公告)日:2022-10-13
申请号:US17714434
申请日:2022-04-06
Applicant: NEC Laboratories America, Inc.
Inventor: Renqiang Min , Iain Melvin , Christopher A White , Christopher Malon , Hans Peter Graf
IPC: G06Q10/10 , G06F40/279
Abstract: Systems and methods for matching job descriptions with job applicants is provided. The method includes allocating each of one or more job applicants' curriculum vitae (CV) into sections; applying max pooled word embedding to each section of the job applicants' CVs; using concatenated max-pooling and average-pooling to compose the section embeddings into an applicant's CV representation; allocating each of one or more job position descriptions into specified sections; applying max pooled word embedding to each section of the job position descriptions; using concatenated max-pooling and average-pooling to compose the section embeddings into a job representation; calculating a cosine similarity between each of the job representations and each of the CV representations to perform job-to-applicant matching; and presenting an ordered list of the one or more job applicants or an ordered list of the one or more job position descriptions to a user.
-
公开(公告)号:US20220254152A1
公开(公告)日:2022-08-11
申请号:US17585754
申请日:2022-01-27
Applicant: NEC Laboratories America, Inc.
Inventor: Renqiang Min , Hans Peter Graf , Ligong Han
Abstract: A method for learning disentangled representations of videos is presented. The method includes feeding each frame of video data into an encoder to produce a sequence of visual features, passing the sequence of visual features through a deep convolutional network to obtain a posterior of a dynamic latent variable and a posterior of a static latent variable, sampling static and dynamic representations from the posterior of the static latent variable and the posterior of the dynamic latent variable, respectively, concatenating the static and dynamic representations to be fed into a decoder to generate reconstructed sequences, and applying three regularizers to the dynamic and static latent variables to trigger representation disentanglement. To facilitate the disentangled sequential representation learning, orthogonal factorization in generative adversarial network (GAN) latent space is leveraged to pre-train a generator as a decoder in the method.
-
公开(公告)号:US20220130490A1
公开(公告)日:2022-04-28
申请号:US17510882
申请日:2021-10-26
Applicant: NEC Laboratories America, Inc.
Inventor: Renqiang Min , Igor Durdanovic , Hans Peter Graf
Abstract: Methods and systems for generating a peptide sequence include transforming an input peptide sequence into disentangled representations, including a structural representation and an attribute representation, using an autoencoder model. One of the disentangled representations is modified. The disentangled representations, including the modified disentangled representation, are transformed to generate a new peptide sequence using the autoencoder model.
-
公开(公告)号:US11087452B2
公开(公告)日:2021-08-10
申请号:US16248897
申请日:2019-01-16
Applicant: NEC Laboratories America, Inc.
Inventor: Alexandru Niculescu-Mizil , Renqiang Min , Eric Cosatto , Farley Lai , Hans Peter Graf , Xavier Fontaine
Abstract: A false alarm reduction system and method are provided for reducing false alarms in an automatic defect detection system. The false alarm reduction system includes a defect detection system, generating a list of image boxes marking detected potential defects in an input image. The false alarm reduction system further includes a feature extractor, transforming each of the image boxes in the list into a respective set of numerical features. The false alarm reduction system also includes a classifier, computing as a classification outcome for the each of the image boxes whether the detected potential defect is a true defect or a false alarm responsive to the respective set of numerical features for each of the image boxes.
-
公开(公告)号:US20210142120A1
公开(公告)日:2021-05-13
申请号:US17088043
申请日:2020-11-03
Applicant: NEC Laboratories America, Inc.
Inventor: Renqiang Min , Yizhe Zhu , Asim Kadav , Hans Peter Graf
Abstract: A computer-implemented method is provided for disentangled data generation. The method includes accessing, by a variational autoencoder, a plurality of supervision signals. The method further includes accessing, by the variational autoencoder, a plurality of auxiliary tasks that utilize the supervision signals as reward signals to learn a disentangled representation. The method also includes training the variational autoencoder to disentangle a sequential data input into a time-invariant factor and a time-varying factor using a self-supervised training approach which is based on outputs of the auxiliary tasks obtained by using the supervision signals to accomplish the plurality of auxiliary tasks.
-
37.
公开(公告)号:US10796169B2
公开(公告)日:2020-10-06
申请号:US15979505
申请日:2018-05-15
Applicant: NEC Laboratories America, Inc.
Inventor: Asim Kadav , Igor Durdanovic , Hans Peter Graf
Abstract: Systems and methods for predicting changes to an environment, including a plurality of remote sensors, each remote sensor being configured to capture images of an environment. A processing device is included on each remote sensor, the processing device configured to recognize and predict a change to the environment using a pruned convolutional neural network (CNN) stored on the processing device, the pruned CNN being trained to recognize features in the environment by training a CNN with a dataset and removing filters from layers of the CNN that are below a significance threshold for image recognition to produce the pruned CNN. A transmitter is configured to transmit the recognized and predicted change to a notification device such that an operator is alerted to the change.
-
38.
公开(公告)号:US10755136B2
公开(公告)日:2020-08-25
申请号:US15979509
申请日:2018-05-15
Applicant: NEC Laboratories America, Inc.
Inventor: Asim Kadav , Igor Durdanovic , Hans Peter Graf
Abstract: Systems and methods for surveillance are described, including an image capture device configured to mounted to an autonomous vehicle, the image capture device including an image sensor. A storage device is included in communication with the processing system, the storage device including a pruned convolutional neural network (CNN) being trained to recognize obstacles in a road according to images captured by the image sensor by training a CNN with a dataset and removing filters from layers of the CNN that are below a significance threshold for image recognition to produce the pruned CNN. A processing device is configured to recognize the obstacles by analyzing the images captured by the image sensor with the pruned CNN and to predict movement of the obstacles such that the autonomous vehicle automatically and proactively avoids the obstacle according to the recognized obstacle and predicted movement.
-
公开(公告)号:US10330787B2
公开(公告)日:2019-06-25
申请号:US15689755
申请日:2017-08-29
Applicant: NEC Laboratories America, Inc.
Inventor: Iain Melvin , Eric Cosatto , Igor Durdanovic , Hans Peter Graf
IPC: G01S13/93 , G06N3/08 , G06K9/46 , G01S17/93 , B60Q9/00 , B60R1/00 , B60W30/09 , G06K9/00 , G06K9/62 , G01S7/20 , G01S7/295 , G01S7/41 , G01S13/86
Abstract: A computer-implemented method and system are provided for driving assistance. The system includes an image capture device configured to capture image data relative to an outward view from a motor vehicle. The system further includes a processor configured to detect and localize objects, in a real-world map space, from the image data using a trainable object localization Convolutional Neural Network (CNN). The CNN is trained to detect and localize the objects from image and radar pairs that include the image data and radar data for different driving scenes of a natural driving environment. The processor is further configured to provide a user-perceptible object detection result to a user of the motor vehicle.
-
公开(公告)号:US20180082137A1
公开(公告)日:2018-03-22
申请号:US15689755
申请日:2017-08-29
Applicant: NEC Laboratories America, Inc.
Inventor: Iain Melvin , Eric Cosatto , Igor Durdanovic , Hans Peter Graf
CPC classification number: G01S13/931 , B60G2400/823 , B60Q9/008 , B60R1/00 , B60R2300/301 , B60R2300/8093 , B60W30/09 , B60W2420/42 , B60W2420/52 , G01S7/20 , G01S7/2955 , G01S7/417 , G01S13/867 , G01S17/936 , G01S2013/936 , G01S2013/9367 , G01S2013/9375 , G06K9/00805 , G06K9/46 , G06K9/6215 , G06K9/6232 , G06N3/0454 , G06N3/08 , G06N3/084
Abstract: A computer-implemented method and system are provided for driving assistance. The system includes an image capture device configured to capture image data relative to an outward view from a motor vehicle. The system further includes a processor configured to detect and localize objects, in a real-world map space, from the image data using a trainable object localization Convolutional Neural Network (CNN). The CNN is trained to detect and localize the objects from image and radar pairs that include the image data and radar data for different driving scenes of a natural driving environment. The processor is further configured to provide a user-perceptible object detection result to a user of the motor vehicle.
-
-
-
-
-
-
-
-
-