-
公开(公告)号:US20230072400A1
公开(公告)日:2023-03-09
申请号:US17939783
申请日:2022-09-07
Inventor: Shivam Bajpai , Jianming Liang
Abstract: Described herein are means for generating pre-trained models for nnU-Net through the use of improved transfer learning techniques, in which the pre-trained models are then utilized for the processing of medical imaging. According to a particular embodiment, there is a system specially configured for segmenting medical images, in which such a system includes: a memory to store instructions; a processor to execute the instructions stored in the memory; wherein the system is specially configured to: execute instructions via the processor for executing a pre-trained model from Models Genesis within a nnU-Net framework; execute instructions via the processor for learning generic anatomical patterns within the executing Models Genesis through self-supervised learning; execute instructions via the processor for transforming an original image using distortion and cutout-based methods; execute instructions via the processor for learning the reconstruction of the original image from the transformed image using an encoder-decoder architecture of the nnU-Net framework to identify the generic anatomical representation from the transformed image by recovering the original image; and wherein architecture determined by the nnU-Net framework is utilized with Models Genesis and is trained to minimize the L2 distance between the prediction and ground truth. Other related embodiments are disclosed.
-
公开(公告)号:US20220405933A1
公开(公告)日:2022-12-22
申请号:US17843817
申请日:2022-06-17
Inventor: Nima Tajbakhsh , Jianming Liang
IPC: G06T7/00 , G06V10/82 , G06V10/774 , G16H50/20
Abstract: Described herein are means for implementing annotation-efficient deep learning models utilizing sparsely-annotated or annotation-free training, in which trained models are then utilized for the processing of medical imaging. An exemplary system includes at least a processor and a memory to execute instructions for learning anatomical embeddings by forcing embeddings learned from multiple modalities; initiating a training sequence of an AI model by learning dense anatomical embeddings from unlabeled date, then deriving application-specific models to diagnose diseases with a small number of examples; executing collaborative learning to generate pretrained multimodal models; training the AI model using zero-shot or few-shot learning; embedding physiological and anatomical knowledge; embedding known physical principles refining the AI model; and outputting a trained AI model for use in diagnosing diseases and abnormal conditions in medical imaging. Other related embodiments are disclosed.
-
33.
公开(公告)号:US20170265747A1
公开(公告)日:2017-09-21
申请号:US15617111
申请日:2017-06-08
Applicant: MAYO FOUNDATION FOR MEDICAL EDUCATION AND RESEARCH , ARIZONA BOARD OF REGENTS on Behalf of Arizona State University
Inventor: Nima Tajbakhsh , Jianming Liang , Suryakanth R. Gurudu
CPC classification number: A61B5/0084 , G06K9/4604 , G06K9/4633 , G06K9/4642 , G06T7/0012 , G06T2207/10068 , G06T2207/20081 , G06T2207/30032
Abstract: A system and methods for polyp detection using optical colonoscopy images are provided. In some aspects, the system includes an input configured to receive a series of optical images, and a processor configured to process the series of optical images with steps comprising of receiving an optical image from the input, constructing an edge map corresponding to the optical image, the edge map comprising a plurality of edge pixel, and generating a refined edge map by applying a classification scheme based on patterns of intensity variation to the plurality of edge pixels in the edge map. The processor may also process the series with steps of identifying polyp candidates using the refined edge map, computing probabilities that identified polyp candidates are polyps, and generating a report, using the computed probabilities, indicating detected polyps. The system also includes an output for displaying the report.
-
公开(公告)号:US12277687B2
公开(公告)日:2025-04-15
申请号:US17246032
申请日:2021-04-30
Inventor: Fatemeh Haghighi , Mohammad Reza Hosseinzadeh Taher , Zongwei Zhou , Jianming Liang
Abstract: Described herein are means for the generation of semantic genesis models through self-supervised learning in the absence of manual labeling, in which the trained semantic genesis models are then utilized for the processing of medical imaging. For instance, an exemplary system is specially configured with means for performing a self-discovery operation which crops 2D patches or crops 3D cubes from similar patient scans received at the system as input; means for transforming each anatomical pattern represented within the cropped 2D patches or the cropped 3D cubes to generate transformed 2D anatomical patterns or transformed 3D anatomical patterns; means for performing a self-classification operation of the transformed anatomical patterns by formulating a C-way multi-class classification task for representation learning; means for performing a self-restoration operation by recovering original anatomical patterns from the transformed 2D patches or transformed 3D cubes having transformed anatomical patterns embedded therein to learn different sets of visual representation; and means for providing a semantics-enriched pre-trained AI model having a trained encoder-decoder structure with skip connections in between based on the performance of the self-discovery operation, the self-classification operation, and the self-restoration operation. Other related embodiments are disclosed.
-
公开(公告)号:US20240362775A1
公开(公告)日:2024-10-31
申请号:US18641225
申请日:2024-04-19
Inventor: Jianming Liang
CPC classification number: G06T7/0012 , G06T7/12 , G06V10/764 , G16H30/20 , G16H30/40 , G16H50/20 , G06T2207/30096
Abstract: Medical image data is received at the system from a plurality of public or private datasets; An AI model is trained on the datasets to learn image classification and outputs (i) an image-level classification function, (ii) an object-level classification function, and (iii) a plurality of image classification weights; the AI model is trained on the datasets to learn image localization and output an object localization function and image localization weights; the AI model is trained on the datasets to learn image segmentation and output an object segmentation function and image segmentation weights; each of the image classification weights is integrated with the image localization weights and the image segmentation weights into a single pre-trained AI model; each of the image-level classification function, the object-level classification function, the object localization function and the object segmentation function are integrated into a single pre-trained AI model for use with medical image analysis.
-
36.
公开(公告)号:US12118455B2
公开(公告)日:2024-10-15
申请号:US15965691
申请日:2018-04-27
Inventor: Jianming Liang , Zongwei Zhou , Jae Shin
IPC: G06N3/08 , G06F18/21 , G06F18/214 , G06F18/2413 , G06F18/28 , G06N3/045 , G06N3/047 , G06V10/44 , G06V10/764 , G06V10/772 , G06V10/774 , G06V10/776 , G06V10/82
CPC classification number: G06N3/08 , G06F18/2148 , G06F18/217 , G06F18/2413 , G06F18/28 , G06N3/045 , G06N3/047 , G06V10/454 , G06V10/764 , G06V10/772 , G06V10/7747 , G06V10/776 , G06V10/82
Abstract: Systems for selecting candidates for labelling and use in training a convolutional neural network (CNN) are provided, the systems comprising: a memory device; and at least one hardware processor configured to: receive a plurality of input candidates, wherein each candidate includes a plurality of identically labelled patches; and for each of the plurality of candidates: determine a plurality of probabilities, each of the plurality of probabilities being a probability that a unique patch of the plurality of identically labelled patches of the candidate corresponds to a label using a pre-trained CNN; identify a subset of candidates of the plurality of input candidates, wherein the subset does not include all of the plurality of candidates, based on the determined probabilities; query an external source to label the subset of candidates to produce labelled candidates; and train the pre-trained CNN using the labelled candidates.
-
37.
公开(公告)号:US20240338932A1
公开(公告)日:2024-10-10
申请号:US18627810
申请日:2024-04-05
Inventor: Mohammad Reza Hosseinzadeh Taher , Jianming Liang
IPC: G06V10/774 , G06V10/26 , G06V10/82
CPC classification number: G06V10/774 , G06V10/26 , G06V10/82 , G06V2201/03
Abstract: A self-supervised learning (SSL) model that learns from human anatomy in a plurality of medical images. A system receives a plurality of medical images and selects one for processing, including dividing the human anatomy in the selected medical image into a plurality of parts via an Anatomy Decomposer (AD) module. The AD module receives the selected medical image, generates a random anchor instance that represents a selected one of a plurality of parts of the selected medical image, and generates embedding vectors based the random anchor instance. In on embodiment, the AD module augments the random anchor instance to obtain two views of the selected part, which are passed to a respective pair of encoders that generate a respective embedding vector based thereon.
-
公开(公告)号:US20230306723A1
公开(公告)日:2023-09-28
申请号:US18126318
申请日:2023-03-24
Inventor: DongAo Ma , Jiaxuan Pang , Nahid Ul Islam , Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Jianming Liang
IPC: G06T7/00 , G06V10/776 , G06V10/774 , G06V10/764 , G06N3/0895
CPC classification number: G06V10/774 , G06N3/0895 , G06T7/0012 , G06V10/764 , G06V10/776 , G06T2207/10116 , G06T2207/20081 , G06T2207/20092 , G06T2207/30004 , G06V2201/03
Abstract: Described herein are systems, methods, and apparatuses for implementing self-supervised domain-adaptive pre-training via a transformer for use with medical image classification in the context of medical image analysis. An exemplary system includes means for receiving a first set of training data having non-medical photographic images; receiving a second set of training data with medical images; pre-training an AI model on the first set of training data with the non-medical photographic images; performing domain-adaptive pre-training of the AI model via self-supervised learning operations using the second set of training data having the medical images; generating a trained domain-adapted AI model by fine-tuning the AI model against the targeted medical diagnosis task using the second set of training data having the medical images; outputting the trained domain-adapted AI model; and executing the trained domain-adapted AI model to generate a predicted medical diagnosis from an input image not present within the training data.
-
公开(公告)号:US20230116897A1
公开(公告)日:2023-04-13
申请号:US17961896
申请日:2022-10-07
Inventor: Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Ruibin Feng , Jianming Liang
IPC: G16H50/20 , G06T7/00 , G06V10/774 , G06V10/82
Abstract: Described herein are means for implementing systematic benchmarking analysis to improve transfer learning for medical image analysis. An exemplary system is configured with specialized instructions to cause the system to perform operations including: receiving training data having a plurality medical images therein; iteratively transforming a medical image from the training data into a transformed image by executing instructions for resizing and cropping each respective medical image from the training data to form a plurality of transformed images; applying data augmentation operations to the transformed images; applying segmentation operations to the augmented images; pre-training an AI model on different input images which are not included in the training data by executing self-supervised learning for the AI model; fine-tuning the pre-trained AI model to generate a pre-trained diagnosis and detection AI model; applying the pre-trained diagnosis and detection AI model to a new medical image to render a prediction as to the presence or absence of a disease within the new medical image; and outputting the prediction as a predictive medical diagnosis for a medical patient.
-
公开(公告)号:US20220328189A1
公开(公告)日:2022-10-13
申请号:US17716929
申请日:2022-04-08
Inventor: Zongwei Zhou , Jianming Liang
IPC: G16H50/20 , G06V10/774
Abstract: Embodiments described herein include systems for implementing annotation-efficient deep learning in computer-aided diagnosis. Exemplary embodiments include systems having a processor and a memory specially configured with instructions for learning annotation-efficient deep learning from non-labeled medical images to generate a trained deep-learning model by applying a multi-phase model training process via specially configured instructions for pre-training a model by executing a one-time learning procedure using an initial annotated image dataset; iteratively re-training the model by executing a fine-tuning learning procedure using newly available annotated images without re-using any images from the initial annotated image dataset; selecting a plurality of most representative samples related to images of the initial annotated image dataset and the newly available annotated images by executing an active selection procedure based on the which of a collection of un-annotated images exhibit either a greatest uncertainty or a greatest entropy; extracting generic image features; updating the model using the generic image features extrated; and outputting the model as the trained deep-learning model for use in analyzing a patient medical image. Other related embodiments are disclosed.
-
-
-
-
-
-
-
-
-