公开(公告)号：US10936160B2

公开(公告)日：2021-03-02

申请号：US16246156

申请日：2019-01-11

Applicant: Google LLC

Inventor： Marcin Sieniek

IPC: G06F3/0482 ,  G16H50/30 ,  G16H50/20 ,  G06F3/0354 ,  G06F3/0488 ,  G06N3/08 ,  G06N5/04 ,  G06T7/00

Abstract: A method and system for assessing a machine learning model providing a prediction as to the disease state of a patient from a 2D or 3D image of the patient or a sample obtained therefrom. The machine learning model produces a prediction of the disease state from the image. The method involves presenting on a display of a workstation the image of the patient or a sample obtained therefrom along with a risk score or classification associated with the prediction. The image is further augmented with highlighting to indicate one or more regions in the image which affected the prediction produced by the machine learning model. Tools are provided by which the user may highlight one or more regions of the image which the user deems to be suspicious for the disease state. Inference is performed on the user-highlighted areas by the machine learning model. The results of the inference are presented to the user via the display.

公开(公告)号：US11934634B2

公开(公告)日：2024-03-19

申请号：US17422356

申请日：2019-10-10

Applicant: GOOGLE LLC

Inventor： Marcin Sieniek

IPC: G06F3/0482 ,  G06F3/0354 ,  G06F3/04883 ,  G06N3/08 ,  G06N5/04 ,  G06T7/00 ,  G16H50/20 ,  G16H50/30

CPC classification number: G06F3/0482 ,  G06F3/03543 ,  G06F3/04883 ,  G06N3/08 ,  G06N5/04 ,  G06T7/0012 ,  G16H50/20 ,  G16H50/30 ,  G06T2207/30096

Abstract: A method and system for assessing a machine learning model providing a prediction as to the disease state of a patient from a 2D or 3D image of the patient or a sample obtained therefrom. The machine learning model produces a prediction of the disease state from the image. The method involves presenting on a display of a workstation the image of the patient or a sample obtained therefrom along with a risk score or classification associated with the prediction. The image is further augmented with high-lighting to indicate one or more regions in the image which affected the prediction produced by the machine learning model. Tools are provided by which the user may highlight one or more regions of the image which the user deems to be suspicious for the disease state. Inference is performed on the user-highlighted areas by the machine learning model. The results of the inference are presented to the user via the display.

公开(公告)号：US20220254023A1

公开(公告)日：2022-08-11

申请号：US17597876

申请日：2020-06-16

Applicant: Google LLC

Inventor： Scott McKinney ,  Marcin Sieniek ,  Varun Godbole ,  Shravya Shetty ,  Natasha Antropova ,  Jonathan Godwin ,  Christopher Kelly ,  Jeffrey De Fauw

IPC: G06T7/00 ,  G06V10/22 ,  G06V10/82 ,  G16H30/40 ,  G06V10/44 ,  G16H50/20

Abstract: A method is disclosed of processing a set of images. Each image in the set has an associated counterpart image. One or more regions of interest (ROIs) are identified in one or more of the images in the set of images. For ROI identified, a reference region is identified in the associated counterpart image. ROIs and associated reference regions are cropped out, thereby forming cropped pairs of images 1 . . . n1, that are fed to a deep learning model trained to make a prediction of probability of a state of the ROI, e.g., disease state, which generates a prediction Pi-, (i=1 . . . n) for each cropped pair. The model generates an overall prediction P from each of the predictions Pi. A visualization of the set of medical images and the associated counterpart images including the cropped pair of images is generated.

公开(公告)号：US20200225811A1

公开(公告)日：2020-07-16

申请号：US16246156

申请日：2019-01-11

Applicant: Google LLC

Inventor： Marcin Sieniek

IPC: G06F3/0482 ,  G06T7/00 ,  G06N5/04 ,  G06N3/08 ,  G16H50/20 ,  G16H50/30 ,  G06F3/0354 ,  G06F3/0488

Abstract: A method and system for assessing a machine learning model providing a prediction as to the disease state of a patient from a 2D or 3D image of the patient or a sample obtained therefrom. The machine learning model produces a prediction of the disease state from the image. The method involves presenting on a display of a workstation the image of the patient or a sample obtained therefrom along with a risk score or classification associated with the prediction. The image is further augmented with highlighting to indicate one or more regions in the image which affected the prediction produced by the machine learning model. Tools are provided by which the user may highlight one or more regions of the image which the user deems to be suspicious for the disease state. Inference is performed on the user-highlighted areas by the machine learning model. The results of the inference are presented to the user via the display.