摘要:
A probe pose is detected in fluoroscopy medical imaging. The pose of the probe through a sequence of fluoroscopic images is detected. The detection relies on an inference framework for visual tracking overtime. By applying visual tracking, the pose through the sequence is consistent or the pose at one time guides the detection of the probe at another time. Single frame drop-out of detection may be avoided. Verification using detection of the tip of the probe and/or weighting of possible detections by separate detection of markers on the probe may further improve the accuracy.
摘要:
A probe pose is detected in fluoroscopy medical imaging. The pose of the probe through a sequence of fluoroscopic images is detected. The detection relies on an inference framework for visual tracking overtime. By applying visual tracking, the pose through the sequence is consistent or the pose at one time guides the detection of the probe at another time. Single frame drop-out of detection may be avoided. Verification using detection of the tip of the probe and/or weighting of possible detections by separate detection of markers on the probe may further improve the accuracy.
摘要:
Pose of a probe is detected in x-ray medical imaging. Since the TEE probe is inserted through the esophagus of a patient, the pose is limited to being within the esophagus. The path of the esophagus is determined from medical imaging prior to the intervention. During the intervention, the location in 2D is found from one x-ray image at a given time. The 3D probe location is provided by assigning the depth of the esophagus at that 2D location to be the depth of the probe. A single x-ray image may be used to determine the probe location in 3D, allowing for real-time pose determination without requiring space to rotate a C-arm during the intervention.
摘要:
Pose of an ultrasound transducer is recovered. In one approach, inertial measurement units are positioned on the ultrasound transducer. The measurements from the inertial measurement units are used with pose or measurements from another position sensor (e.g., x-ray, electromagnetic, or optical) to improve accuracy and/or provide pose information at a greater rate. In another approach, a curve, line, or other connected shape of light emitting diodes are incorporated into the transducer. Optical tracking, with a filter specific to the light emitting diodes, using the connected shape pattern is used to determine the pose.
摘要:
A method and apparatus for convolutional neural network (CNN) regression based 2D/3D registration of medical images is disclosed. A parameter space zone is determined based on transformation parameters corresponding to a digitally reconstructed radiograph (DRR) generated from the 3D medical image. Local image residual (LIR) features are calculated from local patches of the DRR and the X-ray image based on a set of 3D points in the 3D medical image extracted for the determined parameter space zone. Updated transformation parameters are calculated based on the LIR features using a hierarchical series of regressors trained for the determined parameter space zone. The hierarchical series of regressors includes a plurality of regressors each of which calculates updates for a respective subset of the transformation parameters.
摘要:
Systems and methods for automatically navigating a catheter in a patient are provided. An image of a current view of a catheter in a patient is received. A set of actions of a robotic navigation system for navigating the catheter from the current view towards a target view is determined using a machine learning based network. The catheter is automatically navigated in the patient from the current view towards the target view using the robotic navigation system based on the set of actions.
摘要:
In order to reduce computation time and provide more accurate solutions for bi-directional, multi-modal image registration, a learning-based unsupervised multi-modal deformable image registration method that does not require any aligned image pairs or anatomical landmarks is provided. A bi-directional registration function is learned based on disentangled shape representation by optimizing a similarity criterion defined on both latent space and image space.
摘要:
A correspondence between a source image and a reference image is determined. A generative model corresponds to a prior probability distribution of deformation fields, each deformation field corresponding to a respective coordinate transformation. A conditional model generates a style transfer probability distribution of reference images, given a source image and a deformation field. The first image data is the source image, and the second image data is the reference image. An initial first deformation field is determined. An update process is iteratively performed until convergence to update the first deformation field, to generate a converged deformation field representing the correspondence between the source image and the reference image. The update process includes: determining a change in one or more characteristics of the first deformation field to increase a posterior probability density associated with the first deformation field, given the source image and reference image; and changing the one or more characteristics in accordance with the determined change.
摘要:
A method and system for 3D/3D medical image registration. A digitally reconstructed radiograph (DRR) is rendered from a 3D medical volume based on current transformation parameters. A trained multi-agent deep neural network (DNN) is applied to a plurality of regions of interest (ROIs) in the DRR and a 2D medical image. The trained multi-agent DNN applies a respective agent to each ROI to calculate a respective set of action-values from each ROI. A maximum action-value and a proposed action associated with the maximum action value are determined for each agent. A subset of agents is selected based on the maximum action-values determined for the agents. The proposed actions determined for the selected subset of agents are aggregated to determine an optimal adjustment to the transformation parameters and the transformation parameters are adjusted by the determined optimal adjustment. The 3D medical volume is registered to the 2D medical image using final transformation parameters resulting from a plurality of iterations.
摘要:
In order to reduce computation time and provide more accurate solutions for bi-directional, multi-modal image registration, a learning-based unsupervised multi-modal deformable image registration method that does not require any aligned image pairs or anatomical landmarks is provided. A bi-directional registration function is learned based on disentangled shape representation by optimizing a similarity criterion defined on both latent space and image space.