Department of Electrical Engineering, University of Ljubljana, Ljubljana, Slovenia.
Purpose: A promising patient positioning technique is based on registering computed tomographic (CT) or magnetic resonance (MR) images to cone-beam CT images (CBCT). The extra radiation dose delivered to the patient can be substantially reduced by using fewer projections. This approach results in lower quality CBCT images. The purpose of this study is to evaluate a number of similarity measures (SMs) suitable for registration of CT or MR images to low-quality CBCTs. Methods and Materials: Using the recently proposed evaluation protocol, we evaluated nine SMs with respect to pretreatment imaging modalities, number of two-dimensional (2D) images used for reconstruction, and number of reconstruction iterations. The image database consisted of 100 X-ray and corresponding CT and MR images of two vertebral columns. Results: Using a higher number of 2D projections or reconstruction iterations results in higher accuracy and slightly lower robustness. The similarity measures that behaved the best also yielded the best registration results. The most appropriate similarity measure was the asymmetric multi-feature mutual information (AMMI). Conclusions: The evaluation protocol proved to be a valuable tool for selecting the best similarity measure for the reconstruction-based registration. The results indicate that accurate and robust CT/CBCT or even MR/CBCT registrations are possible if the AMMI similarity measure is used.
Other papers by authors:
Med Image Comput Comput Assist Interv Int Conf Med Image Comput Comput Assist Interv. 2007 ;10 (Pt 1):450-7 18051090 (P,S,G,E,B)
An important part of image-guided radiation therapy or surgery is registration of a three-dimensional (3D) preoperative image to two-dimensional (2D) images of the patient. It is expected that the accuracy and robustness of a 3D/2D image registration method do not depend solely on the registration method itself but also on the number and projections (views) of intraoperative images. In this study, we systematically investigate these factors by using registered image data, comprising of CT and X-ray images of a cadaveric lumbar spine phantom and the recently proposed 3D/2D registration method. The results indicate that the proportion of successful registrations (robustness) significantly increases when more X-ray images are used for registration.
Comparative evaluation of similarity measures for the rigid registration of multi-modal head images.
Image registrations that are based on similarity measures simply adjust the parameters of an appropriate spatial transformation model until the similarity measure reaches an optimum. The numerous similarity measures that have been proposed in the past are differently sensitive to imaging modality, image content and differences in the image content, selection of the floating and target image, partial image overlap, etc. In this paper, we evaluate and compare 12 similarity measures for the rigid registration. To study the impact of different imaging modalities on the behavior of similarity measures, we have used 16 CT/MR and 6 PET/MR image pairs with known 'gold standard' registrations. The results for the PET/MR registration and for the registration of CT to both rectified and unrectified MR images indicate that mutual information, normalized mutual information and the entropy correlation coefficient are the most accurate similarity measures and have the smallest risk of being trapped in a local optimum. The results of an experiment on the impact of exchanging the floating and target image indicate that, especially in MR/PET registrations, the behavior of some similarity measures, such as mutual information, significantly depends on which image is the floating and which is the target.
University of Ljubljana, Faculty of Electrical Engineering, Slovenia. darko.skerl@fe.uni-lj.si
The accuracy and robustness of a registration method depend on a number of factors, such as imaging modality, image content and image degrading effects, the class of spatial transformation used for registration, similarity measure, optimization, and numerous implementation details. The complex interdependence of these factors makes the assessment of the influence of a particular factor on registration difficult, although it is often desirable to have some estimate of such influences prior to registration. The similarity measure used to create the cost function is one of the factors that most influences the quality of registration. Traditionally, limited information on the behavior of a similarity measure is obtained either by studying the quality of the final registration or by drawing plots of similarity measure values obtained by translating or rotating one image relative to the "gold standard." In this paper, we present a protocol for a more thorough, optimization-independent, and systematic statistical evaluation of similarity measures. This protocol estimates a similarity measure's capture range, the number, location and extent of local optima, and the accuracy and distinctiveness of the global optimum. To show that the proposed evaluation protocol is viable, we have conducted several experiments with nine similarity measures and real computed tomography and magnetic resonance (MR) images of a spine phantom, MR brain images, and MR and positron emission tomography brain images, for which "gold standard" registrations were available. We have also studied the impact of histogram bin size on the behavior of nine similarity measures. The proposed evaluation protocol is useful for selecting the best similarity measure and corresponding optimization method for a particular application, as well as for studying the influence of sampling, interpolation, histogram bin size, partial image overlap, and image degradation, such as noise, intensity inhomogeneity, and geometrical distortions on the behavior of a similarity measure.
Med Image Comput Comput Assist Interv Int Conf Med Image Comput Comput Assist Interv. 2005 ;8 (Pt 2):231-8 16685964 (P,S,G,E,B)
University of Ljubljana, Faculty of Electrical Engineering, Trzaska 25, 1000 Ljubljana, Slovenia. dejan.tomazevic@fe.uni-lj.si
In this paper we present a novel 3D/2D registration method, where first, a 3D image is reconstructed from a few 2D X-ray images and next, the preoperative 3D image is brought into the best possible spatial correspondence with the reconstructed image by optimizing a similarity measure. Because the quality of the reconstructed image is generally low, we introduce a novel asymmetric mutual information similarity measure, which is able to cope with low image quality as well as with different imaging modalities. The novel 3D/2D registration method has been evaluated using standardized evaluation methodology and publicly available 3D CT, 3DRX, and MR and 2D X-ray images of two spine phantoms, for which gold standard registrations were known. In terms of robustness, reliability and capture range the proposed method outperformed the gradient-based method and the method based on digitally reconstructed radiographs (DRRs).
University of Ljubljana, Faculty of Electrical Engineering, Trzaska 25, 1000 Ljubljana, Slovenia. dejan.tomazevic@fe.uni-lj.si
In image-guided therapy, high-quality preoperative images serve for planning and simulation, and intraoperatively as "background", onto which models of surgical instruments or radiation beams are projected. The link between a preoperative image and intraoperative physical space of the patient is established by image-to-patient registration. In this paper, we present a novel 3-D/2-D registration method. First, a 3-D image is reconstructed from a few 2-D X-ray images and next, the preoperative 3-D image is brought into the best possible spatial correspondence with the reconstructed image by optimizing a similarity measure (SM). Because the quality of the reconstructed image is generally low, we introduce a novel SM, which is able to cope with low image quality as well as with different imaging modalities. The novel 3-D/2-D registration method has been evaluated and compared to the gradient-based method (GBM) using standardized evaluation methodology and publicly available 3-D computed tomography (CT), 3-D rotational X-ray (3DRX), and magnetic resonance (MR) and 2-D X-ray images of two spine phantoms, for which gold standard registrations were known. For each of the 3DRX, CT, or MR images and each set of X-ray images, 1600 registrations were performed from starting positions, defined as the mean target registration error (mTRE), randomly generated and uniformly distributed in the interval of -20 mm around the gold standard. The capture range was defined as the distance from gold standard for which the final TRE was less than 2 mm in at least 95% of all cases. In terms of success rate, as the function of initial misalignment and capture range the proposed method outperformed the GBM. TREs of the novel method and the GBM were approximately the same. For the registration of 3DRX and CT images to X-ray images as few as 2-3 X-ray views were sufficient to obtain approximately .4 mm TREs, 7-9 mm capture range, and 80%-90% of successful registrations. To obtain similar results for MR to X-ray registrations, an image, reconstructed from at least 11 X-ray images was required. Reconstructions from more than 11 images had no effect on the registration results.
Faculty of Electrical Engineering, University of Ljubljana, Ljubljana, Slovenia.
Evaluation and comparison of registration techniques for image-guided surgery is an important problem that has received little attention in the literature. In this paper we address the challenging problem of generating reliable "gold standard" data for use in evaluating the accuracy of 3D/2D registrations. We have devised a cadaveric lumbar spine phantom with fiducial markers and established highly accurate correspondences between 3D CT and MR images and 18 2D X-ray images. The expected target registration errors for target points on the pedicles are less than .26 mm for CT-to-X-ray registration and less than .42 mm for MR-to-X-ray registration. As such, the "gold standard" data, which has been made publicly available on the Internet (http://lit.fe.uni-lj.si/Downloads/downloads.asp), is useful for evaluation and comparison of 3D/2D image registration methods.
University of Ljubljana, Faculty of Electrical Engineering, Trzaska 25, 1000 Ljubljana, Slovenia. dejan.tomazevic@fe.uni-lj.si
A crucial part of image-guided therapy is registration of preoperative and intraoperative images, by which the precise position and orientation of the patient's anatomy is determined in three dimensions. This paper presents a novel approach to register three-dimensional (3-D) computed tomography (CT) or magnetic resonance (MR) images to one or more two-dimensional (2-D) X-ray images. The registration is based solely on the information present in 2-D and 3-D images. It does not require fiducial markers, intraoperative X-ray image segmentation, or timely construction of digitally reconstructed radiographs. The originality of the approach is in using normals to bone surfaces, preoperatively defined in 3-D MR or CT data, and gradients of intraoperative X-ray images at locations defined by the X-ray source and 3-D surface points. The registration is concerned with finding the rigid transformation of a CT or MR volume, which provides the best match between surface normals and back projected gradients, considering their amplitudes and orientations. We have thoroughly validated our registration method by using MR, CT, and X-ray images of a cadaveric lumbar spine phantom for which "gold standard" registration was established by means of fiducial markers, and its accuracy assessed by target registration error. Volumes of interest, containing single vertebrae L1-L5, were registered to different pairs of X-ray images from different starting positions, chosen randomly and uniformly around the "gold standard" position. CT/X-ray (MR/ X-ray) registration, which is fast, was successful in more than 91%(82% except for L1) of trials if started from the "gold standard" translated or rotated for less than 6 mm or 17 degrees (3 mm or 8.6 degrees), respectively. Root-mean-square target registration errors were below .5 mm for the CT to X-ray registration and below 1.4 mm for MR to X-ray registration.
One of the most important technical challenges in image-guided intervention is to obtain a precise transformation between the intrainterventional patient's anatomy and corresponding preinterventional 3-D image on which the intervention was planned. This goal can be achieved by acquiring intrainterventional 2-D images and matching them to the preinterventional 3-D image via 3-D/2-D image registration. A novel 3-D/2-D registration method is proposed in this paper. The method is based on robustly matching 3-D preinterventional image gradients and coarsely reconstructed 3-D gradients from the intrainterventional 2-D images. To improve the robustness of finding the correspondences between the two sets of gradients, hypothetical correspondences are searched for along normals to anatomical structures in 3-D images, while the final correspondences are established in an iterative process, combining the robust random sample consensus algorithm (RANSAC) and a special gradient matching criterion function. The proposed method was evaluated using the publicly available standardized evaluation methodology for 3-D/2-D registration, consisting of 3-D rotational X-ray, computed tomography, magnetic resonance (MR), and 2-D X-ray images of two spine segments, and standardized evaluation criteria. In this way, the proposed method could be objectively compared to the intensity, gradient, and reconstruction-based registration methods. The obtained results indicate that the proposed method performs favorably both in terms of registration accuracy and robustness. The method is especially superior when just a few X-ray images and when MR preinterventional images are used for registration, which are important advantages for many clinical applications.
Med Image Comput Comput Assist Interv Int Conf Med Image Comput Comput Assist Interv. 2008 ;11 (Pt 1):942-50 18979836 (P,S,G,E,B)
University of Ljubljana, Faculty of Electrical Engineering, Slovenia. tomaz.vrtovec@fe.uni-lj.si
In the past, a number of methods were proposed for quantitative assessment of vertebral rotation from three-dimensional (3D) images. However, these methods were based on manual identification of distinctive anatomical landmarks, required manual determination of cross-sections from 3D images, and measured only axial vertebral rotation instead of the rotation in 3D. In this paper, we propose an automated method for quantitative assessment of vertebral rotation in 3D that is based on finding the planes of vertebral symmetry by matching image intensity gradients on both sides of each plane. The method was evaluated on 28 images of normal and pathological vertebrae, obtained by computed tomography (CT) and magnetic resonance (MR). For each vertebra, final angle displacements of 200 initial angle displacements, uniformly distributed within 30 degrees from manually obtained reference angles, were obtained. The results show that by the proposed method, vertebral rotation can be successfully estimated in 3D with an average accuracy of 1. degrees and precision of .5 degrees.
Med Image Comput Comput Assist Interv Int Conf Med Image Comput Comput Assist Interv. 2008 ;11 (Pt 1):762-70 18979815 (P,S,G,E,B)
Faculty of Electrical Engineering, University of Ljubljana, Slovenia. ziga.spiclin@fe.uni-lj.si
In this paper, a novel method for EEG to MRI registration is proposed. Initial registration is achieved by extracting and matching symmetry planes of MRI and EEG data, followed by iterative registration based on minimizing a cost function. Comparison of the intensity distributions of the whole MR image and MRI voxels around a head surface point yields global similarities, while the comparison of intensity distributions of MRI voxels around corresponding EEG points, which reflects the head's sagittal symmetry, yields local similarities. Therefore, when the EEG points are registered to the MR image, maximal global and local similarities should be obtained. The cost function, incorporating global and local similarities, was the sum of Kullback-Leibler divergences between corresponding intensity distributions. The proposed method was evaluated on clinical MRI data with simulated EEG data, yielding mean registration error of .48 +/- .33 mm, while with real EEG data an average root-mean-square point-to-surface error of 2.27 +/- .02 mm was obtained.
Latest similar papers:
Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada N2L 3G1.
A novel similarity measure for registering magnetic resonance (MR) and computed tomography (CT) images has been designed and built. MR-CT registration methods often rely on the statistical intensity relationship between the images. The proposed similarity measure instead depends on the statistical relationship between the complex phase order between the images. By utilizing the complex phase order likelihood (CPOL) as a similarity measure, structural relationships instead of intensity relationships are explicitly used. This approach can be advantageous for MR-CT registration, where the intensities of the CT imagery have highly complex and nonlinear relationships with the intensities of corresponding MR imagery but simpler linear structural relationships. This new similarity measure has been tested on real MR-CT 3D volumes and has been evaluated based on fiducial registration error to determine alignment accuracy. Quantitative results show that CPOL is capable of achieving comparable alignment accuracy when compared to normalized mutual information, while being more robust to imaging artifacts such as noise.
Yunkai Zhang,
James C H Chu,
Wenchien Hsi,
Atif J Khan,
Parthiv S Mehta,
Damian B Bernard,
Ross A Abrams
Department of Radiation Oncology, Rush University Medical Center, Chicago, IL.
We evaluated 4 volume-based automatic image registration algorithms from 2 commercially available treatment planning systems (Philips Syntegra and BrainScan). The algorithms based on cross correlation (CC), local correlation (LC), normalized mutual information (NMI), and BrainScan mutual information (BSMI) were evaluated with: (1) the synthetic computed tomography (CT) images,(2) the CT and magnetic resonance (MR) phantom images, and (3) the CT and MR head image pairs from 12 patients with brain tumors. For the synthetic images, the registration results were compared with known transformation parameters, and all algorithms achieved accuracy of submillimeter in translation and subdegree in rotation. For the phantom images, the registration results were compared with those provided by frame and marker-based manual registration. For the patient images, the results were compared with anatomical landmark-based manual registration to qualitatively determine how the results were close to a clinically acceptable registration. NMI and LC outperformed CC and BSMI, with the sense of being closer to a clinically acceptable result. As for the robustness, NMI and BSMI outperformed CC and LC. A guideline of image registration in our institution was given, and final visual assessment is necessary to guarantee reasonable results.
Wolfgang Birkfellner,
Markus Stock,
Michael Figl,
Christelle Gendrin,
Johann Hummel,
Shuo Dong,
Joachim Kettenbach,
Dietmar Georg,
Helmar Bergmann
Center for Biomedical Engineering and Physics, Medical University Vienna, Waehringer Guertel 18-20 AKH 4L, A-1090 Vienna, Austria. wolfgang.birkfellner@meduniwien.ac.at
In this article, the authors evaluate a merit function for 2D/3D registration called stochastic rank correlation (SRC). SRC is characterized by the fact that differences in image intensity do not influence the registration result; it therefore combines the numerical advantages of cross correlation (CC)-type merit functions with the flexibility of mutual-information-type merit functions. The basic idea is that registration is achieved on a random subset of the image, which allows for an efficient computation of Spearman's rank correlation coefficient. This measure is, by nature, invariant to monotonic intensity transforms in the images under comparison, which renders it an ideal solution for intramodal images acquired at different energy levels as encountered in intrafractional kV imaging in image-guided radiotherapy. Initial evaluation was undertaken using a 2D/3D registration reference image dataset of a cadaver spine. Even with no radiometric calibration, SRC shows a significant improvement in robustness and stability compared to CC. Pattern intensity, another merit function that was evaluated for comparison, gave rather poor results due to its limited convergence range. The time required for SRC with 5% image content compares well to the other merit functions; increasing the image content does not significantly influence the algorithm accuracy. The authors conclude that SRC is a promising measure for 2D/3D registration in IGRT and image-guided therapy in general.
Brigham and Women's Hospital, Harvard Medical School, USA. mt@bwh.harvard.edu
We propose a novel Bayesian registration formulation in which image location is represented as a latent random variable. Location is marginalized to determine the maximum a priori (MAP) transform between images, which results in registration that is more robust than the alternatives of omitting locality (i.e. global registration) or jointly maximizing locality and transform (i.e. iconic registration). A mathematical link is established between the Bayesian registration formulation and the mutual information (MI) similarity measure. This leads to a novel technique for selecting informative image regions for registration, based on the MI of image intensity and spatial location. Experimental results demonstrate the effectiveness of the marginalization formulation and the MI-based region selection technique for ultrasound (US) to magnetic resonance (MR) registration in an image-guided neurosurgical application.
We introduce a new measure of image similarity called the Complex Wavelet Structural Similarity (CW-SSIM) index and show its applicability as a general purpose image similarity index. The key idea behind CW-SSIM is that certain image distortions lead to consistent phase changes in the local wavelet coefficients, and that a consistent phase shift of the coefficients does not change the structural content of the image. By conducting four case studies, we have demonstrated the superiority of the CW-SSIM index against other indices (e.g., Dice, Hausdorff distance) commonly used for assessing the similarity of a given pair of images. In addition, we show that the CW-SSIM index has a number of advantages. It is robust to small rotations and translations. It provides useful comparisons even without a pre-processing image registration step, which is essential for other indices. Moreover, it is computationally less expensive.
Department of Oral and Cranio-Maxillofacial Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany.
Image-guidance in maxillofacial surgery is based predominantly on computed tomographic (CT) images. Its main disadvantage is the considerable amount of radiation to which the patient is exposed, and dental metal artefacts. Recently, a new class of devices based on the concept of cone-beam computed tomography (CBCT) has been introduced for maxillofacial imaging, which we have investigated. In a clinical study, the first seven patients to be operated using a navigation system based on CBCT images, were evaluated. In all cases patient to image recording was uneventful and the surgical objective was reached. The guidance given by the navigation system was helpful. CBCT is an alternative to conventional CT, gives a lower dose of radiation, and costs less. Limitations in the quality of the images and the size of the field of view may restrict its use. It is suitable for image-guided surgery using a navigation system as long as the images show enough of the relevant anatomy and pathology.
Dynamic cardiac magnetic resonance imaging (MR) and computed tomography (CT) provide cardiologists and cardiac surgeons with high-quality four-dimensional (4D) images for diagnosis and therapy, yet the effective use of these high-quality anatomical models remains a challenge. Ultrasound (US) is a flexible imaging tool, but the US images produced are often difficult to interpret unless they are placed within their proper three-dimensional (3D) anatomical context. The ability to correlate real-time three-dimensional US volumes (RT3D US) with dynamic MR/CT images would offer a significant contribution to improve the quality of cardiac procedures. In this work, we present a rapid two-step method for registering RT3D US to high-quality dynamic 3D MR/CT images of the beating heart. This technique overcomes some major limitations of image registration (such as the correct registration result not necessarily occurring at the maximum of the mutual information (MI) metric) using the MI metric. We demonstrate the effectiveness of our method in a dynamic heart phantom (DHP) study and a human subject study. The achieved mean target registration error of CT+US images in the phantom study is 2.59 mm. Validation using human MR/US volumes shows a target registration error of 1.76 mm. We anticipate that this technique will substantially improve the quality of cardiac diagnosis and therapies.
Vrije Universiteit Brussel, Department of Mathematics, Operational Research, Statistics, and Information Systems, MOSI, Pleinlaan 2, B-1050 Brussels, Belgium.
Spatial alignment of image data is a common task in computer vision and medical imaging. This should preferentially be done with minimal intervention of an operator. Similarity measures with origin in the information theory such as mutual information (MI) have proven to be robust registration criteria for this purpose. Intra-oral radiographs can be considered images of piecewise rigid objects. Teeth and jaws are rigid but can be displaced with respect to each other. Therefore MI criteria combined with affine deformations tend to fail, when teeth and jaws move with respect to each other between image acquisitions. In this paper, we consider a focused weighing of pixels in the reference image. The resulting criterion, focused mutual information (FMI) is an adequate tool for the registration of rigid parts of a scene. We also show that the use of FMI is more robust for the subtraction of lateral radiographs of teeth, than MI confined to a region of interest. Furthermore, the criterion allows the follow-up of small carious lesions when upper and lower jaw moved between the acquisition of test and reference image.
Bradley J Beattie,
Alexander D Klose,
Carl H Le,
Valerie A Longo,
Konstantine Dobrenkov,
Jelena Vider,
Jason A Koutcher,
Ronald G Blasberg
Memorial Sloan-Kettering Cancer Center, Department of Neurology, 1275 York Avenue, New York, New York 10065.
The procedures we propose make possible the mapping of two-dimensional (2-D) bioluminescence image (BLI) data onto a skin surface derived from a three-dimensional (3-D) anatomical modality [magnetic resonance (MR) or computed tomography (CT)] dataset. This mapping allows anatomical information to be incorporated into bioluminescence tomography (BLT) reconstruction procedures and, when applied using sources visible to both optical and anatomical modalities, can be used to evaluate the accuracy of those reconstructions. Our procedures, based on immobilization of the animal and a priori determined fixed projective transforms, should be more robust and accurate than previously described efforts, which rely on a poorly constrained retrospectively determined warping of the 3-D anatomical information. Experiments conducted to measure the accuracy of the proposed registration procedure found it to have a mean error of .36+/- .23 mm. Additional experiments highlight some of the confounds that are often overlooked in the BLT reconstruction process, and for two of these confounds, simple corrections are proposed.
Gwen Swennen,
Wouter Mollemans,
Calix De Clercq,
Johan Abeloos,
Philippe Lamoral,
Frank Lippens,
Nathalie Neyt,
Jan Casselman,
Filip Schutyser
The aim of this study was to present a new approach to acquire a three-dimensional virtual skull model appropriate for orthognathic surgery planning without the use of plaster dental models and without deformation of the facial soft-tissue mask. A "triple" cone-beam computed tomography (CBCT) scan procedure with triple voxel-based rigid registration was evaluated and validated on 10 orthognathic patients. First, the patient was scanned vertically with a wax bite wafer in place (CBCT scan N degrees 1). Second, a limited dose scan of the patient with a Triple Tray AlgiNot impression in place was carried out (CBCT scan N degrees 2). Finally, a high-resolution scan of the Triple Tray AlgiNot impression was done (CBCT scan N degrees 3). Sequential and semiautomatic triple voxel-based rigid registration (RN degrees 1-RN degrees 3) was performed to augment the patient's skull model with accurate occlusal and intercuspidation data (Maxilim, version 2.1.1., Medicim NV, Mechelen, Belgium). All registrations were based on the Maximisation of Mutual Information registration algorithm. Because the accuracy and stability of the voxel-based registration (RN degrees 1) between the Triple Tray AlgiNot impression scan and the limited low-dose patient scan were not known, this particular registration step needed to be validated. The accuracy of registration was measured on a synthetic skull and showed to be highly accurate. A volume overlap of 98.1% was found for registered impression scan N degrees 1. The mean distance between registered impression scan N degrees 1 and registered impression scan N degrees 2 was .08 +/- .03 mm (range, .04- .11 mm). As far as the stability of registration was concerned, successful registration with a stable optimal position was obtained with a maximum variability of less than .1 mm. The results of this study showed that semiautomatic sequential triple voxel-based rigid registration of the triple CBCT scans augmented the 3-D virtual skull model with detailed occlusal and intercuspidation data in a highly accurate and robust way. The method is therefore appropriate and valid for 3-D virtual orthognathic surgery planning in the clinical routine.
