PURPOSE: In external beam radiation therapy of pelvic sites, patient setup errors can be quantified by registering 2D projection radiographs acquired during treatment to a 3D planning computed tomograph (CT). We present a 2D-3D registration framework based on a statistical model of the intensity values in the two imaging modalities. METHODS: The model assumes that intensity values in projection radiographs are independently but not identically distributed due to the nonstationary nature of photon counting noise. Two probability distributions are considered for the intensity values: Poisson and Gaussian. Using maximum likelihood estimation, two similarity measures, maximum likelihood with a Poisson (MLP) and maximum likelihood with Gaussian (MLG), distribution are derived. Further, we investigate the merit of the model-based registration approach for data obtained with current imaging equipment and doses by comparing the performance of the similarity measures derived to that of the Pearson correlation coefficient (ICC) on accurately collected data of an anthropomorphic phantom of the pelvis and on patient data. RESULTS: Registration accuracy was similar for all three similarity measures and surpassed current clinical requirements of 3 mm for pelvic sites. For pose determination experiments with a kilovoltage (kV) cone-beam CT (CBCT) and kV projection radiographs of the phantom in the anterior-posterior (AP) view, registration accuracies were 0.42 mm (MLP), 0.29 mm (MLG), and 0.29 mm (ICC). For kV CBCT and megavoltage (MV) AP portal images of the same phantom, registration accuracies were 1.15 mm (MLP), 0.90 mm (MLG), and 0.69 mm (ICC). Registration of a kV CT and MV AP portal images of a patient was successful in all instances. CONCLUSIONS: The results indicate that high registration accuracy is achievable with multiple methods including methods that are based on a statistical model of a 3D CT and 2D projection images.

In this article, the authors evaluate a merit function for 2D/3D registration called stochastic rank correlation (SRC). SRC is characterized by the fact that differences in image intensity do not influence the registration result; it therefore combines the numerical advantages of cross correlation (CC)-type merit functions with the flexibility of mutual-information-type merit functions. The basic idea is that registration is achieved on a random subset of the image, which allows for an efficient computation of Spearman's rank correlation coefficient. This measure is, by nature, invariant to monotonic intensity transforms in the images under comparison, which renders it an ideal solution for intramodal images acquired at different energy levels as encountered in intrafractional kV imaging in image-guided radiotherapy. Initial evaluation was undertaken using a 2D/3D registration reference image dataset of a cadaver spine. Even with no radiometric calibration, SRC shows a significant improvement in robustness and stability compared to CC. Pattern intensity, another merit function that was evaluated for comparison, gave rather poor results due to its limited convergence range. The time required for SRC with 5% image content compares well to the other merit functions; increasing the image content does not significantly influence the algorithm accuracy. The authors conclude that SRC is a promising measure for 2D/3D registration in IGRT and image-guided therapy in general.

One of the most important technical challenges in image-guided intervention is to obtain a precise transformation between the intrainterventional patient's anatomy and corresponding preinterventional 3-D image on which the intervention was planned. This goal can be achieved by acquiring intrainterventional 2-D images and matching them to the preinterventional 3-D image via 3-D/2-D image registration. A novel 3-D/2-D registration method is proposed in this paper. The method is based on robustly matching 3-D preinterventional image gradients and coarsely reconstructed 3-D gradients from the intrainterventional 2-D images. To improve the robustness of finding the correspondences between the two sets of gradients, hypothetical correspondences are searched for along normals to anatomical structures in 3-D images, while the final correspondences are established in an iterative process, combining the robust random sample consensus algorithm (RANSAC) and a special gradient matching criterion function. The proposed method was evaluated using the publicly available standardized evaluation methodology for 3-D/2-D registration, consisting of 3-D rotational X-ray, computed tomography, magnetic resonance (MR), and 2-D X-ray images of two spine segments, and standardized evaluation criteria. In this way, the proposed method could be objectively compared to the intensity, gradient, and reconstruction-based registration methods. The obtained results indicate that the proposed method performs favorably both in terms of registration accuracy and robustness. The method is especially superior when just a few X-ray images and when MR preinterventional images are used for registration, which are important advantages for many clinical applications.

Significant research has been conducted in radiation beam gating technology to manage target and organ motions in radiotherapy treatment of cancer patients. As more and more on-board imagers are installed onto linear accelerators, fluoroscopic imaging becomes readily available at the radiation treatment stage. Thus, beam gating parameters, such as beam-on timing and beam-on window can be potentially determined by employing image registration between treatment planning CT images and fluoroscopic images. We propose a new registration method on deformable soft tissue between fluoroscopic images and DRR (Digitally Reconstructed Radiograph) images from planning CT images using active shape models. We present very promising results of our method applied to 30 clinical datasets. These preliminary results show that the method is very robust for the registration of deformable soft tissue. The proposed method can be used to determine beam-on timing and treatment window for radiation beam gating technology, and can potentially greatly improve radiation treatment quality.

In many radiotherapy clinics, geometric uncertainties in the delivery of 3D conformal radiation therapy and intensity modulated radiation therapy of the prostate are reduced by aligning the patient's bony anatomy in the planning 3D CT to corresponding bony anatomy in 2D portal images acquired before every treatment fraction. In this paper, we seek to determine if there is a frequency band within the portal images and the digitally reconstructed radiographs (DRRs) of the planning CT in which bony anatomy predominates over non-bony anatomy such that portal images and DRRs can be suitably filtered to achieve high registration accuracy in an automated 2D-3D single portal intensity-based registration framework. Two similarity measures, mutual information and the Pearson correlation coefficient were tested on carefully collected gold-standard data consisting of a kilovoltage cone-beam CT (CBCT) and megavoltage portal images in the anterior-posterior (AP) view of an anthropomorphic phantom acquired under clinical conditions at known poses, and on patient data. It was found that filtering the portal images and DRRs during the registration considerably improved registration performance. Without filtering, the registration did not always converge while with filtering it always converged to an accurate solution. For the pose-determination experiments conducted on the anthropomorphic phantom with the correlation coefficient, the mean (and standard deviation) of the absolute errors in recovering each of the six transformation parameters were Theta(x):0.18(0.19) degrees, Theta(y):0.04(0.04) degrees, Theta(z):0.04(0.02) degrees, t(x):0.14(0.15) mm, t(y):0.09(0.05) mm, and t(z):0.49(0.40) mm. The mutual information-based registration with filtered images also resulted in similarly small errors. For the patient data, visual inspection of the superimposed registered images showed that they were correctly aligned in all instances. The results presented in this paper suggest that robust and accurate registration can be achieved with intensity-based methods by focusing on rigid bony structures in the images while diminishing the influence of artifacts with similar frequencies as soft tissue.

Image registrations that are based on similarity measures simply adjust the parameters of an appropriate spatial transformation model until the similarity measure reaches an optimum. The numerous similarity measures that have been proposed in the past are differently sensitive to imaging modality, image content and differences in the image content, selection of the floating and target image, partial image overlap, etc. In this paper, we evaluate and compare 12 similarity measures for the rigid registration. To study the impact of different imaging modalities on the behavior of similarity measures, we have used 16 CT/MR and 6 PET/MR image pairs with known 'gold standard' registrations. The results for the PET/MR registration and for the registration of CT to both rectified and unrectified MR images indicate that mutual information, normalized mutual information and the entropy correlation coefficient are the most accurate similarity measures and have the smallest risk of being trapped in a local optimum. The results of an experiment on the impact of exchanging the floating and target image indicate that, especially in MR/PET registrations, the behavior of some similarity measures, such as mutual information, significantly depends on which image is the floating and which is the target.

In this paper, we present a protocol for the evaluation of similarity measures for non-rigid registration. The evaluation is based on five intuitive properties that characterize the behavior of a similarity measure, i.e. the accuracy, capture range, distinctiveness of the optimum, number of local minima, and risk of non-convergence. These five properties are estimated locally from similarity measure values that correspond to a range of systematic local free-form deformations, obtained by displacing control points in random directions from the gold standard position. Global similarity measure properties are obtained by combining the local properties over image regions or over the entire image. The feasibility of the proposed evaluation protocol is demonstrated for three similarity measures: mutual information, normalized mutual information and correlation ratio. The evaluation is carried out on a number of MR and CT images: a pair of simulated MR T1 and MR T2 images of the head, three pairs of real MR T1 and T2 images of the head, six pairs of real MR T1 and CT images of the head, and pairs of MR and CT images of three vertebrae. The protocol may help researchers to select the most appropriate similarity measure for a non-rigid registration task.

The endoscope is a popular imaging modality used in many preevaluations and surgical treatments, and is also one of the essential tools in minimally invasive surgery. However, regular endoscopes provide only 2-D images. Even though stereoendoscopy systems can display 3-D images, the real anatomical structure of the observed lesion is unavailable and can only be judged by the surgeon's imagination. In this paper, we present a constraint-based factorization method for reconstructing 3-D structures registered to the patient, from 2-D endoscopic images. The proposed method incorporates the geometric constraints from the tracked surgical instrument into the traditional factorization method based on frame-to-frame feature motion on the endoscopically viewed scene. Experiments with real and synthetic data demonstrate good real-scale 3-D extraction, with greater accuracy than is available from traditional methods. The reconstruction process can also be accomplished in a few seconds, making it suitable for on-line surgical applications to provide surgeons with additional 3-D shape information, critical distance monitoring and warnings.

We propose a new method for CT to fluoroscope registration which is very robust and has a wide capture range. The method relies on the Unscented Kalman Filter to search for an optimal registration solution and on modern commodity graphics cards for fast generation of digitally reconstructed radiographs. We extensively test our method using three different anatomical data sets and compare it with an implementation of the commonly used simplex-based method. The experimental results firmly support that, under the same testing conditions, our proposed technique outperforms the simplex-based method in capture range while providing comparable accuracy and computation time.

An important part of image-guided radiation therapy or surgery is registration of a three-dimensional (3D) preoperative image to two-dimensional (2D) images of the patient. It is expected that the accuracy and robustness of a 3D/2D image registration method do not depend solely on the registration method itself but also on the number and projections (views) of intraoperative images. In this study, we systematically investigate these factors by using registered image data, comprising of CT and X-ray images of a cadaveric lumbar spine phantom and the recently proposed 3D/2D registration method. The results indicate that the proportion of successful registrations (robustness) significantly increases when more X-ray images are used for registration.

Purpose: A promising patient positioning technique is based on registering computed tomographic (CT) or magnetic resonance (MR) images to cone-beam CT images (CBCT). The extra radiation dose delivered to the patient can be substantially reduced by using fewer projections. This approach results in lower quality CBCT images. The purpose of this study is to evaluate a number of similarity measures (SMs) suitable for registration of CT or MR images to low-quality CBCTs. Methods and Materials: Using the recently proposed evaluation protocol, we evaluated nine SMs with respect to pretreatment imaging modalities, number of two-dimensional (2D) images used for reconstruction, and number of reconstruction iterations. The image database consisted of 100 X-ray and corresponding CT and MR images of two vertebral columns. Results: Using a higher number of 2D projections or reconstruction iterations results in higher accuracy and slightly lower robustness. The similarity measures that behaved the best also yielded the best registration results. The most appropriate similarity measure was the asymmetric multi-feature mutual information (AMMI). Conclusions: The evaluation protocol proved to be a valuable tool for selecting the best similarity measure for the reconstruction-based registration. The results indicate that accurate and robust CT/CBCT or even MR/CBCT registrations are possible if the AMMI similarity measure is used.

In this paper we present a novel 3D/2D registration method, where first, a 3D image is reconstructed from a few 2D X-ray images and next, the preoperative 3D image is brought into the best possible spatial correspondence with the reconstructed image by optimizing a similarity measure. Because the quality of the reconstructed image is generally low, we introduce a novel asymmetric mutual information similarity measure, which is able to cope with low image quality as well as with different imaging modalities. The novel 3D/2D registration method has been evaluated using standardized evaluation methodology and publicly available 3D CT, 3DRX, and MR and 2D X-ray images of two spine phantoms, for which gold standard registrations were known. In terms of robustness, reliability and capture range the proposed method outperformed the gradient-based method and the method based on digitally reconstructed radiographs (DRRs).

Evaluation and comparison of registration techniques for image-guided surgery is an important problem that has received little attention in the literature. In this paper we address the challenging problem of generating reliable "gold standard" data for use in evaluating the accuracy of 3D/2D registrations. We have devised a cadaveric lumbar spine phantom with fiducial markers and established highly accurate correspondences between 3D CT and MR images and 18 2D X-ray images. The expected target registration errors for target points on the pedicles are less than 0.26 mm for CT-to-X-ray registration and less than 0.42 mm for MR-to-X-ray registration. As such, the "gold standard" data, which has been made publicly available on the Internet (http://lit.fe.uni-lj.si/Downloads/downloads.asp), is useful for evaluation and comparison of 3D/2D image registration methods.

A crucial part of image-guided therapy is registration of preoperative and intraoperative images, by which the precise position and orientation of the patient's anatomy is determined in three dimensions. This paper presents a novel approach to register three-dimensional (3-D) computed tomography (CT) or magnetic resonance (MR) images to one or more two-dimensional (2-D) X-ray images. The registration is based solely on the information present in 2-D and 3-D images. It does not require fiducial markers, intraoperative X-ray image segmentation, or timely construction of digitally reconstructed radiographs. The originality of the approach is in using normals to bone surfaces, preoperatively defined in 3-D MR or CT data, and gradients of intraoperative X-ray images at locations defined by the X-ray source and 3-D surface points. The registration is concerned with finding the rigid transformation of a CT or MR volume, which provides the best match between surface normals and back projected gradients, considering their amplitudes and orientations. We have thoroughly validated our registration method by using MR, CT, and X-ray images of a cadaveric lumbar spine phantom for which "gold standard" registration was established by means of fiducial markers, and its accuracy assessed by target registration error. Volumes of interest, containing single vertebrae L1-L5, were registered to different pairs of X-ray images from different starting positions, chosen randomly and uniformly around the "gold standard" position. CT/X-ray (MR/ X-ray) registration, which is fast, was successful in more than 91%(82% except for L1) of trials if started from the "gold standard" translated or rotated for less than 6 mm or 17 degrees (3 mm or 8.6 degrees), respectively. Root-mean-square target registration errors were below 0.5 mm for the CT to X-ray registration and below 1.4 mm for MR to X-ray registration.

We propose a completely automated algorithm for the detection of the spinal centreline and the centres of vertebral bodies and intervertebral discs in images acquired by computed tomography (CT) and magnetic resonance (MR) imaging. The developed methods are based on the analysis of the geometry of spinal structures and the characteristics of CT and MR images and were evaluated on 29 CT and 13 MR images of lumbar spine. The overall mean distance between the obtained and the ground truth spinal centrelines and centres of vertebral bodies and intervertebral discs were 1.8 +/- 1.1 mm and 2.8 +/- 1.9 mm, respectively, and no considerable differences were detected among the results for CT, T(1)-weighted MR and T(2)-weighted MR images. The knowledge of the location of the spinal centreline and the centres of vertebral bodies and intervertebral discs is valuable for the analysis of the spine. The proposed method may therefore be used to initialize the techniques for labelling and segmentation of vertebrae.

One of the most important technical challenges in image-guided intervention is to obtain a precise transformation between the intrainterventional patient's anatomy and corresponding preinterventional 3-D image on which the intervention was planned. This goal can be achieved by acquiring intrainterventional 2-D images and matching them to the preinterventional 3-D image via 3-D/2-D image registration. A novel 3-D/2-D registration method is proposed in this paper. The method is based on robustly matching 3-D preinterventional image gradients and coarsely reconstructed 3-D gradients from the intrainterventional 2-D images. To improve the robustness of finding the correspondences between the two sets of gradients, hypothetical correspondences are searched for along normals to anatomical structures in 3-D images, while the final correspondences are established in an iterative process, combining the robust random sample consensus algorithm (RANSAC) and a special gradient matching criterion function. The proposed method was evaluated using the publicly available standardized evaluation methodology for 3-D/2-D registration, consisting of 3-D rotational X-ray, computed tomography, magnetic resonance (MR), and 2-D X-ray images of two spine segments, and standardized evaluation criteria. In this way, the proposed method could be objectively compared to the intensity, gradient, and reconstruction-based registration methods. The obtained results indicate that the proposed method performs favorably both in terms of registration accuracy and robustness. The method is especially superior when just a few X-ray images and when MR preinterventional images are used for registration, which are important advantages for many clinical applications.

In the past, a number of methods were proposed for quantitative assessment of vertebral rotation from three-dimensional (3D) images. However, these methods were based on manual identification of distinctive anatomical landmarks, required manual determination of cross-sections from 3D images, and measured only axial vertebral rotation instead of the rotation in 3D. In this paper, we propose an automated method for quantitative assessment of vertebral rotation in 3D that is based on finding the planes of vertebral symmetry by matching image intensity gradients on both sides of each plane. The method was evaluated on 28 images of normal and pathological vertebrae, obtained by computed tomography (CT) and magnetic resonance (MR). For each vertebra, final angle displacements of 200 initial angle displacements, uniformly distributed within 30 degrees from manually obtained reference angles, were obtained. The results show that by the proposed method, vertebral rotation can be successfully estimated in 3D with an average accuracy of 1.0 degrees and precision of 0.5 degrees.

In this paper, a novel method for EEG to MRI registration is proposed. Initial registration is achieved by extracting and matching symmetry planes of MRI and EEG data, followed by iterative registration based on minimizing a cost function. Comparison of the intensity distributions of the whole MR image and MRI voxels around a head surface point yields global similarities, while the comparison of intensity distributions of MRI voxels around corresponding EEG points, which reflects the head's sagittal symmetry, yields local similarities. Therefore, when the EEG points are registered to the MR image, maximal global and local similarities should be obtained. The cost function, incorporating global and local similarities, was the sum of Kullback-Leibler divergences between corresponding intensity distributions. The proposed method was evaluated on clinical MRI data with simulated EEG data, yielding mean registration error of 0.48 +/- 0.33 mm, while with real EEG data an average root-mean-square point-to-surface error of 2.27 +/- 0.02 mm was obtained.

The purpose of this study is to present a framework for quantitative analysis of spinal curvature in 3D. In order to study the properties of such complex 3D structures, we propose two descriptors that capture the characteristics of spinal curvature in 3D. The descriptors are the geometric curvature (GC) and curvature angle (CA), which are independent of the orientation and size of spine anatomy. We demonstrate the two descriptors that characterize the spinal curvature in 3D on 30 computed tomography (CT) images of normal spine and on a scoliotic spine. The descriptors are determined from 3D vertebral body lines, which are obtained by two different methods. The first method is based on the least-squares technique that approximates the manually identified vertebra centroids, while the second method searches for vertebra centroids in an automated optimization scheme, based on computer-assisted image analysis. Polynomial functions of the fourth and fifth degree were used for the description of normal and scoliotic spinal curvature in 3D, respectively. The mean distance to vertebra centroids was 1.1 mm (+/-0.6 mm) for the first and 2.1 mm (+/-1.4 mm) for the second method. The distributions of GC and CA values were obtained along the 30 images of normal spine at each vertebral level and show that maximal thoracic kyphosis (TK), thoracolumbar junction (TJ) and maximal lumbar lordosis (LL) on average occur at T3/T4, T12/L1 and L4/L5, respectively. The main advantage of GC and CA is that the measurements are independent of the orientation and size of the spine, thus allowing objective intra- and inter-subject comparisons. The positions of maximal TK, TJ and maximal LL can be easily identified by observing the GC and CA distributions at different vertebral levels. The obtained courses of the GC and CA for the scoliotic spine were compared to the distributions of GC and CA for the normal spines. The significant difference in values indicates that the descriptors of GC and CA may be used to detect and quantify scoliotic spinal curvatures. The proposed framework may therefore improve the understanding of spine anatomy and aid in the clinical quantitative evaluation of spinal deformities.

Three-dimensional skeletal movement is often impossible to accurately quantify from external markers. X-ray imaging more directly visualizes moving bones, but extracting 3-D kinematic data is notoriously difficult from a single perspective. Stereophotogrammetry is extremely powerful if bi-planar fluoroscopy is available, yet implantation of three radio-opaque markers in each segment of interest may be impractical. Herein we introduce scientific rotoscoping (SR), a new method of motion analysis that uses articulated bone models to simultaneously animate and quantify moving skeletons without markers. The three-step process is described using examples from our work on pigeon flight and alligator walking. First, the experimental scene is reconstructed in 3-D using commercial animation software so that frames of undistorted fluoroscopic and standard video can be viewed in their correct spatial context through calibrated virtual cameras. Second, polygonal models of relevant bones are created from CT or laser scans and rearticulated into a hierarchical marionette controlled by virtual joints. Third, the marionette is registered to video images by adjusting each of its degrees of freedom over a sequence of frames. SR outputs high-resolution 3-D kinematic data for multiple, unmarked bones and anatomically accurate animations that can be rendered from any perspective. Rather than generating moving stick figures abstracted from the coordinates of independent surface points, SR is a morphology-based method of motion analysis deeply rooted in osteological and arthrological data. J. Exp. Zool. 313A, 2010.(c) 2010 Wiley-Liss, Inc.

This paper presents a novel automatic framework to perform 3D face recognition. The proposed method uses a Simulated Annealing-based approach (SA) for range image registration with the Surface Interpenetration Measure (SIM), as similarity measure, in order to match two face images. The authentication score is obtained by combining the SIM values corresponding to the matching of four different face regions: circular and elliptical areas around the nose, forehead, and the entire face region. Then, a modified SA approach is proposed taking advantage of invariant face regions to better handle facial expressions. Comprehensive experiments were performed on the FRGC v2 database, the largest available database of 3D face images composed of 4,007 images with different facial expressions. The experiments simulated both verification and identification systems and the results compared to those reported by state-of-the-art works. By using all of the images in the database, a verification rate of 96.5 percent was achieved at a False Acceptance Rate (FAR) of 0.1 percent. In the identification scenario, a rank-one accuracy of 98.4 percent was achieved. To the best of our knowledge, this is the highest rank-one score ever achieved for the FRGC v2 database when compared to results published in the literature.

The practice of clinical cytology relies on bright-field microscopy using absorption dyes like hematoxylin and eosin in the transmission mode, while the practice of research microscopy relies on fluorescence microscopy in the epi-illumination mode. The optical projection tomography microscope is an optical microscope that can generate 3-D images of single cells with isometric high resolution both in absorption and fluorescence mode. Although the depth of field of the microscope objective is in the submicron range, it can be extended by scanning the objective's focal plane. The extended depth of field image is similar to a projection in a conventional x-ray computed tomography. Cells suspended in optical gel flow through a custom-designed microcapillary. Multiple pseudoprojection images are taken by rotating the microcapillary. After these pseudoprojection images are further aligned, computed tomography methods are applied to create 3-D reconstruction. 3-D reconstructed images of single cells are shown in both absorption and fluorescence mode. Fluorescence spatial resolution is measured at 0.35 microm in both axial and lateral dimensions. Since fluorescence and absorption images are taken in two different rotations, mechanical error may cause misalignment of 3-D images. This mechanical error is estimated to be within the resolution of the system.

OBJECTIVE: Radio frequency ablation (RFA) can be used to treat liver cancer minimally invasively by depositing energy from the RF probe placed in the center of the tumor. The procedure relies on pre-operative imaging (typically MRI or CT) for the interventional planning and ultrasound (US) for intra-operative guidance during needle insertion. Visual presentation of co-registered pre- and intra-operative images would help to improve the navigation during the needle positioning phase. METHODS: In the present study, we compared six registration methods using different similarity metrics: two versions of the correlation ratio, bivariate correlation ratio, and conventional normalized mutual information and correlation coefficient. The accuracy, robustness and speed were assessed by computing rigid registrations between eight pairs of the MR and freehand 3D US datasets. RESULTS: The correlation ratio computed on the MR-gradient-norm and US images outperformed other similarity metrics in terms of robustness (40-82%) and demonstrated average accuracy (0.32 degrees , 0.69 mm) which is clinically acceptable for the RFA of liver cancer. CONCLUSIONS: We observed that the performance of all similarity metrics is largely dependent on the quality of the US images, sufficient field of view of the reconstructed 3D US and absence of motion artifacts.

PURPOSE: An important issue in computer-assisted surgery of the liver is a fast and reliable transfer of preoperative resection plans to the intraoperative situation. One problem is to match the planning data, derived from preoperative CT or MR images, with 3D ultrasound images of the liver, acquired during surgery. As the liver deforms significantly in the intraoperative situation non-rigid registration is necessary. This is a particularly challenging task because pre- and intraoperative image data stem from different modalities and ultrasound images are generally very noisy. METHODS: One way to overcome these problems is to incorporate prior knowledge into the registration process. We propose a method of combining anatomical landmark information with a fast non-parametric intensity registration approach. Mathematically, this leads to a constrained optimization problem. As distance measure we use the normalized gradient field which allows for multimodal image registration. RESULTS: A qualitative and quantitative validation on clinical liver data sets of three different patients has been performed. We used the distance of dense corresponding points on vessel center lines for quantitative validation. The combined landmark and intensity approach improves the mean and percentage of point distances above 3 mm compared to rigid and thin-plate spline registration based only on landmarks. CONCLUSION: The proposed algorithm offers the possibility to incorporate additional a priori knowledge-in terms of few landmarks-provided by a human expert into a non-rigid registration process.

PURPOSE: To measure and compare the clinical localization and registration errors in image-guided neurosurgery, with the purpose of revising current assumptions. MATERIALS AND METHODS: Twelve patients who underwent brain surgeries with a navigation system were randomly selected. A neurosurgeon localized and correlated the landmarks on preoperative MRI images and on the intraoperative physical anatomy with a tracked pointer. In the laboratory, we generated 612 scenarios in which one landmark pair was defined as the target and the remaining ones were used to compute the registration transformation. Four errors were measured:(1) fiducial localization error (FLE);(2) target registration error (TRE);(3) fiducial registration error (FRE);(4) Fitzpatrick's target registration error estimation (F-TRE). We compared the different errors and computed their correlation. RESULTS: The image and physical FLE ranges were 0.5-2.0 and 1.6-3.0 mm, respectively. The measured TRE, FRE and F-TRE were 4.1 +/- 1.6, 3.9 +/- 1.2, and 3.7 +/- 2.2 mm, respectively. Low correlations of 0.19 and 0.37 were observed between the FRE and TRE and between the F-TRE and the TRE, respectively. The differences of the FRE and F-TRE from the TRE were 1.3 +/- 1.0 mm (max = 5.5 mm) and 1.3 +/- 1.2 mm (max = 7.3 mm), respectively. CONCLUSION: Contrary to common belief, the FLE presents significant variations. Moreover, both the FRE and the F-TRE are poor indicators of the TRE in image-to-patient registration.

PURPOSE: We present a system which supports deformable image registration guided by a haptic device. METHODS: The haptic device is tied to a block matching method where a set of uniformly distributed control points determine the block positions. Each control point constitutes a particle in a mass spring grid which limits the space of allowed movements to elastic movements. Control points are manipulated by the haptic device, and the negative gradient of the similarity metric over the corresponding block is rendered as a force on the haptic device guiding the user to a minimum of the optimization landscape. Fast update of forces was achieved by exploiting the GPU for computations of the similarity metric and for interpolation of the deformation field. RESULTS: We show that haptic guided registration facilitates faster and improved registration compared to using a purely visual alignment in a user study on synthetic images. We also demonstrate feasibility of applying the system on medical images through a comparison with an automatic block matching algorithm. A radiologist performing registration with the haptic registration system posted faster registration times and better registration results than the automatic block matching algorithm when using identical grid and block sizes. CONCLUSIONS: Possible applications of the system are refinement of registration results from automatic registration methods and construction of initial state used in automatic deformable registration methods.

PURPOSE: Robust and accurate automated co-registration of the coronary arteries in 3D CTA and 2D X-ray angiography during percutaneous coronary interventions (PCI), in order to present a fused visualization. METHODS: A novel vesselness-based similarity measure was developed, that avoids an explicit segmentation of the X-ray image. A stochastic optimizer searches the optimal registration using the similarity measure. RESULTS: Both simulated data and clinical data were used to investigate the accuracy and capture range of the proposed method. The experiments show that the proposed method outperforms the iterative closest point method in terms of accuracy (average residual error of 0.42 mm vs. 1.44 mm) and capture range (average 71.1 mm/20.3 degrees vs. 14.1 mm/5.2 degrees ). CONCLUSION: The proposed method has proven to be accurate and the capture range is ample for usage in PCI. Especially the absence of an explicit segmentation of the interventionally acquired X-ray images considerably aids the robustness of the method.

PURPOSE: Thin-plate splines (TPS) represent an effective tool for estimating the deformation that warps one set of landmarks to another based on the physical equivalent of thin metal sheets. In the original formulation, data used to estimate the deformation field are restricted to landmark locations only and thus does not allow to incorporate information about the rotation of the image around the landmark. It furthermore assumes that landmark positions are known exactly which is not the case in real world applications. These localization inaccuracies are propagated to the entire deformation field as each landmark has a global influence. We propose to use a TPS approximation method that incorporates anisotropic landmark errors and rotational information and integrate it into a hierarchical elastic registration framework (HERA). The improvement of the registration performance has been evaluated. METHODS: The proposed TPS approximation scheme integrates anisotropic landmark errors with rotational information of the landmarks. The anisotropic landmark errors are represented by their covariance matrices estimated directly from the image data as a minimal stochastic localization error, i.e. the Cramér-Rao bound. The rotational attribute of each landmark is characterized by an additional angular landmark, thus doubling the number of landmarks in the TPS model. This allows the TPS approximation to better cope up with local deformations. RESULTS: We integrated the proposed TPS approach into the HERA registration framework and applied it to register 161 image pairs from a digital mammogram database. Experiments showed that the mean squared error using the proposed TPS approximation was superior to pure TPS interpolation. On artificially deformed breast images HERA, with the proposed TPS approximation, performed significantly better than the state-of-the-art registration method presented by Rueckert. CONCLUSION: The TPS approximation approach proposed in this publication allows to incorporate anisotropic landmark errors as well as rotational information. The integration of the method into an intensity-based hierarchical non-rigid registration framework is straightforward and improved the registration quality significantly.

In this paper, we propose a novel computational integral-imaging reconstruction (CIIR)-based three-dimensional (3-D) image correlator system for the recognition of 3-D volumetric objects by employing a 3-D reference object. That is, a number of plane object images (POIs) computationally reconstructed from the 3-D reference object are used for the 3-D volumetric target recognition. In other words, simultaneous 3-D image correlations between two sets of target and reference POIs, which are depth-dependently reconstructed by using the CIIR method, are performed for effective recognition of 3-D volumetric objects in the proposed system. Successful experiments with this CIIR-based 3-D image correlator confirmed the feasibility of the proposed method.