Search

Motion artefacts from involuntary changes in eye fixation remain a major imaging issue in optical coherence tomography (OCT). This paper reviews the state-of-the-art of retrospective procedures to correct retinal motion and axial eye motion artefacts in OCT imaging. Following an overview of motion induced artefacts and correction strategies, a chronological survey of retrospective approaches since the introduction of OCT until the current days is presented. Pre-processing, registration, and validation techniques are described. The review finishes by discussing the limitations of the current techniques and the challenges to be tackled in future developments. [ABSTRACT FROM AUTHOR]

Image registration is an important task in medical image analysis. Whereas most methods are designed for the registration of two images (pairwise registration), there is an increasing interest in simultaneously aligning more than two images using groupwise registration. Multimodal registration in a groupwise setting remains difficult, due to the lack of generally applicable similarity metrics. In this work, a novel similarity metric for such groupwise registration problems is proposed. The metric calculates the sum of the conditional entropy between each image in the group and a representative template image constructed iteratively using principal component analysis. The proposed metric is validated in extensive experiments on synthetic and intrasubject clinical image data. These experiments showed equivalent or improved registration accuracy compared to other state-of-the-art (dis)similarity metrics and improved transformation consistency compared to pairwise mutual information. [ABSTRACT FROM AUTHOR]

B-splines are commonly utilized to construct the transformation model in free-form deformation (FFD) based registration. B-splines become smoother with increasing spline order. However, a higher-order B-spline requires a larger support region involving more control points, which means higher computational cost. In general, the third-order B-spline is considered as a good compromise between spline smoothness and computational cost. A lower-order function is seldom used to construct the transformation model for registration since it is less smooth. In this research, we investigated whether lower-order B-spline functions can be utilized for more efficient registration, while preserving smoothness of the deformation by using a novel random perturbation technique. With the proposed perturbation technique, the expected value of the cost function given probability density function (PDF) of the perturbation is minimized by a stochastic gradient descent optimization. Extensive experiments on 2D synthetically deformed brain images, and real 3D lung and brain scans demonstrated that the novel randomly perturbed free-form deformation (RPFFD) approach improves the registration accuracy and transformation smoothness. Meanwhile, lower-order RPFFD methods reduce the computational cost substantially. [ABSTRACT FROM AUTHOR]

Purpose In CT-guided liver tumor ablation interventions, registration of a preoperative contrast-enhanced CT image to the intraoperative CT image is hypothesized to improve guidance. This is a highly challenging registration task due to differences in patient poses and large deformations, and therefore high registration errors are expected. In this study, our objective is to develop a method that enables users to locally improve the registration where the registration fails, with minimal user interaction. Methods The method is based on a conventional nonrigid intensity-based registration framework, extended with a novel point-to-surface penalty. The point-to-surface penalty serves to improve the alignment of the liver boundary, while requiring minimal user interaction during the intervention: annotating some points on the liver surface at those regions where the conventional registration seems inaccurate. Results The method is evaluated on 18 clinical datasets. It improves registration accuracy compared with the conventional nonrigid registration in terms of average surface distance (from 2.75 to 2.05 mm) and target registration error (from 6.92 to 5.8 mm). Conclusions In this study, we introduce a semiautomated registration algorithm that improves the accuracy of image registration. [ABSTRACT FROM AUTHOR]

Background: To evaluate the influence of image registration on apparent diffusion coefficient (ADC) images obtained from abdominal free-breathing diffusion-weighted MR images (DW-MRIs). Methods: A comprehensive pipeline based on automatic three-dimensional nonrigid image registrations is developed to compensate for misalignments in DW-MRI datasets obtained from five healthy subjects scanned twice. Motion is corrected both within each image and between images in a time series. ADC distributions are compared with and without registration in two abdominal volumes of interest (VOIs). The effects of interpolations and Gaussian blurring as alternative strategies to reduce motion artifacts are also investigated. Results: Among the four considered scenarios (no processing, interpolation, blurring and registration), registration yields the best alignment scores. Median ADCs vary according to the chosen scenario: for the considered datasets, ADCs obtained without processing are 30% higher than with registration. Registration improves voxelwise reproducibility at least by a factor of 2 and decreases uncertainty (Fréchet-Cramér-Rao lower bound). Registration provides similar improvements in reproducibility and uncertainty as acquiring four times more data. Conclusion: Patient motion during image acquisition leads to misaligned DW-MRIs and inaccurate ADCs, which can be addressed using automatic registration. [ABSTRACT FROM AUTHOR]

Purpose: To introduce a semiautomatic algorithm to perform the registration of free-hand B-Mode ultrasound (US) and magnetic resonance imaging (MRI) of the carotid artery. Methods: The authors' approach combines geometrical features and intensity information. The only user interaction consists of placing three seed points in US and MRI. First, the lumen centerlines are used as landmarks for point based registration. Subsequently, in a joint optimization the distance between centerlines and the dissimilarity of the image intensities is minimized. Evaluation is performed in left and right carotids from six healthy volunteers and five patients with atherosclerosis. For the validation, the authors measure the Dice similarity coefficient (DSC) and the mean surface distance (MSD) between carotid lumen segmentations in US and MRI after registration. The effect of several design parameters on the registration accuracy is investigated by an exhaustive search on a training set of five volunteers and three patients. The optimum configuration is validated on the remaining images of one volunteer and two patients. Results: On the training set, the authors achieve an average DSC of 0.74 and a MSD of 0.66 mm on volunteer data. For the patient data, the authors obtain a DSC of 0.77 and a MSD of 0.69 mm. In the independent set composed of patient and volunteer data, the DSC is 0.69 and the MSD is 0.87 mm. The experiments with different design parameters show that nonrigid registration outperforms rigid registration, and that the combination of intensity and point information is superior to approaches that use intensity or points only. Conclusions: The proposed method achieves an accurate registration of US and MRI, and may thus enable multimodal analysis of the carotid plaque. [ABSTRACT FROM AUTHOR]

Nonrigid image registration is an important, but time-consuming task in medical image analysis. In typical neuroimaging studies, multiple image registrations are performed, i.e., for atlas-based segmentation or template construction. Faster image registration routines would therefore be beneficial. In this paper we explore acceleration of the image registration package elastix by a combination of several techniques: (i) parallelization on the CPU, to speed up the cost function derivative calculation; (ii) parallelization on the GPU building on and extending the OpenCL framework from ITKv4, to speed up the Gaussian pyramid computation and the image resampling step; (iii) exploitation of certain properties of the B-spline transformation model; (iv) further software optimizations. The accelerated registration tool is employed in a study on diagnostic classification of Alzheimer's disease and cognitively normal controls based on T1-weighted MRI. We selected 299 participants from the publicly available Alzheimer's Disease Neuroimaging Initiative database. Classification is performed with a support vector machine based on gray matter volumes as a marker for atrophy. We evaluated two types of strategies (voxel-wise and region-wise) that heavily rely on nonrigid image registration. Parallelization and optimization resulted in an acceleration factor of 4-5x on an 8-core machine. Using OpenCL a speedup factor of 2 was realized for computation of the Gaussian pyramids, and 15-60 for the resampling step, for larger images. The voxel-wise and the region-wise classification methods had an area under the receiver operator characteristic curve of 88 and 90%, respectively, both for standard and accelerated registration. We conclude that the image registration package elastix was substantially accelerated, with nearly identical results to the non-optimized version. The new functionality will become available in the next release of elastix as open source under the BSD license. [ABSTRACT FROM AUTHOR]

Multiresolution strategies are commonly used in the nonrigid registration to avoid local minima in the optimization space. Generally, a step-by-step hierarchical approach is adopted, in which the registration starts on a level with reduced complexity (downsampled images, global transformations), then continuing to levels with increased complexity, until the finest level is reached. In this paper, we propose two alternative multiresolution strategies for both the data and transformation models, in which different resolution levels are considered simultaneously instead of subsequently. Through combining the different strategies for data and transformation, we systematically define 3\,\times\,3 multiresolution schemes, including both existing and novel methods. Experiments on 10 pairs of computed tomography lung data sets showed that the best performing strategy resulted in a reduction of the upper quartile of the mean target registration error from 2 to 1.5 mm, compared with the conventionally hierarchical multiresolution method, while achieving smoother deformations. Experiments with intersubject registration of 18 3D T1-weighted MRI brain scans confirmed that simultaneous multiresolution strategies produce more accurate registration results (median of mean overlap increased from 0.55 to 0.57) and smoother deformation fields than the traditionally hierarchical method. Evaluation of robustness indicated that the largest differences in accuracy between methods are observed for structures with a relatively large initial misalignment. [ABSTRACT FROM AUTHOR]

Accurate automated brain structure segmentation methods facilitate the analysis of large-scale neuroimaging studies. This work describes a novel method for brain structure segmentation in magnetic resonance images that combines information about a structure's location and appearance. The spatial model is implemented by registering multiple atlas images to the target image and creating a spatial probability map. The structure's appearance is modeled by a classifier based on Gaussian scale-space features. These components are combined with a regularization term in a Bayesian framework that is globally optimized using graph cuts. The incorporation of the appearance model enables the method to segment structures with complex intensity distributions and increases its robustness against errors in the spatial model. The method is tested in cross-validation experiments on two datasets acquired with different magnetic resonance sequences, in which the hippocampus and cerebellum were segmented by an expert. Furthermore, the method is compared to two other segmentation techniques that were applied to the same data. Results show that the atlas- and appearance-based method produces accurate results with mean Dice similarity indices of 0.95 for the cerebellum, and 0.87 for the hippocampus. This was comparable to or better than the other methods, whereas the proposed technique is more widely applicable and robust. [ABSTRACT FROM PUBLISHER]

Medical image registration is an important task in medical image processing. It refers to the process of aligning data sets, possibly from different modalities (e.g., magnetic resonance and computed tomography), different time points (e.g., follow-up scans), and/or different subjects (in case of population studies). A large number of methods for image registration are described in the literature. Unfortunately, there is not one method that works for all applications. We have therefore developed elastix, a publicly available computer program for intensity-based medical image registration. The software consists of a collection of algorithms that are commonly used to solve medical image registration problems. The modular design of elastix allows the user to quickly configure, test, and compare different registration methods for a specific application. The command-line interface enables automated processing of large numbers of data sets, by means of scripting. The usage of elastix for comparing different registration methods is illustrated with three example experiments, in which individual components of the registration method are varied. [ABSTRACT FROM AUTHOR]

A retrospective view on the past two decades of the field of medical image registration is presented, guided by the article “A survey of medical image registration” (Maintz and Viergever, 1998). It shows that the classification of the field introduced in that article is still usable, although some modifications to do justice to advances in the field would be due. The main changes over the last twenty years are the shift from extrinsic to intrinsic registration, the primacy of intensity-based registration, the breakthrough of nonlinear registration, the progress of inter-subject registration, and the availability of generic image registration software packages. Two problems that were called urgent already 20 years ago, are even more urgent nowadays: Validation of registration methods, and translation of results of image registration research to clinical practice. It may be concluded that the field of medical image registration has evolved, but still is in need of further development in various aspects. [ABSTRACT FROM AUTHOR]

Deformable image registration is an essential component of medical image analysis and plays an irreplaceable role in clinical practice. In recent years, deep learning-based registration methods have demonstrated significant improvements in convenience, robustness and execution time compared to traditional algorithms. However, registering images with large displacements, such as those of the liver organ, remains underexplored and challenging. In this study, we present a novel convolutional neural network (CNN)-based unsupervised learning registration method, Cascaded Multi-scale Spatial-Channel Attention-guided Network (CMAN), which addresses the challenge of large deformation fields using a double coarse-to-fine registration approach. The main contributions of CMAN include: (i) local coarse-to-fine registration in the base network, which generates the displacement field for each resolution and progressively propagates these local deformations as auxiliary information for the final deformation field; (ii) global coarse-to-fine registration, which stacks multiple base networks for sequential warping, thereby incorporating richer multi-layer contextual details into the final deformation field; (iii) integration of the spatial-channel attention module in the decoder stage, which better highlights important features and improves the quality of feature maps. The proposed network was trained using two public datasets and evaluated on another public dataset as well as a private dataset across several experimental scenarios. We compared CMAN with four state-of-the-art CNN-based registration methods and two well-known traditional algorithms. The results show that the proposed double coarse-to-fine registration strategy outperforms other methods in most registration evaluation metrics. In conclusion, CMAN can effectively handle the large-deformation registration problem and show potential for application in clinical practice. The source code is made publicly available at https://github.com/LocPham263/CMAN.git. • CMAN is designed to address the large deformation field between liver CT images using a double coarse-to-fine registration approach. • The spatial-channel attention module in the decoder stage highlights key features and enhances feature map quality at every resolution. • The study used both public and private liver datasets divided into four types of CT images, each tagged with a specific deformation level. • The proposed method was thoroughly assessed against well-known registration techniques and achieved promising results. [ABSTRACT FROM AUTHOR]

Abstract: Anatomical alignment in neuroimaging studies is of such importance that considerable effort is put into improving the registration used to establish spatial correspondence. Tract-based spatial statistics (TBSS) is a popular method for comparing diffusion characteristics across subjects. TBSS establishes spatial correspondence using a combination of nonlinear registration and a “skeleton projection” that may break topological consistency of the transformed brain images. We therefore investigated feasibility of replacing the two-stage registration-projection procedure in TBSS with a single, regularized, high-dimensional registration. To optimize registration parameters and to evaluate registration performance in diffusion MRI, we designed an evaluation framework that uses native space probabilistic tractography for 23 white matter tracts, and quantifies tract similarity across subjects in standard space. We optimized parameters for two registration algorithms on two diffusion datasets of different quality. We investigated reproducibility of the evaluation framework, and of the optimized registration algorithms. Next, we compared registration performance of the regularized registration methods and TBSS. Finally, feasibility and effect of incorporating the improved registration in TBSS were evaluated in an example study. The evaluation framework was highly reproducible for both algorithms (R2 0.993; 0.931). The optimal registration parameters depended on the quality of the dataset in a graded and predictable manner. At optimal parameters, both algorithms outperformed the registration of TBSS, showing feasibility of adopting such approaches in TBSS. This was further confirmed in the example experiment. [Copyright &y& Elsevier]

Abstract: Tagged magnetic resonance imaging (tMRI) is a well-known noninvasive method for studying regional heart dynamics. It offers great potential for quantitative analysis of a variety of kine(ma)tic parameters, but its clinical use has so far been limited, in part due to the lack of robustness and accuracy of existing tag tracking algorithms in dealing with low (and intrinsically time-varying) image quality. In this paper, we evaluate the performance of four frequently used concepts found in the literature (optical flow, harmonic phase (HARP) magnetic resonance imaging, active contour fitting, and non-rigid image registration) for cardiac motion analysis in 2D tMRI image sequences, using both synthetic image data (with ground truth) and real data from preclinical (small animal) and clinical (human) studies. In addition we propose a new probabilistic method for tag tracking that serves as a complementary step to existing methods. The new method is based on a Bayesian estimation framework, implemented by means of reversible jump Markov chain Monte Carlo (MCMC) methods, and combines information about the heart dynamics, the imaging process, and tag appearance. The experimental results demonstrate that the new method improves the performance of even the best of the four previous methods. Yielding higher consistency, accuracy, and intrinsic tag reliability assessment, the proposed method allows for improved analysis of cardiac motion. [Copyright &y& Elsevier]

Image registration is typically formulated as an optimization process, which aims to find the optimal transformation parameters of a given transformation model by minimizing a cost function. Local minima may exist in the optimization landscape, which could hamper the optimization process. To eliminate local minima, smoothing the cost function would be desirable. In this paper, we investigate the use of a randomized smoothing (RS) technique for stochastic gradient descent (SGD) optimization, to effectively smooth the cost function. In this approach, Gaussian noise is added to the transformation parameters prior to computing the cost function gradient in each iteration of the SGD optimizer. The approach is suitable for both rigid and nonrigid registrations. Experiments on synthetic images, cell images, public CT lung data, and public MR brain data demonstrate the effectiveness of the novel RS technique in terms of registration accuracy and robustness. [ABSTRACT FROM AUTHOR]

Abstract: An accurate spatial relationship between 3D in-vivo carotid plaque and lumen imaging and histological cross sections is required to study the relationship between biomechanical parameters and atherosclerotic plaque components. We present and evaluate a fully three-dimensional approach for this registration problem, which accounts for deformations that occur during the processing of the specimens. By using additional imaging steps during tissue processing and semi-automated non-linear registration techniques, a 3D-reconstruction of the histology is obtained. The methodology was evaluated on five specimens obtained from patients, operated for severe atherosclerosis in the carotid bifurcation. In more than 80% of the histology slices, the quality of the semi-automated registration with computed tomography angiography (CTA) was equal to or better than the manual registration. The inter-observer variability was between one and two in-vivo CT voxels and was equal to the manual inter-observer variability. Our technique showed that the angles between the normals of the registered histology slices and the in-vivo CTA scan direction ranged 6–56°, indicating that proper 3D-registration is crucial for establishing a correct spatial relation with in-vivo imaging modalities. This new 3D-reconstruction technique of atherosclerotic plaque tissue opens new avenues in the field of biomechanics as well as in the field of image processing, where it can be used for validation purposes of segmentation algorithms. [ABSTRACT FROM AUTHOR]