Search

Computational cardiology is the scientific field devoted to the development of methodologies that enhance our mechanistic understanding, diagnosis and treatment of cardiovascular disease. In this regard, the field embraces the extraordinary pace of discovery in imaging, computational modeling, and cardiovascular informatics at the intersection of atherogenesis and vascular biology. This paper highlights existing methods, practices, and computational models and proposes new strategies to support a multidisciplinary effort in this space. We focus on the means by that to leverage and coalesce these multiple disciplines to advance translational science and computational cardiology. Analyzing the scientific trends and understanding the current needs we present our perspective for the future of cardiovascular treatment. [ABSTRACT FROM AUTHOR]

In this paper, we formulate a recently proposed qualitative imaging approach named near-field orthogonality sampling method (NOSM) for a general measurement configuration. In the very first version, the NOSM was basically a backpropagation method, which analytically transforms the scattered fields, which is obtained with some specific multiview–multistatic measurement configurations (circular or linear), to reduced scattered electric fields on the sampling domain, which encapsulates the targets. The contributions of this paper are: 1) physical meaning of the reduced scattered field of the NOSM is explained by showing how it approximates the contrast source values in the sampling domain for different generic and limited aperture configurations; 2) the application of the NOSM is generalized to a generic configuration and some comments are made how to reduce the computational complexity and source requirements; 3) the reciprocity of the data is accounted for to improve the performance for limited aperture measurement scenarios; and 4) finally, a useful modified indicator is obtained by relying on the physical meaning of the indicator. The accuracy and stability of the proposed formulations are corroborated with numerical examples for which the excitation-measurement configuration is of limited aperture. [ABSTRACT FROM AUTHOR]

Ultrasound techniques for flow investigation have been extensively developed for several years. Many methods have reached a level of maturity that allows widespread and still growing clinical use. Recently, new exciting developments have been introduced by the combination of Doppler techniques with advanced (e.g. plane wave) imaging methods. Therefore, a comprehensive review of the current state-of-the-art ultrasound methods applied to flow measurement and imaging becomes relevant. [ABSTRACT FROM AUTHOR]

Machine learning has been widely used in medical image analysis under an assumption that the training and test data are under the same feature distributions. However, medical images from difference devices or the same device with different parameter settings are often contaminated with different amount and types of noises, which violate the above assumption. Therefore, the models trained using data from one device or setting often fail to work for that from another. Moreover, it is very expensive and tedious to label data and re-train models for all different devices or settings. To overcome this noise adaptation issue, it is necessary to leverage on the models trained with data from one device or setting for new data. In this paper, we reformulate this noise adaptation task as an image-to-image translation task such that the noise patterns from the test data are modified to be similar to those from the training data while the contents of the data are unchanged. In this paper, we propose a novel Noise Adaptation Generative Adversarial Network (NAGAN), which contains a generator and two discriminators. The generator aims to map the data from source domain to target domain. Among the two discriminators, one discriminator enforces the generated images to have the same noise patterns as those from the target domain, and the second discriminator enforces the content to be preserved in the generated images. We apply the proposed NAGAN on both optical coherence tomography (OCT) images and ultrasound images. Results show that the method is able to translate the noise style. In addition, we also evaluate our proposed method with segmentation task in OCT and classification task in ultrasound. The experimental results show that the proposed NAGAN improves the analysis outcome. [ABSTRACT FROM AUTHOR]

Ultrasound techniques for flow investigation have been extensively developed for several years. Many methods have reached a level of maturity that allows widespread and still growing clinical use. Recently, new exciting developments have been introduced by the combination of Doppler techniques with advanced (e.g. plane wave) imaging methods. Therefore, a comprehensive review of the current state-of-the-art ultrasound methods applied to flow measurement and imaging becomes relevant. [ABSTRACT FROM AUTHOR]

Atlas-based segmentation is used in radiotherapy planning to accelerate the delineation of organs at risk (OARs). Atlas selection has been proposed to improve the performance of segmentation, assuming that the more similar the atlas is to the patient, the better the result. It follows that the larger the database of atlases from which to select, the better the results should be. This paper seeks to estimate a clinically achievable expected performance under this assumption. Assuming a perfect atlas selection, an extreme value theory has been applied to estimate the accuracy of single-atlas and multi-atlas segmentation given a large database of atlases. For this purpose, clinical contours of most common OARs on computed tomography of the head and neck (${N}=\textsf {316}$) and thoracic (${N}=\textsf {280}$) cases were used. This paper found that while for most organs, perfect segmentation cannot be reasonably expected, auto-contouring performance of a level corresponding to clinical quality could be consistently expected given a database of 5000 atlases under the assumption of perfect atlas selection. [ABSTRACT FROM AUTHOR]

The article discusses various reports published within the issue, including one regarding Biomedical Robotics and Biomechatronics, one on Neuroengineering and Neuroprostheses, and regarding Emerging Technologies in Multi-Parameter Biomedical Optical Imaging and Image Analysis.

We have developed a method that allows manufacturing of 18F radioactive printed sources using a standard ink-jet printer. Although previously used in printing and imaging single gamma emitter sources, such techniques have not been, to our knowledge, applied to the manufacturing of positron emitting sources. The added complication in the latter instance is a nonzero positron range and, thus, the need for some attenuating material surrounding the positron emitting atoms. The point sources were first imaged on a phosphor imager and then scanned on three different tomographs (Siemens/CTI ECAT 953B, CPS high-resolution reserach tomograph (HRRT) and Concorde microPET R4) to measure their point spread functions (PSFs). Where appropriate, the resolution agrees with published values. A comparison of the full width and tenth width half maxima of the point source profiles obtained with and without additional attenuating material showed no effect of the additional attenuation material on their values. The presence of the attenuating material however increased the number of counts in the point source image several fold due to a larger fraction of the positrons annihilating in the region close to the printed source. The results show that printed sources either on paper alone or on paper sandwiched between some additional attenuating material provide a practical means to obtain positron emitting sources. [ABSTRACT FROM AUTHOR]

Deep neural networks have been tremendously successful at segmenting objects in images. However, it has been shown they still have limitations on challenging problems such as the segmentation of medical images. The main reason behind this lower success resides in the reduced size of the object in the image. In this paper we overcome this limitation through a cyclic collaborative framework, CyCoSeg. The proposed framework is based on a deep active shape model (D-ASM), which provides prior information about the shape of the object, and a semantic segmentation network (SSN). These two models collaborate to reach the desired segmentation by influencing each other: SSN helps D-ASM identify relevant keypoints in the image through an Expectation Maximization formulation, while D-ASM provides a segmentation proposal that guides the SSN. This cycle is repeated until both models converge. Extensive experimental evaluation shows CyCoSeg boosts the performance of the baseline models, including several popular SSNs, while avoiding major architectural modifications. The effectiveness of our method is demonstrated on the left ventricle segmentation on two benchmark datasets, where our approach achieves one of the most competitive results in segmentation accuracy. Furthermore, its generalization is demonstrated for lungs and kidneys segmentation in CT scans. [ABSTRACT FROM AUTHOR]

The task of finding a sparse signal decomposition in an overcomplete dictionary is made more complicated when the signal undergoes an unknown modulation (or convolution in the complementary Fourier domain). Such simultaneous sparse recovery and blind demodulation problems appear in many applications including medical imaging, super resolution, self-calibration, etc. In this paper, we consider a more general sparse recovery and blind demodulation problem in which each atom comprising the signal undergoes a distinct modulation process. Under the assumption that the modulating waveforms live in a known common subspace, we employ the lifting technique and recast this problem as the recovery of a column-wise sparse matrix from structured linear measurements. In this framework, we accomplish sparse recovery and blind demodulation simultaneously by minimizing the induced atomic norm, which in this problem corresponds to the block $\ell _{1}$ norm minimization. For perfect recovery in the noiseless case, we derive near optimal sample complexity bounds for Gaussian and random Fourier overcomplete dictionaries. We also provide bounds on recovering the column-wise sparse matrix in the noisy case. Numerical simulations illustrate and support our theoretical results. [ABSTRACT FROM AUTHOR]

Recent works show that generative adversarial networks (GANs) can be successfully applied to image synthesis and semi-supervised learning, where, given a small labeled database and a large unlabeled database, the goal is to train a powerful classifier. In this paper, we trained a retinal image synthesizer and a semi-supervised learning method for automatic glaucoma assessment using an adversarial model on a small glaucoma-labeled database and a large unlabeled database. Various studies have shown that glaucoma can be monitored by analyzing the optic disc and its surroundings, and for that reason, the images used in this paper were automatically cropped around the optic disc. The novelty of this paper is to propose a new retinal image synthesizer and a semi-supervised learning method for glaucoma assessment based on the deep convolutional GANs. In addition, and to the best of our knowledge, this system is trained on an unprecedented number of publicly available images (86926 images). This system, hence, is not only able to generate images synthetically but to provide labels automatically. Synthetic images were qualitatively evaluated using t-SNE plots of features associated with the images and their anatomical consistency was estimated by measuring the proportion of pixels corresponding to the anatomical structures around the optic disc. The resulting image synthesizer is able to generate realistic (cropped) retinal images, and subsequently, the glaucoma classifier is able to classify them into glaucomatous and normal with high accuracy (AUC = 0.9017). The obtained retinal image synthesizer and the glaucoma classifier could then be used to generate an unlimited number of cropped retinal images with glaucoma labels. [ABSTRACT FROM AUTHOR]

Many new clinical investigations of microwave breast imaging have been published in recent years. Trials with over one hundred participants have indicated the potential of microwave imaging to detect breast cancer, with particularly encouraging sensitivity results reported from women with dense breasts. The next phase of clinical trials will involve larger and more diverse populations, including women with no breast abnormalities or benign breast diseases. These trials will need to address clinical efficacy in terms of sensitivity and specificity. A number of challenges exist when using microwave imaging with broad populations: 1) addressing the substantial variance in breast composition observed in the population and 2) achieving high specificity given differences between individuals. This paper analyses these challenges using a diverse phantom set which models the variance in breast composition and tumor shape and size seen in the population. The data show that the sensitivity of microwave breast imaging in breasts of differing density can suffer if patient-specific beamforming is not used. Moreover, the results suggest that achieving high specificity in dense breasts may be difficult, but that patient-specific beamforming does not adversely affect the expected specificity. In summary, this paper finds that patient-specific beamforming has a tangible impact on expected sensitivity in experimental cases and that achieving high specificity in dense breasts may be challenging. [ABSTRACT FROM AUTHOR]

Data, which lie in the space \mathcal Pm\, , of $m \times m$ symmetric positive definite matrices, (sometimes called tensor data), play a fundamental role in applications, including medical imaging, computer vision, and radar signal processing. An open challenge, for these applications, is to find a class of probability distributions, which is able to capture the statistical properties of data in \mathcal Pm\, , as they arise in real-world situations. The present paper meets this challenge by introducing Riemannian Gaussian distributions on \mathcal Pm\, . Distributions of this kind were first considered by Pennec in 2006. However, the present paper gives an exact expression of their probability density function for the first time in existing literature. This leads to two original contributions. First, a detailed study of statistical inference for Riemannian Gaussian distributions, uncovering the connection between the maximum likelihood estimation and the concept of Riemannian centre of mass, widely used in applications. Second, the derivation and the implementation of an expectation-maximisation algorithm, for the estimation of mixtures of Riemannian Gaussian distributions. The paper applies this new algorithm, to the classification of data in \mathcal Pm\, , (concretely, to the problem of texture classification, in computer vision), showing that it yields significantly better performance, in comparison to recent approaches. [ABSTRACT FROM PUBLISHER]

The papers in this special issue focus on the topic of Big Data. This is a second in a series of papers on the topic of Big Data. This first part in this series (IEEE Proceedings, January 2016) consist of papers that are devoted to the theoretical aspects of big data. This second in a two-part series focuses on the practical applications of Big Data. [ABSTRACT FROM PUBLISHER]

In this paper, we propose a microwave imaging technique that involves an adaptive back-projection (BP) algorithm based on a climb method. In general, the range migration algorithm (RMA) provides high computational efficiency and high accuracy for synthetic aperture radar (SAR) imaging. However, RMA involves wavenumber domain interpolation, which may adversely affect the accuracy of the target imaging. The BP algorithm, which has its origins in medical imaging techniques, has been studied to overcome this problem in SAR imaging, because it avoids interpolation associated with domain conversion, but it also has a huge computational cost. Therefore, this paper proposes adaptive processing based on a climb method to find the target indicator as real target responses. The real target responses are predetermined and the raw data are reproduced to reduce the computational cost and to improve the image quality. Finally, the superiority of proposed algorithm is demonstrated using both the simulated and experimental data. [ABSTRACT FROM AUTHOR]

Although deep networks have been shown to perform very well on a variety of medical imaging tasks, inference in the presence of pathology presents several challenges to common models. These challenges impede the integration of deep learning models into real clinical workflows, where the customary process of cascading deterministic outputs from a sequence of image-based inference steps (e.g. registration, segmentation) generally leads to an accumulation of errors that impacts the accuracy of downstream inference tasks. In this paper, we propose that by embedding uncertainty estimates across cascaded inference tasks, performance on the downstream inference tasks should be improved. We demonstrate the effectiveness of the proposed approach in three different clinical contexts: (i) We demonstrate that by propagating T2 weighted lesion segmentation results and their associated uncertainties, subsequent T2 lesion detection performance is improved when evaluated on a proprietary large-scale, multi-site, clinical trial dataset acquired from patients with Multiple Sclerosis. (ii) We show an improvement in brain tumour segmentation performance when the uncertainty map associated with a synthesised missing MR volume is provided as an additional input to a follow-up brain tumour segmentation network, when evaluated on the publicly available BraTS-2018 dataset. (iii) We show that by propagating uncertainties from a voxel-level hippocampus segmentation task, the subsequent regression of the Alzheimer’s disease clinical score is improved. [ABSTRACT FROM AUTHOR]

Nonnegative matrix factorization (NMF) has been successfully applied in several data mining tasks. Recently, there is an increasing interest in the acceleration of NMF, due to its high cost on large matrices. On the other hand, the privacy issue of NMF over federated data is worthy of attention, since NMF is prevalently applied in image and text analysis which may involve leveraging privacy data (e.g, medical image and record) across several parties (e.g., hospitals). In this paper, we study the acceleration and security problems of distributed NMF. First, we propose a distributed sketched alternating nonnegative least squares(DSANLS) framework for NMF, which utilizes a matrix sketching technique to reduce the size of nonnegative least squares subproblems with a convergence guarantee. For the second problem, we show that DSANLS with modification can be adapted to the security setting, but only for one or limited iterations. Consequently, we propose four efficient distributed NMF methods in both synchronous and asynchronous settings with a security guarantee. We conduct extensive experiments on several real datasets to show the superiority of our proposed methods. The implementation of our methods is available at https://github.com/qianyuqiu79/DSANLS. [ABSTRACT FROM AUTHOR]

Multimodal medical image fusion can combine salient information from different source images of the same part and reduce the redundancy of information. In this paper, an efficient hybrid image decomposition (HID) method is proposed. It combines the advantages of spatial domain and transform domain methods and breaks through the limitations of the algorithms based on single category features. The accurate separation of base layer and texture details is conducive to the better effect of the fusion rules. First, the source anatomical images are decomposed into a series of high frequencies and a low frequency via nonsubsampled shearlet transform (NSST). Second, the low frequency is further decomposed using the designed optimization model based on structural similarity and structure tensor to get an energy texture layer and a base layer. Then, the modified choosing maximum (MCM) is designed to fuse base layers. The sum of modified Laplacian (SML) is used to fuse high frequencies and energy texture layers. Finally, the fused low frequency can be obtained by adding fused energy texture layer and base layer. And the fused image is reconstructed by the inverse NSST. The superiority of the proposed method is verified by amounts of experiments on 50 pairs of magnetic resonance imaging (MRI) images and computed tomography (CT) images and others, and compared with 12 state-of-the-art medical image fusion methods. It is demonstrated that the proposed hybrid decomposition model has a better ability to extract texture information than conventional ones. [ABSTRACT FROM AUTHOR]

Digital topology and geometry refers to the use of topologic and geometric properties and features for images defined in digital grids. Such methods have been widely used in many medical imaging applications, including image segmentation, visualization, manipulation, interpolation, registration, surface-tracking, object representation, correction, quantitative morphometry etc. Digital topology and geometry play important roles in medical imaging research by enriching the scope of target outcomes and by adding strong theoretical foundations with enhanced stability, fidelity, and efficiency. This paper presents a comprehensive yet compact survey on results, principles, and insights of methods related to digital topology and geometry with strong emphasis on understanding their roles in various medical imaging applications. Specifically, this paper reviews methods related to distance analysis and path propagation, connectivity, surface-tracking, image segmentation, boundary and centerline detection, topology preservation and local topological properties, skeletonization, and object representation, correction, and quantitative morphometry. A common thread among the topics reviewed in this paper is that their theory and algorithms use the principle of digital path connectivity, path propagation, and neighborhood analysis. [ABSTRACT FROM AUTHOR]

This paper presents a new method for selecting a patient specific forward model to compensate for anatomical variations in electrical impedance tomography (EIT) monitoring of neonates. The method uses a combination of shape sensors and absolute reconstruction. It takes advantage of a probabilistic approach which automatically selects the best estimated forward model fit from pre-stored library models. Absolute/static image reconstruction is performed as the core of the posterior probability calculations. The validity and reliability of the algorithm in detecting a suitable model in the presence of measurement noise is studied with simulated and measured data from 11 patients. The paper also demonstrates the potential improvements on the clinical parameters extracted from EIT images by considering a unique case study with a neonate patient undergoing computed tomography imaging as clinical indication prior to EIT monitoring. Two well-known image reconstruction techniques, namely GREIT and tSVD, are implemented to create the final tidal images. The impacts of appropriate model selection on the clinical extracted parameters such as center of ventilation and silent spaces are investigated. The results show significant improvements to the final reconstructed images and more importantly to the clinical EIT parameters extracted from the images that are crucial for decision-making and further interventions. [ABSTRACT FROM AUTHOR]

Adequate medical images are often indispensable in contemporary deep learning-based medical imaging studies, although the acquisition of certain image modalities may be limited due to several issues including high costs and patients issues. However, thanks to recent advances in deep learning techniques, the above tough problem can be substantially alleviated by medical images synthesis, by which various modalities including T1/T2/DTI MRI images, PET images, cardiac ultrasound images, retinal images, and so on, have already been synthesized. Unfortunately, the arterial spin labeling (ASL) image, which is an important fMRI indicator in dementia diseases diagnosis nowadays, has never been comprehensively investigated for the synthesis purpose yet. In this paper, ASL images have been successfully synthesized from structural magnetic resonance images for the first time. Technically, a novel unbalanced deep discriminant learning-based model equipped with new ResNet sub-structures is proposed to realize the synthesis of ASL images from structural magnetic resonance images. The extensive experiments have been conducted. Comprehensive statistical analyses reveal that: 1) this newly introduced model is capable to synthesize ASL images that are similar towards real ones acquired by actual scanning; 2) synthesized ASL images obtained by the new model have demonstrated outstanding performance when undergoing rigorous tests of region-based and voxel-based corrections of partial volume effects, which are essential in ASL images processing; and 3) it is also promising that the diagnosis performance of dementia diseases can be significantly improved with the help of synthesized ASL images obtained by the new model, based on a multi-modal MRI dataset containing 355 demented patients in this paper. [ABSTRACT FROM AUTHOR]

We present VoxelMorph, a fast learning-based framework for deformable, pairwise medical image registration. Traditional registration methods optimize an objective function for each pair of images, which can be time-consuming for large datasets or rich deformation models. In contrast to this approach and building on recent learning-based methods, we formulate registration as a function that maps an input image pair to a deformation field that aligns these images. We parameterize the function via a convolutional neural network and optimize the parameters of the neural network on a set of images. Given a new pair of scans, VoxelMorph rapidly computes a deformation field by directly evaluating the function. In this paper, we explore two different training strategies. In the first (unsupervised) setting, we train the model to maximize standard image matching objective functions that are based on the image intensities. In the second setting, we leverage auxiliary segmentations available in the training data. We demonstrate that the unsupervised model’s accuracy is comparable to the state-of-the-art methods while operating orders of magnitude faster. We also show that VoxelMorph trained with auxiliary data improves registration accuracy at test time and evaluate the effect of training set size on registration. Our method promises to speed up medical image analysis and processing pipelines while facilitating novel directions in learning-based registration and its applications. Our code is freely available at https://github.com/voxelmorph/voxelmorph. [ABSTRACT FROM AUTHOR]

The effect of Brownian motion on maneuvering of micro-objects in a fluid medium is one of the fundamental differences between micro-manipulation and robotic manipulators in the physical world. Besides, due to the limitation of feasible sensors and actuators in micro-manipulation, current control techniques for manipulation of micro-objects or cells are mostly dependent on the physical properties of target micro-objects or cells. In this paper, we propose the first stochastic control technique to achieve simultaneous orientation and transportation of micro-objects with Brownian perturbations. Several micro-particles which are optically trapped and driven by laser beams are utilized as fingertips to first grasp a target micro-object. Cooperative control of robot-assisted stage and the fingertips is then performed to achieve the control objective, in which the target micro-object is transported toward a desired position by using the robot-assisted stage, and at the same time, it is oriented toward a desired angular position by using the fingertips. This paper provides a stochastic control framework for simultaneous orientation and transportation of micro-objects with arbitrary types in the micro-world, and thus bringing micro-manipulation using optical tweezers closer to robotic manipulation in the physical world. Rigorous mathematical formulation and stability analysis for simultaneous orientation and positioning feedback control of micro-objects in the presence of the stochastic perturbations are derived, and experimental results are also presented. [ABSTRACT FROM AUTHOR]

Acoustic-resolution photoacoustic microscopy (AR-PAM) is a promising technology for vascular or tumor-targeted molecular imaging. Unique advantages of AR-PM are its non-invasive, non-ionizing real-time, and deeper imaging depth. AR-PAM typically uses an ultrasound transducer with a high acoustic numerical aperture (NA) to enable deeper imaging depth. While high NA achieves good lateral resolution in the focal plane but significantly degrades the lateral resolution in the out-of-focus region. Synthetic aperture focusing technique (SAFT) has been introduced to overcome this out-of-focus degradation by synthesizing the correlated signals. Several 2-D SAFTs have been also reported to improve degraded resolution in all directions. However, the resolution enhancement of the previously reported 2-D SAFTs are suboptimal and are not equivalent to the 1-D SAFT performance under an ideal condition with the sample orientation perpendicular to the synthetic aperture direction. In this paper, we present a new 2-D SAFT called 2-D directional SAFT that improves the lateral resolution significantly and we compare our results against 1-D SAFT under ideal condition. We applied this algorithm to phantom and in vivo images to show the improvement in image quality. We also implement this algorithm in a graphical processing unit to achieve high performance to show the practicality of implementing this new algorithm in a system. [ABSTRACT FROM AUTHOR]

In this paper, a novel nonlinear thermoacoustic imaging (NTAI) system is developed based on the temperature-dependent thermoelastic response under microwave irradiation. Specifically, we consider the high-pulse repetition frequency (HPRF) microwave regime, where the tissue temperature increases after microwave irradiation. In this circumstance, the temperature-dependent thermodynamic parameters of the tissue change; thus, the influence of absorbed microwave energy on the thermoacoustic (TA) amplitude is reflected in the change of thermodynamic parameters. Hence, this temperature dependence yields a nonlinear relationship between the TA amplitude and the absorbed microwave energy in the HPRF regime. In this paper, we obtain the nonlinear coefficient as a new parameter to distinguish biological tissues by performing differential measurements in the NTAI system. We further experimentally extract the nonlinear coefficient in phantom and ex vivo mouse, revealing the feasibility of applications in biological tissues identification with high contrast. [ABSTRACT FROM AUTHOR]

Delineation of the left ventricular cavity, myocardium, and right ventricle from cardiac magnetic resonance images (multi-slice 2-D cine MRI) is a common clinical task to establish diagnosis. The automation of the corresponding tasks has thus been the subject of intense research over the past decades. In this paper, we introduce the “Automatic Cardiac Diagnosis Challenge” dataset (ACDC), the largest publicly available and fully annotated dataset for the purpose of cardiac MRI (CMR) assessment. The dataset contains data from 150 multi-equipments CMRI recordings with reference measurements and classification from two medical experts. The overarching objective of this paper is to measure how far state-of-the-art deep learning methods can go at assessing CMRI, i.e., segmenting the myocardium and the two ventricles as well as classifying pathologies. In the wake of the 2017 MICCAI-ACDC challenge, we report results from deep learning methods provided by nine research groups for the segmentation task and four groups for the classification task. Results show that the best methods faithfully reproduce the expert analysis, leading to a mean value of 0.97 correlation score for the automatic extraction of clinical indices and an accuracy of 0.96 for automatic diagnosis. These results clearly open the door to highly accurate and fully automatic analysis of cardiac CMRI. We also identify scenarios for which deep learning methods are still failing. Both the dataset and detailed results are publicly available online, while the platform will remain open for new submissions. [ABSTRACT FROM AUTHOR]

Biomedical parameters of tissue can be important indicators for clinical diagnosis. One such parameter that reflects tissue stiffness is elasticity, the imaging of which is called elastography. In this paper, we use displacements from harmonic excitations to solve the inverse problem of elasticity based on a finite-element method (FEM) formulation. This leads to iterative solution of nonlinear and nonconvex problems. In this paper, we show the importance and selection of viable initializations in numerical simulation studies and propose techniques for the fusion of multiple initializations for ideal reconstructions of unknown tissue as well as combining information from excitations at multiple frequencies. Results show that our method leads up to 76% decrease in root-mean-squared error (RMSE) and 9.9 dB increase in contrast-to-noise ratio (CNR) in simulations with noise, when compared to conventional iterative FEM without multiple initializations and frequencies. As the wave patterns in individually selected frequencies may introduce artifacts, a joint inverse-problem solution of multi-frequency excitations is introduced as a robust solution, where CNR improvements of up to 11.9 dB are observed. We also present the methods on a tissue-mimicking gelatin phantom study using mechanical excitation and ultrafast plane-wave ultrasound imaging, where the RMSE was improved by up to 51%. An experiment of ablation via heating an ex-vivo bovine liver shows that reconstruction artifacts are reduced with our proposed method. [ABSTRACT FROM AUTHOR]

Structured low-rank matrix models have previously been introduced to enable calibrationless MR image reconstruction from sub-Nyquist data, and such ideas have recently been extended to enable navigator-free echo-planar imaging (EPI) ghost correction. This paper presents a novel theoretical analysis which shows that, because of uniform subsampling, the structured low-rank matrix optimization problems for EPI data will always have either undesirable or non-unique solutions in the absence of additional constraints. This theory leads us to recommend and investigate problem formulations for navigator-free EPI that incorporate side information from either image-domain or k-space domain parallel imaging methods. The importance of using nonconvex low-rank matrix regularization is also identified. We demonstrate using phantom and in vivo data that the proposed methods are able to eliminate ghost artifacts for several navigator-free EPI acquisition schemes, obtaining better performance in comparison with the state-of-the-art methods across a range of different scenarios. Results are shown for both single-channel acquisition and highly accelerated multi-channel acquisition. [ABSTRACT FROM AUTHOR]

This special issue consists of 12 research papers. The papers cover a wide range of important topics including novel imaging, computational modeling, automatic vertebra segmentation, as well as computer assisted intervention. Among the 12 papers, nine are related to medical image analysis and three are in the scope of computer assisted intervention. The papers cover a variety of imaging modalities, include CT, MR, X-ray, ), ultrasound, and multi-modality. [ABSTRACT FROM AUTHOR]

The thirteen papers in this special section focuses on the development of smart health monitoring systems. The rapid growth of smart healthcare applications is made possible by the advancements in the Internet of Things (IoT). The IoT collect data related to healthcare, public safety, energy, and behavior monitoring that provides useful information to a variety of applications. For example, in a smart health monitoring and improvement (SHAMI) system, healthcare professionals share the medical data of patients for a better and quick diagnosis of a disease. The integrity of electronic medical records and medical reports is necessary because modified, altered or corrupted medical data can make wrong diagnoses and create serious health issues for any individual. In addition, privacy leakage and medical identity theft is a growing concern and has contributed to a large number of e-fraud cases across the world. Therefore, in this special issue, we aim to focus on the security and privacy of medical data and reports in a smart healthcare application. [ABSTRACT FROM AUTHOR]

Clinically oriented deep learning algorithms, combined with large-scale medical datasets, have significantly promoted computer-aided diagnosis. To address increasing ethical and privacy issues, Federated Learning (FL) adopts a distributed paradigm to collaboratively train models, rather than collecting samples from multiple institutions for centralized training. Despite intensive research on FL, two major challenges are still existing when applying FL in the real-world medical scenarios, including the performance degradation (i.e., retrogress) after each communication and the intractable class imbalance. Thus, in this paper, we propose a novel personalized FL framework to tackle these two problems. For the retrogress problem, we first devise a Progressive Fourier Aggregation (PFA) at the server side to gradually integrate parameters of client models in the frequency domain. Then, at the client side, we design a Deputy-Enhanced Transfer (DET) to smoothly transfer global knowledge to the personalized local model. For the class imbalance problem, we propose the Conjoint Prototype-Aligned (CPA) loss to facilitate the balanced optimization of the FL framework. Considering the inaccessibility of private local data to other participants in FL, the CPA loss calculates the global conjoint objective based on global imbalance, and then adjusts the client-side local training through the prototype-aligned refinement to eliminate the imbalance gap with such a balanced goal. Extensive experiments are performed on real-world dermoscopic and prostate MRI FL datasets. The experimental results demonstrate the advantages of our FL framework in real-world medical scenarios, by outperforming state-of-the-art FL methods with a large margin. The source code is available at https://github.com/CityU-AIM-Group/PRR-Imbalance https://github.com/CityU-AIM-Group/PRR-Imbalance. [ABSTRACT FROM AUTHOR]

Medical visual question answering (VQA) aims to correctly answer a clinical question related to a given medical image. Nevertheless, owing to the expensive manual annotations of medical data, the lack of labeled data limits the development of medical VQA. In this paper, we propose a simple yet effective data augmentation method, VQAMix, to mitigate the data limitation problem. Specifically, VQAMix generates more labeled training samples by linearly combining a pair of VQA samples, which can be easily embedded into any visual-language model to boost performance. However, mixing two VQA samples would construct new connections between images and questions from different samples, which will cause the answers for those new fabricated image-question pairs to be missing or meaningless. To solve the missing answer problem, we first develop the Learning with Missing Labels (LML) strategy, which roughly excludes the missing answers. To alleviate the meaningless answer issue, we design the Learning with Conditional-mixed Labels (LCL) strategy, which further utilizes language-type prior to forcing the mixed pairs to have reasonable answers that belong to the same category. Experimental results on the VQA-RAD and PathVQA benchmarks show that our proposed method significantly improves the performance of the baseline by about 7% and 5% on the averaging result of two backbones, respectively. More importantly, VQAMix could improve confidence calibration and model interpretability, which is significant for medical VQA models in practical applications. All code and models are available at https://github.com/haifangong/VQAMix. [ABSTRACT FROM AUTHOR]

Medical images contain various abnormal regions, most of which are closely related to the lesions or diseases. The abnormality or lesion is one of the major concerns during clinical practice and therefore becomes the key in answering questions about medical images. However, the recent efforts still focus on constructing a generic Visual Question Answering framework for medical-domain tasks, which is not adequate for practical medical requirements and applications. In this paper, we present two novel medical-specific modules named multiplication anomaly sensitive module and residual anomaly sensitive module to utilize weakly supervised anomaly localization information in medical Visual Question Answering. Firstly, the proposed multiplication anomaly sensitive module designed for anomaly-related questions can mask the feature of the whole image according to the anomaly location map. Secondly, the residual anomaly sensitive module could learn a flexible anomaly feature while preserving the information of the original questioned image, which is more helpful in answering anomaly-unrelated questions. Thirdly, the transformer decoder and multi-task learning strategy are combined to further enhance the question-reasoning ability and the model generalization performance. Finally, qualitative and quantitative experiments on a variety of medical datasets exhibit the superiority of the proposed approaches compared to the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Medical image segmentation is fundamental and essential for the analysis of medical images. Although prevalent success has been achieved by convolutional neural networks (CNN), challenges are encountered in the domain of medical image analysis by two aspects: 1) lack of discriminative features to handle similar textures of distinct structures and 2) lack of selective features for potential blurred boundaries in medical images. In this paper, we extend the concept of contrastive learning (CL) to the segmentation task to learn more discriminative representation. Specifically, we propose a novel patch-dragsaw contrastive regularization (PDCR) to perform patch-level tugging and repulsing. In addition, a new structure, namely uncertainty-aware feature re- weighting block (UAFR), is designed to address the potential high uncertainty regions in the feature maps and serves as a better feature re- weighting. Our proposed method achieves state-of-the-art results across 8 public datasets from 6 domains. Besides, the method also demonstrates robustness in the limited-data scenario. The code is publicly available at https://github.com/lzh19961031/PDCR_UAFR-MIShttps://github.com/lzh19961031/PDCR_UAFR-MIS. [ABSTRACT FROM AUTHOR]

Domain adaptation techniques have been demonstrated to be effective in addressing label deficiency challenges in medical image segmentation. However, conventional domain adaptation based approaches often concentrate on matching global marginal distributions between different domains in a class-agnostic fashion. In this paper, we present a dual-attention domain-adaptative segmentation network (DADASeg-Net) for cross-modality medical image segmentation. The key contribution of DADASeg-Net is a novel dual adversarial attention mechanism, which regularizes the domain adaptation module with two attention maps respectively from the space and class perspectives. Specifically, the spatial attention map guides the domain adaptation module to focus on regions that are challenging to align in adaptation. The class attention map encourages the domain adaptation module to capture class-specific instead of class-agnostic knowledge for distribution alignment. DADASeg-Net shows superior performance in two challenging medical image segmentation tasks. [ABSTRACT FROM AUTHOR]

Representation learning is the critical task for medical image analysis in computer-aided diagnosis. However, it is challenging to learn discriminative features due to the limited size of the dataset and the lack of labels. In this paper, we propose a stochastic routing normalization and neighborhood embedding framework with application to breast tissue classification by learning discriminative features of probe-based confocal laser endomicroscopy. In order to align the low-level and mid-level of pCLE and histology domain, we firstly build the domain-specific normalization module with stochastic activation strategy considering both depth-wise and feature-wise criterion. For high-level features, the latent centers are learned from the histology domain as the template for feature matching. The proposed method is evaluated on a clinical database with 700 pCLE mosaics. The accuracy of image classification with limited training samples demonstrates that the proposed method can outperform previous works on domain alignment. [ABSTRACT FROM AUTHOR]

Effectively integrating multi-scale information is of considerable significance for the challenging multi-class segmentation of fundus lesions because different lesions vary significantly in scales and shapes. Several methods have been proposed to successfully handle the multi-scale object segmentation. However, two issues are not considered in previous studies. The first is the lack of interaction between adjacent feature levels, and this will lead to the deviation of high-level features from low-level features and the loss of detailed cues. The second is the conflict between the low-level and high-level features, this occurs because they learn different scales of features, thereby confusing the model and decreasing the accuracy of the final prediction. In this paper, we propose a progressive multi-scale consistent network (PMCNet) that integrates the proposed progressive feature fusion (PFF) block and dynamic attention block (DAB) to address the aforementioned issues. Specifically, PFF block progressively integrates multi-scale features from adjacent encoding layers, facilitating feature learning of each layer by aggregating fine-grained details and high-level semantics. As features at different scales should be consistent, DAB is designed to dynamically learn the attentive cues from the fused features at different scales, thus aiming to smooth the essential conflicts existing in multi-scale features. The two proposed PFF and DAB blocks can be integrated with the off-the-shelf backbone networks to address the two issues of multi-scale and feature inconsistency in the multi-class segmentation of fundus lesions, which will produce better feature representation in the feature space. Experimental results on three public datasets indicate that the proposed method is more effective than recent state-of-the-art methods. [ABSTRACT FROM AUTHOR]

During clinical practice, radiologists often use attributes, e.g., morphological and appearance characteristics of a lesion, to aid disease diagnosis. Effectively modeling attributes as well as all relationships involving attributes could boost the generalization ability and verifiability of medical image diagnosis algorithms. In this paper, we introduce a hybrid neuro-probabilistic reasoning algorithm for verifiable attribute-based medical image diagnosis. There are two parallel branches in our hybrid algorithm, a Bayesian network branch performing probabilistic causal relationship reasoning and a graph convolutional network branch performing more generic relational modeling and reasoning using a feature representation. Tight coupling between these two branches is achieved via a cross-network attention mechanism and the fusion of their classification results. We have successfully applied our hybrid reasoning algorithm to two challenging medical image diagnosis tasks. On the LIDC-IDRI benchmark dataset for benign-malignant classification of pulmonary nodules in CT images, our method achieves a new state-of-the-art accuracy of 95.36% and an AUC of 96.54%. Our method also achieves a 3.24% accuracy improvement on an in-house chest X-ray image dataset for tuberculosis diagnosis. Our ablation study indicates that our hybrid algorithm achieves a much better generalization performance than a pure neural network architecture under very limited training data. [ABSTRACT FROM AUTHOR]

The automatic and accurate segmentation of the prostate cancer from the multi-modal magnetic resonance images is of prime importance for the disease assessment and follow-up treatment plan. However, how to use the multi-modal image features more efficiently is still a challenging problem in the field of medical image segmentation. In this paper, we develop a cross-modal self-attention distillation network by fully exploiting the encoded information of the intermediate layers from different modalities, and the generated attention maps of different modalities enable the model to transfer significant and discriminative information that contains more details. Moreover, a novel spatial correlated feature fusion module is further employed for learning more complementary correlation and non-linear information of different modality images. We evaluate our model in five-fold cross-validation on 358 MRI images with biopsy confirmed. Without bells and whistles, our proposed network achieves state-of-the-art performance on extensive experiments. [ABSTRACT FROM AUTHOR]

In this paper, we propose a novel method to estimate the confidence of a registration that does not require any ground truth, is independent from the registration algorithm and the resulting confidence is correlated with the amount of registration error. We first apply a local search to match patterns between the registered image pairs. Local search induces a cost space per voxel which we explore further to estimate the confidence of the registration similar to confidence estimation algorithms for stereo matching. We test our method on both synthetically generated registration errors and on real registrations with ground truth. The experimental results show that our confidence measure can estimate registration errors and it is correlated with local errors. [ABSTRACT FROM PUBLISHER]

This editorial introduces the Special Issue on Simulation and Synthesis in Medical Imaging. In this editorial, we define so-far ambiguous terms of simulation and synthesis in medical imaging. We also briefly discuss the synergistic importance of mechanistic (hypothesis-driven) and phenomenological (data-driven) models of medical image generation. Finally, we introduce the twelve papers published in this issue covering both mechanistic (5) and phenomenological (7) medical image generation. This rich selection of papers covers applications in cardiology, retinopathy, histopathology, neurosciences, and oncology. It also covers all mainstream diagnostic medical imaging modalities. We conclude the editorial with a personal view on the field and highlight some existing challenges and future research opportunities. [ABSTRACT FROM PUBLISHER]

Efficient storing and retrieval of medical images has direct impact on reducing costs and improving access in cloud-based health care services. JPEG 2000 is currently the commonly used compression format for medical images shared using the DICOM standard. However, new formats such as high efficiency video coding (HEVC) can provide better compression efficiency compared to JPEG 2000. Furthermore, JPEG 2000 is not suitable for efficiently storing image series and 3-D imagery. Using HEVC, a single format can support all forms of medical images. This paper presents the use of HEVC for diagnostically acceptable medical image compression, focusing on compression efficiency compared to JPEG 2000. Diagnostically acceptable lossy compression and complexity of high bit-depth medical image compression are studied. Based on an established medically acceptable compression range for JPEG 2000, this paper establishes acceptable HEVC compression range for medical imaging applications. Experimental results show that using HEVC can increase the compression performance, compared to JPEG 2000, by over 54%. Along with this, a new method for reducing computational complexity of HEVC encoding for medical images is proposed. Results show that HEVC intra encoding complexity can be reduced by over 55% with negligible increase in file size. [ABSTRACT FROM PUBLISHER]

The large number of electronics channels has become an issue to the further applications of micropattern gas detectors (MPGDs) and poses a big challenge for the integration, power consumption, cooling, and cost. Induced position encoding readout technique provides an attractive way to significantly reduce the number of readout channels. In this paper, we present an extensible induced position encoding readout method for MPGDs. The method is demonstrated by the Eulerian path of the graph theory. A standard encoding rule is provided, and a general formula of encoding and decoding for n channels is derived. Under the premise of such method, a 1-D induced position encoding readout prototyping board is designed on a $5\times 5$ cm2 thick gas electron multiplier, where 47 anode strips are readout by 15 encoded multiplexing channels. Verification tests are carried out on an 8-keV Cu X-ray source with 100- \mu \text{m} slit. The test results show a robust feasibility of the method and have a good spatial resolution and linearity in its position response. This method can dramatically reduce the number of readout channels, has potential to build large-area detectors, and can be easily adapted to other detectors like MPGDs. [ABSTRACT FROM PUBLISHER]

Even though sparse recovery (SR) has been successfully applied in a wide range of research communities, there still exists a barrier to real applications because of the inefficiency of the state-of-the-art algorithms. In this paper, we propose a dynamical approach to SR, which is highly efficient and with finite-time convergence property. First, instead of solving the $\ell _1$ regularized optimization programs that requires exhausting iterations, which is computer-oriented, the solution to SR problem in this paper is resolved through the evolution of a continuous dynamical system which can be realized by analog circuits. Moreover, the proposed dynamical system is proved to have the finite-time convergence property, and thus more efficient than locally competitive algorithm (LCA) (the recently developed dynamical system to solve SR) with exponential convergence property. Consequently, our proposed dynamical system is more appropriate than LCA to deal with the time-varying situations. Simulations are carried out to demonstrate the superior properties of our proposed system. [ABSTRACT FROM PUBLISHER]

This paper describes a highly efficient method for lossless compression of volumetric sets of medical images, such as CTs or MRIs. The proposed method, referred to as 3-D-MRP, is based on the principle of minimum rate predictors (MRPs), which is one of the state-of-the-art lossless compression technologies presented in the data compression literature. The main features of the proposed method include the use of 3-D predictors, 3-D-block octree partitioning and classification, volume-based optimization, and support for 16-b-depth images. Experimental results demonstrate the efficiency of the 3-D-MRP algorithm for the compression of volumetric sets of medical images, achieving gains above 15% and 12% for 8- and 16-bit-depth contents, respectively, when compared with JPEG-LS, JPEG2000, CALIC, and HEVC, as well as other proposals based on the MRP algorithm. [ABSTRACT FROM AUTHOR]

Automated radiographic report generation is challenging in at least two aspects. First, medical images are very similar to each other and the visual differences of clinic importance are often fine-grained. Second, the disease-related words may be submerged by many similar sentences describing the common content of the images, causing the abnormal to be misinterpreted as the normal in the worst case. To tackle these challenges, this paper proposes a pure transformer-based framework to jointly enforce better visual-textual alignment, multi-label diagnostic classification, and word importance weighting, to facilitate report generation. To the best of our knowledge, this is the first pure transformer-based framework for medical report generation, which enjoys the capacity of transformer in learning long range dependencies for both image regions and sentence words. Specifically, for the first challenge, we design a novel mechanism to embed an auxiliary image-text matching objective into the transformer’s encoder-decoder structure, so that better correlated image and text features could be learned to help a report to discriminate similar images. For the second challenge, we integrate an additional multi-label classification task into our framework to guide the model in making correct diagnostic predictions. Also, a term-weighting scheme is proposed to reflect the importance of words for training so that our model would not miss key discriminative information. Our work achieves promising performance over the state-of-the-arts on two benchmark datasets, including the largest dataset MIMIC-CXR. [ABSTRACT FROM AUTHOR]