Search

The final publication is available at Springer via http://dx.doi.org/DOI 10.1007/s10618-014-0378-6. Published online., Knowledge discovery on biomedical data can be based on on-line, data-stream analyses, or using retrospective, timestamped, off-line datasets. In both cases, changes in the processes that generate data or in their quality features through time may hinder either the knowledge discovery process or the generalization of past knowledge. These problems can be seen as a lack of data temporal stability. This work establishes the temporal stability as a data quality dimension and proposes new methods for its assessment based on a probabilistic framework. Concretely, methods are proposed for (1) monitoring changes, and (2) characterizing changes, trends and detecting temporal subgroups. First, a probabilistic change detection algorithm is proposed based on the Statistical Process Control of the posterior Beta distribution of the Jensen–Shannon distance, with a memoryless forgetting mechanism. This algorithm (PDF-SPC) classifies the degree of current change in three states: In-Control, Warning, and Out-of-Control. Second, a novel method is proposed to visualize and characterize the temporal changes of data based on the projection of a non-parametric information-geometric statistical manifold of time windows. This projection facilitates the exploration of temporal trends using the proposed IGT-plot and, by means of unsupervised learning methods, discovering conceptually-related temporal subgroups. Methods are evaluated using real and simulated data based on the National Hospital Discharge Survey (NHDS) dataset.

The final publication is available at Springer via http://dx.doi.org/DOI 10.1007/s10618-014-0378-6. Published online., Knowledge discovery on biomedical data can be based on on-line, data-stream analyses, or using retrospective, timestamped, off-line datasets. In both cases, changes in the processes that generate data or in their quality features through time may hinder either the knowledge discovery process or the generalization of past knowledge. These problems can be seen as a lack of data temporal stability. This work establishes the temporal stability as a data quality dimension and proposes new methods for its assessment based on a probabilistic framework. Concretely, methods are proposed for (1) monitoring changes, and (2) characterizing changes, trends and detecting temporal subgroups. First, a probabilistic change detection algorithm is proposed based on the Statistical Process Control of the posterior Beta distribution of the Jensen–Shannon distance, with a memoryless forgetting mechanism. This algorithm (PDF-SPC) classifies the degree of current change in three states: In-Control, Warning, and Out-of-Control. Second, a novel method is proposed to visualize and characterize the temporal changes of data based on the projection of a non-parametric information-geometric statistical manifold of time windows. This projection facilitates the exploration of temporal trends using the proposed IGT-plot and, by means of unsupervised learning methods, discovering conceptually-related temporal subgroups. Methods are evaluated using real and simulated data based on the National Hospital Discharge Survey (NHDS) dataset.

The final publication is available at Springer via http://dx.doi.org/10.1007/s10334-010-0241-8, Object: This study demonstrates that 3T SV-MRS data can be used with the currently available automatic brain tumour diagnostic classifiers which were trained on databases of 1.5T spectra. This will allow the existing large databases of 1.5T MRS data to be used for diagnostic classification of 3T spectra, and perhaps also the combination of 1.5T and 3T databases. Materials and methods: Brain tumour classifiers trained with 154 1.5T spectra to discriminate among high grade malignant tumours and common grade II glial tumours were evaluated with a subsequently-acquired set of 155 1.5T and 37 3T spectra. A similarity study between spectra and main brain tumour metabolite ratios for both field strengths (1.5T and 3T) was also performed. Results: Our results showed that classifiers trained with 1.5T samples had similar accuracy for both test datasets (0.87 ± 0.03 for 1.5T and 0.88 ± 0.03 for 3.0T). Moreover, non-significant differences were observed with most metabolite ratios and spectral patterns. Conclusion: These results encourage the use of existing classifiers based on 1.5T datasets for diagnosis with 3T 1H SV-MRS. The large 1.5T databases compiled throughout many years and the prediction models based on 1.5T acquisitions can therefore continue to be used with data from the new 3T instruments. © 2011 ESMRMB.

The final publication is available at Springer via http://dx.doi.org/10.1007/s10334-010-0241-8, Object: This study demonstrates that 3T SV-MRS data can be used with the currently available automatic brain tumour diagnostic classifiers which were trained on databases of 1.5T spectra. This will allow the existing large databases of 1.5T MRS data to be used for diagnostic classification of 3T spectra, and perhaps also the combination of 1.5T and 3T databases. Materials and methods: Brain tumour classifiers trained with 154 1.5T spectra to discriminate among high grade malignant tumours and common grade II glial tumours were evaluated with a subsequently-acquired set of 155 1.5T and 37 3T spectra. A similarity study between spectra and main brain tumour metabolite ratios for both field strengths (1.5T and 3T) was also performed. Results: Our results showed that classifiers trained with 1.5T samples had similar accuracy for both test datasets (0.87 ± 0.03 for 1.5T and 0.88 ± 0.03 for 3.0T). Moreover, non-significant differences were observed with most metabolite ratios and spectral patterns. Conclusion: These results encourage the use of existing classifiers based on 1.5T datasets for diagnosis with 3T 1H SV-MRS. The large 1.5T databases compiled throughout many years and the prediction models based on 1.5T acquisitions can therefore continue to be used with data from the new 3T instruments. © 2011 ESMRMB.