Search

Abstract We propose the addition of usability validation to the extended V3 framework, now “V3+”, and describe a pragmatic approach to ensuring that sensor-based digital health technologies can be used optimally at scale by diverse users. Alongside the original V3 components (verification; analytical validation; clinical validation), usability validation will ensure user-centricity of digital measurement tools, paving the way for more inclusive, reliable, and trustworthy digital measures within clinical research and clinical care.

Major depressive disorder (MDD) is defined by an array of symptoms that make it challenging to understand the condition at a population level. Subtyping offers a way to unpick this phenotypic diversity for improved disorder characterisation. We aimed to identify depression subtypes longitudinally using the Inventory of Depressive Symptomatology: Self-Report (IDS-SR). A secondary analysis of a two-year cohort study called Remote Assessment of Disease and Relapse in Major Depressive Disorder (RADAR-MDD), which collected data every three months from patients with a history of recurrent MDD in the United Kingdom, the Netherlands, and Spain (N = 619). We used latent class and latent transition analysis to identify subtypes at baseline, determined their consistency at 6- and 12-month follow-ups, and examined transitions over time. We identified a 4-class solution: (1) severe with appetite decrease, (2) severe with appetite increase, (3) moderate severity and (4) low severity. These same classes were identified at 6- and 12-month follow-ups, and participants tended to remain in the same class over time. We found no statistically significant differences between the two severe subtypes regarding baseline clinical and sociodemographic characteristics. Our findings emphasize severity differences over symptom types, suggesting that current subtyping methods provide insights akin to existing severity measures. When examining transitions, participants were most likely to remain in their respective classes over 1-year, indicating chronicity rather than oscillations in depression severity. Future work recommendations are made.

The Remote Assessment of Disease and Relapse – Alzheimer’s Disease (RADAR-AD) consortium evaluated remote measurement technologies (RMTs) for assessing functional status in AD. The consortium engaged with the European Medicines Agency (EMA) to obtain feedback on identification of meaningful functional domains, selection of RMTs and clinical study design to assess the feasibility of using RMTs in AD clinical studies. We summarized the feedback and the lessons learned to guide future projects.

BackgroundIncreasing adoption of sensor-based digital health technologies (sDHTs) in recent years has cast light on the many challenges in implementing these tools into clinical trials and patient care at scale across diverse patient populations; however, the methodological approaches taken toward sDHT usability evaluation have varied markedly. ObjectiveThis review aims to explore the current landscape of studies reporting data related to sDHT human factors, human-centered design, and usability, to inform our concurrent work on developing an evaluation framework for sDHT usability. MethodsWe conducted a scoping review of studies published between 2013 and 2023 and indexed in PubMed, in which data related to sDHT human factors, human-centered design, and usability were reported. Following a systematic screening process, we extracted the study design, participant sample, the sDHT or sDHTs used, the methods of data capture, and the types of usability-related data captured. ResultsOur literature search returned 442 papers, of which 85 papers were found to be eligible and 83 papers were available for data extraction and not under embargo. In total, 164 sDHTs were evaluated; 141 (86%) sDHTs were wearable tools while the remaining 23 (14%) sDHTs were ambient tools. The majority of studies (55/83, 66%) reported summative evaluations of final-design sDHTs. Almost all studies (82/83, 99%) captured data from targeted end users, but only 18 (22%) out of 83 studies captured data from additional users such as care partners or clinicians. User satisfaction and ease of use were evaluated for 83% (136/164) and 91% (150/164) of sDHTs, respectively; however, learnability, efficiency, and memorability were reported for only 11 (7%), 4 (2%), and 2 (1%) out of 164 sDHTs, respectively. A total of 14 (9%) out of 164 sDHTs were evaluated according to the extent to which users were able to understand the clinical data or other information presented to them (understandability) or the actions or tasks they should complete in response (actionability). Notable gaps in reporting included the absence of a sample size rationale (reported for 21/83, 25% of all studies and 17/55, 31% of summative studies) and incomplete sociodemographic descriptive data (complete age, sex/gender, and race/ethnicity reported for 14/83, 17% of studies). ConclusionsBased on our findings, we suggest four actionable recommendations for future studies that will help to advance the implementation of sDHTs: (1) consider an in-depth assessment of technology usability beyond user satisfaction and ease of use, (2) expand recruitment to include important user groups such as clinicians and care partners, (3) report the rationale for key study design considerations including the sample size, and (4) provide rich descriptive statistics regarding the study sample to allow a complete understanding of generalizability to other patient populations and contexts of use.

Abstract Augmented reality (AR) apps, in which the virtual and real world are combined, can recreate instrumental activities of daily living (IADL) and are therefore promising to measure cognition needed for IADL in early Alzheimer’s disease (AD) both in the clinic and in the home settings. The primary aim of this study was to distinguish and classify healthy controls (HC) from participants with AD pathology in an early AD stage using an AR app. The secondary aims were to test the association of the app with clinical cognitive and functional tests and investigate the feasibility of at-home testing using AR. We furthermore investigated the test-retest reliability and potential learning effects of the task. The digital score from the AR app could significantly distinguish HC from preclinical AD (preAD) and prodromal AD (proAD), and preAD from proAD, both with in-clinic and at-home tests. For the classification of the proAD group, the digital score (AUCclinic_visit = 0.84 [0.75–0.93], AUCat_home = 0.77 [0.61–0.93]) was as good as the cognitive score (AUC = 0.85 [0.78–0.93]), while for classifying the preAD group, the digital score (AUCclinic_visit = 0.66 [0.53–0.78], AUCat_home = 0.76 [0.61–0.91]) was superior to the cognitive score (AUC = 0.55 [0.42–0.68]). In-clinic and at-home tests moderately correlated (rho = 0.57, p

Abstract Major depressive disorder (MDD) is a chronic illness wherein relapses contribute to significant patient morbidity and mortality. Near-term prediction of relapses in MDD patients has the potential to improve outcomes by helping implement a ‘predict and preempt’ paradigm in clinical care. In this study, we developed a novel personalized (N-of-1) encoder-decoder anomaly detection-based framework of combining anomalies in multivariate actigraphy features (passive) as triggers to utilize an active concurrent self-reported symptomatology questionnaire (core symptoms of depression and anxiety) to predict near-term relapse in MDD. The framework was evaluated on two independent longitudinal observational trials, characterized by regular bimonthly (every other month) in-person clinical assessments, weekly self-reported symptom assessments, and continuous activity monitoring data with two different wearable sensors for ≥ 1 year or until the first relapse episode. This combined passive-active relapse prediction framework achieved a balanced accuracy of ≥ 71%, false alarm rate of ≤ 2.3 alarm/patient/year with a median relapse detection time of 2–3 weeks in advance of clinical onset in both studies. The study results suggest that the proposed personalized N-of-1 prediction framework is generalizable and can help predict a majority of MDD relapses in an actionable time frame with relatively low patient and provider burden.

BackgroundPrevious mobile health (mHealth) studies have revealed significant links between depression and circadian rhythm features measured via wearables. However, the comprehensive impact of seasonal variations was not fully considered in these studies, potentially biasing interpretations in real-world settings. ObjectiveThis study aims to explore the associations between depression severity and wearable-measured circadian rhythms while accounting for seasonal impacts. MethodsData were sourced from a large longitudinal mHealth study, wherein participants’ depression severity was assessed biweekly using the 8-item Patient Health Questionnaire (PHQ-8), and participants’ behaviors, including sleep, step count, and heart rate (HR), were tracked via Fitbit devices for up to 2 years. We extracted 12 circadian rhythm features from the 14-day Fitbit data preceding each PHQ-8 assessment, including cosinor variables, such as HR peak timing (HR acrophase), and nonparametric features, such as the onset of the most active continuous 10-hour period (M10 onset). To investigate the association between depression severity and circadian rhythms while also assessing the seasonal impacts, we used three nested linear mixed-effects models for each circadian rhythm feature: (1) incorporating the PHQ-8 score as an independent variable, (2) adding seasonality, and (3) adding an interaction term between season and the PHQ-8 score. ResultsAnalyzing 10,018 PHQ-8 records alongside Fitbit data from 543 participants (n=414, 76.2% female; median age 48, IQR 32-58 years), we found that after adjusting for seasonal effects, higher PHQ-8 scores were associated with reduced daily steps (β=–93.61, P

Abstract Recent growth in digital technologies has enabled the recruitment and monitoring of large and diverse populations in remote health studies. However, the generalizability of inference drawn from remotely collected health data could be severely impacted by uneven participant engagement and attrition over the course of the study. We report findings on long-term participant retention and engagement patterns in a large multinational observational digital study for depression containing active (surveys) and passive sensor data collected via Android smartphones, and Fitbit devices from 614 participants for up to 2 years. Majority of participants (67.6%) continued to remain engaged in the study after 43 weeks. Unsupervised clustering of participants’ study apps and Fitbit usage data showed 3 distinct engagement subgroups for each data stream. We found: (i) the least engaged group had the highest depression severity (4 PHQ8 points higher) across all data streams; (ii) the least engaged group (completed 4 bi-weekly surveys) took significantly longer to respond to survey notifications (3.8 h more) and were 5 years younger compared to the most engaged group (completed 20 bi-weekly surveys); and (iii) a considerable proportion (44.6%) of the participants who stopped completing surveys after 8 weeks continued to share passive Fitbit data for significantly longer (average 42 weeks). Additionally, multivariate survival models showed participants’ age, ownership and brand of smartphones, and recruitment sites to be associated with retention in the study. Together these findings could inform the design of future digital health studies to enable equitable and balanced data collection from diverse populations.

BackgroundMajor depressive disorder (MDD) affects millions of people worldwide, but timely treatment is not often received owing in part to inaccurate subjective recall and variability in the symptom course. Objective and frequent MDD monitoring can improve subjective recall and help to guide treatment selection. Attempts have been made, with varying degrees of success, to explore the relationship between the measures of depression and passive digital phenotypes (features) extracted from smartphones and wearables devices to remotely and continuously monitor changes in symptomatology. However, a number of challenges exist for the analysis of these data. These include maintaining participant engagement over extended time periods and therefore understanding what constitutes an acceptable threshold of missing data; distinguishing between the cross-sectional and longitudinal relationships for different features to determine their utility in tracking within-individual longitudinal variation or screening individuals at high risk; and understanding the heterogeneity with which depression manifests itself in behavioral patterns quantified by the passive features. ObjectiveWe aimed to address these 3 challenges to inform future work in stratified analyses. MethodsUsing smartphone and wearable data collected from 479 participants with MDD, we extracted 21 features capturing mobility, sleep, and smartphone use. We investigated the impact of the number of days of available data on feature quality using the intraclass correlation coefficient and Bland-Altman analysis. We then examined the nature of the correlation between the 8-item Patient Health Questionnaire (PHQ-8) depression scale (measured every 14 days) and the features using the individual-mean correlation, repeated measures correlation, and linear mixed effects model. Furthermore, we stratified the participants based on their behavioral difference, quantified by the features, between periods of high (depression) and low (no depression) PHQ-8 scores using the Gaussian mixture model. ResultsWe demonstrated that at least 8 (range 2-12) days were needed for reliable calculation of most of the features in the 14-day time window. We observed that features such as sleep onset time correlated better with PHQ-8 scores cross-sectionally than longitudinally, whereas features such as wakefulness after sleep onset correlated well with PHQ-8 longitudinally but worse cross-sectionally. Finally, we found that participants could be separated into 3 distinct clusters according to their behavioral difference between periods of depression and periods of no depression. ConclusionsThis work contributes to our understanding of how these mobile health–derived features are associated with depression symptom severity to inform future work in stratified analyses.

Objective: The aim of this study was to evaluate the association between changes in the autonomic control of cardiorespiratory system induced by walk tests and outcome measures in people with Multiple Sclerosis (pwMS).Methods: Electrocardiogram (ECG) recordings of 148 people with Relapsing-Remitting MS (RRMS) and 58 with Secondary Progressive MS (SPMS) were acquired using a wearable device before, during, and after walk test performance from a total of 386 periodical clinical visits. A subset of 90 participants repeated a walk test at home. Various MS-related symptoms, including fatigue, disability, and walking capacity were evaluated at each clinical visit, while heart rate variability (HRV) and ECG-derived respiration (EDR) were analyzed to assess autonomic nervous system (ANS) function. Statistical tests were conducted to assess differences in ANS control between pwMS grouped based on the phenotype or the severity of MS-related symptoms. Furthermore, correlation coefficients (r) were calculated to assess the association between the most significant ANS parameters and MS-outcome measures.Results: People with SPMS, compared to RRMS, reached higher mean heart rate (HRM) values during walk test, and larger sympathovagal balance after test performance. Furthermore, pwMS who were able to adjust their HRM and ventilatory values, such as respiratory rate and standard deviation of the ECG-derived respiration, were associated with better clinical outcomes. Correlation analyses showed weak associations between ANS parameters and clinical outcomes when the Multiple Sclerosis phenotype is not taken into account. Blunted autonomic response, in particular HRM reactivity, was related with worse walking capacity, yielding r = 0.36 r = 0.29 (RRMS) and r > 0.5 (SPMS). A positive strong correlation r > 0.7 r > 0.65 between cardiorespiratory parameters derived at hospital and at home was also found.Conclusion: Autonomic function, as measured by HRV, differs according to MS phenotype. Autonomic response to walk tests may be useful for assessing clinical outcomes, mainly in the progressive stage of MS. Participants with larger changes in HRM are able to walk longer distance, while reduced ventilatory function during and after walk test performance is associated with higher fatigue and disability severity scores. Monitoring of disorder severity could also be feasible using ECG-derived cardiac and respiratory parameters recorded with a wearable device at home.

Abstract Background Major Depressive Disorder (MDD) is prevalent, often chronic, and requires ongoing monitoring of symptoms to track response to treatment and identify early indicators of relapse. Remote Measurement Technologies (RMT) provide an opportunity to transform the measurement and management of MDD, via data collected from inbuilt smartphone sensors and wearable devices alongside app-based questionnaires and tasks. A key question for the field is the extent to which participants can adhere to research protocols and the completeness of data collected. We aimed to describe drop out and data completeness in a naturalistic multimodal longitudinal RMT study, in people with a history of recurrent MDD. We further aimed to determine whether those experiencing a depressive relapse at baseline contributed less complete data. Methods Remote Assessment of Disease and Relapse – Major Depressive Disorder (RADAR-MDD) is a multi-centre, prospective observational cohort study conducted as part of the Remote Assessment of Disease and Relapse – Central Nervous System (RADAR-CNS) program. People with a history of MDD were provided with a wrist-worn wearable device, and smartphone apps designed to: a) collect data from smartphone sensors; and b) deliver questionnaires, speech tasks, and cognitive assessments. Participants were followed-up for a minimum of 11 months and maximum of 24 months. Results Individuals with a history of MDD (n = 623) were enrolled in the study,. We report 80% completion rates for primary outcome assessments across all follow-up timepoints. 79.8% of people participated for the maximum amount of time available and 20.2% withdrew prematurely. We found no evidence of an association between the severity of depression symptoms at baseline and the availability of data. In total, 110 participants had > 50% data available across all data types. Conclusions RADAR-MDD is the largest multimodal RMT study in the field of mental health. Here, we have shown that collecting RMT data from a clinical population is feasible. We found comparable levels of data availability in active and passive forms of data collection, demonstrating that both are feasible in this patient group.

BackgroundGait is an essential manifestation of depression. However, the gait characteristics of daily walking and their relationships with depression have yet to be fully explored. ObjectiveThe aim of this study was to explore associations between depression symptom severity and daily-life gait characteristics derived from acceleration signals in real-world settings. MethodsWe used two ambulatory data sets (N=71 and N=215) with acceleration signals collected by wearable devices and mobile phones, respectively. We extracted 12 daily-life gait features to describe the distribution and variance of gait cadence and force over a long-term period. Spearman coefficients and linear mixed-effects models were used to explore the associations between daily-life gait features and depression symptom severity measured by the 15-item Geriatric Depression Scale (GDS-15) and 8-item Patient Health Questionnaire (PHQ-8) self-reported questionnaires. The likelihood-ratio (LR) test was used to test whether daily-life gait features could provide additional information relative to the laboratory gait features. ResultsHigher depression symptom severity was significantly associated with lower gait cadence of high-performance walking (segments with faster walking speed) over a long-term period in both data sets. The linear regression model with long-term daily-life gait features (R2=0.30) fitted depression scores significantly better (LR test P=.001) than the model with only laboratory gait features (R2=0.06). ConclusionsThis study indicated that the significant links between daily-life walking characteristics and depression symptom severity could be captured by both wearable devices and mobile phones. The daily-life gait patterns could provide additional information for predicting depression symptom severity relative to laboratory walking. These findings may contribute to developing clinical tools to remotely monitor mental health in real-world settings.

The aim of this study was to investigate the feasibility of automatically assessing the 2-Minute Walk Distance (2MWD) for monitoring people with multiple sclerosis (pwMS). For 154 pwMS, MS-related clinical outcomes as well as the 2MWDs as evaluated by clinicians and derived from accelerometer data were collected from a total of 323 periodic clinical visits. Accelerometer data from a wearable device during 100 home-based 2MWD assessments were also acquired. The error in estimating the 2MWD was validated for walk tests performed at hospital, and then the correlation (r) between clinical outcomes and home-based 2MWD assessments was evaluated. Robust performance in estimating the 2MWD from the wearable device was obtained, yielding an error of less than 10% in about two-thirds of clinical visits. Correlation analysis showed that there is a strong association between the actual and the estimated 2MWD obtained either at hospital (r = 0.71) or at home (r = 0.58). Furthermore, the estimated 2MWD exhibits moderate-to-strong correlation with various MS-related clinical outcomes, including disability and fatigue severity scores. Automatic assessment of the 2MWD in pwMS is feasible with the usage of a consumer-friendly wearable device in clinical and non-clinical settings. Wearable devices can also enhance the assessment of MS-related clinical outcomes.

BackgroundThe mobility of an individual measured by phone-collected location data has been found to be associated with depression; however, the longitudinal relationships (the temporal direction of relationships) between depressive symptom severity and phone-measured mobility have yet to be fully explored. ObjectiveWe aimed to explore the relationships and the direction of the relationships between depressive symptom severity and phone-measured mobility over time. MethodsData used in this paper came from a major EU program, called the Remote Assessment of Disease and Relapse–Major Depressive Disorder, which was conducted in 3 European countries. Depressive symptom severity was measured with the 8-item Patient Health Questionnaire (PHQ-8) through mobile phones every 2 weeks. Participants’ location data were recorded by GPS and network sensors in mobile phones every 10 minutes, and 11 mobility features were extracted from location data for the 2 weeks prior to the PHQ-8 assessment. Dynamic structural equation modeling was used to explore the longitudinal relationships between depressive symptom severity and phone-measured mobility. ResultsThis study included 2341 PHQ-8 records and corresponding phone-collected location data from 290 participants (age: median 50.0 IQR 34.0, 59.0) years; of whom 215 (74.1%) were female, and 149 (51.4%) were employed. Significant negative correlations were found between depressive symptom severity and phone-measured mobility, and these correlations were more significant at the within-individual level than the between-individual level. For the direction of relationships over time, Homestay (time at home) (φ=0.09, P=.01), Location Entropy (time distribution on different locations) (φ=−0.04, P=.02), and Residential Location Count (reflecting traveling) (φ=0.05, P=.02) were significantly correlated with the subsequent changes in the PHQ-8 score, while changes in the PHQ-8 score significantly affected (φ=−0.07, P

BackgroundMost smartphones and wearables are currently equipped with location sensing (using GPS and mobile network information), which enables continuous location tracking of their users. Several studies have reported that various mobility metrics, as well as home stay, that is, the amount of time an individual spends at home in a day, are associated with symptom severity in people with major depressive disorder (MDD). Owing to the use of small and homogeneous cohorts of participants, it is uncertain whether the findings reported in those studies generalize to a broader population of individuals with MDD symptoms. ObjectiveThe objective of this study is to examine the relationship between the overall severity of depressive symptoms, as assessed by the 8-item Patient Health Questionnaire, and median daily home stay over the 2 weeks preceding the completion of a questionnaire in individuals with MDD. MethodsWe used questionnaire and geolocation data of 164 participants with MDD collected in the observational Remote Assessment of Disease and Relapse–Major Depressive Disorder study. The participants were recruited from three study sites: King’s College London in the United Kingdom (109/164, 66.5%); Vrije Universiteit Medisch Centrum in Amsterdam, the Netherlands (17/164, 10.4%); and Centro de Investigación Biomédica en Red in Barcelona, Spain (38/164, 23.2%). We used a linear regression model and a resampling technique (n=100 draws) to investigate the relationship between home stay and the overall severity of MDD symptoms. Participant age at enrollment, gender, occupational status, and geolocation data quality metrics were included in the model as additional explanatory variables. The 95% 2-sided CIs were used to evaluate the significance of model variables. ResultsParticipant age and severity of MDD symptoms were found to be significantly related to home stay, with older (95% CI 0.161-0.325) and more severely affected individuals (95% CI 0.015-0.184) spending more time at home. The association between home stay and symptoms severity appeared to be stronger on weekdays (95% CI 0.023-0.178, median 0.098; home stay: 25th-75th percentiles 17.8-22.8, median 20.9 hours a day) than on weekends (95% CI −0.079 to 0.149, median 0.052; home stay: 25th-75th percentiles 19.7-23.5, median 22.3 hours a day). Furthermore, we found a significant modulation of home stay by occupational status, with employment reducing home stay (employed participants: 25th-75th percentiles 16.1-22.1, median 19.7 hours a day; unemployed participants: 25th-75th percentiles 20.4-23.5, median 22.6 hours a day). ConclusionsOur findings suggest that home stay is associated with symptom severity in MDD and demonstrate the importance of accounting for confounding factors in future studies. In addition, they illustrate that passive sensing of individuals with depression is feasible and could provide clinically relevant information to monitor the course of illness in patients with MDD.

Identification of risk factors of treatment resistance may be useful to guide treatment selection, avoid inefficient trial-and-error, and improve major depressive disorder (MDD) care. We extended the work in predictive modeling of treatment resistant depression (TRD) via partition of the data from the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) cohort into a training and a testing dataset. We also included data from a small yet completely independent cohort RIS-INT-93 as an external test dataset. We used features from enrollment and level 1 treatment (up to week 2 response only) of STAR*D to explore the feature space comprehensively and applied machine learning methods to model TRD outcome at level 2. For TRD defined using QIDS-C16 remission criteria, multiple machine learning models were internally cross-validated in the STAR*D training dataset and externally validated in both the STAR*D testing dataset and RIS-INT-93 independent dataset with an area under the receiver operating characteristic curve (AUC) of 0.70-0.78 and 0.72-0.77, respectively. The upper bound for the AUC achievable with the full set of features could be as high as 0.78 in the STAR*D testing dataset. Model developed using top 30 features identified using feature selection technique (k-means clustering followed by χ2 test) achieved an AUC of 0.77 in the STAR*D testing dataset. In addition, the model developed using overlapping features between STAR*D and RIS-INT-93, achieved an AUC of > 0.70 in both the STAR*D testing and RIS-INT-93 datasets. Among all the features explored in STAR*D and RIS-INT-93 datasets, the most important feature was early or initial treatment response or symptom severity at week 2. These results indicate that prediction of TRD prior to undergoing a second round of antidepressant treatment could be feasible even in the absence of biomarker data.