Search

BackgroundDespite the increasing use of remote measurement technologies (RMT) such as wearables or biosensors in health care programs, challenges associated with selecting and implementing these technologies persist. Many health care programs that use RMT rely on commercially available, “off-the-shelf” devices to collect patient data. However, validation of these devices is sparse, the technology landscape is constantly changing, relative benefits between device options are often unclear, and research on patient and health care provider preferences is often lacking. ObjectiveTo address these common challenges, we propose a novel device selection framework extrapolated from human-centered design principles, which are commonly used in de novo digital health product design. We then present a case study in which we used the framework to identify, test, select, and implement off-the-shelf devices for the Remote Assessment of Disease and Relapse-Central Nervous System (RADAR-CNS) consortium, a research program using RMT to study central nervous system disease progression. MethodsThe RADAR-CNS device selection framework describes a human-centered approach to device selection for mobile health programs. The framework guides study designers through stakeholder engagement, technology landscaping, rapid proof of concept testing, and creative problem solving to develop device selection criteria and a robust implementation strategy. It also describes a method for considering compromises when tensions between stakeholder needs occur. ResultsThe framework successfully guided device selection for the RADAR-CNS study on relapse in multiple sclerosis. In the initial stage, we engaged a multidisciplinary team of patients, health care professionals, researchers, and technologists to identify our primary device-related goals. We desired regular home-based measurements of gait, balance, fatigue, heart rate, and sleep over the course of the study. However, devices and measurement methods had to be user friendly, secure, and able to produce high quality data. In the second stage, we iteratively refined our strategy and selected devices based on technological and regulatory constraints, user feedback, and research goals. At several points, we used this method to devise compromises that addressed conflicting stakeholder needs. We then implemented a feedback mechanism into the study to gather lessons about devices to improve future versions of the RADAR-CNS program. ConclusionsThe RADAR device selection framework provides a structured yet flexible approach to device selection for health care programs and can be used to systematically approach complex decisions that require teams to consider patient experiences alongside scientific priorities and logistical, technical, or regulatory constraints.

Participants with autism spectrum disorder (ASD) (n = 121, mean [SD] age: 14.6 [8.0] years) and typically developing (TD) controls (n = 40, 16.4 [13.3] years) were presented with a series of videos representing biological motion on one side of a computer monitor screen and non-biological motion on the other, while their eye movements were recorded. As predicted, participants with ASD spent less overall time looking at presented stimuli than TD participants (P

BackgroundReduction or differences in facial expression are a core diagnostic feature of autism spectrum disorder (ASD), yet evidence regarding the extent of this discrepancy is limited and inconsistent. Use of automated facial expression detection technology enables accurate and efficient tracking of facial expressions that has potential to identify individual response differences.MethodsChildren and adults with ASD (N = 124) and typically developing (TD, N = 41) were shown short clips of "funny videos." Using automated facial analysis software, we investigated differences between ASD and TD groups and within the ASD group in evidence of facial action unit (AU) activation related to the expression of positive facial expression, in particular, a smile.ResultsIndividuals with ASD on average showed less evidence of facial AUs (AU12, AU6) relating to positive facial expression, compared to the TD group (p < .05, r = - 0.17). Using Gaussian mixture model for clustering, we identified two distinct distributions within the ASD group, which were then compared to the TD group. One subgroup (n = 35), termed "over-responsive," expressed more intense positive facial expressions in response to the videos than the TD group (p < .001, r = 0.31). The second subgroup (n = 89), ("under-responsive"), displayed fewer, less intense positive facial expressions in response to videos than the TD group (p < .001; r = - 0.36). The over-responsive subgroup differed from the under-responsive subgroup in age and caregiver-reported impulsivity (p < .05, r = 0.21). Reduced expression in the under-responsive, but not the over-responsive group, was related to caregiver-reported social withdrawal (p < .01, r = - 0.3).LimitationsThis exploratory study does not account for multiple comparisons, and future work will have to ascertain the strength and reproducibility of all results. Reduced displays of positive facial expressions do not mean individuals with ASD do not experience positive emotions.ConclusionsIndividuals with ASD differed from the TD group in their facial expressions of positive emotion in response to "funny videos." Identification of subgroups based on response may help in parsing heterogeneity in ASD and enable targeting of treatment based on subtypes.Trial registrationClinicalTrials.gov, NCT02299700. Registration date: November 24, 2014.

BackgroundDiminished visual monitoring of faces and activities of others is an early feature of autism spectrum disorder (ASD). It is uncertain whether deficits in activity monitoring, identified using a homogeneous set of stimuli, persist throughout the lifespan in ASD, and thus, whether they could serve as a biological indicator ("biomarker") of ASD. We investigated differences in visual attention during activity monitoring in children and adult participants with autism compared to a control group of participants without autism.MethodsEye movements of participants with autism (n = 122; mean age [SD] = 14.5 [8.0] years) and typically developing (TD) controls (n = 40, age = 16.4 [13.3] years) were recorded while they viewed a series of videos depicting two female actors conversing while interacting with their hands over a shared task. Actors either continuously focused their gaze on each other's face (mutual gaze) or on the shared activity area (shared focus). Mean percentage looking time was computed for the activity area, actors' heads, and their bodies.ResultsCompared to TD participants, participants with ASD looked longer at the activity area (mean % looking time: 58.5% vs. 53.8%, p  60] limited the ability to include individuals with substantial intellectual disability.ConclusionsDifferences in attention to faces could constitute a feature discriminative between individuals with and without ASD across the lifespan, whereas between-group differences in looking at activities may shift with development. These findings may have applications in the search for underlying biological indicators specific to ASD. Trial registration ClinicalTrials.gov identifier NCT02668991.

Objective:The relationship between sleep (caregiver-reported and actigraphy-measured) and other caregiver-reported behaviors in children and adults with autism spectrum disorder (ASD) was examined, including the use of machine learning to identify sleep variables important in predicting anxiety in ASD. Methods:Caregivers of ASD (n = 144) and typically developing (TD) (n = 41) participants reported on sleep and other behaviors. ASD participants wore an actigraphy device at nighttime during an 8 or 10-week non-interventional study. Mean and variability of actigraphy measures for ASD participants in the week preceding midpoint and endpoint were calculated and compared with caregiver-reported and clinician-reported symptoms using a mixed effects model. An elastic-net model was developed to examine which sleep measures may drive prediction of anxiety. Results:Prevalence of caregiver-reported sleep difficulties in ASD was approximately 70% and correlated significantly (p < 0.05) with sleep efficiency measured by actigraphy. Mean and variability of actigraphy measures like sleep efficiency and number of awakenings were related significantly (p < 0.05) to ASD symptom severity, hyperactivity and anxiety. In the elastic net model, caregiver-reported sleep, and variability of sleep efficiency and awakenings were amongst the important predictors of anxiety. Conclusion:Caregivers report problems with sleep in the majority of children and adults with ASD. Reported problems and actigraphy measures of sleep, particularly variability, are related to parent reported behaviors. Measuring variability in sleep may prove useful in understanding the relationship between sleep problems and behavior in individuals with ASD. These findings may have implications for both intervention and monitoring outcomes in ASD.

We propose the addition of usability validation to the extended V3 framework, now "V3+", and describe a pragmatic approach to ensuring that sensor-based digital health technologies can be used optimally at scale by diverse users. Alongside the original V3 components (verification; analytical validation; clinical validation), usability validation will ensure user-centricity of digital measurement tools, paving the way for more inclusive, reliable, and trustworthy digital measures within clinical research and clinical care. [ABSTRACT FROM AUTHOR]

Objective: The Janssen Autism Knowledge Engine (JAKE®) is a clinical research outcomes assessment system developed to more sensitively measure treatment outcomes and identify subpopulations in autism spectrum disorder (ASD). Here we describe JAKE and present results from its digital phenotyping (My JAKE) and biosensor (JAKE Sense) components. Methods: An observational, non-interventional, prospective study of JAKE in children and adults with ASD was conducted at nine sites in the United States. Feedback on JAKE usability was obtained from caregivers. JAKE Sense included electroencephalography, eye tracking, electrocardiography, electrodermal activity, facial affect analysis, and actigraphy. Caregivers of individuals with ASD reported behaviors using My JAKE. Results from My JAKE and JAKE Sense were compared to traditional ASD symptom measures. Results: Individuals with ASD (N = 144) and a cohort of typically developing (TD) individuals (N = 41) participated in JAKE Sense. Most caregivers reported that overall use and utility of My JAKE was "easy" (69%, 74/108) or "very easy" (74%, 80/108). My JAKE could detect differences in ASD symptoms as measured by traditional methods. The majority of biosensors included in JAKE Sense captured sizable amounts of quality data (i.e., 93-100% of eye tracker, facial affect analysis, and electrocardiogram data was of good quality), demonstrated differences between TD and ASD individuals, and correlated with ASD symptom scales. No significant safety events were reported. Conclusions: My JAKE was viewed as easy or very easy to use by caregivers participating in research outside of a clinical study. My JAKE sensitively measured a broad range of ASD symptoms. JAKE Sense biosensors were well-tolerated. JAKE functioned well when used at clinical sites previously inexperienced with some of the technologies. Lessons from the study will optimize JAKE for use in clinical trials to assess ASD interventions. Additionally, because biosensors were able to detect features differentiating TD and ASD individuals, and also were correlated with standardized symptom scales, these measures could be explored as potential biomarkers for ASD and as endpoints in future clinical studies. Clinical Trial Registration: https://clinicaltrials.gov/ct2/show/NCT02668991 identifier: NCT02668991.

Wearables with photoplethysmography (PPG) sensors are being increasingly used in clinical research as a non-invasive, inexpensive method for remote monitoring of physiological health. Ensuring the accuracy and reliability of PPG-derived measurements is critical, as inaccuracies can impact research findings and clinical decisions. This paper systematically compares heart rate (HR) and heart rate variability (HRV) measures from PPG against an electrocardiogram (ECG) monitor in free-living settings. Two devices with PPG and one device with an ECG sensor were worn by 25 healthy volunteers for 10 days. PPG-derived HR and HRV showed reasonable accuracy and reliability, particularly during sleep, with mean absolute error < 1 beat for HR and 6–15 ms for HRV. The relative error of HRV estimated from PPG varied with activity type and was higher than during the resting state by 14–51%. The accuracy of HR/HRV was impacted by the proportion of usable data, body posture, and epoch length. The multi-scale peak and trough detection algorithm demonstrated superior performance in detecting beats from PPG signals, with an F1 score of 89% during sleep. The study demonstrates the trade-offs of utilizing PPG measurements for remote monitoring in daily life and identifies optimal use conditions by recommending enhancements. [ABSTRACT FROM AUTHOR]

Objective: To test usability and optimize the Janssen Autism Knowledge Engine (JAKE®) system's components, biosensors, and procedures used for objective measurement of core and associated symptoms of autism spectrum disorder (ASD) in clinical trials. Methods: A prospective, observational study of 29 children and adolescents with ASD using the JAKE system was conducted at three sites in the United States. This study was designed to establish the feasibility of the JAKE system and to learn practical aspects of its implementation. In addition to information collected by web and mobile components, wearable biosensor data were collected both continuously in natural settings and periodically during a battery of experimental tasks administered in laboratory settings. This study is registered at clinicaltrials.gov, NCT02299700. Results: Feedback collected throughout the study allowed future refinements to be planned for all components of the system. The Autism Behavior Inventory (ABI), a parent-reported measure of ASD core and associated symptoms, performed well. Among biosensors studied, the eye-tracker, sleep monitor, and electrocardiogram were shown to capture high quality data, whereas wireless electroencephalography was difficult to use due to its form factor. On an exit survey, the majority of parents rated their overall reaction to JAKE as positive/very positive. No significant device-related events were reported in the study. Conclusion: The results of this study, with the described changes, demonstrate that the JAKE system is a viable, useful, and safe platform for use in clinical trials of ASD, justifying larger validation and deployment studies of the optimized system.

Background: Increasing adoption of sensor-based digital health technologies (sDHTs) in recent years has cast light on the many challenges in implementing these tools into clinical trials and patient care at scale across diverse patient populations; however, the methodological approaches taken toward sDHT usability evaluation have varied markedly. Objective: This review aims to explore the current landscape of studies reporting data related to sDHT human factors, human-centered design, and usability, to inform our concurrent work on developing an evaluation framework for sDHT usability. Methods: We conducted a scoping review of studies published between 2013 and 2023 and indexed in PubMed, in which data related to sDHT human factors, human-centered design, and usability were reported. Following a systematic screening process, we extracted the study design, participant sample, the sDHT or sDHTs used, the methods of data capture, and the types of usability-related data captured. Results: Our literature search returned 442 papers, of which 85 papers were found to be eligible and 83 papers were available for data extraction and not under embargo. In total, 164 sDHTs were evaluated; 141 (86%) sDHTs were wearable tools while the remaining 23 (14%) sDHTs were ambient tools. The majority of studies (55/83, 66%) reported summative evaluations of final-design sDHTs. Almost all studies (82/83, 99%) captured data from targeted end users, but only 18 (22%) out of 83 studies captured data from additional users such as care partners or clinicians. User satisfaction and ease of use were evaluated for 83% (136/164) and 91% (150/164) of sDHTs, respectively; however, learnability, efficiency, and memorability were reported for only 11 (7%), 4 (2%), and 2 (1%) out of 164 sDHTs, respectively. A total of 14 (9%) out of 164 sDHTs were evaluated according to the extent to which users were able to understand the clinical data or other information presented to them (understandability) or the actions or tasks they should complete in response (actionability). Notable gaps in reporting included the absence of a sample size rationale (reported for 21/83, 25% of all studies and 17/55, 31% of summative studies) and incomplete sociodemographic descriptive data (complete age, sex/gender, and race/ethnicity reported for 14/83, 17% of studies). Conclusions: Based on our findings, we suggest four actionable recommendations for future studies that will help to advance the implementation of sDHTs: (1) consider an in-depth assessment of technology usability beyond user satisfaction and ease of use, (2) expand recruitment to include important user groups such as clinicians and care partners, (3) report the rationale for key study design considerations including the sample size, and (4) provide rich descriptive statistics regarding the study sample to allow a complete understanding of generalizability to other patient populations and contexts of use. [ABSTRACT FROM AUTHOR]

Background: Functional decline in Alzheimer's disease (AD) is typically measured using single-time point subjective rating scales, which rely on direct observation or (caregiver) recall. Remote monitoring technologies (RMTs), such as smartphone applications, wearables, and home-based sensors, can change these periodic subjective assessments to more frequent, or even continuous, objective monitoring. The aim of the RADAR-AD study is to assess the accuracy and validity of RMTs in measuring functional decline in a real-world environment across preclinical-to-moderate stages of AD compared to standard clinical rating scales. Methods: This study includes three tiers. For the main study, we will include participants (n = 220) with preclinical AD, prodromal AD, mild-to-moderate AD, and healthy controls, classified by MMSE and CDR score, from clinical sites equally distributed over 13 European countries. Participants will undergo extensive neuropsychological testing and physical examination. The RMT assessments, performed over an 8-week period, include walk tests, financial management tasks, an augmented reality game, two activity trackers, and two smartphone applications installed on the participants' phone. In the first sub-study, fixed sensors will be installed in the homes of a representative sub-sample of 40 participants. In the second sub-study, 10 participants will stay in a smart home for 1 week. The primary outcome of this study is the difference in functional domain profiles assessed using RMTs between the four study groups. The four participant groups will be compared for each RMT outcome measure separately. Each RMT outcome will be compared to a standard clinical test which measures the same functional or cognitive domain. Finally, multivariate prediction models will be developed. Data collection and privacy are important aspects of the project, which will be managed using the RADAR-base data platform running on specifically designed biomedical research computing infrastructure. Results: First results are expected to be disseminated in 2022. Conclusion: Our study is well placed to evaluate the clinical utility of RMT assessments. Leveraging modern-day technology may deliver new and improved methods for accurately monitoring functional decline in all stages of AD. It is greatly anticipated that these methods could lead to objective and real-life functional endpoints with increased sensitivity to pharmacological agent signal detection. [ABSTRACT FROM AUTHOR]

Background: Alzheimer's Disease (AD) impairs the ability to carry out daily activities, reduces independence and quality of life and increases caregiver burden. Our understanding of functional decline has traditionally relied on reports by family and caregivers, which are subjective and vulnerable to recall bias. The Internet of Things (IoT) and wearable sensor technologies promise to provide objective, affordable, and reliable means for monitoring and understanding function. However, human factors for its acceptance are relatively unexplored. Objective: The Public Involvement (PI) activity presented in this paper aims to capture the preferences, priorities and concerns of people with AD and their caregivers for using monitoring wearables. Their feedback will drive device selection for clinical research, starting with the study of the RADAR-AD project. Method: The PI activity involved the Patient Advisory Board (PAB) of the RADAR-AD project, comprised of people with dementia across Europe and their caregivers (11 and 10, respectively). A set of four devices that optimally represent various combinations of aspects and features from the variety of currently available wearables (e.g., weight, size, comfort, battery life, screen types, water-resistance, and metrics) was presented and experienced hands-on. Afterwards, sets of cards were used to rate and rank devices and features and freely discuss preferences. Results: Overall, the PAB was willing to accept and incorporate devices into their daily lives. For the presented devices, the aspects most important to them included comfort, convenience and affordability. For devices in general, the features they prioritized were appearance/style, battery life and water resistance, followed by price, having an emergency button and a screen with metrics. The metrics valuable to them included activity levels and heart rate, followed by respiration rate, sleep quality and distance. Some concerns were the potential complexity, forgetting to charge the device, the potential stigma and data privacy. Conclusions: The PI activity explored the preferences, priorities and concerns of the PAB, a group of people with dementia and caregivers across Europe, regarding devices for monitoring function and decline, after a hands-on experience and explanation. They highlighted some expected aspects, metrics and features (e.g., comfort and convenience), but also some less expected (e.g., screen with metrics). [ABSTRACT FROM AUTHOR]

Objective: Movement‐based wearable sensors are used for detection of convulsive seizures. The identification of the absence of motion following a seizure, known as post‐ictal immobility (PI), may represent a potential additional application of wearables. PI has been associated with potentially life‐threatening complications and with sudden unexpected death in epilepsy (SUDEP). We aimed to assess whether wearable accelerometers (ACCs) could be used as a digital marker of PI. Method: Devices with embedded ACCs were worn by patients admitted to an epilepsy monitoring unit. Participants presenting with convulsive seizures were included in the study. PI presence and duration were assessed by experts reviewing video recordings. An algorithm for the automatic detection of post‐ictal ACC silence and its duration was developed and the linear pairwise relationship between the automatically detected duration of post‐ictal ACC silence and the duration of the expert‐labeled PI was analyzed. Results: Twenty‐two convulsive seizures were recorded from 18 study participants. Twenty were followed by PI and two by agitation. The automated estimation of post‐ictal ACC silence identified all the 20 expert‐labeled PI. The regression showed that the duration of the post‐ictal ACC silence was correlated with the duration of PI (Pearson r =.92; P <.001), with the age of study participants (Pearson r =.78; P <.001), and with the duration of post‐ictal generalized electroencephalography suppression (PGES; Pearson r =.4; P =.033). Significance: We highlight a novel application of wearables as a way to record post‐ictal manifestations associated with an increased risk of SUDEP. The occurrence of a fatal seizure is unpredictable and the continuous, non‐invasive, long‐term identification of risk factors associated with each individual seizure may assume a great clinical importance. [ABSTRACT FROM AUTHOR]

Objective: The Janssen Autism Knowledge Engine (JAKE®) is a clinical research outcomes assessment system developed to more sensitively measure treatment outcomes and identify subpopulations in autism spectrum disorder (ASD). Here we describe JAKE and present results from its digital phenotyping (My JAKE) and biosensor (JAKE Sense) components. Methods: An observational, non-interventional, prospective study of JAKE in children and adults with ASD was conducted at nine sites in the United States. Feedback on JAKE usability was obtained from caregivers. JAKE Sense included electroencephalography, eye tracking, electrocardiography, electrodermal activity, facial affect analysis, and actigraphy. Caregivers of individuals with ASD reported behaviors using My JAKE. Results from My JAKE and JAKE Sense were compared to traditional ASD symptom measures. Results: Individuals with ASD (N = 144) and a cohort of typically developing (TD) individuals (N = 41) participated in JAKE Sense. Most caregivers reported that overall use and utility of My JAKE was "easy" (69%, 74/108) or "very easy" (74%, 80/108). My JAKE could detect differences in ASD symptoms as measured by traditional methods. The majority of biosensors included in JAKE Sense captured sizable amounts of quality data (i.e., 93–100% of eye tracker, facial affect analysis, and electrocardiogram data was of good quality), demonstrated differences between TD and ASD individuals, and correlated with ASD symptom scales. No significant safety events were reported. Conclusions: My JAKE was viewed as easy or very easy to use by caregivers participating in research outside of a clinical study. My JAKE sensitively measured a broad range of ASD symptoms. JAKE Sense biosensors were well-tolerated. JAKE functioned well when used at clinical sites previously inexperienced with some of the technologies. Lessons from the study will optimize JAKE for use in clinical trials to assess ASD interventions. Additionally, because biosensors were able to detect features differentiating TD and ASD individuals, and also were correlated with standardized symptom scales, these measures could be explored as potential biomarkers for ASD and as endpoints in future clinical studies. Clinical Trial Registration: https://clinicaltrials.gov/ct2/show/NCT02668991 identifier: NCT02668991 [ABSTRACT FROM AUTHOR]