Search

BackgroundPilot studies test the feasibility of methods and procedures to be used in larger-scale studies. Although numerous articles describe guidelines for the conduct of pilot studies, few have included specific feasibility indicators or strategies for evaluating multiple aspects of feasibility. In addition, using pilot studies to estimate effect sizes to plan sample sizes for subsequent randomized controlled trials has been challenged; however, there has been little consensus on alternative strategies.MethodsIn Section 1, specific indicators (recruitment, retention, intervention fidelity, acceptability, adherence, and engagement) are presented for feasibility assessment of data collection methods and intervention implementation. Section 1 also highlights the importance of examining feasibility when adapting an intervention tested in mainstream populations to a new more diverse group. In Section 2, statistical and design issues are presented, including sample sizes for pilot studies, estimates of minimally important differences, design effects, confidence intervals (CI) and nonparametric statistics. An in-depth treatment of the limits of effect size estimation as well as process variables is presented. Tables showing CI around parameters are provided. With small samples, effect size, completion and adherence rate estimates will have large CI.ConclusionThis commentary offers examples of indicators for evaluating feasibility, and of the limits of effect size estimation in pilot studies. As demonstrated, most pilot studies should not be used to estimate effect sizes, provide power calculations for statistical tests or perform exploratory analyses of efficacy. It is hoped that these guidelines will be useful to those planning pilot/feasibility studies before a larger-scale study.

Background/objectivesIn the Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) study, a multifactorial intervention was associated with a nonsignificant 8% reduction in time to first serious fall injury but a significant 10% reduction in time to first self-reported fall injury relative to enhanced usual care. The effect of the intervention on other outcomes important to patients has not yet been reported. We aimed to evaluate the effect of the intervention on patient well-being including concern about falling, anxiety, depression, physical function, and disability.DesignPragmatic cluster-randomized trial of 5,451 community-living persons at high risk for serious fall injuries.SettingA total of 86 primary care practices within 10 U.S. healthcare systems.ParticipantsA random subsample of 743 persons aged 75 and older.MeasurementsThe well-being measures, assessed at baseline, 12 months, and 24 months, included a modified version of the Fall Efficacy Scale, Patient-Reported Outcomes Measurement Information System (PROMIS) anxiety and depression scales, and Late-Life Function and Disability Instrument.ResultsParticipants in the intervention (n = 384) and control groups (n = 359) were comparable in age: mean (standard deviation) of 81.9 (4.7) versus 81.8 (5.0) years. Mean scores were similar between groups at 12 and 24 months for concern about falling, physical function, and disability, whereas the intervention group's mean scores on anxiety and depression were .7 points lower (i.e., better) at 12 months and .6 to .8 points lower at 24 months. For each of these outcomes, differences between the groups' adjusted least square mean changes from baseline to 12 and 24 months, respectively, were quantitatively small. The overall difference in means between groups over 2 years was statistically significant only for depression, favoring the intervention: -1.19 (99% confidence interval, -2.36 to -.02), with 3.5 points representing a minimally important difference.ConclusionsSTRIDE's multifactorial intervention to reduce fall injuries was not associated with clinically meaningful improvements in patient well-being.

Background: Because early recognition of symptoms and timely treatment of stroke can reduce mortality and the longterm effects of such events, efforts to make many people both aware of these symptoms and knowledgeable about what to do when recognising them are critical for reducing impacts from stroke. Objectives: To assess the impact of a stroke preparedness film (intervention) and stroke preparedness pamphlets (usual care) on self-efficacy for stroke recognition and action. Design: Two-arm cluster randomised trial conducted between July 2013 and August 2018. Setting: A total of 13 church sites located in economically disadvantaged urban neighbourhoods in New York. Of the 883 churchgoers approached, 503 expressed interest, 375 completed eligibility screening and 312 were randomised. Participant inclusion criteria were Black or Hispanic churchgoers, aged 34years or older, without stroke history, but at a high risk for stroke. The intervention consisted of two 12-minute stroke films: "Gospel of Stroke," in English for Black participants, and "Derrame Cerebral," in Spanish for Hispanic participants. Method: Participants were pre-post-tested (at baseline, 6-month follow-up and 12-month follow-up) for self-efficacy. Descriptive analysis, a linear mixed model and "t" tests were used to assess the effects of a stroke preparedness film and stroke preparedness pamphlets on self-efficacy. Results: Findings are based on intention-to-treat analysis. A total of 310 participants completed the study (99% retention rate). About half (53.8%) of participants were Black and 46.2% Hispanic in the intervention group; 48.3% were Black and 51.7% were Hispanic in the usual care group. Overall, both groups evidenced higher self-efficacy (i.e. lower predicted means) over time (p < 0.0001), although a significant benefit was not observed for the intervention relative to usual care. Conclusion: Both stroke preparedness films and stroke preparedness pamphlets improved self-efficacy with respect to stroke recognition and action among minority churchgoers.

BackgroundIn health disparities research, studies often fall short of their recruitment goals. Conducting a pilot feasibility study of recruitment in which data are collected systematically on recruitment processes can help investigators refine methods for the larger study. However, there are few guidelines for conducting pilot feasibility studies, and recruitment methods are seldom the focus. Feasibility indicators differ from traditional reports of recruitment results by focusing on the extent to which recruitment goals are met.MethodsWe present an organizing framework for assessing the feasibility of recruitment that includes eight steps, briefly: 1) specify recruitment goals; 2) specify recruitment processes; 3) establish a tracking system for each individual; 4) establish a tracking database for monitoring processes and results; 5) implement recruitment and track each individual's progress; 6) summarize recruitment results; 7) calculate and interpret feasibility measures - were goals met; and 8) if goals were not met, utilize tracking data to modify methods for the larger study. We describe methods within each step, with added details for steps 2-5 (the specific processes). The framework draws from a small literature on recruitment feasibility with a focus on health disparities populations. The guidelines blend well-known methods of recruitment with additional information on calculating feasibility indicators.ConclusionsThese guidelines provide a first step in thinking systematically about recruitment feasibility, to advance the field of measuring feasibility. Feasibility indicators also can be used to track the effectiveness of innovative recruitment strategies as part of building the science of recruitment, especially in disparities populations.

Background: There are few existing methods to quantify total exposure burden to chemical mixtures, independent of a health outcome. A summary metric could be advantageous for use in biomonitoring, risk assessment, health risk calculators, and mediation models. Objective: We developed a novel exposure burden score method for chemical mixtures, applied it to estimate exposure burden to per- and polyfluoroalkyl substances (PFAS) mixtures, and estimated associations of PFAS burden scores with cardio-metabolic outcomes in the general U.S. population. Methods: We applied item response theory (IRT) to biomonitoring data from 1,915 children and adults 12-80 years of age in the 2017-2018 National Health and Examination Survey to quantify a latent PFAS burden score, using serum concentrations of eight measured PFAS biomarkers, each considered an 'item.' The premise of IRT is that through using both information about a participant's concentration of an individual PFAS biomarker, as well as their exposure patterns for the PFAS mixture, we can estimate the participant's latent PFAS exposure burden, independent of a health outcome. We used linear regression to estimate associations of the PFAS burden score with cardio-metabolic outcomes and compared our findings to results using summed PFAS concentrations as the exposure metric. Results: PFAS burden scores and summed PFAS concentrations had moderate-high correlation (p = 0.75). Isomers of PFOS [n-perfluorooctane sulfonic acid (n-PFOS) and perfluoromethylheptane sulfonic acid isomers (Sm-PFOS)] were the most informative to the PFAS burden scores. PFAS burden scores and summed PFAS concentrations were both significantly associated with cardio-metabolic outcomes, but associations were generally closer to the null for summed PFAS concentrations vs. the PFAS burden score. Adjusted associations (95% CIs) with total cholesterol (in milligrams per deciliter) were 8.6 (95% CI: 5.2, 11.9) and 2.4 (95% CI: 0.5, 4.2) per interquartile range increase in the PFAS burden score and summed concentrations, respectively. Sensitivity analyses showed similar associations with cardio-metabolic outcomes when only a subset of PFAS biomarkers was used to estimate PFAS burden. In a validation study, associations between PFAS burden scores and cholesterol were consistent with primary analyses but null when using summed PFAS concentrations. Discussion: IRT offers a straightforward way to include exposure biomarkers with low detection frequencies and can reduce exposure measurement error. Further, IRT enables comparisons of exposure burden to chemical mixtures across studies even if they did not measure the exact same set of chemicals, which supports harmonization across studies and consortia. We provide an accompanying PFAS burden calculator (https://pfasburden. shinyapps.io/app_pfas_burden/), enabling researchers to calculate PFAS burden scores based on U.S. population exposure reference ranges. https:// doi.org/10.1289/EHP10125, Introduction Most existing statistical methods to elucidate health effects of environmental mixtures are supervised, (1-5) meaning that they study associations between individual exposures or chemical mixtures in the context of [...]

Most studies of vision in persons with Alzheimer's disease either exclude those with advanced dementia or are unable to assess their vision adequately, and therefore, improperly report these persons' visual acuity status. In this study, visual acuity was assessed using the ETDRS Snellen-type acuity chart and Teller Acuity Cards. The Teller Acuity Cards were used only after the participants were unable to respond appropriately to the ETDRS, which in most studies would be a basis for excluding such persons or misreporting their visual acuity. This study yielded additional data on visual acuity in a population of elderly persons for whom visual acuity has not previously been well documented. The results presented estimates of visual acuity by level of dementia and data on prevalence for a population of elderly persons, including those at all stages of dementia. This study also demonstrated that assessments of visual acuity with Snellen-type protocols, such as the ETDRS, are generally inadequate for assessing visual acuity in persons with dementia and that Teller Acuity Cards are useful for this purpose after the use of ETDRS is no longer possible. Moreover, the utility of both methods declines as the level of dementia increases. The ability to assess the visual acuity of persons with dementia will contribute to a more precise determination of the prevalence of visual impairment in elderly people.

Unexpected lucidity is a phenomenon of scientific, clinical, and psychological relevance to health professionals, to those who experience it, and their relatives. This paper describes qualitative methods used to develop an informant-based measure of lucidity episodes. The approach was refinement of the operationalization of the construct; review of seminal items, modification, and purification; and confirmation of the feasibility of reporting methodology. Modified focus groups were conducted with 20 staff and 10 family members using a web-based survey. Themes included reaction when hearing the term; words that come to mind; description of and first reaction to referenced or observed 'lucidity' events. Semi-structured cognitive interviews were conducted with 10 health professionals working with older adults with cognitive impairment. Data were extracted from Qualtrics or Microsoft 365 Word® for analysis using NVivo. Conceptual issues, as well as issues regarding comprehension, interpretation, clarity, semantics, and standardization of definitions derived from an external advisory board, focus groups and cognitive interviews informed items' modification, and resulted in the final lucidity measure. An obstacle to understanding the mechanisms and estimating the prevalence of lucid events among individuals with dementia and other neurological conditions is the scarcity of reliable and valid measures. The substantive and varied data gathered from multiple methods including the collaborative work of an External Advisory Board, modified focus groups with staff and family caregivers, and structured cognitive interviews with health professionals were central in creating the revised version of the lucidity measure. [ABSTRACT FROM AUTHOR]

Pre-Conference Workshop in conjunction with the Annual Meeting of the Geriatrics Society of America San Diego Convention Center, San Diego, CA, USA, 14 November 2012 In 2004, the NIH awarded contracts to initiate the development of high-quality psychological and neuropsychological outcome measures for the improved assessment of health-related outcomes. The workshop introduced these measurement development initiatives, the measures created and the NIH-supported resource (Assessment Center) for internet or tablet-based test administration and scoring. Presentations covered item response theory and assessment of test bias, construction of item banks and computerized adaptive testing, and the different ways in which qualitative analyses contribute to the definition of construct domains and the refinement of outcome constructs. The panel discussion included questions about representativeness of samples and the assessment of cultural bias.

A randomized controlled trial examined whether the diagnostic process for Alzheimer's disease and other dementias may be influenced by knowledge of the patient's education and/or self-reported race. Four conditions were implemented: diagnostic team knows (a) race and education, (b) education only, (c) race only, or (d) neither. Diagnosis and clinical staging was established at baseline, at Wave 2, and for a random sample of Wave 3 respondents by a consensus panel. At study end, a longitudinal, "gold standard" diagnosis was made for patients with follow-up data (71%). Group differences in "Diagnostic and Statistical Manual of Mental Disorders" (4th ed.; American Psychiatric Association, 1994) diagnosis were estimated using logistic regression and generalized estimating equations. Sensitivity and specificity were examined for baseline diagnosis in relation to the gold standard, longitudinal diagnosis. Despite equivalent status on all measured variables across waves, members of the "knows race only" group were less likely than those of other groups to receive a diagnosis of dementia. At final diagnosis, 19% of the "knows race only" group was diagnosed with dementia versus 38% to 40% in the other 3 conditions (p = 0.038). Examination of sensitivities and specificities of baseline diagnosis in relation to the gold standard diagnosis showed a nonsignificant trend for lower sensitivities in the knowing race conditions (0.3846), as contrasted with knowing education only (0.480) or neither (0.600). The finding that knowledge of race may influence the diagnostic process in some unknown way is timely, given the recent State-of-the-Science conference on Alzheimer's disease prevention, the authors of which called for information about and standardization of the diagnostic process. (Contains 2 figures and 5 tables.)

Purpose: Despite its prevalence and negative consequences, research on elder abuse has rarely considered resident-to-resident aggression (RRA) in nursing homes. This study employed a qualitative event reconstruction methodology to identify the major forms of RRA that occur in nursing homes. Design and methods: Events of RRA were identified within a 2-week period in all units (n = 53) in nursing homes located in New York City. Narrative reconstructions were created for each event based on information from residents and staff who were involved as well as other sources. The event reconstructions were analyzed using qualitative methods to identify common features of RRA events. Results: Analysis of the 122 event reconstructions identified 13 major forms of RRA, grouped under five themes. The resulting framework demonstrated the heterogeneity of types of RRA, the importance of considering personal, environmental, and triggering factors, and the potential emotional and physical harm to residents. Implications: These results suggest the need for person-centered and environmental interventions to reduce RRA, as well as for further research on the topic.

Context: Few telemedicine projects have systematically examined provider satisfaction and attitudes. Purpose: To determine the acceptability and perceived impact on primary care providers' (PCP) practices of a randomized clinical trial of the use of telemedicine to electronically deliver health care services to Medicare patients with diabetes in federally designated medically underserved areas of upstate New York, primarily those in rural areas and small towns with limited access to primary care. Methods: A longitudinal phone survey was completed by 116 PCPs with patients with diabetes in the treatment arm of the trial, and conducted 12 and 24 months after a PCP's first patient was randomized to the home telemedicine arm of the trial. The 36-item survey included measures of acceptability (to PCPs, time required), impact (on patient knowledge, confidence, perceived health outcomes), and communication. Six open-ended questions were analyzed qualitatively. Results: The quantitative data indicated positive responses in terms of acceptability of the telemedicine intervention to the PCPs and of the impact on the PCPs' patients. This was most evident in issues critical to good control of diabetes: patient knowledge, ability to manage diabetes, confidence, and compliance in managing diabetes. Key qualitative themes, on the positive end, were more patient control and motivation, helpfulness of having extra patient data, and involvement of nurses and dieticians. Negative themes were excessive paperwork and duplication taking more PCP time, and conflicting advice and management decisions from the telemedicine team, some without informing the PCP but none involving medications. Conclusions: Telemedicine was reported to be a positive experience for predominantly rural PCPs and their Medicare-eligible patients from medically underserved areas; several inefficiencies need to be refined.