Search

Purpose: To determine the utility of countermovement-jump and Keiser leg-press tests for tracking changes in elite athletes of different sports. Methods: Elite athletes of the Norwegian Olympic Federation (126 individuals from 18 sports) performed countermovement-jump and Keiser tests on 2 to 11 occasions between 2014 and 2021. Separate analyses were performed for male and female alpine skiing, male and female handball, male ice hockey, and males and females of other sports. Means and standard deviations of consecutive change scores were combined with short-term error of measurement (3.7%–7.0%) and smallest important changes (2.0%–3.6%, defined by standardization) to determine the proportions of athletes who experienced decisive changes in 2 senses: first, the athlete did not get substantially worse or better (>90% chance of either), and second, the athlete did get substantially worse or better (>90% chance of either). Results: Averaged over sports, Keiser peak power and relative peak power had the highest proportions of decisive changes in the first (60% and 55%) and second senses (25% and 28%). The velocity intercept of the force–velocity relationship had the lowest proportions in the first and second senses (29% and 11%), while jump height, Keiser mean power, relative mean power, the force intercept, and the slope of the force–velocity relationship had similar proportions (40%–53% and 15%–21%). Conclusions: With the possible exception of the Keiser test velocity intercept, the proportions of observed decisive changes in elite athletes using Keiser measures and countermovement-jump height between tests appear adequate for the measures to be useful for routine monitoring. [ABSTRACT FROM AUTHOR]

Objective: To assess the psychometric properties of the Spanish King's Parkinson's Disease Pain Scale (KPPS). Design: A descriptive transversal study at a Spanish hospital. Methods: Fifty‐three Parkinson's disease (PD) patients suffering from otherwise explained pain (34 females, age = 63.42 ± 10.52 years, time with disease = 7.25 ± 4.65 years) were evaluated by the KPPS, Brief Pain Inventory (BPI), two Pain Pressure Thresholds (PPTs), Widespread Mechanical Hyperalgesia (WMH), and Conditioned Pain Modulation (CPM). A retest of the KPPS was performed 7–15 days later. Internal consistency, test–retest reliability (intraclass correlation coefficient (ICC)), measurement error, factor structure, and criterion/convergent validity were assessed. Results: Internal consistency of the Spanish KPPS was acceptable (Cronbach's alpha = 0.77). The mean test and retest total KPPS scores were similar (test = 34.83 ± 23.50 points, retest = 35.87 ± 26.23 points), and test–retest reliability was good (ICC = 0.85, 95% CI = 0.75–0.91). Standard error of measurement (SEM) was 9.1 points and smallest detectable change (SDC) was 25.22 points. The sampling adequacy was not sufficient to perform factor analysis. The total KPPS score was not correlated to the BPI intensity subscale (r = 0.18, p = 0.19), but it was moderately and positively correlated to the interference subscale (r = 0.43, p = 0.001). The total KPPS was moderately and negatively correlated to both the remote PPT (r = −0.4, p = 0.003) and WMH (r = −0.38, p = 0.005). No statistical correlations were found with local PPT or CPM. Conclusion: The present study provides evidence that the Spanish KPPS effectively measures pain in individuals with PD, with its total score demonstrating good reliability, minimal measurement error, and adequate criterion and convergent validity. [ABSTRACT FROM AUTHOR]

Test‐retest reliability—establishing that measurements remain consistent across multiple testing sessions—is critical to measuring, understanding, and predicting individual differences in infant language development. However, previous attempts to establish measurement reliability in infant speech perception tasks are limited, and reliability of frequently used infant measures is largely unknown. The current study investigated the test‐retest reliability of infants' preference for infant‐directed speech over adult‐directed speech in a large sample (N = 158) in the context of the ManyBabies1 collaborative research project. Labs were asked to bring in participating infants for a second appointment retesting infants on their preference for infant‐directed speech. This approach allowed us to estimate test‐retest reliability across three different methods used to investigate preferential listening in infancy: the head‐turn preference procedure, central fixation, and eye‐tracking. Overall, we found no consistent evidence of test‐retest reliability in measures of infants' speech preference (overall r = 0.09, 95% CI [−0.06,0.25]). While increasing the number of trials that infants needed to contribute for inclusion in the analysis revealed a numeric growth in test‐retest reliability, it also considerably reduced the study's effective sample size. Therefore, future research on infant development should take into account that not all experimental measures may be appropriate for assessing individual differences between infants. Research Highlights: We assessed test‐retest reliability of infants' preference for infant‐directed over adult‐directed speech in a large pre‐registered sample (N = 158).There was no consistent evidence of test‐retest reliability in measures of infants' speech preference.Applying stricter criteria for the inclusion of participants may lead to higher test‐retest reliability, but at the cost of substantial decreases in sample size.Developmental research relying on stable individual differences should consider the underlying reliability of its measures. [ABSTRACT FROM AUTHOR]

Objective: The objective of this study was the measurement of the test–retest reliability of n-back in Chinese stroke patients. Methods: Seventy-five sub-acute stroke patients performed n-back twice in three days. The test–retest reliability of n-back was analyzed by correlation coefficient. Results: The n-back had excellent test–retest reliability in stroke patients. Pearson or Spearman coefficients ranged from 0.81 to 0.88. The intra-class correlation coefficients ranged from 0.72 to 0.87. The Chinese version of Montreal Cognitive Assessment-Basic (MoCA-BC) score was significantly correlated with the performance of n-back. MoCA-BC and n-back accuracy were significantly related in the Mild Cognitive Impairment (MCI) group (r = 0.60 in 1-back, p =.002; r = 0.43 in 2-back, p =.040). However, MoCA-BC was correlated with reaction time (RT) in the Cognitively Normal (CN) group (r = –0.44 in 1-back, p =.003; r = –0.36 in 2-back, p =.018). The test–retest reliability of CN group was mostly higher than that of MCI group RT: 0.71–0.76 in MCI, 0.80–0.88 in CN; accuracy: 0.80–0.85 in MCI, 0.75–0.86 in CN). The practice effect was observed in the CN group instead of the MCI group. Conclusions: This study indicated that the test–retest reliability of n-back was high in stroke patients. N-back was correlated with cognition. It was preferable to conduct subgroup analyses according to the level of cognitive assessment of patients with stroke. [ABSTRACT FROM AUTHOR]

Background: Psychological Insulin Resistance (PIR) and negative perceptions regarding insulin treatment are noteworthy challenges in T2DM management, which hinder the timely initiation of insulin treatment. To get past these obstacles a reliable tool is required to evaluate patients' perspectives on insulin administration. Our study aims to conduct a comprehensive systematic review to evaluate the validity and reliability of different validation tests used in the psychometric validation of the ITAS in T2DM patients. Methods: A literature search was carried out, using PubMed, Google Scholar, EMBASE, Cochrane Library and Science Direct. Only those studies assessing content validity, construct validity, concurrent validity, discriminant validity, internal consistency reliability (Cronbach' α), and items-total correlation were retrieved. Results: A total of 14 studies illustrated the validity and reliability of ITAS in T2DM patients. Content validity results of S-CVI was 0.97, and I-CVI was 0.8–1.00. Construct validity with factor loading was greater than the threshold value of 0.3. The concurrent validity of ITAS vs. PAID, WHO-5, and SPI was 0.35 (P < 0.05), −0.14 (P < 0.05), and 0.80 (P < 0.001) respectively. The mean difference between insulin and non-insulin group was significant (P < 0.001) showing reliable discriminant validity. Reported results of Cronbach's α for the main scale (0.79–0.89), subscale-1 (0.72–0.9), and subscale-2 (0.61–0.89) showed "good to excellent" internal consistency reliability of ITAS. Item-total correlation results for the main scale, subscale-1, and subscale-2 were (0.40–0.82), (0.31–0.74) and (0.34–0.58) respectively. Test-retest reliability of ITAS was 0.571–0.87. Conclusions: Study findings confirm the robustness of various validation tests utilized in the psychometric validation of ITAS in T2DM patients. ITAS is a well-validated and reliable tool for determining the perspectives, PIR, and changes in patients' perception over time and it can be used to overcome hurdles in the timely initiation of insulin treatment in T2DM patients. [ABSTRACT FROM AUTHOR]

Background: Financial toxicity describes the impairment of financial wellbeing in patients due to the burden of cancer diagnosis and care. The COST: A Functional Assessment of Chronic Illness Therapy Measure of Financial Toxicity (FACIT-COST) is the most widely used cancer-specific measure of subjective financial toxicity, having been validated in multiple languages, but not in Indonesian. This study aimed to validate the Indonesian version of FACIT-COST in a breast cancer sample. Methods: A single-center prospective cohort study was performed in Indonesia. Female breast cancer patients aged ≥ 18 undergoing treatment at baseline were invited to participate and followed for up to six months. The survey included the official Indonesian version of FACIT-COST (v2) which was administered to the patients by interviewers. Clinical information (e.g., metastasis status, disease duration) was provided based on medical records. The following measurement properties of FACIT-COST were tested: distributional characteristics, structural validity (principal component [PCA] and confirmatory factor analyses [CFA]), internal consistency reliability (Cronbach's alpha and McDonald's omega), known-groups validity (Mann-Whitney U or Kruskal-Wallis H test), test-retest reliability, and responsiveness to change. Results: Overall, 300 female patients participated at baseline. No patients reported the best or worst possible FACIT-COST total scores. The PCA proposed a two-factor model structure for the instrument, which was confirmed by the CFA (RMSEA = 0.042, SRMR = 0.049, CFI = 0.99, TLI = 0.99). The internal consistency reliability of the two factors was considered adequate (Cronbach's alpha = 0.774–0.882, McDonald's omega = 0.786–0.888). The FACIT-COST total score significantly discriminated across the following known-groups: age, education, residential setting, income, employment, metastasis status, number of symptoms, and financial coping strategies. The FACIT-COST demonstrated excellent test-retest reliability (intraclass correlation coefficient = 0.96) and satisfactory responsiveness to change (standardized response mean and effect size ranges=|0.39| to |0.92|). Conclusions: This is the first study to validate the FACIT-COST in patients with breast cancer and to present the measurement properties of the Indonesian version of FACIT-COST. The Indonesian FACIT-COST demonstrates acceptable psychometric performance and shows potential as a valid measure of subjective financial toxicity. The instrument may serve as a valuable tool for informing health policies that focus on providing resource support to improve cancer care in Indonesia. [ABSTRACT FROM AUTHOR]

Test-retest reliability is often estimated using naturally occurring data from test repeaters. In settings such as admissions testing, test takers choose if and when to retake an assessment. This self-selection can bias estimates of test-retest reliability because individuals who choose to retest are typically unrepresentative of the broader testing population and because differences among test takers in learning or practice effects may increase with time between test administrations. We develop a set of methods for estimating test-retest reliability from observational data that can mitigate these sources of bias, which include sample weighting, polynomial regression, and Bayesian model averaging. We demonstrate the value of using these methods for reducing bias and improving precision of estimated reliability using empirical and simulated data, both of which are based on more than 40,000 repeaters of a high-stakes English language proficiency test. Finally, these methods generalize to settings in which only a single, error-prone measurement is taken repeatedly over time and where self-selection and/or changes to the underlying construct may be at play. [ABSTRACT FROM AUTHOR]

Background: The available evidence suggests that people with epilepsy have reduced cardio-respiratory fitness and muscle strength endurance, and impaired balance and mobility. The 6-minute walk test (6MWT), Timed Up and Go (TUG), and 30-second chair stand test (30CST) are physical performance tests frequently used in clinical practice. Objective: To establish the test-retest reliability and minimal detectable change of the 6MWT, TUG, and 30CST in people with epilepsy. Methods: The study was designed as an observational study. Forty-one people with epilepsy (23 females, 18 males; mean age 34.7 ± 10.4 years) participated. The 6MWT, TUG, and 30CST were tested by a trained physiotherapist during two sessions, which were conducted 7–14 days apart. The test-retest reliability of measures was assessed using the intra-class correlation coefficients (ICC) using two-way random effects and absolute agreement methods. The 95% limits of agreement, standard error of measurement (SEM), and minimal detectable change (MDC₉₅) were calculated. Results: The 6MWT (ICC = 0.92, SEM = 15.8, MDC₉₅ = 43.8), TUG (ICC = 0.95, SEM = 3.2, MDC₉₅ = 0.5) and 30CST (ICC = 0.92, SEM = 1.0, MDC₉₅ = 2.8) performance measurements demonstrated excellent test-retest reliability. The 95% limits of agreement was calculated, as illustrated in a Bland-Altman plot. Conclusion: The 6MWT, TUG, and 30CST are reliable for measuring physical performance. The findings of this study can support researchers and clinicians to decide if a change score of a person with epilepsy is likely to be measurement error or true change. [ABSTRACT FROM AUTHOR]

Objective: This article provides the test–retest reliability and Reliable Change Indices (RCIs) of the Philips IntelliSpace Cognition (ISC) platform, which contains digitized versions of well-established neuropsychological tests. Method: 147 participants (ages 19 to 88) completed a digital cognitive test battery on the ISC platform or paper-pencil versions of the same test battery during two separate visits. Intraclass correlation coefficients (ICC) were calculated separately for the ISC and analog test versions to compare reliabilities between administration modalities. RCIs were calculated for the digital tests using the practice-adjusted RCI and standardized regression-based (SRB) method. Results: Test–retest reliabilities for the ISC tests ranged from moderate to excellent and were comparable to the test-retest reliabilities for the paper-pencil tests. Baseline test performance, retest interval, age, and education predicted test performance at visit 2 with baseline test performance being the strongest predictor for all outcome measures. For most outcome measures, both methods for the calculation of RCIs show agreement on whether or not a reliable change was observed. Conclusions: RCIs for the digital tests enable clinicians to determine whether a measured change between assessments is due to real improvement or decline. Together, this contributes to the growing evidence for the clinical utility of the ISC platform. [ABSTRACT FROM AUTHOR]

Rapid adaptation to sudden changes in the environment is a hallmark of flexible human behaviour. Many computational, neuroimaging, and even clinical investigations studying this cognitive process have relied on a behavioural paradigm known as the predictive-inference task. However, the psychometric quality of this task has never been examined, leaving unanswered whether it is indeed suited to capture behavioural variation on a within- and between-subject level. Using a large-scale test–retest design (T1: N = 330; T2: N = 219), we assessed the internal (internal consistency) and temporal (test–retest reliability) stability of the task's most used measures. We show that the main measures capturing flexible belief and behavioural adaptation yield good internal consistency and overall satisfying test–retest reliability. However, some more complex markers of flexible behaviour show lower psychometric quality. Our findings have implications for the large corpus of previous studies using this task and provide clear guidance as to which measures should and should not be used in future studies. [ABSTRACT FROM AUTHOR]

Introduction/Aims Methods Results Discussion Limitations exist in evaluating mechanical detection thresholds (MDTs) due to a lack of dependable electronic instruments designed to assess Aβ fibers and measure MDTs across different body areas. This study aims to evaluate the test–retest and inter‐rater reliability of the cutaneous mechanical stimulator (CMS), an electronic tactile stimulator, in quantifying MDTs.Using a test–retest design, participants underwent assessments of MDTs using Semmes–Weinstein monofilaments (SWM) and the CMS. This study included 27 healthy volunteers (mean age 24.07 ± 3.76 years). Two raters assessed MDTs using SWM and the CMS at two stimulation sites (the left hand and foot) in two experimental sessions approximately 2 weeks apart.MDTs using SWM and the CMS showed excellent reliability on the hand (intraclass correlation coefficient [ICC] = .84) and foot (ICC = .90). A comparison of results obtained at the two sessions showed that MDTs on the hand displayed good reliability for both SWM (ICC = .63) and the CMS (ICC = .73), whereas MDTs on the foot displayed fair reliability for SWM (ICC = .50) and the CMS (ICC = .42). MDTs exhibited good inter‐rater reliability with SWM (ICC = .66) and excellent inter‐rater reliability with the CMS (ICC = .82) on the hand, as well as showing fair inter‐rater reliability with SWM (ICC = .53) and good inter‐rater reliability with the CMS (ICC = .60) on the foot.The CMS showed superior inter‐rater reliability, indicating its potential as a valuable tool for assessing tactile sensitivity in research and clinical settings. [ABSTRACT FROM AUTHOR]

The 33-item Childhood Trauma Questionnaire (CTQ-33) is a recently developed tool expanded from the 28-item Childhood Trauma Questionnaire (CTQ-28) to assess childhood trauma events, which showed good test-retest reliability over 2 weeks. However, little is known regarding the factor structure and long-term test-retest reliability of the CTQ-33. To fill such a gap, this study investigated the factorial validity of the CTQ-33 and test-retest reliability of the scale over a relatively long interval of 1 year. Data on demographics, the CTQ-33 scores, and mental health statuses such as depressive/anxiety symptoms were collected in Chinese adolescents (n = 188) twice across a one-year period. Results of the confirmatory factor analysis (CFA) revealed that the Chinese version of CTQ-33 has close factor validity when compared to the original CTQ-28 in college students. Furthermore, the total and most subscale scores of the CTQ-33 have fair to good test-retest reliability (intra-class correlation coefficients >0.6 for the total score, and > 0.4 for most subscales), except for the physical abuse subscale. Moreover, we replicated previous findings of significant positive relationships between levels of different childhood trauma subtypes using the CTQ-33. These findings provide initial evidence supporting that the CTQ-33 is overall reliable to assess childhood traumatic events in adolescents over relatively long intervals. [ABSTRACT FROM AUTHOR]

Introduction: Nomophobia is considered a modern-age phobia whereby individuals fear being without a smartphone. The present study focuses on translating the Nomophobia Questionnaire (NMP-Q) into Gujarati to measure nomophobia. Aim: To assess the reliability and validity of the Gujarati version of the NMP-Q, aiming to enhance research, public health initiatives and clinical assessments. Materials and Methods: This cross-sectional study was conducted from May 2023 to November 2023 at the Department of Physiotherapy, Vidhyadeep Institute of Physiotherapy, Surat, Gujarat, India and comprised two phases: 1) Face and content validation through expert clinical review; 2) Test-retest reliability. Face and content validity of the Gujarati NMP-Q were determined using the consensus method with a total of 200 participants aged between 15-18 years. To assess the reliability of the Gujarati NMP-Q, internal consistency and test-retest reliability were evaluated. Test-retest reliability was determined using the Intraclass Correlation Coefficient (ICC) and internal consistency was calculated using Cronbach's alpha. Results: A total of 200 participants (mean age 17.60±1.40 years) were included in the study. The Gujarati version of the NMP-Q demonstrated excellent test-retest reliability, indicated by a high ICC (0.986) and high internal consistency (0.972). The values for Content Validation Ratio (CVR), Item-level Content Validation Index (I-CVI), Modified Kappa (K) and Proportion of Agreement were all 1. Conclusion: The Gujarati version of the NMP-Q exhibits excellent reliability and good face and content validity. It is deemed adequate and valuable for assessing the level of fear of being without a smartphone in daily life among Gujaratispeaking school students. [ABSTRACT FROM AUTHOR]

Background: Measurement of freezing of gait (FOG) relies on the sensitivity and reliability of tasks to provoke FOG. It is currently unclear which tasks provide the best outcomes and how medication state plays into this. Objective: To establish the sensitivity and test-retest reliability of various FOG-provoking tasks for presence and severity of FOG, with (ON) and without (OFF) dopaminergic medication. Methods: FOG-presence and percentage time frozen (% TF) were derived from video annotations of a home-based FOG-provoking protocol performed in OFF and ON. This included: the four meter walk (4MW), Timed Up and Go (TUG) single (ST) and dual task (DT), 360° turns in ST and DT, a doorway condition, and a personalized condition. Sensitivity was tested at baseline in 63 definite freezers. Test-retest reliability was evaluated over 5 weeks in 26 freezers. Results: Sensitivity and test-retest reliability were highest for 360° turns and higher in OFF than ON. Test-retest intra-class correlation coefficients of % TF varied between 0.63–0.90 in OFF and 0.18–0.87 in ON, and minimal detectable changes (MDCs) were high. The optimal protocol included TUG ST, 360° turns ST, 360° turns DT and a doorway condition, provoking FOG in all freezers in OFF and 91.9% in ON and this could be done reliably in 95.8% (OFF) and 84.0% (ON) of the sample. Combining OFF and ON further improved outcomes. Conclusions: The highest sensitivity and reliability was achieved with a multi-trigger protocol performed in OFF + ON. However, the high MDCs for % TF underscore the need for further optimization of FOG measurement. Plain Language Summary: Freezing of gait is a very burdensome and episodic symptom in Parkinson's disease that is difficult to measure. Measurement of freezing is needed to determine whether someone has freezing and how severe this is, and relies on observation during a freezing-triggering protocol. However, it is unclear what protocol is sufficiently sensitive to trigger freezing in many freezers, and whether freezing can be triggered reliably at different timepoints. Here, we investigated 1) which tasks can trigger freezing-presence and freezing-severity sensitively and reliably, 2) how medication state influences this, and 3) what task combination was most reliable. Sixty-three patients with daily freezing performed several freezing-triggering tasks in their homes, both with (ON) and without (OFF) anti-Parkinsonian medication. In twenty-six patients, the measurement was repeated 5 weeks later to determine test-retest reliability. First, we found that performing 360° turns in place with a cognitive dual task was the most sensitive and reliable task to trigger FOG. Second, sensitivity and reliability were better in OFF than in ON. Third, the most reliable protocol included: the Timed-Up and Go, 360° turns in place with and without the dual task, and a doorway condition. This protocol triggered freezing in all patients in OFF and 91.9% in ON and did so reliably in 95.8% (OFF) and 84.0% (ON) of the sample. We recommend to measure freezing with this protocol in OFF + ON, which further improved reliability. However, the measurement error for freezing-severity was high, even for this optimal protocol, underscoring the need for further optimization of freezing measurement. [ABSTRACT FROM AUTHOR]

State-of-the-art augmented reality (AR) glasses record their 3D pose in space, enabling measurements and analyses of clinical gait and balance tests. This study's objective was to evaluate concurrent validity and test–retest reliability for common clinical gait and balance tests in people with Parkinson's disease: Five Times Sit To Stand (FTSTS) and Timed Up and Go (TUG) tests. Position and orientation data were collected in 22 participants with Parkinson's disease using HoloLens 2 and Magic Leap 2 AR glasses, from which test completion durations and durations of distinct sub-parts (e.g., sit to stand, turning) were derived and compared to reference systems and over test repetitions. Regarding concurrent validity, for both tests, an excellent between-systems agreement was found for position and orientation time series (ICC(C,1) > 0.933) and test completion durations (ICC(A,1) > 0.984). Between-systems agreement for FTSTS (sub-)durations were all excellent (ICC(A,1) > 0.921). TUG turning sub-durations were excellent (turn 1, ICC(A,1) = 0.913) and moderate (turn 2, ICC(A,1) = 0.589). Regarding test–retest reliability, the within-system test–retest variation in test completion times and sub-durations was always much greater than the between-systems variation, implying that (sub-)durations may be derived interchangeably from AR and reference system data. In conclusion, AR data are of sufficient quality to evaluate gait and balance aspects in people with Parkinson's disease, with valid quantification of test completion durations and sub-durations of distinct FTSTS and TUG sub-parts. [ABSTRACT FROM AUTHOR]

Advances in research on language processing have originally come from group-level comparisons, but there is now a growing interest in individual differences. To investigate individual differences, tasks that have shown robust group-level differences are often used with the implicit assumption that they will also be reliable when used as an individual differences measure. Here, we examined whether one of the primary tasks used in psycholinguistic research on language processing, the self-paced reading task, can reliably measure individual differences in relative clause processing. We replicated the well-established effects of relative clauses at the group level, with object relative clauses being more difficult to process than subject relative clauses. However, when using difference scores, the reliability of the size of the relative clause effect was close to zero because the self-paced reading times for the different relative clause types were highly correlated within individuals. Nonetheless, we found that the self-paced reading task can be used to reliably capture individual differences in overall reading speed as well as key sentence regions when the two types of relative clause sentences are considered separately. Our results indicate that both the reliability and validity of different sentence regions need to be assessed to determine whether and when self-paced reading can be used to examine individual differences in language processing. [ABSTRACT FROM AUTHOR]

The flanker task (Eriksen & Eriksen, Perception & Psychophysics, 16(1), 143-149, 1974) has been highly influential and widely used in studies of visual attention. Its simplicity has made it popular to include it in experimental software packages and online platforms. The spacing flanker task (SFT), in which the distance between the target and flankers varies, is useful for studying the distribution of attention across space as well as inhibitory control. Use of the SFT requires that the viewing environment (e.g., stimulus size and viewing distance) be controlled, which is a challenge for online delivery. We implement and evaluate an online version of the SFT that includes two calibration pretests to provide the necessary control. Test–retest and split-half reliability of the online version was compared with a laboratory version on measures of inhibitory control and measures of the distribution of attention across space. Analyses show that the online SFT is comparable to laboratory testing on all measures. Results also identify two measures with good test–retest reliability that hold promise for studying performance in the SFT: the mean flanker effect (ICC = 0.745) and RTs on incongruent trials across distances (ICC = 0.65–0.71). [ABSTRACT FROM AUTHOR]

Copyright of HNO is the property of Springer Nature and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Abstract Background Financial toxicity describes the impairment of financial wellbeing in patients due to the burden of cancer diagnosis and care. The COST: A Functional Assessment of Chronic Illness Therapy Measure of Financial Toxicity (FACIT-COST) is the most widely used cancer-specific measure of subjective financial toxicity, having been validated in multiple languages, but not in Indonesian. This study aimed to validate the Indonesian version of FACIT-COST in a breast cancer sample. Methods A single-center prospective cohort study was performed in Indonesia. Female breast cancer patients aged ≥ 18 undergoing treatment at baseline were invited to participate and followed for up to six months. The survey included the official Indonesian version of FACIT-COST (v2) which was administered to the patients by interviewers. Clinical information (e.g., metastasis status, disease duration) was provided based on medical records. The following measurement properties of FACIT-COST were tested: distributional characteristics, structural validity (principal component [PCA] and confirmatory factor analyses [CFA]), internal consistency reliability (Cronbach’s alpha and McDonald’s omega), known-groups validity (Mann-Whitney U or Kruskal-Wallis H test), test-retest reliability, and responsiveness to change. Results Overall, 300 female patients participated at baseline. No patients reported the best or worst possible FACIT-COST total scores. The PCA proposed a two-factor model structure for the instrument, which was confirmed by the CFA (RMSEA = 0.042, SRMR = 0.049, CFI = 0.99, TLI = 0.99). The internal consistency reliability of the two factors was considered adequate (Cronbach’s alpha = 0.774–0.882, McDonald’s omega = 0.786–0.888). The FACIT-COST total score significantly discriminated across the following known-groups: age, education, residential setting, income, employment, metastasis status, number of symptoms, and financial coping strategies. The FACIT-COST demonstrated excellent test-retest reliability (intraclass correlation coefficient = 0.96) and satisfactory responsiveness to change (standardized response mean and effect size ranges=|0.39| to |0.92|). Conclusions This is the first study to validate the FACIT-COST in patients with breast cancer and to present the measurement properties of the Indonesian version of FACIT-COST. The Indonesian FACIT-COST demonstrates acceptable psychometric performance and shows potential as a valid measure of subjective financial toxicity. The instrument may serve as a valuable tool for informing health policies that focus on providing resource support to improve cancer care in Indonesia.

Introduction: Nomophobia is considered a modern-age phobia whereby individuals fear being without a smartphone. The present study focuses on translating the Nomophobia Questionnaire (NMP-Q) into Gujarati to measure nomophobia. Aim: To assess the reliability and validity of the Gujarati version of the NMP-Q, aiming to enhance research, public health initiatives and clinical assessments. Materials and Methods: This cross-sectional study was conducted from May 2023 to November 2023 at the Department of Physiotherapy, Vidhyadeep Institute of Physiotherapy, Surat, Gujarat, India and comprised two phases: 1) Face and content validation through expert clinical review; 2) Test-retest reliability. Face and content validity of the Gujarati NMP-Q were determined using the consensus method with a total of 200 participants aged between 15-18 years. To assess the reliability of the Gujarati NMP-Q, internal consistency and test-retest reliability were evaluated. Test-retest reliability was determined using the Intraclass Correlation Coefficient (ICC) and internal consistency was calculated using Cronbach's alpha. Results: A total of 200 participants (mean age 17.60±1.40 years) were included in the study. The Gujarati version of the NMP-Q demonstrated excellent test-retest reliability, indicated by a high ICC (0.986) and high internal consistency (0.972). The values for Content Validation Ratio (CVR), Item-level Content Validation Index (I-CVI), Modified Kappa (K) and Proportion of Agreement were all 1. Conclusion: The Gujarati version of the NMP-Q exhibits excellent reliability and good face and content validity. It is deemed adequate and valuable for assessing the level of fear of being without a smartphone in daily life among Gujarati-speaking school students.

Introduction: Primary Dysmenorrhoea (PD) is a common disorder in both young and adult females which is characterised by cramps that start immediately before or at the beginning of menstruation in the lower abdomen and are spasmodic and painful in nature, without any pelvic pathology. PD has a serious detrimental effect on quality of life and productivity in terms of health. Need of the Study: To the best of author’s knowledge, there is no specific scale meant to extensively assess the overall physical, social, psychological and nutritional status of females with PD and evaluate the quality of life, therefore, a comprehensive tool is required to resolve these issues and capture a comprehensive overview of the typical distress encountered during menstruation. Aim: To develop the items and domains, estimate its content and concurrent validity as well as assess intra-rater and test-retest reliability of the scale, which comprehensively assesses physical, social, psychological and nutritional status of females with PD and determine their quality of life. Materials and Methods: The present study is a cross-sectional study, that will be conducted at General Outpatient Department (OPD), Maharishi Markandeshwar Institute of Physiotherapy and Rehabilitation, Maharishi Markandeshwar Deemed to be University, Mullana, Ambala, Haryana, India from April 2023 to March 2024. It consists of three phases. First phase comprises of the scale development procedure which includes generation of domains and items. Second phase is to validate the scale. This phase includes content validation through Delphi method as well as evaluation of criterion (concurrent) validity. Third phase consists of assessing intra-rater and test-retest reliability of the scale.

Even before the advent of fMRI, the amygdala occupied a central space in the affective neurosciences. Yet this amygdala-centred view on emotion processing gained even wider acceptance after the inception of fMRI in the early 1990s, a landmark that triggered a goldrush of fMRI studies targeting the amygdala in vivo. Initially, this amygdala fMRI research was mostly confined to task-activation studies measuring the magnitude of the amygdala's response to emotional stimuli. Later, interest began to shift more towards the study of the amygdala's resting-state functional connectivity and task-based psychophysiological interactions. Later still, the test-retest reliability of amygdala fMRI came under closer scrutiny, while at the same time, amygdala-based real-time fMRI neurofeedback gained widespread popularity. Each of these major subdomains of amygdala fMRI research has left its marks on the field of affective neuroscience at large. The purpose of this review is to provide a critical assessment of this literature. By integrating the insights garnered by these research branches, we aim to answer the question: What part (if any) can amygdala fMRI still play within the current landscape of affective neuroscience? Our findings show that serious questions can be raised with regard to both the reliability and validity of amygdala fMRI. These conclusions force us to cast doubt on the continued viability of amygdala fMRI as a core pilar of the affective neurosciences. [ABSTRACT FROM AUTHOR]

Summary The advent of modern data collection and processing techniques has seen the size, scale and complexity of data grow exponentially. A seminal step in leveraging these rich datasets for downstream inference is understanding the characteristics of the data which are repeatable—the aspects of the data that are able to be identified under duplicated analyses. Conflictingly, the utility of traditional repeatability measures, such as the intra‐class correlation coefficient, under these settings is limited. In recent work, novel data repeatability measures have been introduced in the context where a set of subjects are measured twice or more, including: fingerprinting, rank sums and generalisations of the intra‐class correlation coefficient. However, the relationships between, and the best practices among, these measures remains largely unknown. In this manuscript, we formalise a novel repeatability measure, discriminability. We show that it is deterministically linked with the intra‐class correlation coefficients under univariate random effect models and has the desired property of optimal accuracy for inferential tasks using multivariate measurements. Additionally, we overview and systematically compare existing repeatability statistics with discriminability, using both theoretical results and simulations. We show that the rank sum statistic is deterministically linked to a consistent estimator of discriminability. The statistical power of permutation tests derived from these measures are compared numerically under Gaussian and non‐Gaussian settings, with and without simulated batch effects. Motivated by both theoretical and empirical results, we provide methodological recommendations for each benchmark setting to serve as a resource for future analyses. We believe these recommendations will play an important role towards improving repeatability in fields such as functional magnetic resonance imaging, genomics, pharmacology and more. [ABSTRACT FROM AUTHOR]

The Iowa Gambling Task (IGT) is used to assess decision-making in clinical populations. The original IGT does not disambiguate reward and punishment learning; however, an adaptation of the task, the "play-or-pass" IGT, was developed to better distinguish between reward and punishment learning. We evaluated the test-retest reliability of measures of reward and punishment learning from the play-or-pass IGT and examined associations with self-reported measures of reward/punishment sensitivity and internalizing symptoms. Participants completed the task across two sessions, and we calculated mean-level differences and rank-order stability of behavioral measures across the two sessions using traditional scoring, involving session-wide choice proportions, and computational modeling, involving estimates of different aspects of trial-level learning. Measures using both approaches were reliable; however, computational modeling provided more insights regarding between-session changes in performance, and how performance related to self-reported measures of reward/punishment sensitivity and internalizing symptoms. Our results show promise in using the play-or-pass IGT to assess decision-making; however, further work is still necessary to validate the play-or-pass IGT. [ABSTRACT FROM AUTHOR]

The negative affective priming (NAP) task is a behavioral measure of inhibition of emotional stimuli. Previous studies using the NAP task have found that individuals with depression show reduced inhibition of negative stimuli, suggesting that inhibition biases may play a role in the etiology and maintenance of depression. However, the psychometric properties of the NAP task have not been evaluated or reported. In the present study, we report data on the association between NAP task performance and depression symptoms in three independent samples, and we evaluate the internal consistency and test–retest reliability of the NAP effect indices. The NAP effect for both negative and positive target words had poor internal consistency in all three samples, as well as poor 2-week (Study 2) and 6-month (Study 3) test–retest reliability. The internal consistency and test–retest reliability of response times (RT) for the individual trial types were moderate to high, as were the intercorrelations between trial types. This pattern of results indicates that overall RT is reliable but variance in RTs for the different trial types in the NAP task is indistinguishable from variance in overall RT. Depression symptom severity was not associated with the NAP effect for negative or positive target words in any of the samples, which could be due to the poor reliability of the NAP effect. Based on these findings, we do not recommend that researchers use the NAP task as a measure of individual differences in the inhibition of emotional stimuli. [ABSTRACT FROM AUTHOR]

It has recently been suggested that parameter estimates of computational models can be used to understand individual differences at the process level. One area of research in which this approach, called computational phenotyping, has taken hold is computational psychiatry. One requirement for successful computational phenotyping is that behavior and parameters are stable over time. Surprisingly, the test–retest reliability of behavior and model parameters remains unknown for most experimental tasks and models. The present study seeks to close this gap by investigating the test–retest reliability of canonical reinforcement learning models in the context of two often-used learning paradigms: a two-armed bandit and a reversal learning task. We tested independent cohorts for the two tasks (N = 69 and N = 47) via an online testing platform with a between-test interval of five weeks. Whereas reliability was high for personality and cognitive measures (with ICCs ranging from.67 to.93), it was generally poor for the parameter estimates of the reinforcement learning models (with ICCs ranging from.02 to.52 for the bandit task and from.01 to.71 for the reversal learning task). Given that simulations indicated that our procedures could detect high test–retest reliability, this suggests that a significant proportion of the variability must be ascribed to the participants themselves. In support of that hypothesis, we show that mood (stress and happiness) can partly explain within-participant variability. Taken together, these results are critical for current practices in computational phenotyping and suggest that individual variability should be taken into account in the future development of the field. [ABSTRACT FROM AUTHOR]

Objective: Lower sensitivity to the acute effects of alcohol is known to confer risk for the development of alcohol use disorder. Alcohol sensitivity, or level of response to alcohol's subjective effects, is heritable but also can change as a result of persistent alcohol exposure (i.e., acquired tolerance). Here, we examined how changes over time in four indices of alcohol involvement affected scores on two validated, retrospective self-report measures of alcohol response—the Self-Rating of the Effects of Alcohol (SRE) form and the Alcohol Sensitivity Questionnaire (ASQ)—in a sample of emerging adult drinkers. Method: Participants (N = 173; Mage = 19.5 years; 60% assigned female at birth) completed the ASQ, SRE, and measures of alcohol use and problems at two time points separated by a median of 0.77 years (range: 0.30–2.54 years). Results: Multiple linear regression showed that increases in drinking over this period accounted for increases in SRE and ASQ scores (i.e., in reported numbers of drinks needed to experience subjective effects of alcohol). Increased drinking accounted for more variance in the number of drinks needed to experience lighter drinking versus heavier drinking effects, and increases in the number of drinks consumed per occasion had a larger effect than did changes in total numbers of drinks consumed, number of binge-drinking occasions, or drinking-related problems. Conclusions: Findings suggest that both SRE and ASQ capture some stable, trait-like variability in alcohol response as well as some state-dependent, within-person variability in alcohol response acquired through increases in alcohol involvement. Public Health Significance Statement: The findings in this report provide evidence that validated questionnaire measures of individual differences in level of response to alcohol, also known as subjective response, are sensitive to changes in young adults' drinking over time. Given that a reduction in level of response to alcohol is an indicator of possible alcohol use disorder (AUD), these findings support the use of these questionnaire measures to track changes in AUD risk over time. [ABSTRACT FROM AUTHOR]

Data on the strength ratio between agonist and antagonist muscles are frequently examined in sports testing, given its correlation with athletic performance. The purpose of this study was to determine the agonist-to-antagonist ratio of upper body strength in female and male elite Swedish track and field throwers using a new push (bench press) and pull (supine bench row) test device, and to determine its reliability. The study involved eight female and nine male athletes, aged 19–29 years, engaging, respectively, in discus, hammer, and shot put competitions at both national and international levels. The athletes' maximum isometric force was assessed during the bench press (push) and supine bench row (pull) exercises, respectively, using a custom-built test device. The test–retest reliability of the device was also examined. The total push-to-pull strength ratio for the female throwers was 1.15, whereas male throwers demonstrated a ratio of 1.22. Total push and pull force for the female throwers was significantly less than for the male throwers (5511 N vs. 8970 N, p < 0.001). Intraclass correlation coefficients ranged from 0.93 to 0.96 for the bench press and supine bench row exercise, indicating that the push and pull test device was highly reliable. The main findings of this study were that elite female and male discus, hammer, and shot put throwers exhibited 15% and 22% more pushing (bench press) than pulling (supine bench row) strength. Push and pull strength in the female throwers ranged from 47% to 71% of that of the male throwers. The push and pull test device is a reliable tool in establishing the agonist-to-antagonist ratio of upper body strength of athletes. Coaches and athletes may benefit from examining upper body push and pull strength ratios for training planning and prescription. [ABSTRACT FROM AUTHOR]

The present study aimed to establish test–retest reliability and investigate practice effects of the Mindmore cognitive assessment tool, a digital adaptation of traditional pencil and paper tests designed for self‐administration. Additionally, normative change scores for the most frequently used tests were derived. A total of 149 healthy Swedish adults (aged 20–79) completed the test battery twice, 1 month apart. The battery assessed attention and processing speed, memory, language, visuospatial functions, and executive functions. Test–retest reliability, measured by ICC and Spearman coefficients, and practice effects were estimated for 22 main‐scores and 33 sub‐scores. Regression models were used to assess change in performance while controlling for demographics, computer equipment, testing location (online or in‐laboratory) and baseline performance for 12 main‐scores and nine sub‐scores. Test–retest reliability was good for 11 main‐scores (≥0.70), satisfactory for five (0.60–0.69), and minimal for six (<0.60) albeit three having satisfactory sub‐scores. Practice effects were observed for tests with a major speed component, but not for reaction time, sustained attention, verbal memory and naming (alternate forms), nor visuospatial functions. Trackpad negatively influenced change for one test. Demographics and testing location did not significantly affect the change scores. Our study provides support for test–retest reliability and practice effects of the Mindmore cognitive assessment tool which were comparable to those of traditional tests. These findings, together with the normative change scores, can aid researchers and clinicians in interpreting test results and distinguishing between normal variations in performance and changes indicative of clinical impairment. [ABSTRACT FROM AUTHOR]

AbstractAimMethodsResultsConclusionThe Test of Gross Motor Development Third Edition (TGMD-3) is used to assess the development of fundamental movement skills in children from 3 to 10 years old. This study aimed to evaluate the intra-rater, inter-rater, and test-retest reliability and to determine the minimal detectable change (MDC) value of the TGMD-3 in children with developmental coordination disorder (DCD).The TGMD-3 was administered to 20 children with DCD. The child’s fundamental movement skills were recorded using a digital video camera. Reliability was assessed at two occasions by three raters using the generalizability theory.The TGMD-3 demonstrates good inter-rater reliability for the locomotor skills subscale, the ball skills subscale, and the total score (φ = 0.77 − 0.91), while the intra-rater reliability was even higher (φ = 0.94 − 0.97). Test-retest reliability was also shown to be good (φ = 0.79-0.93). The MDC95 was determined to be 10 points.This study provides evidence that the TGMD-3 is a reliable test when used to evaluate fundamental movement skills in children with DCD and suggests that an increase of 10 points represents a significant change in the motor function of a child with DCD. [ABSTRACT FROM AUTHOR]

Research suggests that psychological factors are related to persistence in science, especially for underrepresented students; however, most psychological instruments have been validated through studies conducted at predominately White institutions. In the current study, we report reliability estimates for measures of science identity, science motivation, and science self-efficacy with a sample of undergraduate college students from a Hispanic Serving Institution (N = 309). Internal consistency and test-retest reliability were estimated with Cronbach’s alpha and intra-class correlation coefficients, respectively. We report Cronbach's alpha values separately for male (N = 152), female (N = 152), Hispanic (N = 111), and White (N = 115) students. We also examined whether there were statistically significant differences in the Cronbach’s alpha values between these groups. The results demonstrated good to excellent reliability estimates for internal consistency (α ranged from .89 to .96) and test-retest reliability (ICC ranged from .76 to .80) for all groups. There were no significant differences in Cronbach’s alpha values between students identifying as male versus female or between Hispanic and White identifying students. We conclude by urging science education researchers to examine, report, and interpret reliability estimates for their measures for each dataset. [ABSTRACT FROM AUTHOR]

[Display omitted] • Healthy human MEG resting state sensorimotor activity showed good to excellent test–retest stability across two separate sessions. • 2–3 minute recordings were sufficient to obtain stable test–retest results and automation of analysis was successful in 86% • 'Resting sensorimotor phenotype' is a stable feature of individuals' resting brain activity with potential as a clinical biomarker. Diseases affecting sensorimotor function impair physical independence. Reliable functional clinical biomarkers allowing early diagnosis or targeting treatment and rehabilitation could reduce this burden. Magnetoencephalography (MEG) non-invasively measures brain rhythms such as the somatomotor 'rolandic' rhythm which shows intermittent high-amplitude beta (14–30 Hz) 'events' that predict behavior across tasks and species and are altered by sensorimotor neurological diseases. We assessed test–retest stability, a prerequisite for biomarkers, of spontaneous sensorimotor aperiodic (1/f) signal and beta events in 50 healthy human controls across two MEG sessions using the intraclass correlation coefficient (ICC). Beta events were determined using an amplitude-thresholding approach on a narrow-band filtered amplitude envelope obtained using Morlet wavelet decomposition. Resting sensorimotor characteristics showed good to excellent test–retest stability. Aperiodic component (ICC 0.77–0.88) and beta event amplitude (ICC 0.74–0.82) were very stable, whereas beta event duration was more variable (ICC 0.55–0.7). 2–3 minute recordings were sufficient to obtain stable results. Analysis automatization was successful in 86%. Sensorimotor beta phenotype is a stable feature of an individual's resting brain activity even for short recordings easily measured in patients. Spontaneous sensorimotor beta phenotype has potential as a clinical biomarker of sensorimotor system integrity. [ABSTRACT FROM AUTHOR]

This study aims to identify the optimal method for determining V̇O 2max in competitive swimmers in terms of validity and test–retest reliability. Controlled experiment. Twenty competitive swimmers performed four maximal incremental exercise tests: cycling, arm cranking, ergometer swimming, and tethered swimming. Gas analysis was conducted to estimate V̇O 2max. Validity was assessed in terms of the amount of variance of the performance on a 1500-m time trial explained by the estimated V̇O 2max. Test–retest reliability was evaluated using the intraclass correlation coefficient (ICC). V̇O 2max obtained from tethered swimming, ergometer swimming, and cycling explained a similar amount of variance of the 1500-m performance (R2 = 0.64, 0.64 and 0.65, respectively). However, ergometer swimming yielded significantly lower V̇O 2max estimates (40.54 ± 6.55 ml/kg/min) than tethered swimming (54.40 ± 6.21 ml/kg/min) and cycling (54.39 ± 5.63 ml/kg/min). Arm cranking resulted in both a lower explained variance (R2 = 0.41) and a significantly lower V̇O 2max (43.14 ± 7.81 ml/kg/min). Tethered swimming showed good reliability (ICC = 0.81). Bicycle and tethered swimming tests demonstrated high validity with comparable V̇O 2max estimates, explaining a large proportion of differences in endurance performance. Choosing between these two methods involves a trade-off between a higher practical applicability and reliability of the bicycle test and the more sport-specific nature of the tethered swimming test. [ABSTRACT FROM AUTHOR]

Breast cancer is the most common cancer in women worldwide, and its treatment usually involves a combination of many medical procedures, including surgery, chemotherapy, radiotherapy, and hormonal therapy. One of the detrimental effects on physical function is reduced upper limb muscle strength. This study aimed to evaluate upper body strength intra-day and inter-day (test-retest) reliability using the handgrip strength test (HGS) and the bilateral isometric bench press (BIBP) and the test-retest reliability of the one repetition maximum on the bench press (BP-1RM) in breast cancer survivors (BCS). Thirty-two (52.94 ± 8.99 yrs) BCS participated in this study. The muscle strength tests were performed in two different moments, three to seven days apart. Intraclass coefficient correlation (ICC) and coefficient of variation (CV) were used to assess the reliability. Standard error of measurement (SEM), typical error of measurement (TEM), and minimally detectable change (MDC) analyses were performed. The Bland-Altman analysis was used to assess the agreement between test-retest. We found a reliability that can be described as "high" to "very high" (ICC ≥ 0.88; CV ≤ 10%) for intra-day and test-retest. SEM% and MDC% were lower than 5% and 11%, respectively, for all intra-day testing. SEM% and TEM% ranged from 3% to 11%, and MDC% ranged from 9% to 23% in the test-retest reliability. The agreement demonstrated a systematic bias ranging from 2.3% to 6.0% for all testing, and a lower systematic bias may be presented in the non-treated side assessed by HGS and BIBP. HGS, BIBP, and BP-1RM assessments are reliable for measuring upper-body muscle strength in BCS. [ABSTRACT FROM AUTHOR]

AbstractIntroductionMethodsResultsConclusionThere is still a requirement for concise, practical scales that can be readily incorporated into everyday schedules and predict the likelihood of dementia onset in individuals without dementia. This study aimed to assess the reliability of the ANU-ADRI (Australian National University Alzheimer’s Disease Risk Index)-Short Form in Turkish geriatric patients.This methodological study involved 339 elderly patients attending the geriatric outpatient clinic for various reasons. The known-group validity and divergent validity were assessed. The ANU-ADRI was administered during the baseline test and again within one week for retest purposes. Alongside the ANU-ADRI, all participants underwent a comprehensive geriatric assessment, including Activities of Daily Living (ADL), mobility assessment (Performance-Oriented Mobility Assessment (POMA) and Timed Up and Go Test), nutritional assessment (Mini Nutritional Assessment (MNA)), and global cognition evaluation (Mini-Mental State Examination (MMSE)).The scale demonstrated satisfactory linguistic validity. A correlation was observed between the mean scores of the ANU-ADRI test and retest (r = 0.997, p < 0.001). Additionally, there existed a moderate negative linear association between the ANU-ADRI and MMSE scores (r = −0.310, p < 0.001), POMA (r = −0.406, p < 0.001), Basic ADL (r = −0.359, p < 0.001), and Instrumental ADL (r = −0.294, p < 0.001). Moreover, a moderate positive linear association was found between the ANU-ADRI and the Timed Up and Go Test duration (r = 0.538, p < 0.001).The ANU-ADRI-Short Form was proved as a valuable tool for clinical practice, facilitating the assessment of Alzheimer’s disease risk within the Turkish geriatric population. [ABSTRACT FROM AUTHOR]

Both chronic and recurrent spinal pain alter sensorimotor integration (SMI), which is demonstrated using complex neurophysiological techniques. Currently, there is no patient-reported outcome measure that documents and/or assesses SMI in populations with spinal problems. The purpose of this study was to develop the Sensory–Motor Dysfunction Questionnaire (SMD-Q) and assess its test–retest reliability and internal consistency in individuals with recurrent spinal pain. The SMD-Q was developed based on the existing literature on motor control disturbances associated with disordered SMI. The initial SMD-Q drafts underwent review by two separate panels of subject matter experts and a focus group with subclinical spine pain. Their suggestions were incorporated into the questionnaire prior to reliability testing. The questionnaire was administered twice at a seven-day interval using QualtricsTM. A total of 20 participants (14 females and 6 males; 20.95 ± 2.46 years of age) completed the study. Quadratic weighted kappa (Kw) was used to assess test–retest reliability and Cronbach's alpha (α) was used to assess internal consistency. Four items had a Kw < 0.40, seven had a 0.40 < Kw < 0.75, and one had a Kw > 0.75 (excellent agreement), with excellent internal consistency (α > 0.90). The pilot SMD-Q appears to reliably measure altered SMI, suggesting that revisions and testing with a larger sample are worth pursuing. [ABSTRACT FROM AUTHOR]

In this study, we explored the temporal stability of the Personality Assessment Inventory (PAI), which has not been comprehensively reexamined since it was first published. Our three specific aims were to determine the utility of PAI indicators of basic protocol validity (inconsistent responses [ICN] and highly unusual/unlikely responses [INF]) in identifying suspect responding; calculate the stability coefficients for each PAI scale and subscale across 3-, 6-, and 9-week spans; and explore whether profile stability across four measurements could be prospectively predicted. We administered the PAI to a sample of undergraduates (N = 579) at four separate timepoints. ICN and INF effectively identified likely attriters and inconsistent responders. All PAI full scales and subscales evidenced good test–retest reliability, with some small exceptions. Finally, all PAI clinical scales were correlated with profile instability although many of these correlations were no longer significant when controlling for mean clinical elevation of the profile. We interpreted these results as evidence for the utility of PAI validity scales, the temporal reliability of the PAI, and the role of psychopathology in response variability over time. We also discussed some preliminary evidence that this variability can be prospectively predicted, suggesting that it in part reflects substantive changes rather than random error variance. [ABSTRACT FROM AUTHOR]

Introduction: Primary Dysmenorrhoea (PD) is a common disorder in both young and adult females which is characterised by cramps that start immediately before or at the beginning of menstruation in the lower abdomen and are spasmodic and painful in nature, without any pelvic pathology. PD has a serious detrimental effect on quality of life and productivity in terms of health. Need of the Study: To the best of author's knowledge, there is no specific scale meant to extensively assess the overall physical, social, psychological and nutritional status of females with PD and evaluate the quality of life, therefore, a comprehensive tool is required to resolve these issues and capture a comprehensive overview of the typical distress encountered during menstruation. Aim: To develop the items and domains, estimate its content and concurrent validity as well as assess intra-rater and testretest reliability of the scale, which comprehensively assesses physical, social, psychological and nutritional status of females with PD and determine their quality of life. Materials and Methods: The present study is a cross-sectional study, that will be conducted at General Outpatient Department (OPD), Maharishi Markandeshwar Institute of Physiotherapy and Rehabilitation, Maharishi Markandeshwar Deemed to be University, Mullana, Ambala, Haryana, India from April 2023 to March 2024. It consists of three phases. First phase comprises of the scale development procedure which includes generation of domains and items. Second phase is to validate the scale. This phase includes content validation through Delphi method as well as evaluation of criterion (concurrent) validity. Third phase consists of assessing intra-rater and testretest reliability of the scale. [ABSTRACT FROM AUTHOR]

Wearable sensors are increasingly popular in concussion research because of their objective quantification of subtle balance deficits. However, normative data and minimal detectable change (MDC) values are necessary to serve as references for diagnostic use and tracking longitudinal recovery. To identify normative and MDC values for instrumented static- and reactive-balance tests, an instrumented static mediolateral (ML) root mean square (RMS) sway standing balance assessment and the instrumented, modified push and release (I-mP&R), respectively. Cross-sectional study. Clinical setting. Normative static ML RMS sway and I-mP&R data were collected on 377 (n = 184 female) healthy National Collegiate Athletic Association Division I athletes at the beginning of their competitive seasons. Test-retest data were collected in 36 healthy control athletes based on standard recovery timelines after concussion. Descriptive statistics, intraclass correlation coefficients (ICCs), and MDC values were calculated for primary outcomes of ML RMS sway in a static double-limb stance on firm ground and a foam block, and time to stability and latency from the I-mP&R in single- and dual-task conditions. Normative outcomes across static ML RMS sway and I-mP&R were sensitive to sex and type of footwear. Mediolateral RMS sway demonstrated moderate reliability in the firm condition (ICC = 0.73; MDC = 2.7 cm/s2) but poor reliability in the foam condition (ICC = 0.43; MDC = 11.1 cm/s2). Single- and dual-task times to stability from the I-mP&R exhibited good reliability (ICC = 0.84 and 0.80, respectively; MDC = 0.25 and 0.29 seconds, respectively). Latency from the I-mP&R had poor to moderate reliability (ICC = 0.38 and 0.55; MDC = 107 and 105 milliseconds). Sex-matched references should be used for instrumented static- and reactive-balance assessments. Footwear may explain variability in static ML RMS sway and time to stability of the I-mP&R. Moderate-to-good reliability suggests time to stability from the I-mP&R and ML RMS static sway on firm ground can be used for longitudinal assessments. [ABSTRACT FROM AUTHOR]

Background: Learning analytics (LA) research often aggregates learning process data to extract measurements indicating constructs of interest. However, the warranty that such aggregation will produce reliable measurements has not been explicitly examined. The reliability evidence of aggregate measurements has rarely been reported, leaving an implicit assumption that such measurements are free of errors. Objectives: This study addresses these gaps by investigating the psychometric pros and cons of aggregate measurements. Methods: This study proposes a framework for aggregating process data, which includes the conditions where aggregation is appropriate, and a guideline for selecting the proper reliability evidence and the computing procedure. We support and demonstrate the framework by analysing undergraduates' academic procrastination and programming proficiency in an introductory computer science course. Results and Conclusion: Aggregation over a period is acceptable and may improve measurement reliability only if the construct of interest is stable during the period. Otherwise, aggregation may mask meaningful changes in behaviours and should be avoided. While selecting the type of reliability evidence, a critical question is whether process data can be regarded as repeated measurements. Another question is whether the lengths of processes are unequal and individual events are unreliable. If the answer to the second question is no, segmenting each process into a fixed number of bins assists in computing the reliability coefficient. Major Takeaways: The proposed framework can be a general guideline for aggregating process data in LA research. Researchers should check and report the reliability evidence for aggregate measurements before the ensuing interpretation. Lay Description: What is currently known about this topic: Aggregating learning process data is common in learning analytics.The psychometric pros and cons of aggregating process data are rarely examined. What this paper adds: If the construct of interest is stable during a period, aggregation over this period is desirable.Aggregation over a long period masks meaningful changes in learning behaviours.A guideline for choosing proper reliability coefficients for aggregate measurements is proposed.Methods for computing reliability estimates when processes vary in length are provided. Implications for practice: Report reliability evidence for aggregate measurements for the sake of psychometric rigour.A short period causes unreliable action‐related indicators in learning analytics dashboards.A long period causes inaccurate indicators of learners' current state. [ABSTRACT FROM AUTHOR]

Art interest and art knowledge are central constructs in empirical aesthetics and specifically the psychology of art. Therefore, valid measurement of these constructs is essential. To this aim the Vienna Art Interest Art Knowledge (VAIAK; Specker, Forster, Brinkmann, Boddy, Pelowski, et al., 2020) questionnaire has recently been introduced. Here, I present further validation evidence for this questionnaire in several ways. First, I define a psychometric model for the VAIAK which I consequently test by way of confirmatory factor analysis (CFA), which indicated good model fit and thus provided evidence for my theoretical model. To substantiate the CFA results, I also use exploratory factor analysis (EFA) models. Second, I address measurement invariance—specifically configural measurement invariance—between a group of art experts and non experts. In this case, too, the multigroup CFA indicated good fit and thus provides evidence for configural measurement invariance. Third, I address the issue of reliability from a theoretical standpoint and an empirical standpoint, specifically providing evidence that the VAIAK shows good test–retest reliability. Finally, I address some practical issues in using the VAIAK ("How long does it take?", "Can I shorten the VAIAK?") that researchers might encounter when using the VAIAK in their own work. In sum, the article presents a crucial next step in the validation process of the VAIAK. [ABSTRACT FROM AUTHOR]

Purpose: This study aimed to evaluate the potential of 3D EPI for improving the reliability of T*2-weighted data and quantification of R*2 decay rate and susceptibility (κ) compared with conventional gradient-echo (GRE)-based acquisition. Methods: Eight healthy subjects in a wide age range were recruited. Each subject received repeated scans for both GRE and EPI acquisitions with an isotropic 1mm resolution at 3 T. Maps of R*2 and κ were quantified, and their interscan differences were used to evaluate the test-retest reliability. Interprotocol differences of R*2 and κ between GRE and EPI were also measured voxel by voxel and in selected regions of interest to test the consistency between the two acquisition methods. Results: The quantifications of R*2 and κ using EPI protocols showed increased test-retest reliability with higher EPI factors up to 5 as performed in the experiment and were consistent with those based on GRE. Conclusion: The result suggests thatmultishot multi-echo 3D EPI can be a useful alternative acquisition method for T*2-weighted MRI and quantification of R*2 and κ with reduced scan time, improved test-retest reliability, and similar accuracy compared with commonly used 3D GRE. [ABSTRACT FROM AUTHOR]

As large language models (LLMs) continue to gain popularity due to their human-like traits and the intimacy they offer to users, their societal impact inevitably expands. This leads to the rising necessity for comprehensive studies to fully understand LLMs and reveal their potential opportunities, drawbacks and overall societal impact. With that in mind, this research conducted an extensive investigation into seven LLMs, aiming to assess the temporal stability and inter-rater agreement on their responses on personality instruments in two time points. In addition, LLMs’ personality profile was analysed and compared with human normative data. The findings revealed varying levels of inter-rater agreement in the LLMs’ responses over a short time, with some LLMs showing higher agreement (e.g. Llama3 and GPT-4o) compared with others (e.g. GPT-4 and Gemini). Furthermore, agreement depended on used instruments as well as on domain or trait. This implies the variable robustness in LLMs’ ability to reliably simulate stable personality characteristics. In the case of scales which showed at least fair agreement, LLMs displayed mostly a socially desirable profile in both agentic and communal domains, as well as a prosocial personality profile reflected in higher agreeableness and conscientiousness and lower Machiavellianism. Exhibiting temporal stability and coherent responses on personality traits is crucial for AI systems due to their societal impact and AI safety concerns.

The maximal Lyapunov exponent (MLE) has been used to quantify the dynamic stability of human locomotion. The method for estimating MLE requires selecting a proper time series of kinematic variables and reconstructing phase space using proper time delay. The data length also affects the reliability of the measured MLE. However, there has been no criterion for the choice of the time series, time delay or data length. Here, we quantified the effect of these factors on the test–retest reliability of MLE estimations. We recruited 15 young and healthy adults and let them walk on a treadmill three times. We calculated MLE employing various lengths of time series of 18 frequently used kinematic variables and two typical choices of time delay: fixed delay and delay selected by average mutual information algorithm. Then, we measured the intraclass correlation coefficient (ICC) of the measured MLE under each condition. Our results show that the choice of time delay does not affect reliability. Five among the 18 kinematic variables enabled excellent reliability with ICC above 0.9 within 450 strides and also enabled ICC above 0.75 even with 60 or less strides. These findings can contribute to establishing the criteria for measuring the dynamic stability of human walking.

The article critiques the adaptation of the Transgender Attitudes and Beliefs Scale (TABS). While commending the modernization of language, the critique highlights methodological issues, including limited sample diversity, overemphasis on terminology changes, and a lack of test-retest reliability. Additionally, the study is criticized for inadequate theoretical engagement and insufficient exploration of practical applications, particularly in healthcare. Recommendations for future research include incorporating more diverse samples and deeper theoretical analysis to enhance the scale’s utility. [ABSTRACT FROM AUTHOR]

Abstract Background This paper aims to instigate discussion and publication of methodologies applied to enhance quality management through comprehensive scientific reports. It provides a detailed description of the design, implementation, and results of the quality control program employed in the SMESH study. Methods Cross-sectional, multicenter, national study designed to assess the prevalence of human papillomavirus in sex workers and in men who have sex with men (MSM). Respondent-driven sampling recruitment was used. An online system was developed for the study and checkpoints were defined for data entry. The system checked the quality of biological samples and performed a retest with part of the sample. Results A total of 1.598 participants (442 sex workers and 1.156 MSM) were included. Fifty-four health professionals were trained for face-to-face data collection. The retest showed Kappa values ranging between 0.3030 and 0.7663. Conclusion The retest data were mostly classified as indicating a strong association. The data generated by the checkpoints showed the successful implementation of the quality control program.

Background: This paper aims to instigate discussion and publication of methodologies applied to enhance quality management through comprehensive scientific reports. It provides a detailed description of the design, implementation, and results of the quality control program employed in the SMESH study. Methods: Cross-sectional, multicenter, national study designed to assess the prevalence of human papillomavirus in sex workers and in men who have sex with men (MSM). Respondent-driven sampling recruitment was used. An online system was developed for the study and checkpoints were defined for data entry. The system checked the quality of biological samples and performed a retest with part of the sample. Results: A total of 1.598 participants (442 sex workers and 1.156 MSM) were included. Fifty-four health professionals were trained for face-to-face data collection. The retest showed Kappa values ranging between 0.3030 and 0.7663. Conclusion: The retest data were mostly classified as indicating a strong association. The data generated by the checkpoints showed the successful implementation of the quality control program. [ABSTRACT FROM AUTHOR]

Life balance is a new and important concept in occupational therapy. New measurements are needed to assess and evaluate life balance and interventions aimed to achieve this concept. This article describes the test-retest reliability of three life balance measures: the Activity Calculator (AC), Activity Card Sort (ACS-NL(18-64)) and Occupational Balance Questionnaire (OBQ11-NL). Data collection took place among 50 participants with neuromuscular diseases: facioscapulohumeral dystrophy (FSHD, n = 25) or mitochondrial myopathy (MM, n = 25). The AC, the ACS-NL(18–64) and the OBQ11-NL were assessed twice with an interval of one week. Intraclass correlation coefficients (ICC-agreement) were applied to examine test-retest reliability. The ICC of the AC-average total day score was.95 (95% CI.91-.97), whereas the ICC of the weights allocated to each activity was 0.80 (95% CI.77–0.82). The ICC of the ACS-NL(18–64) percentage retained activities was 0.92 (95% CI 0.86 − 0.96) and the ICC of the importance score per activity was-.76 (95% CI. 0.68–0.89). The ICC of the OBQ11-NL total score was.76 (95% CI 0.62–0.86). All three tools showed good to excellent test-retest reliability in a sample of patients with FSHD or MM, which is promising for its use in clinical practice and research. The AC, ACS-NL(18–64) and the OBQ11-NL are promising, reliable measures of life balance in patients with neuromuscular diseases. The development of three new instruments for life balance enlarges the possibility for health professionals to measure life balance in clinical practice and research. [ABSTRACT FROM AUTHOR]

Objective Decision-making is responsible for the best and worst of human nature. The field of decision science has done much to elucidate the psychological process of decision-making, variables that affect decision-making, and outcomes of disadvantageous decision-making. However, understanding any psychological process requires creation of reliable measures. Few studies focus on the test–retest reliability of behavioral decision-making tasks despite their utility in repeated assessment batteries. Method The present study examined the extent to which common behavioral decision-making tasks are reliable across time. Across two samples and two time points, participants completed multiple decision-making assessments. Results Results revealed moderate at best evidence of test–retest reliability across a 10-week interval in any of the tasks assessed. Conclusions These findings raise large questions for the field of behavioral decision-making and the utility for tasks to track changes in decision-making across time in clinical populations. [ABSTRACT FROM AUTHOR]