Search

Introduction The KLIK Patient Reported Outcome Measures (PROM) portal (www.hetklikt.nu) has been implemented since 2011 in clinical practice in over 20 Dutch hospitals. Patients and/or parents complete PROMs before the outpatient consultation and answers are subsequently discussed by clinicians during consultation. This study aims to provide insight into patients’ and parents’ perspective on the use of the KLIK PROM portal in order to optimize its implementation in pediatric clinical practice. Methods Patients (12–19 years) and parents (of children 0–19 years) from the Emma Children’s Hospital were invited to participate. A mixed-method design was used; (1) Focus groups were held and analyzed using thematic analysis in psychology, (2) a questionnaire was sent out and analyzed using descriptive statistics. Results (1) Eight patients and 17 parents participated. Patients mentioned that KLIK has an attractive layout. However, PROMs were sometimes considered irrelevant and repetitive. Parents valued that KLIK provides insight into their child’s functioning, but they were not satisfied with the extent to which PROMs were discussed by clinicians. (2) 31 patients and 130 parents completed the questionnaire. Overall, patients and parents reported a satisfaction score of 7.9/10 and 7.3/10, respectively. 81% of patients and 74% of parents indicated that KLIK is easy to use. Conclusion Patients and parents are generally satisfied with KLIK, however, points of improvement were mentioned. These are currently being addressed by e.g., upgrading the KLIK website, implementing PROMIS item banks in KLIK to reduce irrelevancy and repetitiveness of PROMs, and implementation strategies to improve the discussion-rate. In this way, implementation of the KLIK PROM portal can be further optimized, with the ultimate goal to improve quality of care.

This study aimed to validate the PROMIS ® pediatric v2.0 Anger scale in the Dutch general population, provide reference data, and compare reliability and relative efficiency between the full-length scale, its short-form, computerized adaptive test (CAT), and Pediatric Quality of Life Inventory (PedsQL TM) emotional functioning (EF) subscale scores. Children (N = 1,328), representative of the Dutch population, were asked to complete the PROMIS pediatric Anger scale (8–18 years) and PedsQL TM (8–17 years). A graded response model (GRM) was fit to the data. Structural validity was assessed by checking item-fit statistics (S−X 2, p 0.50) was expected between the Anger scale and PedsQL TM EF subscale score. Dutch mean T score based on the U.S. model was calculated to provide reference data and cut-offs. Standard error of measurement (SE(θ)) was used to assess reliability (SE(θ) 2/N items) to compare how good the measures performed relative to the amount of items administered. In total, 527 children completed the PROMIS pediatric Anger scale, of which 482 completed the PedsQL TM. Structural validitywas sufficient as no items displayedmisfit (S−X 2 = 22.9–40.3, p >.001). The Anger scale score correlated moderately (Pearson’s r =.64) with the PedsQL TM EF subscale score. Dutch mean T score was 44.20 (SD = 11.39), with cut-offs of >52.2 for moderate and ≥62.3 for severe symptoms. Reliable measurements were obtained at the population mean and >2SD in the clinically relevant direction. CAT outperformed all other measures in efficiency. The PROMIS pediatric Anger scale displayed sufficient psychometric properties within the Dutch population and reference data are available.

Purpose Since 2011, the evidence-based KLIK Patient Reported Outcome Measure (PROM) portal has been implemented in clinical practice in > 20 Dutch hospitals. Patients and/or parents complete PROMs on Health Related Quality of Life, symptoms and psychosocial functioning before their outpatient consultation. Answers are converted into an ePROfile and discussed by clinicians during consultation to monitor well-being over time and detect problems early. This study aims to get insight into the KLIK implementation from the clinician’s perspective. Methods As part of the KLIK implementation process, annual meetings were held with multidisciplinary teams to evaluate the use of KLIK. An online questionnaire was sent regarding (1) overall satisfaction, (2) feeling competent to discuss PROMs, (3) use of KLIK during the consultation, (4) influence of KLIK on the consultation, (5) usability of the KLIK PROM portal, (6) satisfaction with PROMs and feedback, and (7) support of the KLIK expert team. Open questions about (dis)advantages were included. Descriptive analyses were used. Results One hundred and forty-eight clinicians (response-rate 61%) from 14 hospitals in the Netherlands participated. Results show that: (1) clinicians report an overall satisfaction of median = 69/100 (visual analogue scale), (2) 85.8% feel competent discussing the ePROfile, (3) 70.3% (almost) always discuss the ePROfile, (4) 70.3% think that KLIK improves consultation, (5) 71.6% think KLIK is easy to use, (6) 80.4% are satisfied with the feedback of the overall KLIK ePROfile, (7) 71.6% experience sufficient support of the KLIK team. Conclusion Participating clinicians are generally satisfied with KLIK. Improvements to the KLIK PROM portal are now realized based on the mentioned disadvantages (e.g., shorten PROM completion by use of PROMIS and integrating KLIK with Electronic Health Records).

Purpose During the COVID-19 pandemic in the Netherlands, governmental regulations resulted in a lockdown for adults as well as children/adolescents. Schools were closed and contact with other people was limited. In this cross-sectional, population-based study, we aimed to investigate the mental/social health of children/adolescents during COVID-19 lockdown. Methods Two representative samples of Dutch children/adolescents (8–18 years) before COVID-19 (2018, N = 2401) and during lockdown (April 2020, N = 844) were compared on the Patient-Reported Outcomes Measurement Information System (PROMIS) domains: global health, peer relationships, anxiety, depressive symptoms, anger, sleep-related impairment by linear mixed models and calculating relative risks (RR (95% CI)) for the proportion of severe scores. Variables associated with worse mental/social health during COVID-19 were explored through multivariable regression models. The impact of COVID-19 regulations on the daily life of children was qualitatively analyzed. Results Participants reported worse PROMIS T-scores on all domains during COVID-19 lockdown compared to before (absolute mean difference range 2.1–7.1 (95% CI 1.3–7.9). During lockdown, more children reported severe Anxiety (RR = 1.95 (1.55–2.46) and Sleep-Related Impairment (RR = 1.89 (1.29–2.78) and fewer children reported poor Global Health (RR = 0.36 (0.20–0.65)). Associated factors with worse mental/social health were single-parent family, ≥ three children in the family, negative change in work situation of parents due to COVID-19 regulations, and a relative/friend infected with COVID-19. A large majority (> 90%) reported a negative impact of the COVID-19 regulations on daily life. Conclusion This study showed that governmental regulations regarding lockdown pose a serious mental/social health threat on children/adolescents that should be brought to the forefront of political decision-making and mental healthcare policy, intervention, and prevention.

Patients with sickle cell disease (SCD) experience a considerable physical and psychosocial disease burden. In recent years, the application of allogeneic hematopoietic stem cell transplantation (HSCT) to treat adults with SCD has increased. A thorough understanding of patients’ physical, mental, and social health before and after cure is needed to meet the needs of this growing group of patients. We aimed to explore the perspectives of adult SCD patients on the changes in their experienced health and personal life goals after being cured. A mixed-methods approach was used, comprising a semistructured interview and a set of 9 Patient Reported Outcomes Measurement Information System (PROMIS) measures. Adult SCD patients who underwent HSCT at least 1 year earlier were eligible to participate in the study. Interviews were thematically analyzed using MAXQDA software. PROMIS T scores were compared with reference scores of the general population using SPSS Statistics. Ten patients participated in the study; their median age was 29.5 years (range, 19 to 49 years), and their median time since HSCT was 2.7 years (range, 1.0 to 3.5 years). Themes from the interviews were (1) pain/living pain free, (2) physical well-being, (3) mental well-being, (4) perspective/ outlook, (5) education/work, (6) family/friends, and (7) activities/participation. Following the PROMIS framework, we described these themes in a narrative synthesis according to health domain and categorized in 4 chronological time phases: before HSCT, first year post-transplantation, current situation, and future expectations. Physical health improved greatly, but transplantation-related toxicity, ongoing pain from avascular osteonecrosis, and fatigue negatively impacted quality of life in some patients. Furthermore, emotional struggles during the post-transplantation period were common, and patients expressed a need for psychological help. Patients reported improvements in social health and the ability to pursue personal life goals. The mean T scores of all PROMIS measures fell within the normal symptom limits compared with reference data of the general population, although, large variations were observed among the participants, matching our qualitative findings. In general, adult SCD patients experienced improved physical, mental, and social health after cure by HSCT and were able to pursue personal life goals. Yet they found themselves confronted with a new and unfamiliar reality that brought different challenges. Pain due to irreversible avascular osteonecrosis continued to have a negative impact. Clinicians should aim to help patients have realistic expectations before transplantation and offer timely psychological care.

The aim of the study was to assess internalizing problems before and during the pandemic with data from Dutch consortium Child and adolescent mental health and wellbeing in times of the COVID-19 pandemic, consisting of two Dutch general population samples (GS) and two clinical samples (CS) referred to youth/psychiatric care. Measures of internalizing problems were obtained from ongoing data collections pre-pandemic (NGS = 35,357; NCS = 4487) and twice during the pandemic, in Apr–May 2020 (NGS = 3938; clinical: NCS = 1008) and in Nov–Dec 2020 (NGS = 1489; NCS = 1536), in children and adolescents (8–18 years) with parent (Brief Problem Monitor) and/or child reports (Patient-Reported Outcomes Measurement Information System®). Results show that, in the general population, internalizing problems were higher during the first peak of the pandemic compared to pre-pandemic based on both child and parent reports. Yet, over the course of the pandemic, on both child and parent reports, similar or lower levels of internalizing problems were observed. Children in the clinical population reported more internalizing symptoms over the course of the pandemic while parents did not report differences in internalizing symptoms from pre-pandemic to the first peak of the pandemic nor over the course of the pandemic. Overall, the findings indicate that children and adolescents of both the general and clinical population were affected negatively by the pandemic in terms of their internalizing problems. Attention is therefore warranted to investigate long-term effects and to monitor if internalizing problems return to pre-pandemic levels or if they remain elevated post-pandemic.

Background To reduce the burden of completing Patient-Reported Outcome Measures (PROMs), PROMIS® Computerized Adaptive Tests (CATs) are being implemented in pediatric clinical practice. We aimed to develop recommendations for visual feedback options for PROMIS CATs on individual item and domain score level as an evidence-based feedback recommendation for PROMIS CATs is lacking. Methods Focus groups were held with clinicians who use the KLIK PROM portal. Literature-based feedback options were provided to initiate group discussion. Data was analyzed using thematic coding method. Additionally, a questionnaire was sent out to assess patients’ (12-18y) and parents’ (child 0-18y) preference for individual item feedback. Data was analyzed using descriptive statistics. Results Six focus groups were held (N = 28 clinicians). Regarding individual item feedback, showing the complete item bank, with only responses to administered items in traffic light colors was preferred. For domain scores, line graphs were preferred, including numerical (T-)scores, reference and cut-off lines, and traffic light colors. Separate graphs per domain, ranked in order of importance and harmonization of directionality (‘higher = better’) were considered important. Questionnaire results (N = 31 patients/N = 131 parents) showed that viewing their own item responses was preferred above receiving no item feedback by 58.1% of the patients and 77.1% of the parents. Conclusions Based on the outcomes and after discussion with the Dutch-Flemish PROMIS National Center, recommendations for PROMIS CAT feedback options were developed. PROMIS CATs can now be used in clinical practice to help clinicians monitor patient outcomes, while reducing the burden of completing PROMs for patients significantly.

The aim of the study was to assess internalizing problems before and during the pandemic with data from Dutch consortium Child and adolescent mental health and wellbeing in times of the COVID-19 pandemic, consisting of two Dutch general population samples (GS) and two clinical samples (CS) referred to youth/psychiatric care. In each sample, measures of internalizing problems were obtained from ongoing data collections pre-pandemic (NGS= 35,357; NCS= 4,487) and twice during the pandemic, in Apr.–May 2020 (NGS= 3,938; clinical: NCS= 1,008) and in Nov.–Dec. 2020 (NGS= 1,489; NCS= 1,536), in children and adolescents (8-18 years) with parent- (Brief Problem Monitor) and/or child reports (Patient-Reported Outcomes Measurement Information System®). Results show significantly greater proportions of worrisome internalizing problems (based on validated cut-offs) and significantly higher internalizing problems mean levels from pre-pandemic to pandemic measurements in the general population. These levels stabilized or decreased over the course of the pandemic. In the clinical sample, we found an increase in child-reported internalizing problems measures over the course of the pandemic, but parents reported no differences in internalizing problems measures over the course of the pandemic, nor from pre-pandemic to during the pandemic. Overall, the findings indicate that children and adolescents of both the general and clinical population were affected negatively by the pandemic in terms of their internalizing problems. Attention is therefore warranted to investigate what long-term effects this may cause and to monitor if internalizing problems return back to pre-pandemic levels or if they remain elevated post-pandemic.

Introduction This paper describes the different ways in which information is being fed back to health care providers (HCPs) using the Dutch evidence-based KLIK Patient-Reported Outcome Measures (PROMs) portal (www.hetklikt.nu). KLIK was initially developed for children with a chronic illness and their parents, and recently expanded for use in adult health care. Patients complete online PROMs at home about their health-related quality of life (HRQOL), symptoms and/or psychosocial functioning before an outpatient consultation with their HCP. PROMs are subsequently converted into an individual KLIK electronic (e)PROfile and discussed during the consultation to facilitate systematic attention for HRQOL. Methods for pro score interpretation KLIK includes a variety of different PROMs. The KLIK ePROfile initially consisted of literal representations of the individual PROM items in the European traffic light colors (red, orange, green) and only one graph. Over the years, the KLIK ePROfile evolved into a broader spectrum of feedback options; (1) literal representation of individual items, (2) summary scores, and (3) graphic representations (4 options). Developing recommendations for acting on pro results The primary goal of KLIK is to longitudinally monitor patient and parent self-reported or proxy-reported health outcomes, which means that the focus of KLIK is not mainly on recommending actions for PRO results. However, there are several aids that help interpretation of the KLIK ePROfile and recommendations are given for actions based on PROM scores. The main aid is the KLIK training, which includes a theoretical and a practical part. In the training, 2 tools-a decision tree and a summary of information about the KLIK ePROfile-are given to the HCPs to assist them in using KLIK. Discussion Customization of a PROM portal is needed for each different patient group and clinical setting. Because the KLIK website is flexible, every PROM (with good psychometric qualities and permission of the publisher) can be built in. However, implementing and feeding back PROMs in pediatric health care encompasses different challenges, because different versions of the same PROM are needed for children of different ages, as well as proxy and self-report versions.

Background: The COVID-19 lockdown increases psychological problems in children and adolescents from the general population. Here we investigate the mental and social health during the COVID-19 lockdown in children and adolescents with pre-existing mental or somatic problems. Method: We included participants (8-18 years) from a psychiatric (N = 249) and pediatric (N = 90) sample, and compared them to a general population sample (N = 844). Measures were assessed during the first lockdown (April-May 2020) in the Netherlands. Main outcome measures were Patient-Reported Outcomes Measurement Information System (PROMIS) domains: Global Health, Peer Relationships, Anxiety, Depressive Symptoms, Anger, and Sleep-Related Impairment. Additionally, socio-demographic variables, COVID-19-related questions, changes in atmosphere at home from a parent and child perspective, and children's experiences of lockdown regulations were assessed. Results: On all measures except Global Health, the pediatric sample reported least problems. The psychiatric sample reported significantly more problems than the general population sample on all measures except for Anxiety and Peer Relationships. Having a COVID-19 affected friend/relative and a COVID-19 related change in work situation negatively moderated outcome, but not in the samples with pre-existing problems. All parents reported significant decreases in atmosphere at home, as did children from the general population. Conclusion: We observed significant differences in mental and social health between three child and adolescent samples during the COVID-19 pandemic lockdown and identified COVID-19-related factors influencing mental and social health. Our findings contribute to current and future policies during pandemic related lockdowns regarding the mental and social health of children and adolescents.

ImportanceIt is unknown how a lockdown during the COVID-19 pandemic impacts children’s and adolescents’ mental and social health.ObjectiveTo compare mental and social health of children and adolescents during the COVID-19 lockdown versus before, identify associated factors, describe the change in atmosphere at home and qualitatively assess the impact of COVID-19 regulations on daily life.DesignCross-sectional study comparing two Dutch representative samples of children and adolescents (8-18 years); before COVID-19 (Dec2017-July2018) and during the COVID-19 lockdown (April/May 2020).SettingPopulation-basedParticipantsChildren and adolescents aged 8-18 years (M=13.4, 47.4% male), representative of the Dutch population on key demographics.Exposure(s)COVID-19 pandemic lockdownMain Outcome(s) and Measure(s)Patient-Reported Outcomes Measurement Information System (PROMIS®) domains: Global Health, Peer Relationships, Anxiety, Depressive Symptoms, Anger and Sleep-Related Impairment. Single item on atmosphere at home and open question regarding the impact of the regulations on the child/adolescent’s daily lifeResultsChildren and adolescents reported significantly worse PROMIS T-scores on all domains (absolute mean difference range, 2.1-7.1; absolute 95% CI range, 1.3-7.9) during the COVID-19 lockdown as compared to before COVID-19. More children reported severe Anxiety (during 16.7% vs. before 8.6%; relative risk 1.95; 95% CI 1.55-2.46) and Sleep-Related Impairment (during 11.5% vs. before 6.1%; relative risk 1.89; 95% CI 1.29-2.78). Fewer children reported poor Global Health (during 1.7 vs. before 4.6%; relative risk 0.36; 95% CI 0.20-0.65). More mental and social health complaints during the COVID-19 lockdown were found in children and adolescents growing up in a single-parent family, having ≥three children in the family, a negative change in work situation of parents due to COVID-19 regulations, and having a relative/friend infected with COVID-19. A small effect was found on atmosphere at home during the lockdown compared to before (mean difference, −3.1; 95% CI, −4.1 −−2.1). A large majority (>90%) reported a negative impact of the COVID-19 regulations on their daily life.Conclusions and RelevanceThis study showed that governmental regulations regarding lockdown pose a serious mental and social health threat on children and adolescents that should be brought to the forefront of political decision making and mental health care policy, intervention and prevention.Key pointsQuestionWhat is the impact of lockdown during the COVID-19 pandemic on mental and social health in children and adolescents compared to before COVID-19?FindingsThis population-based study shows that during the COVID-19 lockdown children and adolescents report lower mental and social health, especially on anxiety and depressive symptoms.MeaningIn proposing new COVID regulations (e.g., closing schools) governments should be mindful of the negative impact of a lockdown on mental and social health of children and adolescents.