Search

Background: The quality of implementation is important to ensure the effectiveness of behavioral change interventions in practice. Implementing such programs with completeness and adherence is not an automatic process and may require additional support. In school settings, the support teachers receive during implementation is often limited and appears to fall short when attempting to preserve completeness and adherence in program delivery. With the aim to improve completeness and adherence of teachers' delivery of a sexual health promoting intervention ("Long Live Love" [LLL]) in secondary education, a Web-based e-coach was developed ("lesgevenindeliefde.nl"or"teachinglove.nl"). The effectiveness of the e-coach, as part of a broader implementation strategy, in influencing teachers' implementation was evaluated.Objective: This study aimed to report on the effect evaluation to determine the effect of the Web-based e-coach on teacher implementation of a school-based sex education program called LLL and on its determinants.Methods: A cluster randomized controlled trial (e-coaching vs waiting list control) was conducted with a baseline assessment (T0) and follow-up (T1) 2 weeks after completing the LLL program. A total of 43 schools with 83 teachers participated in the study. In the follow-up, 38 schools participated, 23 in the e-coaching condition with 41 teachers and 15 in the control condition with 26 teachers. Multilevel regression analysis was used to evaluate the effect of the e-coaching website on implementation behavior, namely, completeness and adherence to LLL implementation, and on its determinants.Results: The e-coaching intervention was not found to have an effect on teachers' implementation behavior; teachers assigned to the experimental e-coaching website did not score higher on completeness (P=.60) or adherence (P=.67) as compared with teachers in the control condition. When comparing the 30 teachers who made actual use of the e-coaching website with the 37 teachers who did not, no significant differences were found either (P≥.54). In addition, there was no effect of e-coaching on the determinants of teacher implementation behavior (t67-75≤0.69; P≥.22).Conclusions: E-coaching was not found to be effective in enhancing completeness of and adherence to LLL by teachers. The lack of effect may be attributed to the intervention content, the limited use, or the study design itself. The e-coaching intervention may not have adequately addressed adherence and completeness of LLL to bring about behavioral change. Furthermore, the e-coaching intervention was not or insufficiently used by teachers. A possible biased sample of motivated, able teachers may have agreed to participate in the study, and a possible "ceiling effect" may have been present because of the high implementation grade. This, however, does not imply that Web-based coaching in itself is an ineffective strategy to promote adherence and completeness of program implementation. A process evaluation is required as follow-up.Trial Registration: International Standard Randomised Controlled Trial Number ISRCTN11754581; http://www.isrctn.com/ISRCTN11754581 (Archived by WebCite at http://www.webcitation.org/70C5TUOOh). [ABSTRACT FROM AUTHOR]

Background: Despite the growing body of research on complex lifestyle behaviors (eg, Dietary Intake [DI] and Physical Activity [PA]), monitoring of these behaviors has been hampered by a lack of suitable methods. A possible solution to this deficiency is mobile-based Ecological Momentary Assessment (mEMA), which enables researchers to collect data on participants' states in real-time by means of a smartphone application. However, feasibility, usability, and ecological validity need to be anticipated and managed in order to enhance the validity of mEMA. Objective: To examine the feasibility, usability, and ecological validity of a mEMA application (app) with regard to DI and PA among Dutch vocational education students. Methods: The students (n=30) participated in the mEMA study for seven consecutive days. They downloaded the mEMA app on their smartphone. Feasibility and usability of the mEMA app were evaluated by completing an online evaluation after seven days of participation. Ecological validity was measured by assessing the degree to which the content of the mEMA app approximated the real-world setting that was being examined, through several multiple-choice questions. Results: Compliance rates, as registered by the mEMA app, declined 46% over a seven-day period, while self-reported compliance, as measured with an online evaluation questionnaire afterwards, indicated a smaller decrease in compliance (29%). The students evaluated the mEMA app as feasible and usable. Ecological validity analyses showed that all DI and almost all PA multiple-choice options were covered with the compound response categories. Conclusions: The mEMA app offers the opportunity to assess complex health behaviors (eg, DI and PA) in real-time settings, in which specifically routinized behaviors are involved. However, the mEMA app faced several challenges that needed to be overcome in order to improve its validity. Overall, the present study showed that the mEMA app is a usable and ecologically valid tool to measure DI and PA behaviors among vocational education students, but compliance is still limited. (J Med Internet Res 2013;15(9):e214) [ABSTRACT FROM AUTHOR]