Concordance of Text Message Ecological Momentary Assessment and Retrospective Survey Data Among Substance-Using Men Who Have Sex With Men: A Secondary Analysis of a Randomized Controlled Trial

BackgroundAlcohol and illicit drug use is more prevalent among men who have sex with men (MSM) compared to the general population and has been linked to HIV transmission in this population. Research assessing individual patterns of substance use often utilizes questionnaires or interviews that rely on retrospective self-reported information, which can be subject to recall bias. Ecological momentary assessment (EMA) is a set of methods developed to mitigate recall bias by collecting data about subjects’ mental states and behaviors on a near real-time basis. EMA remains underutilized in substance use and HIV research. ObjectiveTo assess the concordance between daily reports of substance use collected by EMA text messages (short message service, SMS) and retrospective questionnaires and identify predictors of daily concordance in a sample of MSM. MethodsWe conducted a secondary analysis of EMA text responses (regarding behavior on the previous day) and audio computer-assisted self-interview (ACASI) survey data (14-day recall) from June 2013 to September 2014 as part of a randomized controlled trial assessing a pharmacologic intervention to reduce methamphetamine and alcohol use among nondependent MSM in San Francisco, California. Reports of daily methamphetamine use, alcohol use, and binge alcohol use (5 or more drinks on one occasion) were collected via EMA and ACASI and compared using McNemar’s tests. Demographic and behavioral correlates of daily concordance between EMA and ACASI were assessed for each substance, using separate multivariable logistic regression models, fit with generalized estimating equations. ResultsAmong 30 MSM, a total of 994 days were included in the analysis for methamphetamine use, 987 for alcohol use, and 981 for binge alcohol use. Methamphetamine (EMA 20%, ACASI 11%, P