Publications

2024

Ivanova, Julia, Hattie Wilczewski, Farina Klocksieben, Mollie Cummins, Hiral Soni, Triton Ong, Janelle Barrera, et al. (2024) 2024. “Patient Preferences for Direct-to-Consumer Telemedicine Services: Replication and Extension of a Nationwide Survey.”. JMIR Human Factors 11: e51056. https://doi.org/10.2196/51056.

BACKGROUND: A 2017 survey of patient perspectives showed overall willingness and comfort to use telemedicine, but low actual use. Given recent growth and widespread exposure of patients to telemedicine, patient preferences are likely to have changed.

OBJECTIVE: This study aimed to (1) identify demographic trends in patient preferences and experiences; (2) measure ease of use and satisfaction of telemedicine; and (3) measure changes in telemedicine use, willingness, and comfort since 2017.

METHODS: We replicated a 2017 study with a nationwide survey of US adults. The survey, an extended version of the previous study, measured patient health care access as well as knowledge, experiences, and preferences regarding telemedicine encounters. We recruited participants using SurveyMonkey Audience in July 2022. We used descriptive statistics and generalized estimating equations to measure change and identify trends.

RESULTS: We accrued 4577 complete responses. Patient experience with telemedicine was substantially higher in 2022 than in 2017, with 61.1% (vs 5.3%) of participants aware that their primary care provider offered telemedicine and 34.5% (vs 3.5%) reporting use of telemedicine with their primary care provider. This study also reported ease of use and satisfaction rates to be similar to in-person visits, while overall willingness and comfort in using telemedicine increased from 2017. Individuals at the poverty line were significantly less likely to report satisfaction with telemedicine visits. We found increased interpersonal distance in a patient and health care professional relationship significantly reduced patient ease of use, willingness, and comfort in using telemedicine.

CONCLUSIONS: This study identified an association between income and patient satisfaction, conveying the importance of understanding telemedicine in relation to health care access and equity. Telemedicine ease of use and satisfaction were comparable to in-person visits. Individuals reported greater use and higher positive perceptions of telemedicine willingness and comfort since 2017.

Cummins, Mollie R, Athanasios Tsalatsanis, Chaitanya Chaphalkar, Julia Ivanova, Triton Ong, Hiral Soni, Janelle F Barrera, Hattie Wilczewski, Brandon M Welch, and Brian E Bunnell. (2024) 2024. “Telemedicine Appointments Are More Likely to Be Completed Than In-Person Healthcare Appointments: A Retrospective Cohort Study.”. JAMIA Open 7 (3): ooae059. https://doi.org/10.1093/jamiaopen/ooae059.

OBJECTIVES: Missed appointments can lead to treatment delays and adverse outcomes. Telemedicine may improve appointment completion because it addresses barriers to in-person visits, such as childcare and transportation. This study compared appointment completion for appointments using telemedicine versus in-person care in a large cohort of patients at an urban academic health sciences center.

MATERIALS AND METHODS: We conducted a retrospective cohort study of electronic health record data to determine whether telemedicine appointments have higher odds of completion compared to in-person care appointments, January 1, 2021, and April 30, 2023. The data were obtained from the University of South Florida (USF), a large academic health sciences center serving Tampa, FL, and surrounding communities. We implemented 1:1 propensity score matching based on age, gender, race, visit type, and Charlson Comorbidity Index (CCI).

RESULTS: The matched cohort included 87 376 appointments, with diverse patient demographics. The percentage of completed telemedicine appointments exceeded that of completed in-person care appointments by 9.2 points (73.4% vs 64.2%, P < .001). The adjusted odds ratio for telemedicine versus in-person care in relation to appointment completion was 1.64 (95% CI, 1.59-1.69, P < .001), indicating that telemedicine appointments are associated with 64% higher odds of completion than in-person care appointments when controlling for other factors.

DISCUSSION: This cohort study indicated that telemedicine appointments are more likely to be completed than in-person care appointments, regardless of demographics, comorbidity, payment type, or distance.

CONCLUSION: Telemedicine appointments are more likely to be completed than in-person healthcare appointments.

Soni, Hiral, Julia Ivanova, Hattie Wilczewski, Triton Ong, Nalubega Ross, Alexandra Bailey, Mollie Cummins, Janelle Barrera, Brian Bunnell, and Brandon Welch. (2024) 2024. “User Preferences and Needs for Health Data Collection Using Research Electronic Data Capture: Survey Study.”. JMIR Medical Informatics 12: e49785. https://doi.org/10.2196/49785.

BACKGROUND: Self-administered web-based questionnaires are widely used to collect health data from patients and clinical research participants. REDCap (Research Electronic Data Capture; Vanderbilt University) is a global, secure web application for building and managing electronic data capture. Unfortunately, stakeholder needs and preferences of electronic data collection via REDCap have rarely been studied.

OBJECTIVE: This study aims to survey REDCap researchers and administrators to assess their experience with REDCap, especially their perspectives on the advantages, challenges, and suggestions for the enhancement of REDCap as a data collection tool.

METHODS: We conducted a web-based survey with representatives of REDCap member organizations in the United States. The survey captured information on respondent demographics, quality of patient-reported data collected via REDCap, patient experience of data collection with REDCap, and open-ended questions focusing on the advantages, challenges, and suggestions to enhance REDCap's data collection experience. Descriptive and inferential analysis measures were used to analyze quantitative data. Thematic analysis was used to analyze open-ended responses focusing on the advantages, disadvantages, and enhancements in data collection experience.

RESULTS: A total of 207 respondents completed the survey. Respondents strongly agreed or agreed that the data collected via REDCap are accurate (188/207, 90.8%), reliable (182/207, 87.9%), and complete (166/207, 80.2%). More than half of respondents strongly agreed or agreed that patients find REDCap easy to use (165/207, 79.7%), could successfully complete tasks without help (151/207, 72.9%), and could do so in a timely manner (163/207, 78.7%). Thematic analysis of open-ended responses yielded 8 major themes: survey development, user experience, survey distribution, survey results, training and support, technology, security, and platform features. The user experience category included more than half of the advantage codes (307/594, 51.7% of codes); meanwhile, respondents reported higher challenges in survey development (169/516, 32.8% of codes), also suggesting the highest enhancement suggestions for the category (162/439, 36.9% of codes).

CONCLUSIONS: Respondents indicated that REDCap is a valued, low-cost, secure resource for clinical research data collection. REDCap's data collection experience was generally positive among clinical research and care staff members and patients. However, with the advancements in data collection technologies and the availability of modern, intuitive, and mobile-friendly data collection interfaces, there is a critical opportunity to enhance the REDCap experience to meet the needs of researchers and patients.

Carris, Nicholas W, Shawn Wallace, Christopher G DuCoin, Rahul Mhaskar, Marilyn Stern, and Brian Bunnell. (2024) 2024. “Discontinuing Semaglutide After Weight Loss: Strategy for Weight Maintenance and a Possible New Side Effect.”. Canadian Journal of Physiology and Pharmacology 102 (6): 391-95. https://doi.org/10.1139/cjpp-2023-0464.

Glucagon-like peptide-1 receptor agonists (GLP-1 RAs) facilitate weight loss. Weight regain off therapy is concerning. We reported the case of a 35-year-old male prescribed oral semaglutide with 22.7 kg weight loss over 120 days. Herein, we describe the clinical course when discontinuing GLP-1 RA therapy, one approach to maintaining weight loss after discontinuation, and a possible new side effect. At day 120, we continued oral semaglutide 7 mg daily, down from 14 mg, for weight maintenance with subsequent weight regain. We re-increased semaglutide to 14 mg/day with weight re-loss within 1 month and weight maintance for a year. We then discontinued semaglutide; weight loss was maintained for 6 months. The patient reported lactose intolerance ∼13 months before starting semaglutide. During semaglutide therapy, the patient reported worsened lactose intolerance and new gluten intolerance. Food allergy/celiac testing were negative. Intolerances did not improve with semaglutide discontinuation. Six months after semaglutide discontinuation, the patient was diagnosed with small intestinal bacterial overgrowth, possibly worsened by semaglutide. Factors potentially supporting weight maintenance were early drug treatment for new-onset obesity, non-geriatric age, strength training, and diet modification. The case highlights tailoring approaches to maintain weight loss without GLP-1 RAs. Trials are needed to optimize weight maintenance strategies.

Cummins, Mollie R, Sukrut Shishupal, Bob Wong, Neng Wan, Jiuying Han, Jace D Johnny, Amy Mhatre-Owens, et al. (2024) 2024. “Travel Distance Between Participants in US Telemedicine Sessions With Estimates of Emissions Savings: Observational Study.”. Journal of Medical Internet Research 26: e53437. https://doi.org/10.2196/53437.

BACKGROUND: Digital health and telemedicine are potentially important strategies to decrease health care's environmental impact and contribution to climate change by reducing transportation-related air pollution and greenhouse gas emissions. However, we currently lack robust national estimates of emissions savings attributable to telemedicine.

OBJECTIVE: This study aimed to (1) determine the travel distance between participants in US telemedicine sessions and (2) estimate the net reduction in carbon dioxide (CO2) emissions attributable to telemedicine in the United States, based on national observational data describing the geographical characteristics of telemedicine session participants.

METHODS: We conducted a retrospective observational study of telemedicine sessions in the United States between January 1, 2022, and February 21, 2023, on the doxy.me platform. Using Google Distance Matrix, we determined the median travel distance between participating providers and patients for a proportional sample of sessions. Further, based on the best available public data, we estimated the total annual emissions costs and savings attributable to telemedicine in the United States.

RESULTS: The median round trip travel distance between patients and providers was 49 (IQR 21-145) miles. The median CO2 emissions savings per telemedicine session was 20 (IQR 8-59) kg CO2). Accounting for the energy costs of telemedicine and US transportation patterns, among other factors, we estimate that the use of telemedicine in the United States during the years 2021-2022 resulted in approximate annual CO2 emissions savings of 1,443,800 metric tons.

CONCLUSIONS: These estimates of travel distance and telemedicine-associated CO2 emissions costs and savings, based on national data, indicate that telemedicine may be an important strategy in reducing the health care sector's carbon footprint.

Soni, Hiral, Heath Morrison, Dinko Vasilev, Triton Ong, Hattie Wilczewski, Caitlin Allen, Chanita Hughes-Halbert, et al. (2024) 2024. “User Experience of a Family Health History Chatbot: A Quantitative Analysis.”. Health Informatics Journal 30 (2): 14604582241262251. https://doi.org/10.1177/14604582241262251.

OBJECTIVE: Family health history (FHx) is an important tool in assessing one's risk towards specific health conditions. However, user experience of FHx collection tools is rarely studied. ItRunsInMyFamily.com (ItRuns) was developed to assess FHx and hereditary cancer risk. This study reports a quantitative user experience analysis of ItRuns.

METHODS: We conducted a public health campaign in November 2019 to promote FHx collection using ItRuns. We used software telemetry to quantify abandonment and time spent on ItRuns to identify user behaviors and potential areas of improvement.

RESULTS: Of 11,065 users who started the ItRuns assessment, 4305 (38.91%) reached the final step to receive recommendations about hereditary cancer risk. Highest abandonment rates were during Introduction (32.82%), Invite Friends (29.03%), and Family Cancer History (12.03%) subflows. Median time to complete the assessment was 636 s. Users spent the highest median time on Proband Cancer History (124.00 s) and Family Cancer History (119.00 s) subflows. Search list questions took the longest to complete (median 19.50 s), followed by free text email input (15.00 s).

CONCLUSION: Knowledge of objective user behaviors at a large scale and factors impacting optimal user experience will help enhance the ItRuns workflow and improve future FHx collection.

Ong, Triton, Julia Ivanova, Hiral Soni, Hattie Wilczewski, Janelle Barrera, Mollie Cummins, Brandon M Welch, and Brian E Bunnell. (2024) 2024. “Therapist Perspectives on Telehealth-Based Virtual Reality Exposure Therapy.”. Virtual Reality 28 (2). https://doi.org/10.1007/s10055-024-00956-7.

Virtual reality (VR) can enhance mental health care. In particular, the effectiveness of VR-based exposure therapy (VRET) has been well-demonstrated for treatment of anxiety disorders. However, most applications of VRET remain localized to clinic spaces. We aimed to explore mental health therapists' perceptions of telehealth-based VRET (tele-VRET) by conducting semi-structured, qualitative interviews with 18 telemental health therapists between October and December 2022. Interview topics included telehealth experiences, exposure therapy over telehealth, previous experiences with VR, and perspectives on tele-VRET. Therapists described how telehealth reduced barriers (88.9%, 16/18), enhanced therapy (61.1%, 11/18), and improved access to clients (38.9%, 7/18), but entailed problems with technology (61.1%, 11/18), uncontrolled settings (55.6%, 10/18), and communication difficulties (50%, 9/18). Therapists adapted exposure therapy to telehealth by using online resources (66.7%, 12/18), preparing client expectations (55.6%, 10/18), and adjusting workflows (27.8%, 5/18). Most therapists had used VR before (72.2%, 13/18) and had positive impressions of VR (55.6%, 10/18), but none had used VR clinically. In response to tele-VRET, therapists requested interactive session activities (77.8%, 14/18) and customizable interventions components (55.6%, 10/18). Concerns about tele-VRET included risks with certain clients (77.8%, 14/18), costs (50%, 9/18), side effects and privacy (22.2%, 4/18), and inappropriateness for specific forms of exposure therapy (16.7%, 3/18). These results reveal how combining telehealth and VRET may expand therapeutic options for mental healthcare providers and can help inform collaborative development of immersive health technologies.

Cummins, Mollie R, Hiral Soni, Julia Ivanova, Triton Ong, Janelle Barrera, Hattie Wilczewski, Brandon Welch, and Brian E Bunnell. (2024) 2024. “Narrative Review of Telemedicine Applications in Decentralized Research.”. Journal of Clinical and Translational Science 8 (1): e30. https://doi.org/10.1017/cts.2024.3.

Telemedicine enables critical human communication and interaction between researchers and participants in decentralized research studies. There is a need to better understand the overall scope of telemedicine applications in clinical research as the basis for further research. This narrative, nonsystematic review of the literature sought to review and discuss applications of telemedicine, in the form of synchronous videoconferencing, in clinical research. We searched PubMed to identify relevant literature published between January 1, 2013, and June 30, 2023. Two independent screeners assessed titles and abstracts for inclusion, followed by single-reviewer full-text screening, and we organized the literature into core themes through consensus discussion. We screened 1044 publications for inclusion. Forty-eight publications met our inclusion and exclusion criteria. We identified six core themes to serve as the structure for the narrative review: infrastructure and training, recruitment, informed consent, assessment, monitoring, and engagement. Telemedicine applications span all stages of clinical research from initial planning and recruitment to informed consent and data collection. While the evidence base for using telemedicine in clinical research is not well-developed, existing evidence suggests that telemedicine is a potentially powerful tool in clinical research.

Obeid, Jihad S, Athanasios Tsalatsanis, Chaitanya Chaphalkar, Sara Robinson, Sierra Klein, Sarah Cool, Elizabeth Szwast, and Brian E Bunnell. (2024) 2024. “A Reproducible Model Based on Clinical Text for Predicting Suicidal Behavior.”. Studies in Health Technology and Informatics 310: 1486-87. https://doi.org/10.3233/SHTI231257.

Suicide risk models are critical for prioritizing patients for intervention. We demonstrate a reproducible approach for training text classifiers to identify patients at risk. The models were effective in phenotyping suicidal behavior (F1=.94) and moderately effective in predicting future events (F1=.63).

Ong, Triton, Janelle F Barrera, Charvi Sunkara, Hiral Soni, Julia Ivanova, Mollie R Cummins, Kaitlyn R Schuler, Hattie Wilczewski, Brandon M Welch, and Brian E Bunnell. (2024) 2024. “Mental Health Providers Are Inexperienced But Interested in Telehealth-Based Virtual Reality Therapy: Survey Study.”. Frontiers in Virtual Reality 5. https://doi.org/10.3389/frvir.2024.1332874.

Virtual reality (VR) is an emerging technology that can enhance experiences and outcomes in mental healthcare. However, mental health therapists have been slow to adopt VR into practice. Implementation of telehealth-based VR therapy (tele-VR) could catalyze adoption and innovation in mental healthcare. To explore therapists' perspectives on tele-VR, we conducted a cross-sectional survey of practicing mental health providers in the United States in June-July 2023. We analyzed 176 completed surveys from therapists, of whom 51.14% had no prior experience with VR, only 6.25% had used VR clinically, and 56.82% had neutral impressions of VR for therapy. Despite therapists' general inexperience with VR, therapists indicated a wide variety of tele-VR simulations (e.g., social situations, flying, heights) and features (e.g., personalized spaces, homework, interactivity) would be moderately to extremely useful for their practices. Therapists also requested additional VR simulations and features for their telehealth clients such as behavioral skills training, exposure therapy, gender identity therapy, and psychological assessments in VR. Therapists rated Health Insurance Portability and Accountability Act compliance, the ability to try VR before buying, affordability for therapists, accessibility for clients, and insurance coverage as the five most influential implementation factors for tele-VR. Overall, therapists were generally inexperienced and neutral about VR for telehealth therapy, but were interested in tele-VR for specific applications. These findings provide actionable directions for future research and collaborative development of therapeutic VR content and features.