Assessing message deployment during public health emergencies through social media: An empirical test of optimizing content for effective dissemination

Document Type

Journal Article

Publication Date

6-11-2024

Journal

Journal of medical Internet research

DOI

10.2196/50871

Abstract

BACKGROUND: During an infodemic, the need for timely, reliable, and accessible information is crucial to combat the proliferation of health misinformation. Message testing can provide vital information to make data-informed decisions, but traditional methods tend to be time and resource intensive. Recognizing this need, we developed the Rapid Message Testing at Scale (RMTS) approach to allow communicators to repurpose existing social media advertising tools and understand the full spectrum of audience engagement. OBJECTIVE: We had two main objectives: a) to demonstrate the use of the RMTS approach for message testing, especially when resources are limited and there is a need to act in a timely manner, and (b) to propose and test the efficacy of an outcome variable that measures engagement along a continuum of viewing experience. METHODS: We developed 12 versions of a single video that was created for a vaccine confidence project in India. We manipulated video length, aspect ratio, and use of subtitles. The videos were tested across four demographic groups (women/men, younger/older). We assessed user engagement along a continuum of viewing experience: getting attention, sustaining attention, conveying the message, and inspiring action. These were measured by percentage of video watched and clicks on the call-to-action link. RESULTS: The video ads were placed on Facebook over four consecutive days at the cost of $450 (U.S.) and garnered a total of 3.34 million impressions. Overall, we found that the best performing video was the shorter version presented in portrait aspect ratio and without subtitles. There was a significant but small association between the length of the video and users' level of engagement at key points along the continuum of viewing experience (N=1,032,888; 〖χ^2〗_4=48,261.97; P<.001; V=.22). We found that for the longer video, those with subtitles held viewers longer after 25% video watch time than those without subtitles (n=15,597; 〖χ^2〗_1=7.33; P<.01; V=.02). While we found some significant associations between the aspect ratio, the use of subtitles, and the number of users watching the video and clicking on the call-to-action link, the effect size for those were extremely small. CONCLUSIONS: This test served as a proof of concept for the RMTS approach. We obtained rapid feedback on formal message attributes from a very large sample in a very short timeframe. The results of this test reinforce the need for platform-specific tailoring of communications. While our data showed a general preference for the short video in portrait orientation and without subtitles among our target audiences on Facebook, that may not necessarily be the case in other social media platforms such as YouTube or TikTok, where users go primarily to watch videos. RMTS testing highlights nuances that communication professionals can address instead of being limited to a 'one size fits all' approach.

Department

Biomedical Laboratory Sciences

Link to Full Text

Share

COinS