Are health-related tweets evidence based? review and analysis of health-related tweets on Twitter

Abstract

Background: Health care professionals are utilizing Twitter to communicate, develop disease surveillance systems, and mine health-related information. The immediate users of this health information is the general public, including patients. This necessitates the validation of health-related tweets by health care professionals to ensure they are evidence based and to avoid the use of noncredible information as a basis for critical decisions. Objective: The aim of this study was to evaluate health-related tweets on Twitter for validity (evidence based) and to create awareness in the community regarding the importance of evidence-based health-related tweets. Methods: All tweets containing health-related information in the Arabic language posted April 1-5, 2015, were mined from Twitter. The tweets were classified based on popularity, activity, interaction, and frequency to obtain 25 Twitter accounts (8 physician accounts, 10 nonofficial health institute accounts, 4 dietitian accounts, and 3 government institute accounts) and 625 tweets. These tweets were evaluated by 3 American Board-certified medical consultants and a score was generated (true/false) and interobserver agreement was calculated. Results: A total of 625 health-related Arabic-language tweets were identified from 8 physician accounts, 10 nonofficial health institute accounts, 4 dietician accounts, and 3 government institute accounts. The reviewers labeled 320 (51.2%) tweets as false and 305 (48.8%) tweets as true. Comparative analysis of tweets by account type showed 60 of 75 (80%) tweets by government institutes, 124 of 201 (61.7%) tweets by physicians, and 42 of 101 (41.6%) tweets by dieticians were true. The interobserver agreement was moderate (range 0.78-0.22). More than half of the health-related tweets (169/248, 68.1%) from nonofficial health institutes and dietician accounts (59/101, 58.4%) were false. Tweets by the physicians were more likely to be rated "true" compared to other groups (P