Next Article in Journal
A Lightweight Convolutional Neural Network Architecture Applied for Bone Metastasis Classification in Nuclear Medicine: A Case Study on Prostate Cancer Patients
Previous Article in Journal
Risk Factors for Dementia Incidence Based on Previous Results of the Specific Health Checkups in Japan
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Healthcare
Volume 8
Issue 4
10.3390/healthcare8040492
healthcare-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Characteristics of the Most Cited, Most Downloaded, and Most Mentioned Articles in General Medical Journals: A Comparative Bibliometric Analysis

by
Ji Hyun Hong
,
Dae Young Yoon
*,
Kyoung Ja Lim
,
Ji Yoon Moon
,
Sora Baek
,
Young Lan Seo
and
Eun Joo Yun
Department of Radiology, Kangdong Seong-Sim Hospital, Hallym University College of Medicine, Seoul 134-701, Korea
*
Author to whom correspondence should be addressed.
Healthcare 2020, 8(4), 492; https://doi.org/10.3390/healthcare8040492
Submission received: 26 September 2020 / Revised: 13 November 2020 / Accepted: 16 November 2020 / Published: 18 November 2020
Review Reports Versions Notes

Abstract

:
We compared the characteristics of the most cited, most downloaded, and most mentioned (the highest Altmetric Attention Score) articles published in general medical journals. We identified the 640 most frequently cited, 662 most frequently downloaded, and 652 most mentioned articles from 48 general medical journals. A comparison was made of the following characteristics of articles in the most cited, most downloaded, and most mentioned articles: medical specialty, publication type, country of origin, year of publication, and accessibility. There was only a 2.5% overlap in these three groups. Original articles were the more frequent among the most mentioned articles, whereas reviews, case reports, and guidelines/consensus statements were more frequent among the most downloaded articles. The most cited articles were more frequently published in 2010 and before, whereas the most downloaded articles were published in 2017−2018. The most mentioned articles were more frequently open-access articles, compared to the most downloaded articles. The most cited were more frequently older, the most downloaded were more frequently recent and educational, and the most mentioned were more frequently original and open-access articles. The results of our study may provide insights into various measures of article impact.

1. Introduction

Accurate measurement of the impact of a scientific publication is important for evaluating an individual’s academic performance and for guiding decisions for promotions, tenure, and grant funding [1].
Traditionally, the number of citations an article receives is the most commonly used measure of the impact of an article and may reflect the impact among researchers rather than the interest of a broad audience [2]. A citation is an acknowledgment that a previous article has been referenced in another article. The number of citations is not only an indicator of the impact of an article but also forms the basis of a journal’s impact factor generation [3,4]. Lately, there has been the need to improve the ways in which the outputs of scholarly research are evaluated [5,6]. Another metric for the impact of an article is the download rate. Nowadays, most scientific articles are published not only in print but also in electronic versions of the journal. Therefore, most articles can be downloaded and read online. The download rate of an article may indicate the interest of the readers in a given scientific field, thus reflecting the popularity of paper [7]. With the advent of the Internet and social media, scientific knowledge is now being disseminated to a much larger and more diverse audience. Alternative metrics, also known as altmetrics, are the measure of the real-time online impact of an article and may reflect the interest of a broad audience [8,9,10]. Altmetric.com is one of the main providers of alternative indicators that track where published research is mentioned on various online sources and generate an Altmetric Attention Score (AAS).
Although there have been many studies to identify the most influential articles in a specific biomedical field, to the best of our knowledge, no study has compared the most cited, most downloaded, and most mentioned articles [11,12,13,14,15,16,17,18]. The aim of this study, therefore, was to evaluate and compare the characteristics of the most cited, most downloaded, and most mentioned (specifically, the highest AAS) articles published in general medical journals.

2. Methods and Materials

The present study did not involve human subjects and, thus, did not require institutional review board approval.

2.1. Selection of Journals and Articles

A search of the Web of Science (Thomson Reuters, New York, NY, USA), Science Edition 2016 was conducted which identified 155 journals listed under the subject category “Medicine, General and Internal”. Of these, 107 journals were excluded from the analysis because they did not display the lists of most downloaded articles (n = 8), most cited articles (n = 12), or both (n = 87) on their websites. Consequently, 48 general medical journals that provided information on both the most cited and most downloaded articles were included in the study. An author (J.H.H.) confirmed that each journal covers a broad spectrum of topics throughout the medical field, based on PubMed’s “Abridged Index Medicus (AIM or ‘Core Clinical’) Journal Titles” and on “Instructions for Authors” in the journal’s website. Authors visited websites of 48 general medical journals, which displayed the list of the most cited and downloaded articles. The total sum of the most cited and downloaded articles from 48 general medical journals were 640 and 662, respectively.
For selection of the most mentioned articles, the AAS provided by Altmetric.com was chosen because Altmetric data are the most comprehensive source covering the vast majority of social media activity associated with scientific papers. The AAS reflects a weighted total of the mentions of the article by the various online platforms. For example, a news story is worth eight points, a tweet is worth one point, and a Facebook post is worth a quarter of a point [9]. For the purpose of comparative analysis, the number of articles with the highest AAS was set as the average of the most cited and most downloaded articles from each journal (after rounding off the average number in each journal). Finally, the 652 articles with the highest AAS published in the 48 journals were identified by an Altmetric Explorer search (Altmetric LLP, London, UK). All searches were conducted on a specific day, 19 May 2018, to avoid changes in lists of articles. No restrictions were applied regarding language, type of study, or scholarly identifiers.

2.2. Data Extraction from Articles

For analyzing the characteristics of the most cited, most downloaded, and most mentioned articles, the following information was obtained from each article: (1) medical specialty, (2) publication type (original article, review, case report, guideline/consensus statement, editorial/commentary, systematic review/meta-analysis, or others), (3) country of origin, (4) year of publication, and (5) accessibility (open-access or pay-for-access). Original articles were considered reports that investigated clearly stated objectives or hypotheses and contained original data, precisely articulated methods, and results sections. When an article had multiple authors from different countries, the country of the first author was considered the country of origin. If the first author had affiliations that were in more than one country, the corresponding author’s country of origin was used.
Two reviewers (J.H.H. and K.J.L.) independently reviewed the titles and abstracts and extracted data from the articles. When relevant information was not available in the abstract, the full text of the article was obtained. In cases of disagreement, a third reviewer (D.Y.Y.) was included in the discussion until consensus was achieved.

2.3. Statistical Analysis

The characteristics between the most cited, most downloaded, and most mentioned articles were compared using the Chi-Square test. Statistical analyses were performed using IBM SPSS Statistics for Windows (Version 20.0; IBM Corp., Armonk, NY, USA), and a p-value of <0.05 was considered statistically significant.

3. Results

Among the 640 most cited, the 662 most downloaded, and the 652 most mentioned articles published in the general medical journals, only 16 (2.5%) articles were included in all three lists. Thirty-seven (5.7%) articles were featured in the lists for both the most cited and most downloaded articles, 61 (9.3%) for the most downloaded and most mentioned articles, and 21 (3.3%) for the most mentioned and most cited articles.
Health care was the more frequent specialty among the most cited articles (p < 0.0001), and gastroenterology/hepatology was more frequent among the most downloaded articles (p < 0.05) (Table 1). Original article was more frequent among the most mentioned articles (p < 0.0001), whereas reviews, case reports, and guidelines/consensus statements were more frequent among the most downloaded articles (p < 0.0001 for all) (Table 2). The country of origin was most frequently the United States in the most cited, downloaded, and mentioned articles, with no significant difference (34.8% vs. 36.9% vs. 35.1%, respectively, p = 0.7). In almost all countries, there were no significant differences between the three groups (Table 3).
The most cited articles were published significantly more frequently in 2010 and before (p < 0.0001), the most downloaded articles were published in 2017−2018 (p < 0.0001), and the most mentioned articles were published in 2013−2014 and 2015−2016 (p < 0.005 for both) (Table 4). Regarding the accessibility, the most mentioned articles were more frequently open-access articles compared to the most downloaded articles (77.5% vs. 70.2%, p < 0.05) (Table 4).

4. Discussion

This study has several potential limitations. First, the survey was limited to lists of the most cited and most downloaded articles on the journals’ website; in most journals, however, no data are available on the period for citation and download of articles. All metrics for individual articles may fluctuate over time. Second, it was not possible to analyze the correlation between the number of citations, download count, and AAS of articles. Most general medical journals included in this study did not provide the number of times each article was cited and downloaded by readers. Third, only data supplied by Altmetric.com was used for assessing alternative metrics given its wide availability and coverage of the most comprehensive social media data. Other tools that provide article-level alternative metrics, such as Plum Analytics, ImpactStory, and ALM-PLoS, were not evaluated. These altmetric tools use different online sources and algorithms, which may lead to different results [19]. In addition, there are several citation databases such as Web of Science, Scopus (Elsevier, Amsterdam, The Netherlands), and Google Scholar (Google Inc., Mountain View, CA, USA). Thus, it is possible that the citation count from these databases differs. In our study, we sought to use Web of Science, which has been shown to be the most commonly used and robust method for clinical medicine.
The number of citations has been widely used as an accurate measure of the impact of an individual article. However, citation rate has been criticized because older articles have a greater citation potential simply because of the length of time they have been in the public domain. Scientific articles usually are not cited until one or two years after publication, and citations reach a maximum after 3–10 years [20]. Therefore, recently published articles may not have had sufficient time to accumulate citations, despite their scientific originality and impact. In addition, the number of citations can be influenced by many different factors such as obliteration by incorporation (i.e., the phenomenon that information from highly influential articles has been incorporated into common knowledge such that they are not explicitly cited), omission bias (i.e., tendency to not cite competitors or sources contradictory to one’s own results), self-citation, referencing high impact factor core journals, and national or language preferences [21].
Scientific publications are the primary channel for the widespread dissemination of research findings. Therefore, it is likely that the number of downloads of articles provides a good indicator of the papers that are most popular with readers [7]. Several years are needed to observe the initial impact of a new article by means of citation count, but the download rate significantly shortens this lead time as a metric. A potential limitation is that download rate may not represent the true access rate of articles by excluding the access of readers who use the print version of the journal.
Altmetrics provides a real-time measure of the impact of articles on both researchers and the public through social media. Altmetrics, therefore, indicate a wider range of research-related activities than citations and downloads provide [22]. However, altmetrics do not cover the demographics of those mentioning online research material (the ‘’who’’), the reason for and meaning behind online mentions (the ‘’why’’), and the nature and importance of each mention (‘’weight’’). Therefore, the validity of altmetric scoring is hindered because of the possibility of “false papers” receiving undeserved mentions and “self-mentions” by the authors of the paper. Furthermore, the altmetric score can be affected by the presence of the journal’s online content such as dedicated Twitter profiles [23].
Several previous studies have examined the relationship between citation counts and various altmetric measures for scientific papers [24,25,26,27,28]. Most studies have shown very weak correlations between citation rates and altmetric measures [24,26,27]. Among the various indicators, Mendeley readership count was most strongly correlated with citation counts of articles [25,28]. These findings suggest that altmetrics operate independently of traditional metrics (citation and download metrics), and thus can be used as an alternative measure of research impact.
Before the appearance of the altmetrics concept, several studies have investigated the relationship between citations and downloads of publications and found varying results. Early studies have shown that the rank correlation between downloads and citations was high at the journal level but only medium-sized at the article level [29,30]. However, a recent study demonstrated that citation count was strongly correlated with access count (the sum of HTML views and PDF downloads) of articles published in a medical education journal [31]. The likely explanation is that articles are more likely to be downloaded by researchers in the same field for subsequent citation rather than by laypeople.
In this study, the characteristics of the most cited, most downloaded, and most mentioned articles published in general medical journals were compared, and substantial differences were found between these three groups.
In terms of the medical specialty, “health care” specialty was significantly more frequent for the most cited articles, whereas “miscellaneous” was significantly more frequent for the most mentioned articles. Although the comparison of medical specialty should be interpreted with caution because of the numerous kinds of specialties which can lead to a small number of articles in each specialty, these findings suggest that citations are more related in general medical topics compared to other groups. In contrast, it is possible that a wide spread public audience is likely to share medical knowledge across diverse specialties rather than major medical specialties.
The distribution of publication type of articles shows that reviews, case reports, and guidelines/consensus statements were more frequent among the most downloaded articles than other groups. This result suggests that readers of medical journals (e.g., physicians, trainees or medical students) are more interested in articles with an educational purpose. This is consistent with our previous research, which showed that the most downloaded articles published in radiology journals were more frequently reviews, case reports, guidelines/consensus statements, editorials/commentaries, and pictorial essays, compared with the most cited articles [32]. On the other hand, original article was more frequent among the most mentioned articles than other groups. This may be explained by the fact that original articles with the new results and conclusion attract greater attention from both academics and non-academics (the general public) on social media and other online platforms. However, these results are in contrast to findings of a previous study that compared citations indicators and social media counts of all papers published in 2012 and reported that reviews, editorial materials, news items, and letters are more popular on Twitter [33]. The reason for this discrepancy may be due to the difference of study design: our study only included the most mentioned articles published in general medical journals.
Regarding the year of publication, 51.9% (332/640) of the most cited articles were published in 2010 and before, whereas 33.8% (224/662) of the most downloaded articles and 27.3% (178/652) of the most mentioned articles were published in 2017–2018. It takes a long time for citations to accumulate because to receive a citation, the citing articles must be written, edited, peer-reviewed, and finally published. In contrast, media has a function to announce new knowledge, so recent articles tend to be frequently mentioned on social media and, consequently, altmetrics accrue at a much faster rate than for citations [24]. An interesting finding of this study is that the proportion of articles published in 2017–2018 was significantly higher in the most downloaded articles (33.8%, 224/662) than in the most mentioned articles (27.3%, 178/652). Based on this result, the authors postulate that the download rate is the most rapid measure of publication impact compared with not only citation number but also altmetric score.
Several previous studies have reported the advantage of open access in terms of article citations and downloads [7]. Our study verified that more than 70% of the most cited and most downloaded articles were open-access articles. Our analysis also found that the most mentioned articles had the highest proportion of open-access articles (77.5%, 505/652), compared with the most cited and most downloaded articles. A possible explanation for this result is that articles published in open-access journals are widely available for the general population and are of high visibility in various online channels, whereas those published in pay-for-access journals are geared toward professional audiences [34]. In addition, institutional journal subscription access may also affect the dissemination of research within scientific community. Therefore, articles published in prestigious journals with high impact factor should have more citations and downloads.
On the whole, our results indicate that there are important disparities between the most cited, most downloaded, and most mentioned articles. In addition, only 16 (2.5%) articles overlapped across the three groups. Therefore, the number of citations, download rate, and AAS should be considered as tools with different meanings in assessing the impact of scientific publications. Given faster availability and reflection of a broader audience, download rate and altmetric scores represent interesting and relevant indices of article impact, complementary to citation indicators. By combining these metrics, a more holistic assessment of the scientific and social impact of research can be substantiated.

5. Conclusions

The most cited were more frequently older, the most downloaded were more frequently recent and educational, and the most mentioned were more frequently original and open-access articles. The results of our study may provide insights into various measures of article impact.

Author Contributions

Conceptualization, J.H.H., D.Y.Y., K.J.L., J.Y.M., S.B., Y.L.S. and E.J.Y.; formal analysis, J.H.H., D.Y.Y., K.J.L., J.Y.M., S.B., Y.L.S. and E.J.Y.; investigation, J.H.H., D.Y.Y., K.J.L., J.Y.M., S.B., Y.L.S. and E.J.Y.; supervision, J.H.H. and D.Y.Y.; writing—original draft, J.H.H., D.Y.Y., K.J.L., J.Y.M., S.B., Y.L.S. and E.J.Y.; writing—review and editing, J.H.H., D.Y.Y., K.J.L., J.Y.M., S.B., Y.L.S. and E.J.Y. All authors have read and approved the final manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Garner, R.M.; Hirsch, J.A.; Albuquerque, F.C.; Fargen, K.M. Bibliometric indices: Defining academic productivity and citation rates of researchers, departments and journals. J. Neurointerv. Surg. 2018, 10, 102–106. [Google Scholar] [CrossRef] [PubMed]
  2. Duszak, R., Jr. The Impact Factory. Acad. Radiol. 2016, 23, 659–660. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Eyre-Walker, A.; Stoletzki, N. The assessment of science: The relative merits of post-publication review, the impact factor, and the number of citations. PLoS Biol. 2013, 11, e1001675. [Google Scholar] [CrossRef] [PubMed]
  4. Zhang, W.J.; Li, Y.F.; Zhang, J.L.; Xu, M.; Yan, R.L.; Jiang, H. Classic citations in main plastic and reconstructive surgery journals. Ann. Plast. Surg. 2013, 71, 103–108. [Google Scholar] [CrossRef]
  5. DORA—San Francisco Declaration on Research Assessment (DORA). Available online: https://sfdora.org/read/ (accessed on 9 November 2020).
  6. Bollen, J.; Van de Sompel, H.; Hagberg, A.; Chute, R. A principal component analysis of 39 scientific impact measures. PLoS ONE 2009, 4, e6022. [Google Scholar] [CrossRef] [Green Version]
  7. Lawrence, S. Free online availability substantially increases a paper’s impact. Nature 2001, 411, 521. [Google Scholar] [CrossRef]
  8. Brigham, T.J. An introduction to altmetrics. Med. Ref. Serv. Q 2014, 33, 438–447. [Google Scholar] [CrossRef]
  9. Trueger, N.S.; Thoma, B.; Hsu, C.H.; Sullivan, D.; Peters, L.; Lin, M. The Altmetric Score: A New Measure for Article-Level Dissemination and Impact. Ann. Emerg. Med. 2015, 66, 549–553. [Google Scholar] [CrossRef] [Green Version]
  10. Altmetrics: A Manifesto. Available online: http://altmetrics.org/manifesto (accessed on 9 November 2020).
  11. Most-downloaded abstracts and full-text views in 2005: A top-12 survey. Acta Radiol. 2006, 47, 1005–1006. [CrossRef] [Green Version]
  12. Barbic, D.; Tubman, M.; Lam, H.; Barbic, S. An Analysis of Altmetrics in Emergency Medicine. Acad. Emerg. Med. 2016, 23, 251–268. [Google Scholar] [CrossRef]
  13. Brandt, J.S.; Downing, A.C.; Howard, D.L.; Kofinas, J.D.; Chasen, S.T. Citation classics in obstetrics and gynecology: The 100 most frequently cited journal articles in the last 50 years. Am. J. Obstet. Gynecol. 2010, 203, 355.e1-7. [Google Scholar] [CrossRef] [PubMed]
  14. Brennan, P.A.; Habib, A. What are we reading? A study of downloaded and cited articles from the British Journal of Oral and Maxillofacial Surgery in 2010. Br. J. Oral. Maxillofac. Surg. 2011, 49, 527–531. [Google Scholar] [CrossRef] [PubMed]
  15. Fardi, A.; Kodonas, K.; Gogos, C.; Economides, N. Top-cited articles in endodontic journals. J. Endod. 2011, 37, 1183–1190. [Google Scholar] [CrossRef] [PubMed]
  16. Rosenkrantz, A.B.; Ayoola, A.; Singh, K.; Duszak, R., Jr. Alternative Metrics (“Altmetrics”) for Assessing Article Impact in Popular General Radiology Journals. Acad. Radiol. 2017, 24, 891–897. [Google Scholar] [CrossRef]
  17. Tang, X.; Gong, W.; Yuan, F.; Li, R.; Han, X.; Huang, S.; Zhi, F.; Jiang, B. Top-cited articles in digestive system disease from 1950 to 2013. J. Gastroenterol. Hepatol. 2016, 31, 107–111. [Google Scholar] [CrossRef]
  18. Wang, J.; Alotaibi, N.M.; Ibrahim, G.M.; Kulkarni, A.V.; Lozano, A.M. The Spectrum of Altmetrics in Neurosurgery: The Top 100 “Trending” Articles in Neurosurgical Journals. World Neurosurg. 2017, 103, 883–895 e1. [Google Scholar] [CrossRef]
  19. Peters, I.; Jobmann, A.; Hoffmann, C.P.; Künne, S.; Schmitz, J.; Wollnik-Korn, G. Altmetrics for large, multidisciplinary research groups: Comparison of current tools. Bibliometrie-Praxis und Forschung 2014, 3, 1–19. [Google Scholar]
  20. Marx, W.; Schier, H.; Wanitschek, M. Citation analysis using online databases: Feasibilities and shortcomings. Scientometrics 2001, 52, 59–82. [Google Scholar] [CrossRef]
  21. Braun, T. The reliability of total citation rankings. J. Chem. Inf. Comput. Sci. 2003, 43, 45–46. [Google Scholar] [CrossRef]
  22. Liu, C.L.; Xu, Y.Q.; Wu, H.; Chen, S.S.; Guo, J.J. Correlation and interaction visualization of altmetric indicators extracted from scholarly social network activities: Dimensions and structure. J. Med. Internet Res. 2013, 15, e259. [Google Scholar] [CrossRef]
  23. Butler, J.S.; Kaye, I.D.; Sebastian, A.S.; Wagner, S.C.; Morrissey, P.B.; Schroeder, G.D.; Kepler, C.K.; Vaccaro, A.R. The Evolution of Current Research Impact Metrics: From Bibliometrics to Altmetrics? Clin. Spine Surg. 2017, 30, 226–228. [Google Scholar] [CrossRef] [PubMed]
  24. Thelwall, M.; Haustein, S.; Lariviere, V.; Sugimoto, C.R. Do altmetrics work? Twitter and ten other social web services. PLoS ONE 2013, 8, e64841. [Google Scholar] [CrossRef] [PubMed]
  25. Haustein, S.; Larivière, V.; Thelwall, M.; Amyot, D.; Peters, I. Tweets vs. Mendeley readers: How do these two social media metrics differ? arXiv 2014, arXiv:1410.0569. [Google Scholar] [CrossRef] [Green Version]
  26. Haustein, S.; Peters, I.; Sugimoto, C.R.; Thelwall, M.; Lariviere, V. Tweeting Biomedicine: An Analysis of Tweets and Citations in the Biomedical Literature. J. Assoc. Inf. Sci. Technol. 2014, 65, 656–669. [Google Scholar] [CrossRef] [Green Version]
  27. Costas, R.; Zahedi, Z.; Wouters, P. Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. J. Assoc. Inf. Sci. Technol. 2015, 66, 2003–2019. [Google Scholar] [CrossRef]
  28. Mohammadi, E.; Thelwall, M.; Haustein, S.; Larivière, V. Who reads research articles? An altmetrics analysis of Mendeley user categories. J. Assoc. Inf. Sci. Technol. 2015, 66, 1832–1846. [Google Scholar] [CrossRef] [Green Version]
  29. Schloegl, C.; Gorraiz, J. Comparison of citation and usage indicators: The case of oncology journals. Scientometrics 2010, 82, 567–580. [Google Scholar] [CrossRef]
  30. Schloegl, C.; Gorraiz, J. Global usage versus global citation metrics: The case of pharmacology journals. J. Am. Soc. Inf. Sci. Technol. 2011, 62, 161–170. [Google Scholar] [CrossRef]
  31. Amath, A.; Ambacher, K.; Leddy, J.J.; Wood, T.J.; Ramnanan, C.J. Comparing alternative and traditional dissemination metrics in medical education. Med. Educ. 2017, 51, 935–941. [Google Scholar] [CrossRef]
  32. Baek, S.; Yoon, D.Y.; Lim, K.J.; Cho, Y.K.; Seo, Y.L.; Yun, E.J. The most downloaded and most cited articles in radiology journals: A comparative bibliometric analysis. Eur. Radiol. 2018, 11, 4832–4838. [Google Scholar] [CrossRef]
  33. Haustein, S.; Costas, R.; Larivière, V. Characterizing Social Media Metrics of Scholarly Papers: The Effect of Document Properties and Collaboration Patterns. PLoS ONE 2015, 10, e0120495. [Google Scholar]
  34. Van Noorden, R. Open access: The true cost of science publishing. Nature 2013, 495, 426–429. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Table
Table 1. Medical specialties of the most cited, most downloaded, and most mentioned articles published in general medical journals.
Table 1. Medical specialties of the most cited, most downloaded, and most mentioned articles published in general medical journals.
Medical SpecialtyMost Cited
Articles
(n = 640)		Most Downloaded
Articles (n = 662)		Most Mentioned
Articles
(n = 652)		p Value
Health care258 (40.3) ‡185 (27.9)163 (25.0)<0.0001
Hematology/oncology47 (7.3)40 (6.0)34 (5.1)0.3
Endocrinology46 (7.2)40 (6.0)44 (6.7)0.7
Neuroscience38 (5.9)71 (10.7) †77 (11.8) †0.0007
Infection38 (5.9)35 (5.3)36 (5.5)0.9
Cardiology29 (4.5)49 (7.4) †32 (4.9)<0.05
Pulmonology17 (2.7)14 (2.1)14 (2.1)0.8
Pain medicine12 (1.9)25 (3.8) †28 (4.3) †0.04
Gastroenterology/hepatology14 (2.1)29 (4.4) *15 (2.3)0.03
Miscellaneous141 (22.0)174 (26.3)209 (32.1) §0.0002
Note: Numbers in parentheses are percentages. * Significantly higher than the most cited and most mentioned articles. † Significantly higher than the most cited articles. ‡ Significantly higher than the most downloaded and most mentioned articles. § Significantly higher than the most cited and most downloaded articles.
Table
Table 2. Publication type of the most cited, most downloaded, and most mentioned articles published in general medical journals.
Table 2. Publication type of the most cited, most downloaded, and most mentioned articles published in general medical journals.
Publication TypeMost Cited
Articles
(n = 640)		Most Downloaded
Articles (n = 662)		Most Mentioned
Articles
(n = 652)		p Value
Original article344 (53.8) †232 (35.0)449 (68.9) ‡<0.0001
Review191 (29.8) §249 (37.6) ǁ122 (18.7)<0.0001
Case report7 (1.1)56 (8.5) ǁ27 (4.1) <0.0001
Guideline/consensus statement9 (1.4)29 (4.4) ǁ3 (0.5)<0.0001
Editorial/commentary47 (7.3) §41 (6.2)27 (4.1)<0.05
Systematic review/meta-analysis36 (5.6) §31 (4.7)18 (2.8)0.04
Others *6 (0.9)24 (3.6) ǁ6 (0.9)0.0002
Note: Numbers in parentheses are percentages. * Include technical note, pictorial essay, letter, news, abstract, correction, and book review. † Significantly higher than the most downloaded articles. ‡ Significantly higher than the most cited and most downloaded articles. § Significantly higher than the most mentioned articles. ǁ Significantly higher than the most cited and most mentioned articles. Significantly higher than the most cited articles.
Table
Table 3. Countries of origin of the most cited, most downloaded, and most mentioned articles published in general medical journals.
Table 3. Countries of origin of the most cited, most downloaded, and most mentioned articles published in general medical journals.
Country/RegionMost Cited
Articles (n = 640)		Most Downloaded
Articles (n = 662)		Most Mentioned
Articles (n = 652)		p Value
United States223 (34.8)244 (36.9)229 (35.1)0.7
United Kingdom *104 (16.3)104 (15.7)116 (17.8)0.6
Canada61 (9.5)64 (9.7)59 (9.0)0.9
China †39 (6.1)36 (5.4)36 (5.5)0.9
Turkey17 (2.7)29 (4.4)28 (4.3)0.2
Korea27 (4.2)22 (3.3)24 (3.7)0.7
Nigeria24 (3.8)21 (3.2)19 (2.9)0.7
The Netherlands17 (2.7)12 (1.8)14 (2.1)0.6
India10 (1.6)13 (2.0)16 (2.5)0.5
Belgium13 (2.0)12 (1.8)10 (1.5)0.8
Taiwan11 (1.7)9 (1.4)15 (2.3)0.4
Sweden8 (1.3)10 (1.5)11 (1.7)0.8
Australia14 (2.2) ‡2 (0.3)6 (0.9)0.005
Others72 (11.3)84 (12.7)69 (10.6)0.5
Note: For the purpose of our research, country of origin was defined by the address provided for the first author. If the first author was affiliated with more than one institution or group name, the corresponding author’s affiliation was used for the origin of the article. Numbers in parentheses are percentages. * Includes articles originating from England, Scotland, Wales, and Northern Ireland. † Includes articles originating from Hong Kong. ‡ Significantly higher compared to the most downloaded articles.
Table
Table 4. Publication year and accessibility of the most cited, most downloaded, and most mentioned articles published in general medical journals.
Table 4. Publication year and accessibility of the most cited, most downloaded, and most mentioned articles published in general medical journals.
Publication InformationMost Cited
Articles
(n = 640)		Most Downloaded Articles
(n = 662)		Most Mentioned
Articles
(n = 652)		p Value
Publication Year
−2010332 (51.9) *154 (23.3) †113 (17.3)<0.0001
2011−201288 (13.8)76 (11.5)69 (10.6)0.2
2013−201479 (12.3)76 (11.5)116 (17.8) ‡0.002
2015−2016121 (18.9)132 (19.9)176 (27.0) ‡0.0006
2017−201820 (3.1)224 (33.8) §178 (27.3) ǁ<0.0001
Accessibility 0.01
Open access473 (73.9)465 (70.2)505 (77.5)
Pay-for-access167 (26.1)197 (29.8)147 (22.5)
Note: Numbers in parentheses are percentages. * Significantly higher than the most downloaded and most mentioned articles. † Significantly higher than the most mentioned articles. ‡ Significantly higher than the most cited and most downloaded articles. § Significantly higher than the most cited and most mentioned articles. ǁ Significantly higher than the most cited articles. Significantly higher than the most downloaded articles.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hong, J.H.; Yoon, D.Y.; Lim, K.J.; Moon, J.Y.; Baek, S.; Seo, Y.L.; Yun, E.J. Characteristics of the Most Cited, Most Downloaded, and Most Mentioned Articles in General Medical Journals: A Comparative Bibliometric Analysis. Healthcare 2020, 8, 492. https://doi.org/10.3390/healthcare8040492

AMA Style

Hong JH, Yoon DY, Lim KJ, Moon JY, Baek S, Seo YL, Yun EJ. Characteristics of the Most Cited, Most Downloaded, and Most Mentioned Articles in General Medical Journals: A Comparative Bibliometric Analysis. Healthcare. 2020; 8(4):492. https://doi.org/10.3390/healthcare8040492

Chicago/Turabian Style

Hong, Ji Hyun, Dae Young Yoon, Kyoung Ja Lim, Ji Yoon Moon, Sora Baek, Young Lan Seo, and Eun Joo Yun. 2020. "Characteristics of the Most Cited, Most Downloaded, and Most Mentioned Articles in General Medical Journals: A Comparative Bibliometric Analysis" Healthcare 8, no. 4: 492. https://doi.org/10.3390/healthcare8040492

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop