Hostname: page-component-8448b6f56d-xtgtn Total loading time: 0 Render date: 2024-04-20T14:03:59.903Z Has data issue: false hasContentIssue false

Standing on the shoulders of Giants: a citation analysis of the paediatric congenital heart disease literature

Published online by Cambridge University Press:  12 April 2021

Daniel P. Sew
Affiliation:
Department of Pediatric Cardiology, Birmingham Children’s Hospital, Birmingham, UK
Nigel E. Drury*
Affiliation:
Department of Pediatric Cardiac Surgery, Birmingham Children’s Hospital, Birmingham, UK Institute of Cardiovascular Sciences, University of Birmingham, Birmingham, UK
*
Author for correspondence: Dr Nigel Drury, Department of Pediatric Cardiac Surgery, Birmingham Children’s Hospital, Steelhouse Lane, Birmingham, B4 6NH, UK. Tel: +44 121 333 8731, fax: +44 121 333 9441. E-mail: n.e.drury@bham.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Objective:

The citation history of a published article reflects its impact on the literature over time. We conducted a comprehensive bibliometric analysis to identify the most cited papers on CHD in children.

Methods:

One-hundred and ninety journals listed in Journal Citation Reports were accessed via Web of Science. Publications with 250 or more citations were identified from Science Citation Index Expanded (1900–2020), and those relating to structural CHD in children were reviewed. Articles were ranked by citation count and the 100 most cited were analysed.

Results:

The number of citations ranged from 2522 to 309 (median 431, IQR 356–518), with 35 published since 2000. All were written in English, most originated from the United States (74%), and were published in cardiovascular journals, with Circulation (28%) the most frequent. There were 86 original research articles, including 50 case series, 14 cohort studies, and 10 clinical trials. The most cited paper was by Hoffman JI and Kaplan S on the incidence of CHD. Thirteen authors had 4 or more publications in the top 100, all of whom had worked in Boston, Philadelphia, San Francisco, or Dallas, and the most prolific author was Newburger JW (9 articles).

Conclusions:

Citation analysis provides a historical perspective on scientific progress by assessing the impact of individual articles. Our study highlights the dominant position of US-based researchers and journals in this field. Most of the highly cited articles remain case series, with few randomised controlled trials in CHD appearing in recent years.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2021. Published by Cambridge University Press

Over the last century, the diagnosis and management of children with CHD has changed rapidly, founded on the work of visionary pioneers, and improved incrementally through advances in knowledge, technique, and technology. Developments in paediatric cardiology, cardiac surgery, imaging, intensive care, genetics, and other areas have radically altered the natural history of CHD, especially for those needing intervention at an early stage in their life trajectory who have the most to gain. Today, we can offer the prospect of “cure” or successful palliation in almost all structural congenital heart conditions.

Progress can be plotted through landmark articles that have made a major impact on the literature, Reference Garfield1,Reference Van Noorden, Maher and Nuzzo2 providing an insight into the evolution of a specialty. Reference Kim, Yoon and Kim3 We therefore conducted a comprehensive bibliometric analysis to identify the most cited papers in the field of structural CHD in children.

Methods

Journals listed in the 2019 Journal Citation Reports of the Web of Science (Clarivate Analytics, Philadelphia, PA) under the following subject categories were evaluated for inclusion: Cardiac & Cardiovascular Systems (138 journals); Critical Care Medicine (12); Genetics & Heredity (9); Medicine, General & Internal (14); Multidisciplinary Science (4); Pediatrics (13); Respiratory System (4); Surgery (11); and Transplantation (11). To identify the most cited articles, each journal was searched individually using the Science Citation Index Expanded (1900–2020) accessed via the Web of Science portal on 16 May, 2020. Articles identified by each journal search were ranked according to the number of times cited, from highest to lowest. An additional search was conducted using key words on CHD as the topic or title (see supplement).

Publications with 250 or more citations were identified, and the abstract and/or full text screened independently by both authors to determine whether it was relevant to structural CHD in children; articles in any language were included and any discrepancies resolved by discussion. Articles containing only non-human species, adult patients, or focusing primarily on arrhythmias, vascular disease, normal cardiac function, anesthesia, cardiomyopathies, or primary pulmonary hypertension were excluded. Relevant articles were ranked according to their citation count and the 100 most cited papers were included in the analysis. Data were extracted independently by both authors from the full-text publication, sourced online or via national libraries, including the title, journal, year, authors, centre and country of origin, language, type of study, level of evidence, 4 field of study, topic, and funding source.

Results

One hundred and ninety journals listed in one or more categories of the Journal Citation Reports were included in the search (see supplement) and 134 articles with 250 or more citations which met the criteria were identified. Articles were ranked according to their citation count and the 100 most cited papers, published in 24 journals, were included in the analysis (Table 1).

Table 1. The top 100 most cited publications in structural CHD in children

The number of citations ranged from 2522 to 309 (median 431, IQR 356–518) and articles were published between 1939 and 2014, with the most cited paper originating from 2002. The most represented decade was the 2000s (28) followed by the 1990s (20), with 35 published since 2000 (Fig 1). All the top 100 papers were published in the English language and the most frequent journals were Circulation (28), Journal of the American College of Cardiology (10), New England Journal of Medicine (8), and Journal of Pediatrics and Journal of Thoracic and Cardiovascular Surgery (both 7); there were seven papers in non-clinical scientific journals, including four in Nature. Most articles originated from the United States (74), followed by Canada (10), United Kingdom (7), Japan (5), France (4), Germany, Italy, and Sweden (2 each), and one each from Austria, the Netherlands, and New Zealand, including seven international collaborations.

Figure 1. Number of articles in the top 100 most cited, by decade of publication.

There were 542 individuals listed as authors, of whom 81 appeared more than once. Thirteen authors had four or more publications included in the list, as shown in Table 2; all these authors were based at four leading US centres for most or all their publications: Boston Children’s Hospital and Harvard University; Children’s Hospital of Philadelphia and University of Pennsylvania; University of California San Francisco; and/or University of Texas Southwestern Medical Center. The leading paediatric cardiologists were Dr Jane W Newburger (9) and Dr Gil Wernovsky (8), and the leading surgeons were Dr Richard A Jonas (6), Dr Thomas L Spray, and Dr J William Gaynor (5 each). Fifty-nine papers reported specific funding, with the US National Institutes of Health cited as the sole or a contributing funder in 28 articles.

Table 2. Authors with 4 or more articles in the 100 most cited

CHD overall was the most considered disease group (46 articles), followed by the spectrum of single-ventricle heart conditions (11), transposition (8), septal defects (7), and patent arterial duct (6). The most common subject was surgical outcomes (19), followed by pathology (18), surgical technique (13), epidemiology (12), and catheter intervention (9) (Table 3). There were 86 original research articles, including 50 case series, 14 cohort studies, and 10 clinical trials (Table 4); one additional case series was published as a conference abstract. The level of evidence of articles by decade of publication is shown in Figure 2, with level 4 evidence predominant before the 1980s and level 3 evidence most prevalent in more recent decades; all bar one of the most cited level 1 evidence has been published in the last 30 years.

Table 3. Subjects of studies in the 100 most cited

Table 4. Types of studies in the 100 most cited

Figure 2. Level of evidence of articles in the top 100 most cited, by decade of publication.

Discussion

The number of times that a published article is cited in the literature reflects its influence and impact over time. Reference Garfield1 Citation counts are being used increasingly as a tool to assess, rank, and compare individuals, institutions, and journals through metrics such as h-index and impact factor. Reference Abbott, Cyranoski, Jones, Maher, Schiermeier and Van Noorden5 These measures assume that influential researchers and important publications are cited proportionately more often than those of lesser value, providing a measure of impact on the scientific field over time. There is marked variability in the rate of accumulating citations amongst highly cited papers with some peaking early before falling away, whilst others have a long rise to prominence. Reference Van Noorden, Maher and Nuzzo2 In this study, we identified the most cited papers on CHD in children, spanning 75 years, from Robert Gross and John Hubbard’s landmark 1939 study on surgical ligation of a patent arterial duct in Boston, MA, Reference Gross and Hubbard6 to Ariane Marelli and colleagues’ 2014 paper on the lifetime prevalence of CHD in Quebec, Canada. Reference Marelli, Ionescu-Ittu, Mackie, Guo, Dendukuri and Kaouache7 Whilst many historical classics remain relevant today, one in three of the most highly cited articles was published in the last 20 years.

Types of highly cited study

Much of modern clinical practice in paediatric cardiology and cardiac surgery is based on expert opinion and institutional case series, Reference Mahony, Sleeper and Anderson8 as reflected by the presence of 61 case reports or series amongst the most cited. Many of the older articles were the classic descriptions of syndromes, such as Williams (727 citations), Patau (563), Cantrell (504), Edwards (500), Alagille (475), and Noonan (408). Similarly, seminal reports of eponymous operations or interventions featured prominently, including Fontan (1631 citations), Blalock and Taussig (837), Mustard (527), Rashkind (523), Senning (490), Norwood (473), and Ross (316). Whilst these procedures remain relevant today and continue to attract attention, it is unlikely that such reports published today would have a similar impact.

Twelve of the top 100 articles were epidemiology studies, including 5 of the top 20 with over 5700 citations between them. Incidence, prevalence, and natural history are often quoted by authors in their introduction as a way of setting the scene, leading to high numbers of citations for those studies that break through and become the standard reference.

Only nine articles reported the outcomes of randomised controlled trials and five of these were on the early and late findings from the Boston Circulatory Arrest trial, Reference Newburger, Jonas and Wernovsky9Reference Bellinger, Wypij and duPlessis13 totalling 2294 citations and involving 8 of the 12 authors appearing in Table 2. The other highly cited randomised controlled trials were the Pediatric Heart Network’s multicentre Single-Ventricle Reconstruction trial (463 citations), Reference Ohye, Sleeper and Mahony14 a national trial of indomethacin in pre-mature infants with a patent arterial duct (427), Reference Gersony, Peckham, Ellison, Miettinen and Nadas15 the multicentre PRIMACORP study of prophylactic milrinone after surgery (404), Reference Hoffman, Wernovsky and Atz16 and the first clinical application of remote ischemic pre-conditioning for myocardial protection (387). Reference Cheung, Kharbanda and Konstantinov17 The low numbers of randomised controlled trials on the list may reflect the lack of late-phase, practice changing trials in paediatric cardiology and cardiac surgery, Reference Gidding18,Reference Drury, Patel and Oswald19 or that clinical trials address specific research questions, and therefore the findings have a narrower appeal. However, all bar one of these trials were published in the last 30 years yet have garnered sufficient citations to enter the top 100 most cited articles in the field.

Over recent years, clinical guidelines endorsed by national or international bodies have emerged as a key resource for patient management. Four scientific statements from the American Heart Association were included on the list, and it is likely that the number of such articles amongst the most cited will increase in the coming decade.

Origins of highly cited studies

We found that the most cited articles on structural CHD in children were all published in English and dominated by clinical research groups in the United States, as found in other areas of cardiovascular disease Reference Usman, Siddiqi and Khan20,Reference Chan, Mak, Chu, Hui and Kwan21 ; only 16 involved authors from non-English speaking countries and 4 originated from outside Europe or North America. Most articles were publishing in US-based cardiovascular journals, whilst almost a quarter appeared in high-impact general medical (17) or non-clinical scientific (7) journals. It is not surprising that of those rapidly rising studies published in the last 15 years, 14 of 16 (88%) were published in high-impact specialty or general medical journals.

The observation that all authors featuring four or more times had worked at one of four US institutions for most or all their impactful publications reinforces the benefits of “team science.” These groups established and sustained successful and collaborative research programmes, where success breeds success, although multiple highly cited papers originating from one clinical trial contributed much to this achievement. However, it also raises the possibility of a publication bias in which work from leading US institutions is favoured by leading US journals.

The most highly cited papers

At the time of our search, three papers had generated over 1000 citations. Julien Hoffman and Samuel Kaplan’s article on the incidence of CHD was by far the most cited with 2,522 citations. Reference Hoffman and Kaplan22 Published in 2002, it is likely to retain this position for many years, although the systematic review and meta-analysis on worldwide prevalence by Van der Linde and colleagues from 2011 is rising fast, already in fourth place with 990 citations. Reference Van der Linde, Konings and Slager23 The second most cited paper was a surgical classic from 1971, Fontan and Baudet’s original description of ventricularisation of the right atrium to direct inferior vena caval blood to the left lung, receiving 1631 citations Reference Fontan and Baudet24 ; the evolution and outcomes of the Fontan procedure have remained the focus of intense research over the last five decades. In third place was Philip Hagen and colleagues’ 1984 autopsy study on the incidence and size of patent foramen ovale by age in children and adults and has grossed over 1500 citations. Reference Hagen, Scholz and Edwards25

Strengths and limitations

This study provides a unique insight into the most influential peer-reviewed publications that have shaped the development of our specialty over the last 100 years, providing a reference list that will be of interest to students, clinicians, and researchers. Our comprehensive search of a wide range of journals listed on the expanded Science Citation Index is likely to have missed few if any of the most cited papers. However, our findings are limited by our use of only one bibliometric tool to determine citation counts; other databases, such as Scopus or Google Scholar, use different data sources and algorithms which may impact on the number of citations detected and therefore which papers appear in the top 100 Reference Falagas, Pitsouni, Malietzis and Pappas26 although as both index fewer articles published prior to the 1990s, they are less suited to historical analyses. Similarly, metrics related to other sources of information, such as number of times accessed online and twitter engagements, were not assessed but are much more relevant to recently published works. Citation analysis demonstrates the overall impact of a paper since publication but is not adjusted to account for its current influence or its quality; infamous papers may receive as much attention as celebrated papers. Like any bibliometric analysis, our findings are a snapshot in time, a now historical view on the most cited articles in the field. Since our search, recently published articles, such as Zaidi et al. in Nature 2013 (426 citations) Reference Zaidi, Choi and Wakimoto27 and Marelli et al in Circulation 2014 (348), Reference Marelli, Ionescu-Ittu, Mackie, Guo, Dendukuri and Kaouache7 will have continued their rapid rise, whilst others, such as the scientific statement by Pierpont et al. in Circulation 2007 (516), Reference Pierpont, Basson and Benson28 have been superseded by updated reviews Reference Pierpont, Brueckner and Chung29 and are therefore likely to plateau. As a time-dependent process, other groundbreaking but recently published articles may have had too little time to accrue sufficient citations to make our list.

Conclusions

This study identified the most influential papers on CHD in children, providing a historical perspective on scientific progress over the last century. Our findings demonstrate that highly cited papers are exclusively published in English, and that researchers and journals based in the United States hold a dominant position in this field. Most of the highly cited articles remain case series, with few randomised controlled trials in CHD appearing in recent years.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/S1047951121001256

Acknowledgements

The authors thank Dr Lynne K Williams, Papworth Hospital, Cambridge, and Miss Vanessa JC Rogers, Queen Elizabeth Hospital Birmingham for their input to the methodology.

Authors contributions

NED devised the study. Both authors undertook data acquisition, data analysis, data interpretation, and manuscript preparation.

Financial support

Nigel Drury is funded by an Intermediate Clinical Research Fellowship from the British Heart Foundation (FS/15/49/31612). The authors received no specific funding for this study.

Conflicts of interest

None.

Footnotes

Twitter: Study reveals 100 most cited papers in congenital heart disease, highest cited by Dr Julien Hoffman @UCSFChildrens & Dr Samuel Kaplan @UCLAHealth, most papers in top 100 Dr Jane Newburger @BostonChildrens.

References

Garfield, E. Citation analysis as a tool in journal evaluation: journals can be ranked by frequency and impact of citations for science policy studies. Science 1972; 178: 471479.CrossRefGoogle Scholar
Van Noorden, R, Maher, B, Nuzzo, R. The top 100 papers. Nature 2014; 514: 550553.CrossRefGoogle ScholarPubMed
Kim, ES, Yoon, DY, Kim, HJ, et al. Citation classics in neurointerventional research: a bibliometric analysis of the 100 most cited articles. J Neurointerv Surg 2017; 9: 508511.CrossRefGoogle ScholarPubMed
OCEBM Levels of Evidence Working Group. The Oxford 2011 Levels of Evidence. Oxford Centre for Evidence-Based Medicine. http://www.cebm.net/index.aspx?o=5653 Google Scholar
Abbott, A, Cyranoski, D, Jones, N, Maher, B, Schiermeier, Q, Van Noorden, R. Metrics: do metrics matter? Nature 2010; 465: 860862.CrossRefGoogle ScholarPubMed
Gross, RE, Hubbard, JP. Surgical ligation of a patent ductus arteriosus: report of first successful case. JAMA 1939; 112: 729731.CrossRefGoogle Scholar
Marelli, AJ, Ionescu-Ittu, R, Mackie, AS, Guo, L, Dendukuri, N, Kaouache, M. Lifetime prevalence of congenital heart disease in the general population from 2000 to 2010. Circulation 2014; 130: 749756.CrossRefGoogle ScholarPubMed
Mahony, L, Sleeper, LA, Anderson, PA, et al. The Pediatric Heart Network: a primer for the conduct of multicenter studies in children with congenital and acquired heart disease. Pediatr Cardiol 2006; 27: 191198.CrossRefGoogle ScholarPubMed
Newburger, JW, Jonas, RA, Wernovsky, G, et al. A comparison of the perioperative neurologic effects of hypothermic circulatory arrest versus low-flow cardiopulmonary bypass in infant heart surgery. N Engl J Med 1993; 329: 10571064.CrossRefGoogle ScholarPubMed
Bellinger, DC, Jonas, RA, Rappaport, LA, et al. Developmental and neurologic status of children after heart surgery with hypothermic circulatory arrest or lowfFlow cardiopulmonary bypass. N Engl J Med 1995; 332: 549555.CrossRefGoogle ScholarPubMed
Wernovsky, G, Wypij, D, Jonas, RA, et al. Postoperative course and hemodynamic profile after the arterial switch operation in neonates and infants. A comparison of low-flow cardiopulmonary bypass and circulatory arrest. Circulation 1995; 92: 22262235.CrossRefGoogle ScholarPubMed
Bellinger, DC, Wypij, D, Kuban, KC, et al. Developmental and neurological status of children at 4 years of age after heart surgery with hypothermic circulatory arrest or low-flow cardiopulmonary bypass. Circulation 1999; 100: 526532.CrossRefGoogle ScholarPubMed
Bellinger, DC, Wypij, D, duPlessis, AJ, et al. Neurodevelopmental status at eight years in children with dextro-transposition of the great arteries: the Boston Circulatory Arrest Trial. J Thorac Cardiovasc Surg 2003; 126: 13851396.CrossRefGoogle ScholarPubMed
Ohye, RG, Sleeper, LA, Mahony, L, et al. Comparison of shunt types in the Norwood procedure for single-ventricle lesions. N Engl J Med 2010; 362: 19801992.CrossRefGoogle ScholarPubMed
Gersony, WM, Peckham, GJ, Ellison, RC, Miettinen, OS, Nadas, AS. Effects of indomethacin in premature infants with patent ductus arteriosus: results of a national collaborative study. J Pediatr 1983; 102: 895906.CrossRefGoogle ScholarPubMed
Hoffman, TH, Wernovsky, G, Atz, AM, et al. Efficacy and safety of milrinone in preventing low cardiac output syndrome in infants and children after corrective surgery for congenital heart disease. Circulation 2003; 107: 9961002.CrossRefGoogle ScholarPubMed
Cheung, MMH, Kharbanda, RK, Konstantinov, IE, et al. Randomized controlled trial of the effects of remote ischemic preconditioning on children undergoing cardiac surgery: first clinical application in humans. J Am Coll Cardiol 2006; 47: 22772282.CrossRefGoogle ScholarPubMed
Gidding, SS. The importance of randomized controlled trials in pediatric cardiology. JAMA 2007; 298: 12141215.CrossRefGoogle ScholarPubMed
Drury, NE, Patel, AJ, Oswald, NK, et al. Randomised controlled trials in children’s heart surgery in the 21st century: a systematic review. Eur J Cardiothorac Surg 2018; 53: 724731.CrossRefGoogle ScholarPubMed
Usman, M, Siddiqi, T, Khan, M, et al. A scientific analysis of the 100 citation classics of valvular heart disease. Am J Cardiol 2017; 120: 14401449.CrossRefGoogle ScholarPubMed
Chan, J, Mak, TLA, Chu, TSM, Hui, TLY, Kwan, LYA. The 100 most cited manuscripts in coronary artery bypass grafting. J Card Surg 2019; 34: 782787.CrossRefGoogle ScholarPubMed
Hoffman, JI, Kaplan, S. The incidence of congenital heart disease. J Am Coll Cardiol 2002; 39: 18901900.CrossRefGoogle ScholarPubMed
Van der Linde, D, Konings, EEM, Slager, MA, et al. Birth prevalence of congenital heart disease worldwide: a systematic review and meta-analysis. J Am Coll Cardiol 2011; 58: 22412247.CrossRefGoogle ScholarPubMed
Fontan, F, Baudet, E. Surgical repair of tricuspid atresia. Thorax 1971; 26: 240248.CrossRefGoogle ScholarPubMed
Hagen, PT, Scholz, DG, Edwards, WD. Incidence and size of patent foramen ovale during the first 10 decades of life: an autopsy study of 965 normal hearts. Mayo Clin Proc 1984; 59: 1720.CrossRefGoogle ScholarPubMed
Falagas, ME, Pitsouni, EI, Malietzis, GA, Pappas, G. Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses. FASEB J 2008; 22: 338342.CrossRefGoogle ScholarPubMed
Zaidi, S, Choi, M, Wakimoto, H, et al. De novo mutations in histone-modifying genes in congenital heart disease. Nature 2013; 498: 220223.CrossRefGoogle ScholarPubMed
Pierpont, ME, Basson, CT, Benson, DW Jr, et al. Genetic basis for congenital heart defects: current knowledge: a scientific statement from the American Heart Association Congenital Cardiac Defects Committee, Council on Cardiovascular Disease in the Young: endorsed by the American Academy of Pediatrics. Circulation 2007; 115: 30153038.CrossRefGoogle Scholar
Pierpont, ME, Brueckner, M, Chung, WK, et al. Genetic basis for congenital heart disease: revisited: a scientific statement from the American Heart Association. Circulation 2018; 138: e653e711.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. The top 100 most cited publications in structural CHD in children

Figure 1

Figure 1. Number of articles in the top 100 most cited, by decade of publication.

Figure 2

Table 2. Authors with 4 or more articles in the 100 most cited

Figure 3

Table 3. Subjects of studies in the 100 most cited

Figure 4

Table 4. Types of studies in the 100 most cited

Figure 5

Figure 2. Level of evidence of articles in the top 100 most cited, by decade of publication.

Supplementary material: PDF

Sew and Drury supplementary material

Sew and Drury supplementary material

Download Sew and Drury supplementary material(PDF)
PDF 33 KB