JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Pathology Section DOI : 10.7860/JCDR/2020/43488.13675
Year : 2020 | Month : May | Volume : 14 | Issue : 05 Full Version Page : EC06 - EC10

Publication of Postgraduate Thesis in Pathology: An Introspection

Pooja Sharma Kala1, AR Piyush2, Hari Shankar Pandey3, Naveen Thapliyal4

1 Assistant Professor, Department of Pathology, Government Doon Medical College, Dehradun, Uttarakhand, India.
2 Assistant Professor, Department of Pathology, Government Doon Medical College, Dehradun, Utarakhand, India.
3 Associate Professor, Department of Pathology, Government Doon Medical College, Dehradun, Uttarakhand, India.
4 Professor and Head, Department of Pathology, Government Doon Medical College, Dehradun, Uttarakhand, India.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Naveen Thapliyal, Professor and Head, Department of Pathology, Government Doon Medical College, Patel Nagar, Dehradun, Uttarakhand, India.
E-mail: naveendun@yahoo.com
Abstract

Introduction

Thesis is an important aspect of postgraduate curriculum, mandatory to be submitted for obtaining Doctor of Medicine (MD)/Masters of Surgery (MS) degree in India. The quality of research in thesis and their publication rates in field of Pathology in India has never been commented upon.

Aim

To evaluate and analyse the research quality and publication rates of postgraduate thesis in speciality of General Pathology in India.

Materials and Methods

This cross-divtional study was done on 41 postgraduate theses (Pathology) submitted for review over a period of 7 years 6 months (January 2012-July 2019) from six different medical institutes from Northern India. Data were recorded and Google online search was done for each topic, author and guide. Publication status, details of publication and journals were recorded and analysed. A journal was considered national or international as declared by the journal itself on the homepage (online journals) and/or cover page (print journals) as well as by the affiliations of editorial board members. The research quality was assessed by the publication status and article citation rates. Statistical analysis was done using SPSS version 18.0 software.

Results

Of all theses assessed, 26 (63.4%) were published in peer-reviewed indexed journals. Of these, 20 (76.9%) were published in a journal indexed with ≥2 indexing bodies. 25 (96.2%) of these were published in international and only 1 (3.8%) was published in a national journal. Most of these 15 (58%) were published within a year of completion of postgraduation. The principal investigator was the first author in 81% of published theses. The mean impact factors of national and international journals were 0.696 and 3.532±1.828, respectively. Of all the published articles, only one was cited with a citation rate of 0.5 per year. Mean citation rate was 0.02 per paper per year which was low.

Conclusion

The publication rate of postgraduate thesis in Pathology was 63.4% but a low citation rate questions the quality of research. Publication of thesis should be encouraged in order to disseminate the knowledge inferred and provide directions for the future researches.

Keywords

Introduction

The aim of thesis is to develop “spirit of enquiry and research attitude” in a postgraduate student. Apart from being a mandatory part of postgraduate curriculum, thesis is an important scientific paper/document, which has been acquired by in depth study and analysis of the concerned topic. It should be published in an indexed peer reviewed journal in order to disseminate the knowledge drawn from the whole exercise and enrich existing medical literature. Academic and professional credibility of a researcher increases with publishing the research work [1]. Getting thesis published in a peer reviewed indexed journal is an indicator of quality of performed research. Studies from Turkey [1], Peru [2], China [3], Finland [4], France [5] and Tunisia [6] have revealed low publication rates of thesis. Single study from a premier institute in India has shown similar results in their experience with postgraduate thesis [7]. Studies have been published regarding publication rates of postgraduate thesis in specialities of general surgery [8], urology [9], public health [10], otorhinolaryngology [11], neurosurgery [12] and medical microbiology [13] from different parts of world. No single study pertaining specifically to publication rates in field of Pathology is available from India.

The objective of this study was to assess publication rates of postgraduate thesis in the speciality of pathology in India. In addition, this study will be first of its kind to assess research quality of postgraduate thesis in India. This will help in assessing the scientific productivity of the postgraduate thesis in field of Pathology and need for improving the research quality in thesis, which is rather considered as a formality by young postgraduates.

Materials and Methods

This was a descriptive cross-sectional study done on secondary data obtained from 41 postgraduate theses (Pathology) over a period of 7 years and 6 months (January 2012-July 2019) from six different medical institutes located in Uttarakhand and Uttar Pradesh states of India. These theses were submitted for review and approval by these institutes. This study was conducted in accordance with the Declaration of Helsinki. Variables recorded were topics, name of research Candidate, guide and coguides, year of submission, type of study and the institute of each thesis. For the search of the publication status of thesis, online Google search of each topic and the research candidate’s full name was done. In case of negative result, the name of guide and coguides were used instead of research candidate’s name. The year of publication, number of publications, journal’s name, indexing, Index Copernicus value (IC value) and impact factor (if available) along with article’s citations, authorship of the research candidate and duplicate publications (if any) were recorded. In case of no publication, the research candidates were contacted telephonically for confirmation and were also interviewed about the reason for failure to do so. A journal was considered indexed, if it was indexed in any one of following databases- Pubmed, Index Copernicus, Scopus, Directory of Open Access Journals (DOAJ), Google Scholar, Indian Citation index and Science citation index. A journal was considered international if declared by the journal itself on the homepage (online journals) and/or cover page (print journals). In case this was not stated, a journal was considered international if its editorial board included members from outside India. The research quality was assessed by the publication status and citation rates of the published article. Citation rate of an article was calculated as total number of times the article was cited divided by number of years since its publication excluding the year of publication.

Statistical Analysis

Statistical analysis was done using SPSS version 18.0 software. Chi-square test was applied and p-value <0.05 was considered significant.

Results

A total of 41 theses from 6 different Medical colleges located in the states of Uttar Pradesh (20; 48.8%) and Uttarakhand (21; 51.2%), India, were analysed. Of 41 theses, 26 (63.4%) were published in peer reviewed indexed journals whereas 15 (36.6%) theses remained unpublished. Of the remaining 15 unpublished theses, confirmation by the thesis authors was possible in 11 theses. In view of failure to contact the authors of remaining 4 theses, a repeat Google search was done after one month of the first or primary search, which did not yield any result and hence, it was considered that these 4 theses were not published. 20 (76.9%) of 26 theses derived articles were published in journals indexed with ≥2 indexing/abstracting bodies evaluated. Only 2 (7.7%) of the thesis derived articles were published in Pubmed indexed journals [Table/Fig-1].

Indexing of the publishing journals.

Indexing/Abstract bodies of the publishing journalsNumber of articles published {n(%)} N=26
Index copernicus18 (69.2%)
Google scholar22 (84.6%)
Scopus4 (15.4%)
Pubmed2 (7.7 %)
Directory of open access journals5 (19.2%)
Indian citation index6 (23.1%)
Science citation index1 (3.8%)
Indexed with one indexing body considered6 (23.1%)
Indexed with two indexing bodies considered12 (46.1%)
Indexed with three indexing bodies considered6 (23.1%)
Indexed with ≥4 indexing bodies2 (7.7%)

A 25 (96.2%) of 26 theses were published in International journals while remaining 1 (3.8%) was published in national journal. These journals were peer reviewed as well as available in print and online formats. There were 8 male and 33 female thesis authors. The publication rate was 75% (6/8) amongst males and 60.6% (20/33) amongst females. Of all 26 published theses, in 21 (81%) had principal investigator (i.e., the postgraduate student) as the first author [Table/Fig-2]. In remaining 5 theses (19%), the guides (usually, professors) and coguides were the first author.

Authorship of thesis author (Principal investigator) in the published article.

Authorship of the principal investigatorNumber of thesis=N (percentage) n=26
1st21 (80.8%)
2nd1 (3.8%)
3rd1 (3.8%)
4th1 (3.8%)
5th2 (7.7%)

Theses were published in varying time period ranging from 8 months to maximum of 3 years of completion of postgraduation. 15 (58%) theses got published in the same year of completion of post graduation, while 8 (31%) thesis were published after one year but before two years of completion of postgraduation. Only one of the thesis derived article was published after 3 years of postgraduation [Table/Fig-3]. Moreover, there were variable publication rates over the period of study ranging from nil (2012) to 100% (2015); average being 58.7% [Table/Fig-4]. The different journals along with their indexing (Index Copernicus, Pubmed, Google Scholar, DOAJ, Scopus, Indian Citation index and Science citation index), IC value, number of citations and impact factor are given in [Table/Fig-5]. The mean impact factors of national and international journals were 0.696 and 3.532±1.828, respectively.

Time taken to publish article after completion of postgraduation.

Publication trend of theses with time.

Year of completion of postgraduationNumber of thesis evaluatedNumber of published thesis n (%) N=26
201210 (0%)
2013--
201411 (100%)
201554 (80%)
201675 (71.4%)
201797 (77.8%)
2018138 (61.5%)
201951 (20%)

Journals in which the articles were published with their indexing and impact factor.

Sl. No.Name of JournalNational/InternationalϯIndexing*Index copernicus value (2018)Impact factor
1.Scholars Journal of Applied Medical SciencesInternationalGS**, Indian citation IndexNA1.62 (?)
2.International Journal of Scientific StudyInternationalGSNA2.605
3.Annals of Pathology and Laboratory MedicineInternationalIC96.77NA
4.Journal of Evolution of Medical and Dental SciencesInternationalGS, IC96.22NA
5.Journal of Clinical and Diagnostic ResearchInternationalGS, IC, DOAJ131.08NA
6.Indian Journal of Pathology and OncologyInternationalGS, IC86.924.852
7.National Journal of Laboratory MedicineInternationalGS, IC, DOAJ95.23NA
8.Annals of International Medical and Dental ResearchInternationalGS, IC89.35NA
9.Indian Journal of Public Health Research and DevelopmentInternationalGS, Scopus, Indian Citation IndexNA6.405
10.International Journal of Medical Science and Clinical InventionsInternationalPubmed, GS, IC, DOAJ, Indian Citation IndexNANA
11.Journal of CytologyNationalScopus, GS, Pubmed, DOAJ, Science Citation IndexNA0.696
12.IOSR-Journal of Dental and Medical Sciences§InternationalGS, ICNA5.164
13.Journal of Medical Science and Clinical ResearchInternationalGS, IC, DOAJNA0.546
14.International Journal of Medical Science and Public HealthInternationalGS, IC86.0NA

ϯAs declared by the journal on its homepage (online) or coverpage (print version) and the affiliations of the editorial board members

*Indexing verified last on 1 March 2020; (?) source not available

**GS: Google scholar, IC-Index copernicus, DOAJ-Directory of open access journals

§Predatory alert (https://journals.indexcopernicus.com/search/form)


Duplicate publication was seen in one thesis (3.8% of all published theses). Similar article with same authors, title and contents were published in two different journals. It was possible to survey 11 of the 15 authors of unpublished theses telephonically. The most common reason for thesis not being published was lack of interest in academic career (5/8; 62.5%). Thus, 5/41 i.e., 12.2% theses were wastage of all time, efforts, resources and knowledge. Another reason was that the thesis derived article was in the process of publication (3/8; 37.5%). Three thesis authors mentioned that their article was rejected by multiple journals considered with remarks being nothing new or poorly written. It was found that sample size and study design had no impact on the publication rates (p-value- 0.993 and 0.579, respectively) [Table/Fig-6,7].

Sample size versus publication rates.

Sample sizeNumber of thesesPublishedNot publishedPublication %
<5053260%
51-1001510566.7%
101-20074357%
201-50096366.7%
501-1000220100%
>100031233.4%

Yates Chi-square-0.465, df=5, p-value-0.993


Study design versus publication rates.

Study designNumber of thesesThesis publishedThesis not publishedPublication %
Retrospective95455.6%
Prospective32211165.6%

Chi-square:-0.307; df=1; p-value-0.579


Research quality: Besides publication status, citation rate was taken as other indicators of research quality. Only one of all published articles had 2 citations. The citation rate of this article was 0.5 per year. Remaining 25 articles were never cited till date. Mean citation rate of the articles derived from thesis was 0.02 per year.

Discussion

Thesis, a mandatory exercise during postgraduation (MD/MS), can be considered as being published as a copy of it is usually maintained in the institutional libraries. However, this does not make the inferred information accessible to the scientific community worldwide for its utilisation. Publication of MD/MS postgraduate thesis in a peer reviewed indexed journal brings recognition of the research work done and this rate itself speaks of the research quality. The publication rate of Master’s thesis in a single study conducted in India was found to be 30% [7]. However, the publication rates of theses in different specialities across the world varied from 3.5% to 49.7% [2,7-10,14,15]. Ozgen U et al., (Turkey) and Elloumi H (Tunisia) in their studies covering multiple specialities mentioned about the publication rate of thesis in Pathology to be 5.5% and 16.2%, respectively [1,6]. In the present study, a higher rate of publication of theses in field of Pathology was noted (63.4%). Although the main regulating body for medical education standards in India i.e., Medical Council of India, has not mandated publication of thesis for postgraduates, but certain individual universities have [16]. Recent amendments in the MCI guidelines for the promotion of faculty mentions 1-3 publication in indexed print and online available journals as a criteria for eligibility for promotion to associate professor and professor [17,18]. If a postgraduate student wishes to pursue academic career (which is recently being more favoured in infrastructure requiring speciality like Pathology), publication(s) really counts. Recent increase in interest amongst young pathologists for academics and MCI guidelines for eligibility of teachers has possibly led to higher publication rates in Pathology postdoctoral thesis in India.

Previous studies reported the publication rates to be higher amongst female than male thesis authors [17,19]. In the present study, M:F ratio for published and unpublished theses were 1:3.3 and 1: 4.1, respectively.

As in the current study, some earlier studies have also shown that a higher proportion of postgraduate thesis was published in international journals as compared to national journals [7,9].

The research candidate was given the privilege of being the first author in 24.5% to 83.5% of the published articles in studies from different parts of world [2,4,6,8]. In a study from India, thesis author was the first author in 54% of master’s thesis derived article [7]. Comparable rate was observed in the present study. It is noticeable that still there is a significant percentage of thesis articles, where the guides or coguides have first authorship. Authorship is determined by multiple factors like conception of idea, literature search, contribution to the research, preparation of manuscript, final approval of the draft etc. This may justify the first authorship of guide or a coguide.

Mayir B et al., (Turkey), reported that time taken for a thesis to be published may vary from 1-7 years [8]. Sipahi H et al., mentioned in their study from Turkey that it takes about 6 months for a thesis to be published [10]. It was observed in current study that majority theses were published within a year of thesis submission. This is in concordance with the findings of Dhaliwal U et al., as they have reported this time to vary from 8-74 months (33.7±17.33 months [7]. Another study from Brazil states that publication starts two years after completion of postgraduation [20]. These variations in opinions can be explained by lack of time during the post graduation course. Also, the process of publication of an article itself takes time.

Duplicate publication i.e., same research results published in more than 1 article(s), should be regarded as misconduct [21]. Duplicate publications have been brought into light by certain articles [22,23]. In present study, the present authors found one such thesis; same manuscript with same contents and authors derived from this thesis was published by two journals at a gap of two months.

Mayir B et al., used citation rates of general surgery thesis in Turkey as a determinant of thesis quality [8]. In India, this is the first study to assess quality of postgraduate thesis by citation rate of published article. Citation rate of thesis derived articles has been reported to vary from 0-14.7 per year in Finland [4]. Median citation rate varied from 0.3 to 5 per paper per year in a study from Turkey [1]. In the present study, the citation rate was low. Majority of articles have never been cited. This difference may be attributed to thesis being not so much scientifically productive as well as lesser time between the publication of theses and the current study. Overtime, the citation rate may increase. It is speculated that immunohistochemical, flow cytometry, molecular biology studies and studies of recent and future interest may be cited more frequently [9].

Willis DL et al., reported that citation rates of an article are affected by study design, sample size and study topic [24]. Study design and sample size did not affect publication rates in present study. Dhaliwal U et al., also reported that publication rates did not vary with study design and sample size [7].

Nieminen P et al., reported in their article that publication rates increased with time from 1990s to 23.8% in 2001-2003 when compared with another European country [4,25]. In present study, there was a rather a declining trend of publication rates over the study duration (2014 onwards). The reason could be that the process of publication takes time. But still, publication of postgraduate thesis should be encouraged and also newer topics of relevant recent interest should be taken up for thesis for possible future publication prospects. As 37.5% of unpublished thesis in present study was rejected by multiple journals, it may be inferred that certain percentage of thesis are either substandard or fail to add anything significant to medical literature. The candidates should be guided for writing a nicely organised and presentable article.

During the study, authors observed that certain journals were preferred for publication over others in certain institutions. This domestic pattern of theses publication was observed in their study by Ozgen U et al., and Quiroz IA et al., also [1,2]. The young research candidates don’t have the idea of which journal to consider and which to condemn. Their seniors or the guides/coguides often provide the guidance in this regard. This explains the affinity for certain journals. The authors would recommend the young research candidates to first search for a reputed, peer reviewed, indexed and preferably international journal which is available online and in print version also. Indexing with recognised databases like Medline, PubMed Central, Science Citation Index, Embase/Excerpta Medica, Scopus and IndMed should be preferred [26]. “Impact factor” is another tool to assess prestige of a journal. Index Copernicus portal has identified 48% of the journals from India as Predatory journal practices [27]. One should also be aware of the predatory journals, prefer journal metrics like Journal citation rate by Clarivate analytics for assessment of a journal and avoid falling in trap of fake metrics [28,29].

Limitation(s)

This study may have failed to access certain articles in case there was a change in surname postmaritally. The four thesis authors could not be contacted for confirming their thesis being unpublished.

Conclusion(s)

Although the publication rates of thesis in field of Pathology are respectable, the quality of research is questioned by number of unpublished thesis, low citation rate, rejection of thesis derived articles and more of a declining trend in thesis publication. The postgraduate education standards in Pathology need to be updated so that the young postgraduates can survive and sustain in the era of molecular investigations. It is also recommended that the regulating body for medical education (MCI in India) should promote publication of theses because of obvious reasons, with clearly defining the standards of the journal for publication. Also, the young postgraduates should not jump upon certain traditional journals of their institute just for the sake of rapid and easy publication, but should evaluate the journal first, before surrendering their valuable research work.

ϯAs declared by the journal on its homepage (online) or coverpage (print version) and the affiliations of the editorial board members*Indexing verified last on 1 March 2020; (?) source not available**GS: Google scholar, IC-Index copernicus, DOAJ-Directory of open access journals§Predatory alert (https://journals.indexcopernicus.com/search/form)Yates Chi-square-0.465, df=5, p-value-0.993Chi-square:-0.307; df=1; p-value-0.579

References

[1]Ozgen U, Egri M, Aktas M, Sandikkaya A, Ozturk OF, Can S, Publication pattern of Turkish medical theses: Analysis of 22.625 medical theses completed in years 1980-2005 Turkiye Klinikleri J Med Sci 2011 31(5):1122-31.10.5336/medsci.2010-20737  [Google Scholar]  [CrossRef]

[2]Quiroz IA, Curioso WH, Encarnacion MC, Gayoso O, Characteristics and publication patterns of theses from a Peruvian medical school Health Information and Libraries Journal 2010 27:148-54.10.1111/j.1471-1842.2010.00878.x20565556  [Google Scholar]  [CrossRef]  [PubMed]

[3]Li J, Gao XH, Bian Q, Guo ZY, Mei XB, Yu G, Comparative study of scientific publications in urology and nephrology journals originating from USA, China and Japan (2001-2010) PLoS ONE 2012 7:e4220010.1371/journal.pone.004220022870301  [Google Scholar]  [CrossRef]  [PubMed]

[4]Nieminen P, Sipilä K, Takkinen H, Renko M, Risteli L, Medical theses as part of the scientific training in basic medical and dental education: Experiences from Finland BMC Med Educ 2007 51:01-07.10.1186/1472-6920-7-5118053247  [Google Scholar]  [CrossRef]  [PubMed]

[5]Salmi LR, Gana S, Mouillet E, Publication pattern of Medical theses, France,1993-98 Medical Education 2001 35(1):18-21.10.1046/j.1365-2923.2001.00768.x11123590  [Google Scholar]  [CrossRef]  [PubMed]

[6]Elloumi H, Theses defended at the Faculty of Medicine of Tunis from 2004 to 2005: Becoming a scientist and predictive factors for publication Tunisia Medical 2017 95(4):236-41.  [Google Scholar]

[7]Dhaliwal U, Singh N, Bhatia A, Master’s theses from a university medical college: Publication in indexed scientific journals Indian J Ophthalmol 2010 58:101-04.10.4103/0301-4738.6007020195030  [Google Scholar]  [CrossRef]  [PubMed]

[8]Mayir B, Bilecik T, Cakir T, Dogan U, Gunduz UR, Aslaner A, Analysis of the publishing rate and the number of citations of general surgery dissertations Turk J Surg 2017 33:33-36.10.5152/UCD.2016.319028740947  [Google Scholar]  [CrossRef]  [PubMed]

[9]Yüksel M, İpekçi T, Tunçkıran A, Publication patterns and citation analysis of urology dissertations written at medical faculties from Turkey between 2008-2011: A cross sectional study Turk J Urol 2018 44(4):341-45.10.5152/tud.2017.3204229799403  [Google Scholar]  [CrossRef]  [PubMed]

[10]Sipahi H, Durusoy R, Ergin I, Hassoy H, Davas A, Karababa A, Publication rates of public health theses in international and national peer-review journals in Turkey Iran J Public Health 2012 41:31-35.  [Google Scholar]

[11]Kalcıoğlu MT, Eğilmez OK, Karaca S, Hanege FM, İleri Y, Publication rates of otolaryngology theses from Turkey in peer-reviewed journals Kulak Burun Bogaz Ihtis Derg 2016 26:143-51.10.5606/kbbihtisas.2016.6362627107600  [Google Scholar]  [CrossRef]  [PubMed]

[12]Öğrenci A, Ekşi , Özcan-Ekşi EE, Koban O, From idea to publication: Publication rates of theses in neurosurgery from Turkey Neurol Neurochir Pol 2016 50:45-47.10.1016/j.pjnns.2015.11.00726851689  [Google Scholar]  [CrossRef]  [PubMed]

[13]Sipahi OR, Caglayan Serin D, Pullukcu H, Tasbakan M, Köseli Ulu D, Yamazhan T, Publication rates of Turkish medical specialty and doctorate theses on Medical Microbiology, Clinical Microbiology and Infectious Diseases disciplines in international journals Mikrobiyol Bul 2014 48:341-45.10.5578/mb.700324819272  [Google Scholar]  [CrossRef]  [PubMed]

[14]Bayramlar H, Karadağ R, KanraGürtürk AY, Öçal A, Dağ Y, Sarı Ü, Publication patterns of opthalmology residency dissertations in Turkey Eur J Gen Med 2015 12:213-16.10.15197/ejgm.01398  [Google Scholar]  [CrossRef]

[15]Yaman H, Kara İH, Baltacı D, Altuğ M, Akdeniz M, Kavukçu E, Qualitative evaluation of theses written in area of family medicine in Turkey Konuralp Tıp Derg 2011 3:01-06.  [Google Scholar]

[16]Medical Council of India. Postgraduate medical education regulations, 2000. The Gazette of India. 2000; Part III: Section 4. Available from: http://www.mciindia.org/know/rules/rules_pg.htm  [Google Scholar]

[17]Medical Council of India. Minimum qualifications for teachers in medical institutions regulations, 1998. The Gazette of India. 1998; Part III: Section 4. Available from: http://mciindia.org/know/rules/teachers.htm  [Google Scholar]

[18]Board of Governors in suppression of Medical Council of India. Minimum qualifications for teachers in medical institutions regulations, 1998. Addition in clause 13 of Schedule-I (MCI-12(2)/2019-Med.Misc./172844). The Gazette of India: Extraordinary. 2020; PART III -section 4. Available from: https://mciindia.org/ActivitiWebClient/open/getDocument?path=/Documents/Public/Portal/Gazette/TEQ-17.02.2019.pdf  [Google Scholar]

[19]Hollmann M, Borrell C, Garin O, Fernandez E, Alonso J, Factors influencing publication of scientific articles derived from masters theses in public health Int J Public Health 2015 60:495-504.10.1007/s00038-015-0664-025740659  [Google Scholar]  [CrossRef]  [PubMed]

[20]Younes RN, Deheinzelin D, Birolini D, Graduate education at the Faculty of Medicine of the University of São Paulo: Quo vadis? Clinics 2005 60:06-08.10.1590/S1807-5932200500010000315838574  [Google Scholar]  [CrossRef]  [PubMed]

[21]International Committee of Medical Journal EditorsUniform requirements for manuscripts submitted to biomedical journals JAMA 1997 277:927-34.10.1001/jama.277.11.9279062335  [Google Scholar]  [CrossRef]  [PubMed]

[22]Reyes H, Palma J, Andresen M, Ethics in articles published in medical journals Revista Medica de Chile 2007 135:529-33.10.4067/S0034-9887200700040001717369977  [Google Scholar]  [CrossRef]  [PubMed]

[23]Salinas JL, Mayta-Tristan P, Duplicate publication: A Peruvian case Revista de Gastroenterologia del Peru 2008 28:390-91.  [Google Scholar]

[24]Willis DL, Bahler CD, Neuberger MM, Dahm P, Predictors of citations in the urological literature BJU International 2011 107:1876-80.10.1111/j.1464-410X.2010.10028.x21332629  [Google Scholar]  [CrossRef]  [PubMed]

[25]Frkovic V, Skender T, Dojcinovic B, Bilic-Zulle L, Publishing scientific papers based on Master’s and Ph.D. theses from a small scientific community: Case study of Croatian medical schools Croat Med J 2003 44:107-11.  [Google Scholar]

[26]Aggarwal R, Gogtay N, Kumar R, Sahni P, Indian Association of Medical Journal Editors. The revised guidelines of the Medical Council of India for academic promotions: Need for a rethink Indian J Anaesth 2016 60:01-05.10.4103/0019-5049.17480026962247  [Google Scholar]  [CrossRef]  [PubMed]

[27]Index Copernicus International. ICI World of Journals. Available from: https://journals.indexcopernicus.com/search/form (Last accessed on 12/3/2020)  [Google Scholar]

[28]Jalalian M, The story of fake impact factor companies and how we detected them Electronic Physician 2015 7:1069-72.  [Google Scholar]

[29]Beall J, Dangerous predatory publishers threaten medical research J Korean Med Sci 2016 31:1511-13.10.3346/jkms.2016.31.10.151127550476  [Google Scholar]  [CrossRef]  [PubMed]