Undergraduate Pharmacology Written Question Papers of Different Universities of Bangladesh: Analysis of One Decade

INTRODUCTION

Undergraduate pharmacology education has always been a topic of tense debate. Credibility of pharmacology education in coping pace with rapid changes and requirements of clinical practice is questionable.^{1, 2} Studies concluded weakness in pharmacological knowledge and skill in prescribing medicines as an important factor of medication error.^{3, 4, 5, 6} Medical students around the world seek more requirement of attention in their pharmacology education.^{7, 8}

Curriculum is a formal document including course content, objectives, learning outcomes, educational strategies and assessments for achievement of learning, teaching and evaluation under the guidance of educational institutions. It represents the expression of educational ideas in practices.^{9, 10} In any curriculum, a close match between instructional objectives, methods and assessment procedures are required.¹¹ It is important to assure that objectives are measurable and specific level of competence being delineated. The assessment methods measures whether the objectives are achieved or not through formative and summative examinations.¹² Formative assessments provide benchmarks to orient the learner who is approaching a relatively unstructured body of knowledge. They can reinforce students’ intrinsic motivation to learn and inspire them to set higher standards for themselves.¹³ On the other hand, summative assessments are intended to provide professional self-regulation and accountability as well as act as a barrier to further practice or training.¹⁴ All methods of assessment have strengths and intrinsic flaws.¹⁵ Written assessment has been considered as cornerstone of testing knowledge of graduates.¹⁶ Various types of questions like MCQ, SAQ, MEQ and SEQ can be used in written assessment.¹⁷ Due to limited validity, poor reliability and less objectivity, long essay questions lost popularity as instrument of written assessment.^{18, 19} Nowadays, SAQs are widely used because of greater objectivity, reliability, specificity and coverage of wider areas of course content.

In Bangladesh, first documented curriculum of MBBS program was introduced in 1988.²⁰ After extensive review a revised curriculum was implemented on students of 2002-2003 session. Introduction of SAQ and MCQ in written assessment system instead of essay questions were the dramatic changes observed in that curriculum. ²¹ Later, reviewed MBBS curriculum 2012 has been developed, and implemented from session 2012-13.²² Seven public universities, Bangladesh University of Professionals (BUP), University of Dhaka (DU), University of Chittagong (CU), University of Rajshahi (RU), Shahjalal University of Science and Technology (SUST), University of Science and Technology, Chittagong (USTC) and Gono Bishwabidyalay (GB) are conducting MBBS examination of all medical students under the guidance of Bangladesh Medical & Dental Council (BMDC). After the implementation of curriculum 2002, Pharmacology had been assessed in 2nd professional exam since January, 2007 and in curriculum 2012, it has been assessed in 3rd professional exam since May, 2017. Several studies were done to evaluate Pharmacology curriculum, textbooks and question papers through different perspectives.^23-28 In this background, current study was conducted to evaluate Pharmacology written question papers of different universities over last 10 years in the context of reflection of curricular objectives, content coverage and selective disease burdens.

MATERIALS & METHODS

The objectives of this study were to compare the reflection of curricular objectives, content coverage and national health priorities in undergraduate pharmacology written question papers of different universities of Bangladesh.

RESULTS

Total 131 SAQ papers (DU-20, CU-20, RU-20, SUST-19, USTC-16, GB-16 & BUP-20) of undergraduate pharmacology written question papers dated from January 2010 to November 2019 were analyzed. Table I showed that no. 1 objective had significant higher weightage throughout the last ten years in all universities. There were statistically significant differences in weightage of reflection of curricular objectives (No.1, 2, 4, 7 & 8) among different universities. There was not a single question reflecting no. 9 objective in last 10 years in any university.

Table II showed there were statistically significant differences in content-wise weightage among different universities except gastrointestinal pharmacology. Chemotherapy was the highest covered area, followed by central nervous system and general principles of pharmacology throughout the last ten years in all universities (Table II). In curriculum, allocated teaching hours for chemotherapy was highest, followed by general principles of pharmacology and central nervous system (Table III).

Table IV showed there was a statistically significant difference in weightage of reflection of cardiovascular disease burden among different universities.

DISCUSSION

Re-addressing assessment methods is a crucial step for transformation of medical education and over the years, innovative measures are taken for provision of accurate and timely assessment of future physicians.³⁰ Current study was conducted to analyze and compare pharmacology question papers of different universities of Bangladesh in respect to reflection of curricular objectives, content coverage and selective disease burdens for last 10 years.

Objectives are statements that describe the end-points or desired outcome of the curriculum which guide the assessment method, outline content and instructional materials, contribute towards achieving the intended educational outcomes, shaping expectations, prepare learners for the educational activity and the standard by which their performance will be measured.³¹ No. 1 objective had significant higher weightage throughout the last ten years in all universities, followed by no. 2 and no. 3 objective. No. 1 objective actually presents knowledge and comprehension, whether no.2 and no. 3 objectives demonstrate application, analysis and evaluation. Higher proportion of coverage of factual knowledge in professional exam question papers of pharmacology was also revealed in studies conducted in Bangladesh and India.^{24, 26, 28, 32, 33} Important issues of prescribing like adverse drug reactions, essential medicines, rational prescribing, ethical and legal aspects are still neglected in undergraduate pharmacology education, and this finding is concordance with previous literatures.^23,27 It is assumed that it’s convenient for question setters and moderators to prepare questions in traditional way as they are probably not adequately trained in adaptation of changing aspects of pharmacology teaching-learning.³⁴ Current study also found statistically significant difference of weightage in reflection of curricular objectives (No.1, 2, 4, 7 & 8) among different universities, and there was no available research to compare the findings.

In case of content coverage, it was found that Chemotherapy, CNS pharmacology, General principles of pharmacology, Renal & cardiovascular pharmacology and Autonomic pharmacology were the maximum weightage of content area, and the findings were similar to related studies conducted in Bangladesh.^{26, 28} Increased weightage on Hematopietic pharmacology was observed in current study that was similar to Begum et al²⁴ but contrary to two recent studies.^{26, 28} Weightage on Endocrine pharmacology was consistent with related studies.^{23, 24, 26, 28} There was statistically significant difference among different universities in weightage of all content areas except Gastrointestinal pharmacology, and no comparable study was found to correlate this finding. There were some discrepancies in weightage of different contents with their allocated teaching hours, and that was concordance with an earlier study conducted in Bangladesh.²³ A test blueprint and question bank would be helpful for the question setters and moderators for adequate content coverage.^{28, 35}

Current study compared reflection of selective disease burdens in written question papers and found statistically significant difference (p value <0.00001) in cardiovascular diseases among different universities. Although there was no comparable study, earlier researches concluded less emphasis on national health priorities in pharmacology question papers of Bangladesh.^{23, 24} One recent study conducted in Bangladesh revealed pharmacology written question papers of different universities under guidance of same curriculum of BMDC differ in the aspect of weightage of problem-based questions.³⁶

CONCLUSION

Current study revealed variation in undergraduate pharmacology written question papers of different universities in the aspects of reflection of curricular objectives, content coverage and cardiovascular disease burden. A clear direction of weightage of each objective, contents and disease burdens are needed to mention in the undergraduate curriculum. As assessment drives learning priority, it’s crucial for question setters and moderators to maintain uniformity of written question papers of different universities following same curriculum of BMDC.