Abstract
Background The key objective of pharmacology education is to make graduates competent enough to prescribe safely and effectively. There is worldwide speculation of inadequacy of pharmacology education to achieve the expected learning outcomes. Problem-based pharmacotherapy is considered as one of the crucial way to prepare future physicians as rational prescribers. As assessment drives learning priorities, adequate weightage on problem-based questions in undergraduate pharmacology examination might be helpful.
Materials and Methods This descriptive cross-sectional study was conducted to analyze the undergraduate pharmacology written question papers (SAQ) of MBBS curriculum of 07 different universities (Bangladesh University of Professionals, University of Dhaka, University of Chittagong, University of Rajshahi, Shahjalal University of Science and Technology, University of Science and Technology, Chittagong and Gono Bishwabidyalay) of Bangladesh in last 10 years (January 2010 to November 2019). Total 131 question papers were collected, and trend and weightage of problem-based questions were evaluated.
Results Problem-based questions have been reduced dramatically over the decade and Mean percentage of marks allocated for problem-based questions was 1.2±1.3 over last years. There was significant difference (<0.00001) of weightage of problem-based questions among different universities of Bangladesh. Highest presence of problem-based question was observed in Gono Bishwabidyalay (GB), followed by Shahjalal University of Science and Technology (SUST), University of Rajshahi (RU) and Bangladesh University of Professionals (BUP) but there was not a single problem-based question in University of Dhaka (DU), University of Chittagong (CU) and University of Science and Technology (USTC) over 10 years period.
Conclusion Current study revealed negligible presence of problem-based questions in undergraduate pharmacology written question papers of Bangladesh over 10 years period.
INTRODUCTION
Assessment is a fundamental component of medical education as it drives students learning and certification.1 It can be formative or summative. Formative assessment reinforces students’ intrinsic motivation to learn and inspire them to set higher standards for themselves.2, 3 On the other hand, summative assessment is intended to provide professional self regulation and accountability which may also act as a barrier to further practice or training. In summative assessment, students tend to study that which they expect to be tested on and it influence learning even in the absence of feedback.4, 5 Written assessment has been used for almost as long as medicine has been taught. It has historically been the cornerstone of testing doctors’ and medical students’ knowledge. In modern times, it is still used throughout the world, at all stages of medical training, principally as a means of testing knowledge.6 Various types of questions can be used like MCQ, SAQ, MEQ and SEQ.7 In the past, long essay questions were commonly used in written examination to assess the cognitive ability of students. But this traditional essay question could not yield the expected answers and wide variation in student’s interpretation was noted. Therefore it is showed limited validity, poor reliability and less objectivity.8, 9 On the other hand, SAQ direct the students towards a precise and specific response and provide greater objectivity, reliability and their range of content area testes is extended. There are several types of SAQ questions including completion items, definitions, unique answer type, label/draw diagram, numerical problems, open ‘SAQs’ and problem-based questions. Problem-based questions is useful to assess whereby medical students can apply and / or transform their knowledge and understanding in order to diagnose and treat clinical conditions which they are supposed to perform in their practice in upcoming days.7, 10
The goal of medical education is to prepare graduates who are competent enough to prescribe safely and effectively.11 A thorough understanding of pharmacology is needed for effective pharmacotherpy and prescribing of medications.12, 13 It is expected that pharmacology teaching program should be able to develop a foundation to enable them to appraise new medicines throughout professional career. In many medical schools, pharmacotherapy teaching is characterized by the transfer of knowledge about drugs, rather than by skill to treat patients. Actually pharmacotherapy is a skill; it is more than knowledge alone. Although World Health Organization (WHO) urges for outcome-based learning in pharmacology, focusing on practice rather than on theory14, studies show growing concerns about inadequacy of pharmacology education to prepare future physicians as rational prescribers.15, 16, 17 Problem-based pharmacotherapy teaching is the best way to make rational prescribers. Problem-based curriculum is not necessary for teaching pharmacotherapy. It is possible to integrate problem-based pharmacotherapy in a traditional curriculum. Introduction of few hours of problem-based learning within the limits of current curriculum, problem-solving exercises and problem-solving questions in different parts of standard assessment systems would be helpful to achieve this goal.14
Bangladesh inherited medical education program from the British, and then Pakistan.18 In 1988, first documented and reformed curriculum for undergraduate medical program was introduced, then subsequently revised in 2002 and 2002.19, 20 Several studies were conducted in Bangladesh to evaluate pharmacology education (curriculum, textbooks and question papers) from different perspectives.21, 22, 23, 24, 25, 26 In this backdrop, current study was conducted to evaluate pharmacology written question papers of last 10 years with the attempt to find out the weightage and trend of problem-solving questions in the written assessment system.
MATERIALS & METHODS
The objective of this study was to assess the weightage and trend of problem-based questions in undergraduate pharmacology written question papers of Bangladesh.
Study Design and Procedure
A descriptive cross-sectional study was designed to meet the study objective and was conducted from January 2021 to March 2021. Ethical approval was taken from the Institutional Review Board (IRB) of Combined Military Hospital (CMH) Bogura, Bangladesh. Pharmacology written question papers (SAQ) of last 10 years (January 2010 to November 2019) of all 7 universities offering MBBS degree (Bangladesh University of Professionals, University of Dhaka, University of Chittagong, University of Rajshahi, Shahjalal University of Science and Technology, University of Science and Technology, Chittagong and Gono Bishwabidyalay) were collected and included in the study for analysis. Total 131 question papers were collected for review. Researchers thoroughly screened the question papers, sorted out problem-solving questions and calculated the weightage. The Pharmacology written question papers (SAQ) contain total 84 marks with options, where students need to answer a maximum of 70 marks. Weightage was calculated as the number reflecting problem-solving question out of 84 marks.
Statistical analysis
Data was compiled, presented and and analyzed using Microsoft Excel 2007, and was expressed as mean percentage (standard deviation). One Way Analysis of Variance (ANOVA) was done to determine the significance of difference between the mean percentages. Statistical analysis was performed at a 95% confidence interval and significance was determined at p< 0.05.
RESULTS
Total 131 SAQ papers of undergraduate pharmacology written question papers dated from January 2010 to November 2019 were analyzed. There was not a single problem-based question in University of Dhaka (DU), University of Chittagong (CU) and University of Science and Technology (USTC) over 10 years period. Mean percentage of marks allocated for problem-based questions was 1.2±1.3 over last years. Highest presence of problem-based question was observed in Gono Bishwabidyalay (GB) 3.9±3.7, followed by Shahjalal University of Science and Technology (SUST), University of Rajshahi (RU) and Bangladesh University of Professionals (BUP). And statistically significant difference (<0.00001) was observed among seven universities (Table I).
Figure 1 represented the trend of problem-based questions (i.e. mean percentage) in pharmacology written question papers throughout the last ten years. The percentage of problem-based question had been reduced dramatically over the years almost climbing down to nil.
DISCUSSION
Prescribing is a complex process involving a mixture of knowledge, attitude and skills. Preparing graduates to be rational prescribers is one of the greatest challenges of undergraduate pharmacology education.27 It has been generally felt that pharmacology course in undergraduate medical education is not adequate to keep pace with the rapid changes and requirements of clinical practice. Traditionally, it has focused more on factual information with little or no emphasis on practical aspects of prescribing. Effectiveness of current pharmacology eduation as a foundation to make graduate competent enough to prescribe safely and effectivly is rather questionable.28, 29 Problem-based pharmacotherapy has been considered as the first step in a long process of changing from traditional teaching towards an integrated curriculum with problem-based learning with the aim to make graduates as competent prescribers.14 Current study was conducted in this context to assess the weightage and trend of problem-based questions in undergraduate pharmacology written question papers of different universities of Bangladesh for last 10 years.
The term ‘medical problem-solving’ is most often used to refer to that process by which physicians arrive at a diagnosis, select a management strategy, initiate remedial action, monitor its effectiveness and modify their interventions accordingly. The situations in which this process may be used range from individual patient discomforts to community or national health problems. Assessment of problem-solving skills is best done by placing an individual in a problematical situation and observing his performance.30 Problem based questions are for students to assess their knowledge and understanding level through which they can solve problem in a novel situation.31 Current research found that percentage of problem based question had reduced dramatically over the last 10 years and this finding was concurrent to previous two studies conducted in Bangladesh24, 26 although there is already identified need by pharmacology educators of the country to incorporate problem based questions in undergraduate written exams.32 Regarding weightage of problem based questions, another point is significant difference (<0.00001) was observed among different universities in current study. Furthermore, a study has revealed the effectiveness of problem-based learning in context of Bangladesh.33 A blend of problem based learning along with conventional classes in pharmacology classroom can trigger the student’s efficiency and prescribing behavior in a prudent way. Therefore, more highlight on problem based teaching learning and eventually on question set up in pharmacology is recommended.
Assessment is the central feature of medical education. Changing the examination system without changing the curriculum had a much more profound impact upon the nature of learning than changing the curriculum without altering the examination.6, 7 Incorporation of problem-based questions in undergraduate pharmacology examination will motivate students about problem-based pharmacotherapy as examination is the driving force for learning in medical education.34
CONCLUSION
Current study showed negligible presence of problem based questions in undergraduate pharmacology written question papers in last 10 years and inter-university variation of weightage was observed. Undergraduate medical students who have been taught by same curriculum could have different learning outcomes as assessment determines learning priority. A clear direction about weightage of problem based questions is needed to spell out in the undergraduate pharmacology curriculum. A test blueprint and question bank might be helpful as a reference tool for the question setters and moderators to prepare question for achieving expected learning outcomes.
Data Availability
All data produced in the present study are available upon reasonable request to the authors