JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Physiology Section DOI : 10.7860/JCDR/2017/29128.10966
Year : 2017 | Month : Dec | Volume : 11 | Issue : 12 Full Version Page : CC01 - CC05

Impact of Feedback on Continuous Cumulative Evaluation System for Learning in Physiology

Puja Dulloo1, Neeraj Vedi2, Geetanjali Purohit3

1 Associate Professor, Department of Physiology, Smt. B.K. Shah Medical Institute and Research Center, Sumandeep Vidyapeeth, Vadodara, Gujarat, India.
2 Resident, Department of Anatomy, Smt. B.K. Shah Medical Institute and Research Center, Sumandeep Vidyapeeth, Vadodara, Gujarat, India.
3 Assistant Professor, Department of Physiology, Smt. B.K. Shah Medical Institute and Research Center, Sumandeep Vidyapeeth, Vadodara, Gujarat, India.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Puja Dulloo, Associate Professor, Department of Physiology, Smt. B.K. Shah Medical Institute and Research Center, Sumadeep Vidyapeeth, Piparia, Vadodara-391760, Gujarat, India.
E-mail: puja_dullo@yahoo.com
Abstract

Introduction

Effective feedback helps students to realize their error and confirm most appropriate response posed by them which moreover, magnifies their conceptual understanding. Implementation of the innovative feedback on formative assessment of Continuous Cumulative Evaluation System (CCES) at our institute primes the untrained minds towards better understanding of the assessed content.

Aim

To determine the impact of feedback on CCES process in medical students on learning physiology.

Materials and Methods

Non-randomized, purposive, survey questionnaire based study for 150 students enrolled in 2015 to 2016 for medical program of SBKSMIRC, Sumandeep Vidyapeeth University were considered. Three focus group discussions were conducted with eight students in each group after completion of session. Pre and post-test was conducted to assess learning outcome of students by feedback methodology. Data was collected, and analyzed statistically using paired t-test and correlation analysis for gender variability for perception.

Results

Pre and post-test showed statistical significance (p<0.001) for learning outcome. Significant correlation for gender variation was observed for some of the survey questions. Focus Group Discussion (FGD) and survey results implied that students improved in the process of learning after receiving feedback.

Conclusion

In depth understanding of the core context of the topic was achieved after receiving feedback with new approach for the formative assessment. This feedback method also showed good peer interaction and better compatibility with the instructor. However, majority disapproved applying the feedback to their future exams.

Keywords

Introduction

Assessment system is constructed so that students performance is analyzed based on which they are stamped to move ahead or with held till they reach up to the standards as per council norms. Have we ever questioned why those backed students are lacking; is it because their approach towards the medical field is not up to the mark? May be “Yes”, but may be “No”. Some of us might have provided them an insight of their flaws but was it enough or we need to work more over it. Every student has right to know how they are doing. Student centered approach has been proved to have enhancement in attaining knowledge and appropriate skills [1,2].

Test enhanced learning gives an idea to a teacher for the output of their teaching tool. In medical education, tests are primarily used for assessment, thus permitting teachers to assess the efficacy of their curriculum and to assign grades.

As a teacher, it is our duty to check that learner understands the content of the feedback we provide them, so that they are encouraged to imbibe rather than misunderstanding the content of feedback [3]. Well planned assessment practice conducted with planned feedback will lead to effective learning facilitated in day to day learning activity [4]. In absence of corrective feedback from an experienced advisor, drive to learning would be a complicated and dangerous endeavour [5]. Effective feedback provides opportunities to bridge the gap between current and desired performance, delivering high-quality information to students about their learning which may depend on the type of school (public and private) [6,7].

In Indian medical institutes first internal assessment for first year student is after six months of their joining (first semester exam). A CCES has been incorporated to assess students of Smt. B.K. Shah Medical Institute and Research Center (SBKSMIRC), on everyday basis to improve their learning process. The term ‘Continuous’ implies learners evaluation spread over the entire span of educational endeavor [8], while “Cumulative’ means accumulation or the addition of successive parts or elements whereas, ‘Evaluation’ means judgment about the amount, number, or value of something; in this case assessment. CCES has a wider array of objectives allowing instructors of different courses to evaluate students performance as per the learning objectives of the lecture. This assessment tool not only improved attendance for the lecture but also attentiveness and alertness within the class. This assessment method enhanced their understanding and consequently improved their academic score which is reflected by cumulative increase in internal assessment grades.

In spite of various obstacles, continuous assessment system makes a positive impact on students by making them self-sufficient by repeated and continuous testing thus encouraging students to put effort into studies. The taught and assessed topics are retested during their first semester formative exam which improves retention of taught subject [9-11].

A new feedback approach has been developed by the author as per the internal assessment. Feedback is provided to students after responding to CCES based Multiple Choice Questions (MCQ’s) thus, focusing on the concept clarification underlining the question. Priming the untrained minds for different patterns of MCQ to have point to point response to questions thus, providing them explanations about the key response as well as importance of distractors. This feedback also prepares students for upcoming competitive exams which determine their future goals.

The aim of this study is to determine the impact of feedback on CCES process in medical students on learning physiology.

Objectives

To provide corrective feedback for the MCQs given after every lecture.

To determine the perception of feedback methodology after completion of the topics in the department of physiology.

To assess gender variation regarding perception of feedback methodology used.

To assess the learning outcome after the feedback process.

Materials and Methods

Non-randomized, purposive, questionnaire and interview based study started after approval from Sumandeep Vidyapeeth Institution Ethics Committee (SVIEC). All the students of first MBBS (150) for the academic year 2015 to 2016 batch were enrolled in the study while repeater students were excluded from the data collection and analysis of the study.

An innovative internal assessment method, CCES in addition to traditional method has been in cooperated in Sumandeep Vidyapeeth University. After every lecture faculty uploads five MCQ’s on the newly developed CCES online server from the taught topic which students have to attempt them within 10 minutes of time frame on their tablets using their institutional ID and password. Questions and its options presented to students are shuffled thus, chance of copying decreases. After completion of test students know their grade but cannot identify the correct answer for the posed question.

For the present study, the author provided feedback for CCES questions, 20 topics related to cardiovascular system, four related to regional circulation and nine linked to higher functions of central nervous system in the physiology department lecture hall. Feedback was provided on alternate weeks for five to six lecture topics designed for CCES program (25-30 questions per feedback session).

Pre and post-test was conducted for all the six feedback sessions to assess the learning outcome. Perception for the feedback process on CCES was collected after validating questionnaire by subject experts using five point Likert scale. Focus group discussion in three groups having eight students per group was also conducted to reconfirm our findings under the facilitation of three different instructors to minimize a biased approach.

Statistical Analysis

Students paired t-test and descriptive statistical analysis and correlation analysis for gender variation was done using SPSS version 23.0 software. Data analysis allowed us to prepare evaluation matrix up to the level II i.e., we can find reaction as well as learning of the students.

Results

The [Table/Fig-1] shows descriptive analysis for pre and post-test with correlation statistical significance (p<0.05) for feedback session 1,3,4 and 6. [Table/Fig-2] shows significant paired sample t-test significant difference (2-tailed <0.001) for each feedback session.

Descriptive analysis for overall pre and post-test for learning outcome.

Feedback SessionPre-test Mean±SDPost-test Mean±SDCorrelationp-value
Feedback-1 (115)3.05±1.444.77±1.500.1850.047
Feedback-2 (115)2.96±1.34.93±1.410.1420.131
Feedback-3 (120)1.85±1.264.50±0.830.2420.008
Feedback-4 (124)2.93±1.475.51±1.780.1730.050
Feedback-5 (115)3.017±1.495.15±1.670.0340.716
Feedback-6 (124)2.75±1.635.95±1.770.1430.014

Pre and post-test for learning outcome.

No.Feedback SessionPaired Differences
MeanMean±SDStd. Error Mean95% Confidence Interval of the DifferencetDfSig. (2-tailed)
LowerUpper
Pair 1Pre-test-1 - Post-test-1-1.711.870.18-2.06-1.37-9.81114p<0.001
Pair 2Pre-test-2 - Post-test-2-1.981.780.17-2.30-1.65-11.90114p<0.001
Pair 3Pre-test-3 - Post-test-3-2.651.330.12-2.89-2.41-21.89119p<0.001
Pair 4Pre-test-4 - Post-test-4-2.582.100.19-2.95-2.21-13.66123p<0.001
Pair 5Pre-test-5 - Post test-5-2.132.200.21-2.54-1.72-10.39114p<0.001
Pair 6Pre-test-6 - Post test-6-3.202.230.20-3.60-2.81-16.01123p<0.001

Test Applied: Significant t-test


Twenty-one questions asked to assess the effect on learning enhancement if feedback is given for CCES question having Cronbach’s Alpha value >0.784 i.e. data for 21 items is reliability statistically. [Table/Fig-3] shows frequency distribution for 21 questions regarding effect of feedback for CCES question for learning enhancement agreement for all the asked question expect for Q5, Q6, Q7, Q10. Which implies that the students felt that there is improvement in the process of learning enhancement by receiving feedback. [Table/Fig-4] shows independent t-test showing significant statistical values for Q3, Q4, Q5, Q9, Q14 and Q17 when comparing male and female were value (p<0.05). Focus group discussion was done among 15 students with three keys question and their comments are stated in [Table/Fig-5].

Frequency distribution for survey questionnaire for perception on feedback for CCES questions.

S. No.QuestionsFrequency in Percentage for Survey questionnaire about feedback for CCES questions.Mean±SD
Strongly DisagreeDisagreeIndifferentAgreeStrongly Agree
1I could identify my mistake4.910.79.85024.63.79±1.09
2Had better understanding of asked questions1.64.910.758.224.63.99±.84
3Better reasoning for key answers3.35.717.257.416.43.78±.91
4Clarified our doubts4.98.211.546.728.73.86±1.08
5Difficulty in understanding explanation for the correct answer9.836.12718.98.22.80±1.11
6Gave us extra-load17.236.113.917.215.62.78±1.35
7Failing to understand reason for giving the feedback16.439.318.913.911.52.65±1.24
8Helped us study seriously and with focus2.512.313.152.519.73.75±.99
9Helped us increase our internal grades4.1921.345.120.53.69±1.03
10Difficulty in applying feedback to future exams10.735.232184.12.70±1.02
11Motivated me to work more for the course6.66.61849.219.73.69±1.07
12Improved my self-planning for other topics4.15.717.250.822.13.81±.98
13Enhanced my learning skills4.16.618.958.613.93.70±.94
14Enough time was not allotted to discuss wrong answers12.326.222.126.213.13.02±1.25
15Enjoyed small group feedback method4.99.816.450.8183.67±1.04
16Session build up on my previous learning5.78.21854.113.93.62±1.02
17Facilitator explained me the answer with clear reasoning4.94.916.446.7273.86±1.03
18This was informal and relaxed way of learning4.94.11853.319.73.79±.97
19Session was interactive and had supportive environment4.115.6948.4233.70±1.11
20Good compatibility with the instructor3.3915.646.725.43.82±1.02
21Good interaction with peer students2.58.218.948.422.13.80±.96

Independent sampling t-test for gender variation.

S.NoQuestions response with Equal variances assumedSig. (2-tailed)Mean±SDMale/Female95% CI of the Difference
LowerUpper
1I could identify my mistake0.3193.69±1.17/ 3.89±0.99-0.5860.192
2Had better understanding of asked questions0.1613.89±0.92/ 4.1±0.75-0.5120.086
3Better reasoning for key answers0.0123.57±0.96/ 3.98±0.81-0.727-0.093
4Clarified our doubts0.0353.66±1.14/ 4.07±0.98-0.791-0.029
5Difficulty in understanding explanation for the correct answer0.0023.1±1.12/ 2.49±1.030.2210.992
6Gave us extra-load0.3152.9±1.35/ 2.66±1.34-0.2360.728
7Failing to understand reason for giving the feedback0.3442.75±1.29/ 2/54±1.19-0.2310.658
8Helped us study seriously and with focus0.1213.61±1.08/ 3.89±0.88-0.6320.075
9Helped us increase our internal grades0.0223.48±1.16/ 3.9±0.83-0.789-0.064
10Difficulty in applying feedback to future exams0.1842.82±1.06/ 2.57±0.97-0.1180.610
11Motivated me to work more for the course0.7363.66±1.11/ 3.72±1.04-0.4500.319
12Improved my self-planning for other topics0.1173.67±1.03/ 3.95±0.92-0.6290.071
13Enhanced my learning skills0.9233.69±0.94/ 3.7±0.94-0.3530.320
14Enough time was not allotted to discuss wrong answers0.0033.34±1.22/ 2.69±1.190.2231.088
15Enjoyed small group feedback method0.2983.57±1.13/ 3.77±0.94-0.5690.176
16Session build up on my previous learning0.2133.51±1.07/ 3.74±0.95-0.5930.134
17Facilitator explained me the answer with clear reasoning0.0433.67±1.11/ 4.05±0.92-0.742-0.012
18This was informal and relaxed way of learning0.5793.74±1.0/ 3.84±0.95-0.4480.251
19Session was interactive and had supportive environment0.6273.66±1.21/ 3.75±1.01-0.4980.301
20Good compatibility with the instructor0.2893.72±1.11/ 3.92±0.92-0.5620.169
21Good interaction with peer students0.7793.77±1.04/ 3.82±0.89-0.3950.297

FGD result complied from three groups.

How beneficial was feedback for CCES to you?How can it be improved as per your view point?
• Concepts were clarified.• Should be only for important topics.
• We could identify our mistake.• Some said it should be for other topics too like endocrine, blood, CNS.
• We could reason out our answers.• Should be after each section.
• We understood how to study and revise the concepts.• Homework is not given thus we do not study for the same.
• It was revisit to topic which we couldn’t understand.• Only interested participants should be asked to attend.
• Came to know about our lacuna.• No attendance for that session.
• Gained confidence to guess.• Attendance should be granted to everyone.
• Clinical implication was interesting.• Teacher should randomly choose students from back bench to answer questions with reasons.
• We can remember things by discussion.• It should be made like a quiz within the class to explain with an answer.
• We have idea about the type of questions asked during exam.
• Inspired us to listen the lecture keenly to attend CCES session.
• Sometime teacher went out of the topic to clarify concept.
Anything specific?
• Important diagnostic or clinical MCQ’s can be added up for explaining questions.
• Twist the framework of questions, extra questions of same pattern for the topic should be provided.
• Other departments should also start this type of feedback.
• If this method is used for every topic then it will be time consuming.
• Topic related videos should be shown.

Discussion

Feedback has been the most powerful tool to improve academic performance and students interaction with their instructor. Our study has also shown significant improvement in learning process of students after providing feedback on formative assessment as CCES at our institute. This goes with the study by Rowe and Wood who concluded that the provision of appropriate and timely feedback promoted deep learning in students [12]. Sichinga KT et al., in their study showed that quality of feedback has significant influence on the academic achievement of students [7]. Duffield and Spencer highlighted that maximum respondents in their study expressed desire for the provision of more feedback on performance in assessment in order to guide future learning [13]. In our study, students disagreed or strongly disagreed as per frequency distribution for the difficulty faced with the CCES questions, or time allocation for completion. Students were confident about the answers written by them for the questions asked. Although, 35% of students did feel that the options given were confusing, 65.6% students agreed that feedback increased their internal grades, 69% approved that feedback motivated them to work for the course while 73% granted that it enhanced their self-planning for other topics. Crisp BR found that, a greatest increase in marks was associated with greatest reductions in the number of problem areas which was due to the consistent feedback for assessed work [14]. While Price M et al., in his study showed that some students saw a distinction between marks and feedback and disliked feedback that just provided justification of the grades [15]. However, those unsure about the purpose of feedback had adjusted and limited their view to align with the grade justifying feedback they were receiving. Moreover, staff commented in their study that they provided feedback in the hope that it would support students in later stage of the course, although, students saw limited opportunities for feed-forward [15].

In our study, 72.5% students approved that feedback enhanced their learning although 46% students disagreed and 32% had indifferent approach towards applying feedback to their future exam. Although, 68% agreed that feedback built on their previous learning and clarified concepts with reasoning was agreed by 74% of students in our study. Hernander R showed that 63% students suggested that feedback given was applicable to their future assignments [16]. Even a significant number of students reported that the feedback comments received by them were limited and did not suggest how to improve their learning. In Doan L study, 165 students accepted that tutors’ feedback was very important for their learning, were majority of them read or acted on tutors feedback [17]. One hundred eighty five students even agreed that feedback helped them to know what they had to achieve and improve in future learning process. Goel K and Ellis B, results revealed that 80.5% students responded for feedback identifying gaps in knowledge, 68.3% said that feedback identifies strengths and encouraged them to do better on future assignment while 73.2% students said that feedback showed their level of achievement against the marked criteria [18]. Study done by Dulloo P and Nazwani N showed that feedback for assessment provided better opportunity for students to improve skill of solving MCQ’s and understand the content to be focussed more upon. Even perception of faculty for feedback showed better learning process for students with conceptual understanding of topic, motivates weak students to come forward to communicate [3]. Hepplestone based on online feedback found that students expressed difficulty in feeding understanding and forwarding comments made on their work to future assignments or between modules [19]. Paul O et al., recommended that student’s feedback could be linked to ‘feed-forward’ by making clarity in structural progression and feedback [20].

In our study, 71.4% students found feedback a relaxed way of learning with interactive and supportive environment. 72.1% students accepted that feedback provides good compatibility with instructor, while 70.5% agreed to have good interaction with peer. Weaver MR showed in his study, that large majority of students felt positive feedback to be very important and confirmed that it increased their confidence [21]. Thus, more balanced feedback should be ensured to motivate rather discourage students. Havnes A et al., study found peer students help was more useful than from a teacher [22]. While teachers in their study expressed concern on various aspects including students capability to respond to feedback whether the students were interested or able to follow up feedback they received. Some researchers found feedback a helpful tool to build trust in the instructor other than motivate faculty to write better MCQ’s for further assessment [3]. Archer JC study showed that feedback enabled students to make their own revisions through dialogue, helps students to gain new understandings without dictating what these understanding will be [23]. Although, Martens R et al., found no difference in students performance as per the way of feedback provided [24].

Gender difference emerged for some of the perception and preferences, with male and female differing significantly across all measures pertaining to this: female students had strong agreement with the identification of the mistakes from the feedback with better clarification of doubts and better reasoning for key answers. Other than this female student significantly agreed that feedback helped them study seriously and increased their internal grades compared male students. They also enjoyed feedback method and appreciated facilitator for explaining concept which led to good compatibility with the instructor. It is difficult to compare the present gender findings to previous studies of Rucker ML and Thomson S because of the measurement of different constructs [25]. However, Rowe and Wood did show some of the similarity with our results as far as satisfaction with the amount of feedback or type of feedback are concerned [12].

Limitation

A time constraint was the major limitation which forced author to conduct feedback after completion of five to six lecture sessions, rather than after each lecture.

Conclusion

The present study illustrates students perceptions about the implementation of newer approach of providing feedback after continuous formative assessment. It shows improvement in student learning outcome and experience. The survey and FGD presented students reflection for the process specifying that concepts were clarified and they were able to identify their mistake which is statistically proven to be significant for the study. The findings highlight the importance of this method since students agreed that they could remember things by discussion and had idea about the type of questions asked during exam.

Way the students perceives the taught context and the way they approach learning affects their learning outcome thus it is important to know the students approach to teaching, learning and feedback methodology. Indian medical institutes are increasingly recognizing feedback as mode to improve their teaching ratings. Future direction for research is to further explore the relationship between student’s preferences and approaches to learning. Improving the methodology of feedback in present setup is another promising area of investigation were students are taught skill of self and peer assessment since, it develops the self-regulation skill necessary for using any feedback.

Test Applied: Significant t-test

References

[1]Gilkar SA, Lone S, Lone RA, Introduction of active learning method in learning physiology by MBBS students Int J App Basic Med Res 2016 6(3):186-190.  [Google Scholar]

[2]Singh V, Kharb P, A paradigm shift from teaching to learning gross anatomy; meta-analysis of implication for instructional methods Journal of the Anatomical Society of India 2013 62:84-89.  [Google Scholar]

[3]Dulloo P, Nazwani N, Analysing the role and relevance of feedback in Medical Education Indian J App Res 2015 5(5):19-24.  [Google Scholar]

[4]Srivastava TK, Waghmare LS, Vagha SJ, Revisiting feedback practices in formative assessment of Indian Medical schools National J Physiol Pharma Pharmacol 2015 5(1):01-04.  [Google Scholar]

[5]McIlwrick J, Nair B, Montgomery G, “How Am I doing?” Many problems but few solutions related to feedback delivery in undergraduate Psychiatry Education Acad Psychiatry 2006 30(2):130-135.  [Google Scholar]

[6]Nicol DJ, Dick DM, Formative assessment and self-regulated learning: A model and seven principles of good feedback practice Studies in Higher Education 2006 31(2):199-18.  [Google Scholar]

[7]Sichinga KT, Mfuni JHC, Nenty HJ, Chakalisa P, Factors influencing quality of feedback in teaching in Botswana Senior secondary schools Int J Res Social Sci 2014 4(1):26-37.  [Google Scholar]

[8]Sardhana G, Teacher’s ability in Continuous and Comprehensive Evaluation System Int J Sci Res 2016 5(10):454-57.  [Google Scholar]

[9]Kerdij KW, Tio RA, Mulder BF, Schotanus JC, Cumulative assessment strategic choices to influence students study effort BMC Med Edu 2013 13:172  [Google Scholar]

[10]Larsen DP, Butter AC, Roediger HL, Repeated testing improves long-term retention relative to repeated study: a randomized controlled trial Med Edu 2009 43(12):1174-181.  [Google Scholar]

[11]Roediger HL, Karpicke JD, The power of testing memory: basic research and implication for educational practice Perspect Psychol Sci 2006 1(3):181-210.  [Google Scholar]

[12]Rowe DA, Wood NL, Student perceptions and preference for feedback Asian Social Science 2008 4(3):78-89.  [Google Scholar]

[13]Duffield KE, Spensor JA, A survey of medical students view about the purposes and fairness of assessment Med Edu 2002 36(9):879-86.  [Google Scholar]

[14]Crisp BR, Is it worth the effort? How feedback influences students subsequent submission of assessable work Assessment and Evaluation in Higher Education 2007 32(5):571-81.  [Google Scholar]

[15]Price M, Handley K, Millar J, O’Donovan B, Feedback: all that effort, but what is the effort? Assessment and Evaluation in Higher Education 2010 35(3):277-89.  [Google Scholar]

[16]Hernander R, Does continuous assessment in higher education support student learning? Higher Education 2012 64:489-502.  [Google Scholar]

[17]Doan L, Is feedback a waste of time? The students perspective Journal of Perspetives in Applied Academic Practice 2013 1(2):03-10.  [Google Scholar]

[18]Goel K, Ellis B, Does feedback enhance learning? Regional students perception and experiences of feedback in a social work program ATN assessment Conference 2011: Meeting challenges: Standards, Leadership, Practical solutions, students Engagement 2011 :98-106.  [Google Scholar]

[19]Hepplestone S, Parkin H, Holden G, Irwin B, Thorpe L, Technology, feedback, Action! The impact of learning technology upon students engagement with their feedback Higher Education Academy: 2009. Enhancing learning through technology research project. 08/09   [Google Scholar]

[20]Paul O, Stephen M, Kevin R. The student use of tutor formative feedback in their learning. Paper presented at the Learning Communities & Assessment Cultures Conference organized by the EARLI Special Interested Group on Assessment and Evaluation, University of Northumbrian 28-30August2002. Education-Online, Oct.2002. Available at www.leeds.ac.uk/educol/documents/00002233.htm  [Google Scholar]

[21]Weaver MR, Do students value feedback? Student perceptions of Tutors’ written responses Assessment and Evaluation in Higher Education 2006 31(3):01-12.  [Google Scholar]

[22]Havnes A, Smith K, Dysthe O, Ludvigsen K, Formative assessment and feedback: Making learning visible Studies in Educational Evaluation 202 38:21-27.  [Google Scholar]

[23]Archer JC, State of the science in health professional education: Effective feedback Medical Education 2010 44(1):101-08.  [Google Scholar]

[24]Martens R, de Brabander C, Rozendaal J, Boekaerts M, Vander LR, Inducing mindsets in self-regulated learning with motivational information Educational studies 2010 36(3):311-27.  [Google Scholar]

[25]Rucker ML, Thomas S, Assessing students learning outcome. An investigation of the relationship among feedback measures College Student Journal 2003 37(3):400-04.  [Google Scholar]