The results section will present findings from the study’s quantitative and qualitative components. The integration of the two data types is described after each qualitative finding.
Quantitative findings
We analyzed the data of 67 participants, representing a 73.6% response rate. The mean age was 21.0 years old (SD 0.73) and 36.4% were male students. See Table
3 for more details.
Table 3
Description of sample characteristics (N = 67)
Age | 21.96 (0.73) |
Gender | |
Male Female | 16 (23.9%) 51 (76.1%) |
Residence | |
In campus Out campus | 46 (68.7%) 21 (31.3%) |
Year in the program | |
Fourth Fifth | 37 (55.2%) 30 (44.8%) |
Cumulative GPA* | |
Less or equal to 3 More than 3 | 33 (49.2%) 33 (49.2%) |
The descriptive analysis showed that the mean value of the perceived efficacy of case analysis as an assessment method was 3.20 (SD = 0.53), demonstrating an 80% agreement rate. Further analysis indicated that 78.5% of the students concurred the acceptability of case analysis as an assessment method (mean = 3.14, SD = 0.58) and 80.3% (m = 3.21, SD = 0.60) assented the clinical competencies associated with it.
For the items representing acceptability, 81.8% of the students agreed that the case analysis was written clearly, and 80.3% reported that it was well organized. As per the questions, 81% described they were appropriate to their level, and 79.8% agreed upon their alignment with the course objectives. Moreover, the time allocated was adequate for 74.5% of the students, and 73.5% recommend using case analysis as an evaluation strategy for other clinical written examinations.
Regarding the clinical competencies, 77.3% of students agreed that the case analysis motivated them to prepare well for the exam, 81.3% reported that it encouraged them to be active in learning, and 81.0% indicated that it stimulated their interest in the topics discussed in the course. Additionally, 76.5% of the students agreed that the case analysis encouraged them to collaborate with other students when studying for the exam. Among the students, 82.5% reported that the case analysis as an assessment method enhanced their critical thinking skills, 81.0% agreed that it helped them practice decision-making skills, and 81.8% indicated that it improved their problem-solving abilities. See Table
4.
Table 4
Perceived effectiveness and acceptability of case analysis as clinical written exam
The case analysis format was well-organized. | 3.21 | 0.71 | 80.3 |
The case analysis format was written clearly. | 3.27 | 0.67 | 81.8 |
The time allocated for answering the case analysis was adequate. | 2.98 | 0.91 | 74.5 |
The questions presented in the case analysis were aligned with the course objectives. | 3.19 | 0.74 | 79.8 |
The questions of the case analysis were appropriate to my level. | 3.24 | 0.68 | 81.0 |
The case analysis format motivated me to prepare well for the exam. | 3.09 | 0.77 | 77.3 |
The case analysis as an exam encouraged me to be active in learning. | 3.25 | 0.68 | 81.3 |
The case analysis as an exam stimulated my interest in the topics discussed in the course. | 3.24 | 0.74 | 81.0 |
The case analysis format encouraged me to collaborate with other students when studying for the exam. | 3.06 | 0.95 | 76.5 |
The case analysis enhanced my critical thinking skills. | 3.30 | 0.76 | 82.5 |
The case analysis helped me practice decision-making skills. | 3.24 | 0.78 | 81.0 |
The case analysis improved my problem-solving abilities. | 3.27 | 0.76 | 81.8 |
I recommend using case analysis as a strategy for clinical written examination. | 2.94 | 0.95 | 73.5 |
The independent t-test analysis revealed no significant difference in the perceived efficacy between students with lower and higher GPAs (t [61] = 0.05,
p > 0.05). Further analysis showed that the means of acceptability and clinical competencies were not significantly different between the lower GPA group and higher GPA group, t [62] = 0.72,
p > 0.05 and t [63] = -0.83,
p > 0.05, respectively (Table
5).
Table 5
Independent t-test to compare the means of students with lower and higher GPA
Perceived efficacy | 0.05 | 61 | 0.958 |
Acceptability | 0.72 | 62 | 0.475 |
clinical competencies | − 0.83 | 63 | 0.413 |
Qualitative findings
A total of 22 had participated in four focus groups, each group had 5–6 students. The qualitative framework analysis revealed three main findings; case analysis is a preferred assessment method to students when compared to MCQs, case analysis assesses students’ knowledge, and case analysis assesses students’ cognitive skills.
Although the case analysis was generally acceptable to students, they have repeatedly expressed a need to allocate more time for this type of exam. A student stated, “The limited time with the type of questions was a problem, …”. When further discussion was prompted to understand this challenge, we figured that students are not used to handwriting, which has caused them to be exhausted during the exam. An example is “writing is time-consuming and energy consuming in contrast to MCQs …”. These statements elucidate that the students don’t necessarily mind writing but recommend more practice as one student stated, “More experience of this type of examination is required, more examples during clinical practice are needed.” Some even recommended adopting this format with other clinical course exams by saying “It’s better to start this method from the first year for the new cohort and to apply it in all other courses.”