Background
Methods
Study design
Eligibility criteria and outcome variables
Search strategies
Quality assessment
Joanna Briggs Institute of Critical Appraisal Tools Checklist for Checklist for Randomized Controlled Trials | Total score | Range | ||||||||||||||
Study ID | Q1 | Q2 | Q3 | Q4 | Q5 | Q6 | Q7 | Q8 | Q9 | Q10 | Q11 | Q12 | Q13 | |||
3 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||
7 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 7 | ||
8 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||
11 | 1 | 0 | 1 | 1 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 9 | ||
12 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 7 | ||
13 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 8 | ||
14 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 8 | ||
16 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 8 | ||
20 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||
21 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 8 | ||
23 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 8 | ||
Total | 9 | 0 | 11 | 1 | 0 | 11 | 0 | 11 | 11 | 11 | 11 | 3 | 11 | 8.18 | 7–9 | |
Joanna Briggs Institute of Critical Appraisal Tools Checklist for Quasi-experimental study | Total score | Range | ||||||||||||||
Study ID | Q1 | Q2 | Q3 | Q4 | Q5 | Q6 | Q7 | Q8 | Q9 | |||||||
1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 8 | ||||||
2 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 6 | ||||||
4 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||||||
5 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||||||
6 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 6 | ||||||
9 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 8 | ||||||
10 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||||||
15 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 8 | ||||||
17 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 8 | ||||||
18 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 7 | ||||||
19 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||||||
22 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 7 | ||||||
24 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||||||
25 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 9 | ||||||
Total | 14 | 10 | 14 | 14 | 14 | 7 | 14 | 14 | 11 | 8.00 | 6–9 |
Selection process
Data analysis and statistical methods
Results
Study selection
Study characteristics
Risk of bias in studies
Effect of simulation-based intervention on empathy
Variables | Category | K | Study ID | N | Hedge’s g | 95% CI | Z | p | ||
---|---|---|---|---|---|---|---|---|---|---|
Lower limit | Upper limit | |||||||||
Year | < 2019 | 13 | 2, 6, 8, 13, 14, 15, 17, 18, 20, 21a, 21b, 21c, 21d | 987 | 0.13 | −0.24 | 0.50 | 0.67 | 0.504 | |
≥ 2019 | 15 | 1, 3, 4, 5, 7, 9, 10, 11, 12, 16, 19, 22, 23, 24, 25 | 1611 | 0.52 | 0.31 | 0.73 | 4.93 | < 0.001 | ||
2 | 7 | 2, 5, 12, 13, 15, 16, 25 | 461 | 0.62 | 0.24 | 0.99 | 3.23 | 0.001 | ||
IRB | No | 5 | 3, 11, 14, 16, 25 | 829 | 0.20 | −0.21 | 0.61 | 0.94 | 0.346 | |
Yes | 23 | 1, 2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 15, 17, 18, 19, 20, 21a, 21b, 21c, 21d, 22, 23, 24 | 1769 | 0.39 | 0.15 | 0.62 | 3.24 | 0.001 | ||
Research design | Quasi-E | 14 | 1, 2, 4, 5, 6, 9, 10, 15, 17, 18, 19, 22, 24, 25 | 1241 | 0.51 | 0.27 | 0.74 | 4.19 | < 0.001 | |
RCT | 14 | 3, 7, 8, 11, 12, 13, 14, 16, 20, 21a, 21b, 21c, 21d, 23 | 1357 | 0.19 | −0.14 | 0.51 | 1.13 | 0.258 | ||
Participants | < 60 | 15 | 2, 3, 8, 10, 12, 13, 14, 17, 18, 21a, 21b, 21c, 21d, 24, 25 | 923 | 0.41 | 0.06 | 0.75 | 2.33 | 0.020 | |
≥ 60 | 13 | 1, 4, 5, 6, 7, 9, 11, 15, 16, 19, 20, 22, 23 | 1675 | 0.31 | 0.02 | 0.59 | 2.12 | 0.034 | ||
Intervention type | Simulation | 13 | 1, 2, 3, 4, 6, 7, 8, 10, 11, 13, 18, 23, 24 | 1313 | 0.43 | 0.22 | 0.65 | 4.01 | < 0.001 | |
Role-play | 15 | 5, 9, 12, 14, 15, 16, 17, 19, 20, 21a, 21b, 21c, 21d, 22, 25 | 1285 | 0.25 | −0.12 | 0.62 | 1.34 | 0.181 | ||
Control group intervention | No or usual | 21 | 1, 3, 4, 6, 7, 8, 9, 10, 11, 15, 16, 17, 20, 21a, 21b, 21c, 21d, 22, 23, 24, 25 | 1876 | 0.30 | 0.08 | 0.53 | 2.60 | 0.009 | |
Comparison | 7 | 2, 5, 12, 13, 14, 18, 19 | 722 | 0.51 | −0.06 | 1.08 | 1.76 | 0.078 | ||
Intervention duration | Not reported or < 4weeks | 17 | 1, 6, 8, 10, 12, 14, 16, 18, 19, 20, 21a, 21b, 21c, 21d, 22, 23, 25 | 1537 | 0.27 | −0.05 | 0.58 | 1.67 | 0.095 | |
≥ 4weeks | 11 | 2, 3, 4, 5, 7, 9, 11, 13, 15, 17, 24 | 1061 | 0.47 | 0.21 | 0.72 | 3.56 | < 0.001 | ||
Intervention time/session | Not reported or < 1 h | 16 | 1, 2, 6, 7, 8, 9, 10, 11, 12, 13, 21a, 21b, 21c, 21d, 22, 23 | 1245 | 0.42 | 0.20 | 0.63 | 3.74 | < 0.001 | |
≥ 1 h | 12 | 3, 4, 5, 14, 15, 16, 17, 18, 19, 20, 24, 25 | 1353 | 0.28 | −0.10 | 0.66 | 1.44 | 0.150 | ||
Outcome measurement time | Immediately | 26 | 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13, 14, 15, 16, 18, 19, 20, 21a, 21b, 21c, 21d, 22, 23, 24, 25 | 2490 | 0.38 | 0.16 | 0.60 | 3.35 | 0.001 | |
Delayed | 2 | 10, 17 | 108 | −0.01 | −0.61 | 0.59 | −0.04 | 0.968 | ||
Outcome Follow up | No | 18 | 1, 3, 4, 5, 6, 7, 9, 10, 11, 12, 13, 14, 15, 18, 19, 22, 24, 25 | 2005 | 0.45 | 0.22 | 0.68 | 3.78 | < 0.001 | |
Yes | 10 | 2, 8, 16, 17, 20, 21a, 21b, 21c, 21d, 23 | 593 | 0.16 | −0.33 | 0.65 | 0.63 | 0.528 | ||
Pre-briefing | No | 22 | 1, 2, 3, 6, 7, 8, 9, 12, 13, 14, 16, 17, 18, 19, 20, 21a, 21b, 21c, 21d, 22, 23, 24 | 1862 | 0.31 | 0.05 | 0.57 | 2.31 | 0.021 | |
Yes | 6 | 4, 5, 10, 11, 15, 25 | 736 | 0.50 | 0.13 | 0.88 | 2.61 | 0.009 | ||
Debriefing | No | 14 | 7, 11, 12, 13, 16, 18, 19, 20, 21a, 21b, 21c, 21d, 22, 23 | 1169 | 0.22 | −0.10 | 0.54 | 1.35 | 0.178 | |
Yes | 14 | 1, 2, 3, 4, 5, 6, 8, 9, 10, 14, 15, 17, 24, 25 | 1429 | 0.48 | 0.18 | 0.78 | 3.14 | 0.002 | ||
Quality score | < Mean | 14 | 2, 6, 7, 12, 13, 14, 16, 18, 21a, 21b, 21c, 21d, 22, 23 | 1338 | 0.28 | 0.02 | 0.55 | 2.11 | 0.035 | |
≥Mean | 14 | 1, 3, 4, 5, 8, 9, 10, 11, 15, 17, 19, 20, 24, 25 | 1260 | 0.43 | 0.08 | 0.77 | 2.40 | 0.016 |
Covariates (Ref.) | Estimate | SE | 95% CI | Z | p | |
---|---|---|---|---|---|---|
Lower limit | Upper limit | |||||
Year (Ref.: <2019) | 0.01 | 0.00 | 0.00 | 0.02 | 2.25 | 0.024 |
IRB (Ref.: No) | 0.45 | 0.09 | 0.28 | 0.62 | 5.25 | < 0.001 |
Research design (Ref.: Quasi-E) | −0.43 | 0.08 | −0.58 | −0.27 | −5.32 | < 0.001 |
Participants (Ref.: <60) | 0.17 | 0.08 | 0.01 | 0.33 | 2.06 | 0.040 |
Intervention type (Ref.: Simulation) | −0.19 | 0.08 | −0.35 | −0.03 | −2.39 | 0.017 |
Control group intervention (Ref.: No or usual) | 0.33 | 0.15 | 0.04 | 0.63 | 2.21 | 0.027 |
Intervention time/session (Ref.: not reported or < 1 h) | −0.03 | 0.09 | −0.21 | 0.15 | −0.32 | 0.746 |
Intervention duration (Ref.: not reported or < 4weeks) | 0.17 | 0.08 | 0.01 | 0.33 | 2.12 | 0.034 |
Outcome measurement time (Ref.: Immediately) | −0.27 | 0.20 | −0.66 | 0.12 | −1.37 | 0.172 |
Outcome Follow up (Ref.: No) | −0.16 | 0.09 | −0.34 | 0.02 | −1.70 | 0.089 |
Pre-briefing (Ref.: No) | 0.12 | 0.09 | −0.05 | 0.29 | 1.36 | 0.173 |
Debriefing (Ref.: No) | −0.06 | 0.08 | −0.22 | 0.10 | −0.73 | 0.465 |
Quality score (Ref.: < mean) | 0.14 | 0.08 | −0.02 | 0.30 | 1.73 | 0.083 |
Study ID | K | Hedge’s g | 95% CI | Z | p | |
---|---|---|---|---|---|---|
Lower limit | Upper limit | |||||
1 | 27 | 0.36 | 0.14 | 0.58 | 3.22 | 0.001 |
2 | 27 | 0.34 | 0.12 | 0.55 | 3.07 | 0.002 |
3 | 27 | 0.35 | 0.13 | 0.57 | 3.13 | 0.002 |
4 | 27 | 0.36 | 0.13 | 0.58 | 3.08 | 0.002 |
5 | 27 | 0.32 | 0.11 | 0.52 | 2.96 | 0.003 |
6 | 27 | 0.37 | 0.14 | 0.59 | 3.24 | 0.001 |
7 | 27 | 0.34 | 0.12 | 0.56 | 3.05 | 0.002 |
8 | 27 | 0.31 | 0.10 | 0.52 | 2.94 | 0.003 |
9 | 27 | 0.35 | 0.14 | 0.57 | 3.17 | 0.002 |
10 | 27 | 0.36 | 0.14 | 0.57 | 3.19 | 0.001 |
11 | 27 | 0.37 | 0.15 | 0.59 | 3.27 | 0.001 |
12 | 27 | 0.36 | 0.14 | 0.57 | 3.22 | 0.001 |
13 | 27 | 0.34 | 0.13 | 0.56 | 3.11 | 0.002 |
14 | 27 | 0.38 | 0.18 | 0.59 | 3.65 | 0.000 |
15 | 27 | 0.36 | 0.14 | 0.58 | 3.17 | 0.002 |
16 | 27 | 0.37 | 0.14 | 0.59 | 3.24 | 0.001 |
17 | 27 | 0.38 | 0.16 | 0.59 | 3.43 | 0.001 |
18 | 27 | 0.37 | 0.15 | 0.58 | 3.29 | 0.001 |
19 | 27 | 0.33 | 0.12 | 0.54 | 3.02 | 0.003 |
20 | 27 | 0.42 | 0.23 | 0.61 | 4.26 | 0.000 |
21a | 27 | 0.36 | 0.14 | 0.58 | 3.26 | 0.001 |
21b | 27 | 0.34 | 0.13 | 0.56 | 3.10 | 0.002 |
21c | 27 | 0.37 | 0.16 | 0.59 | 3.41 | 0.001 |
21d | 27 | 0.36 | 0.14 | 0.58 | 3.27 | 0.001 |
22 | 27 | 0.33 | 0.12 | 0.54 | 3.03 | 0.002 |
23 | 27 | 0.36 | 0.13 | 0.58 | 3.11 | 0.002 |
24 | 27 | 0.33 | 0.12 | 0.54 | 3.03 | 0.002 |
25 | 27 | 0.33 | 0.11 | 0.54 | 3.00 | 0.003 |
Effect of an intervention program on secondary outcomes
Variables | K | Study ID | N | Hedge’s g | 95% CI | Z | p | |
---|---|---|---|---|---|---|---|---|
Lower limit | Upper limit | |||||||
Empathic communication | 6 | 4, 5, 7, 17, 24, 25 | 595 | 1.35 | 0.25 | 2.45 | 2.40 | 0.016 |
Interpersonal relationship | 9 | 4, 5, 8, 9, 16, 21a, 21b, 21c, 21d | 606 | 0.52 | 0.21 | 0.84 | 3.25 | 0.001 |
Competency | 9 | 9, 11, 12, 15, 16, 21a, 21b, 21c, 21d | 591 | 0.75 | 0.24 | 1.26 | 2.90 | 0.004 |