Background
At the beginning of the 21st-century, deficiencies of healthcare safety and quality were highlighted by the Institute of Medicine [
1]. One of the primary aims of healthcare organizations is to furnish patients with high-quality and safe care [
2]. This imperative stems from reports indicating that millions of patients worldwide suffer disability or death each year due to unsafe medical practices. Moreover, caregiver infractions against patient safety can impose significant financial burdens on patients [
3]. Upholding the purpose to protect medical care deficiencies, a fresh competency framework for all health careers to provide patient-centered care and improve the safety and quality of patients’ care was put forward by the IOM in the early 2003 [
4]. Nurses are pivotal in the healthcare service system, constituting the foremost group in accomplishing the goal of providing quality and safe care to patients [
2].However, the nursing errors or deficiency remain high among newly graduated nurses. For instance, 86 nursing errors were reported from 42 new nurses by Zhang [
5]. A study by Treiber and Jones also revealed that approximately 55% of newly admitted nurses committed nursing errors within the initial five years of their clinical careers [
6]. Thus, the competency based quality and safety education for nurses has been correspondingly developed, which is consistent with the mission of IOM [
7]. In the early 2005, the initiative was launched to establish the national competency framework for Quality and Safety Education for Nurses (QSEN) by the reputed organization of American Association of Colleges of Nursing (AACN) [
1].The QSEN framework was respond to quality and safety concerns by providing the foundational knowledge, skills and attitudes to ensure that nurses provide quality and safe care in their daily practice [
8]. Furthermore, over the past decade or so, this competency-based framework has been integrated into the curricula of nursing programs in numerous countries [
9].
McClelland, an American psychologist, initially referred competency to the knowledge, attitudes, skills and traits that affected the job performance of an individual [
10]. The globally renowned Knowledge, Skills, and Attitudes (KSA) model, proposed by Benjamin Bloom [
11], has found widespread application in the human resource management industry for assessing employees’ competency [
11,
12]. In the field of nursing, the competencies of QSEN involve a complete set of knowledge, skills, and attitudes as the chief tactics that effectively apply competencies including patient-center care, safety, evidence-based practice, collaboration and teamwork, continuous quality improvement, and informatics [
7], which is based on KSA model [
9]. The QSEN competency framework was initially developed for prelicensed nursing students with the purpose of establishing minimum standards for secure clinical settings safety and high-quality practice [
7]. However, the development of the comprehensive QSEN competency assessment scale to assess graduated bachelor nursing students (BNS) experienced a long history upon the completion of this study.
At the beginning, Cronenwett, et al. [
7] recruited 16 universities among the USA to clarify the definitions associated with the six dimensions of QSEN ability components and the guidelines of overall teaching courses for prelicensure nursing students at graduation. Soon after, Barton, et al. [
13] performed a Delphi among the USA for consensus regarding varied QSEN abilities to be included in teaching courses. At last, a total of 162 QSEN abilities were obtained from 18 nursing experts among 16 states. Simultaneously, Sullivan, et al. [
14] conducted a survey in 17 universities among 565 students to develop a nursing students assessment tool regarding the preparation and importance of these QSEN abilities. This tool was named as QSEN of student evaluation survey (QSEN-SES), which included 19 items of learned contents in the knowledge dimension; while in the skill dimension, it was composed of 22 items of skill preparedness; and in the attitude dimension, it was comprised of 22 items. Additionally, the results confirmed that QSEN competencies were important for the further work of most of the nursing students. However, this scale did not test the psychometric property.
Later, Pauly-O’Neill, et al. [
15] conducted a study to assess the QSEN competencies of BNS using the observational checklist tool, but there was also no psychometric property reported for this tool. At the same time, Piscotty, et al. [
16] developed BSN Quality and Safety Self-Inventory (QSSI) with two dimensions and 18 items. Although QSSI featured acceptable validity and reliability, it failed to reflect the QSEN framework through six components.
The utilization of the QSEN framework was not only implemented in the USA, but also in the South Korean. Lee, et al. [
17] assessed the evaluation methods and contents of the QSEN competencies of nursing students. They translated and modified the QSEN-SES of Sullivan, et al. [
14] into a Korean version. However, the Korean version of QSEN-SES only reported the content validity, and there was no other psychometrics report.
Additionally, Nygårdh, et al. [
18] applied the QSEN framework to create the competency tool of QSEN in Sweden. According to previously reported results, three main dimensions were chosen to present the QSEN competencies by Nygårdh, et al. [
18]. The reliability of the Swedish version of the QSEN instrument was compared with the reliability of the instrument of Cronenwett et al. [
7], but its validity and internal consistency reliability were not evaluated.
More recently, based on the QSEN framework, Liu, et al. [
19] conducted an e-Delphi study in China to develop indicators for evaluating the QSEN competencies of BNSs at their graduation. Through three rounds of e-Delphi with 22 experts, consensus was achieved regarding 88 indicators in six dimensions among these experts that a comprehensive indicator could be used to formulate the curriculum and teaching content, while it could not be used as the assessment tool to measure newly graduated nurses’ quality and safety competencies (QSC). Therefore, further efforts were required to develop the assessment tool.
Through the history of QSEN competency development, it can be noticed that various countries have recognized the importance of formulating the QSEN competencies of nursing students to provide safety and quality nursing care to patients in their future work. However, there is an obvious deficiency between the requirement of an assessment tool and QSEN [
20]. Besides, in the nursing discipline, the students achieving baccalaureate are regarded as the leading workforce in the clinical practice [
21], but no Competency Scale of Quality and Safety (CSQS) has been found to measure their QSC when they are graduated, making it necessarily important to develop an assessment tool to evaluate the QSC of the pre-licensed BNSs using the QSEN framework. To this end, the present study was carried out to develop the evaluation scale and measure the QSC of BNSs upon their graduation.
Discussion
In the current clinical environment, it is of great value to keep the quality and safety of healthcare services. Based on the QSEN competency framework and the common view of Chinese experts, six dimensions of QSC were hereby formed, which were congruent with previous academic claims [
7,
18]. Additionally, it was also known as the first valid and reliable scale developed globally to measure the QSC of newly graduated nurses with bachelor degree.
The development of CSQS items ensued from meticulous scrutiny, integrating insights derived from an extensive literature review and three iterative rounds of e-Delphi. During the initial e-Delphi round, definitions pertaining to QSC and its six dimensions were distilled from semi-structured questionnaires, drawing upon the expertise of Chinese professionals and aligning with the QSEN competency framework [
7,
8]. Subsequent rigorous evaluations across the second and third e-Delphi rounds yielded a refined set of 88 items, meeting stringent criteria (IR ≤ 1.5, median ≥ 3.5, and CLA ≥ 70%) [
22]. This meticulous process secured agreement from Chinese experts, affirming the suitability of these items for evaluating the quality and safety competencies of BNSs.
In the second phase, the psychometric properties of CSQS were tested through four steps including CVI testing, pre-testing CSQS, CFA testing, and test-retest reliability. The purpose of conducting CVI testing was to assess the ability of the instrument’s items to effectively capture the specific constructs of interest [
25]. With both S-CVI/Ave and I-CVI meeting the criteria outlined by Polit et al. [
24], it is evident that the constructs of CSQS adequately reflect the QSC of BNSs. In order to ensure the readability of CSQS for participants, a pretesting phase was implemented. Results indicated that the items within CSQS were easily comprehensible, exhibiting an initial high level of intrinsic consistency (ICR value > 0.8) [
24]. Prior to performing CFA, item analysis was conducted. This analysis identified 24 items with excessively high ITC scores (over 0.7), suggesting redundancy and the potential for participant fatigue [
25,
33]. Consequently, these items were removed. Subsequently, the CFA conducted on the remaining 64 CSQS items supported the final modified model with empirical data and all items’ factor loadings exceeding 0.3 [
30]. Thus, the six dimensions of the final 64-item CSQS demonstrated satisfactory construct validity. Furthermore, the ICR value of the final CSQS was notably high, with both the total scale and each dimension’s score surpassing 0.8 [
23], indicating a homogeneous reflection of the overarching construct of QSC. Moreover, the stability of the final CSQS was confirmed, with the total scale’s score exceeding 0.8 [
23]. Based on the average scores of the six dimensions ranked in descending order, they were discussed in an orderly manner as follows.
Safety competency is defined as the knowledge, skills, and attitudes of BNSs in the future clinical work to grasp nursing technology and knowledge, abide by hospital regulations and rules, standardize nursing operations, protect patients and themselves from injury, or minimize the risk of injury during their practice or clinical work. Nygårdh, et al. [
18] also proposed that nursing students should avoid risk factors while implementing patient care, which was consistent with the present findings. Furthermore, the World Health Organization’s (WHO) World Alliance for Patient Safety endeavors to incorporate patient safety courses into curricula worldwide, with the goal of instructing medical and nursing students in risk management [
34]. Hence, the enhancement of patient safety can commence with the education of students [
35].
In addition, from patient admission to discharge, nurses spend the most time to communicate and contact with patients and play a key role in protecting their rights and security, which makes nurses one of the high-risk groups of occupational exposure. Thus, efforts should be made not only to ensure the safety of patients, but also the occupational safety of nurses. In this developed measurement tool, the content related to the occupational safety of nurses was included, which was consistent with the results of Qaraman, et al. [
36], who also stressed the necessity of providing training concerning occupational health and safety for nursing students by setting up appropriate courses.
Additionally, in this study, safety competency garnered the highest average score among the six dimensions. This outcome could be attributed to nursing schools placing greater emphasis on patient safety education for nursing students, addressing perspectives from both patients and nurses. Educational institutions typically aim to instill safety competencies in nursing students by providing training in both patient and occupational safety [
37]. Furthermore, teaching hospitals often enhance nursing students’ safety competency through the implementation of patient safety education programs [
38] and occupational health training [
39]. However, it’s noteworthy that the item pertaining to “Handling specialist resuscitation procedures and being capable of performing resuscitation work” received the lowest score within this dimension. Hence, there’s a pressing need to enhance students’ proficiency in resuscitation workflows and complex problem-solving skills [
40].
The competency of collaboration and teamwork refers to the knowledge, skills, and attitudes of BNSs in further clinical work to collaborate with multidisciplinary team members and play their duty role in the group, such as coordinating with team members, improving team member communication, and making the decision with patients together. In addition to doctors, nurses and patients, the chief nurses, other nursing staff, patients’ families, nutritionists and cleaners should also be included as team members. This dimension was previously brought up [
41]. Taking the operating room team as an example, it is crucial to improve the team cooperation ability of all members for the successful achievement of the goal. In their study, Burke et al. [
42] highlighted coordination, cooperation, and collaboration as fundamental focal points essential for shaping and executing integrated care models. In China, Li and Wang [
43] also highlighted the importance of helping nursing students master cooperation and teamwork skills, and learn how to communicate with both their peers and patients. This dimension’s high average score could be attributed to the widespread adoption of the “problem-oriented” teaching method in China. This approach encourages students to collaborate in groups to analyze and resolve issues, thereby fostering the development of communication, collaboration, and teamwork competencies [
44].
The definition of “Patient-centered Care” is referred to as the knowledge, skills, and attitudes of BNSs mastered to provide humanistic care and effective communication with patients, satisfy patient needs, and guide or care patients or their families to involve self-care activities in their future clinical work. Charette, et al. [
45] also mentioned this domain in their study. The significance of patient-centered care has grown substantially, as it correlates with enhanced quality of care [
46]. Studies have demonstrated that patient satisfaction rises when students exhibit a positive outlook towards patient-centered care [
47]. In nursing specialty courses, educators typically underscore the importance of prioritizing patient-centered care. Consequently, this dimension received a relatively high average score. However, the item pertaining to “correctly assessing the physical, spiritual, psychological, cultural, and social needs of patients” scored the lowest. This could be attributed to nursing students’ deficiency in evaluating patients as holistic individuals [
48]. Thus, nursing students should be encouraged to carry out holistic and patient-centered nursing care and adapt to the varieties from person to person. Schools or hospital managers should also set up courses or provide an environment to help students develop their comprehensive humanistic and cultural nursing care abilities in their future work.
Informatics competency refers to the knowledge, skills, and attitudes of BNSs in the future clinical work to obtain and utilize information to implement management, provide nursing care, conduct scientific research, and improve the progress of nursing care. The hereby obtained results were in line with those proposed by Nygårdh, et al. [
18]. Given the pervasive integration of information technologies into the healthcare system [
49], nurses, comprising the majority of the workforce in the health sector, require proficient nursing informatics skills [
50]. Chinese nursing educators have developed the information literacy of students by setting up the section of information management in the
Nursing Management textbook [
37]. The item concerning “making correct decisions about relatively complex care issues based on the retrieval of relevant information” received the lowest score. This could be attributed to nursing students’ insufficient mastery of information retrieval skills and their ineffective utilization of health information [
51,
52]. Consequently, integrating nursing informatics, particularly for the retrieval of relevant nursing care information, into undergraduate nursing education can enhance nurses’ capability to leverage technology in addressing patients’ complex issues. This, in turn, empowers them to deliver high-quality nursing care.
Evidence-based practice (EBP) competency is defined as the knowledge, skills, and attitudes of BNSs in the future clinical work, which can effectively integrate the clinical opinions of the experts as well as the most effective empirical evidence in clinical nursing care. These findings were consistent with those of the study by Nygårdh, et al. [
18], who proposed that it was vital to provide best care on the basis of evidence-based nursing practice. The ability of evidence-based nursing practice can help nursing students solve complicated clinical problems by using evidence instead of subjective judgment in their practice or future work [
53,
54]. However, the item regarding “describing the meaning of evidence-based nursing care” obtained the lowest score within this dimension. This could be attributed to EBP being a core course primarily for master’s degree nursing students, with less emphasis on undergraduate education [
55]. The findings underscored by Adamakidou et al. [
56] highlight the imperative of enhancing nurses’ competence in EBP through education, suggesting that introducing EBP education at the undergraduate level to raise awareness among nursing students is a foundational step. Therefore, nursing educators should impart sufficient knowledge of EBP to bachelor of nursing students and train them to apply EBP principles in resolving patients’ clinical issues.
The definition of continuous quality improvement competency is the knowledge, skills, and attitudes of BNSs in the future clinical work, who are required to be clear about the evaluation criteria and methods of nursing quality, use them to monitor the nursing process, and be able to perform improvement methods to continuously enhance the nursing care quality and safety. Cronenwett, et al. [
7] and Nygårdh, et al. [
18] also stated the same conclusion. This dimension exhibited the lowest average score among the six dimensions. Notably, the item addressing “describing continuous quality improvement methods such as Deming Circle, Root Cause Analysis, and Quality Control Circle” received the lowest rating within this dimension. This could be attributed to BNSs’ limited clinical experience [
57]. Furthermore, the abstract nature of the content related to quality improvement methods might pose challenges for these students in comprehension and application [
57]. Additionally, researches have consistently indicated that both students and newly graduated registered nurses tend to score lower on quality improvement compared to other QSEN competencies since the inception of QSEN in 2005 [
14,
58]. However, it is crucial to underscore that the advancement of patient safety hinges on the knowledge of quality improvement among clinical frontline staff [
59]. Thus, it is necessary for nursing students to master the relevant concepts and measures of quality improvement, such as some nursing quality management methods designed in Chinese nursing management courses, including the plan-do-check-act (PDCA) cycle, root cause analysis (RCA), and clinical pathway (CP) [
37]. Besides, cultivating the competency of continuous quality improvement enables nursing students to be aware of the importance of continuous quality improvement as part of their daily work, which may encourage them to get continuously involved in quality improving activities.