Construct validity of advanced practice nurse core competence scale: an exploratory factor analysis

The rising demand for healthcare services and the shortage of health professionals, especially during the COVID-19 pandemic, are putting tremendous pressure on healthcare systems [1, 2]. Therefore, it is crucial to utilize manpower efficiently to guarantee the availability of high-quality and cost-effective healthcare services. As the largest occupational group in the health sector, nursing accounts for approximately 59% of health occupations [1]. One of the effective approaches is to make greater use of nurses in advanced practice [3, 4]. Advanced practice is a contemporary term emphasizing the progressive movement of graduate education within nursing [5]. The minimum entry requirement to advanced practice nursing roles is a master’s degree, helping advanced practice nurses (APNs) in more advanced practice activities including, education, management, leadership roles, policy, and research [6]. It is well documented that APNs have contributed significantly to improving patient care and outcomes and reducing healthcare costs [7, 8]. Implicated by the positive relationship between competence and performance [9, 10], clarifying and improving the core competencies of APNs could fundamentally optimize the implementation and impact of their roles. The APN core competencies in the Hong Kong context were developed by the Hong Kong Academy of Nursing (HKAN) [11]. However, to the best of our knowledge, they have not been validated to date. Internationally, achieving greater consistency among advanced practice nursing role competencies across countries is identified as an essential strategy for supporting the global development, effectiveness and impact, and geographic mobility of these roles [12]. Establishing a validated set of core APN competencies that are relevant to the healthcare contexts of Hong Kong is essential for the future development of the role in this region and for assessing competency alignment with the global advanced practice nursing community. Thus, this study set out to determine the construct validity of the proposed APN core competence scale.

The International Council of Nurses (ICN) [3] defines the APN as a registered nurse with at least a master’s degree who has acquired the expert knowledge base, advanced decision-making skills, and clinical competencies for expanded practice. Internationally, the two most common types of APNs are clinical nurse specialists (CNS) and nurse practitioners (NP) [3, 13]; however, it is recognized that advanced practice nursing role titles and competencies are shaped by the healthcare policies and contexts of the country in which the roles are established [14]. For example, nurse consultant (NC), who provides consultation services to improve nursing and other health care programs and standards, is also a title signifying the APN role that has been introduced in Hong Kong, Australia, and the UK [15, 16].

The APN in management is one of the 16 specialties in the Hong Kong advanced nursing practice. APNs in management and NCs share common capabilities HKAN developed in 2018 [8]. These competencies are well in line with international standards for APNs and facilitate greater role clarity and integration in Hong Kong [16]. Competencies are the attributes involving knowledge, skills, judgment, and attitudes that enable APNs to conduct a range of nursing tasks at an advanced professional level [17‐19]. Establishing core competencies is foundational to defining and facilitating advanced practice nursing roles’ optimal development and performance [20]. Core competencies provide the basis for entry-level practice standards that are used to develop advanced practice nursing education programs and to set benchmarks for student evaluation, credentialing, and ongoing competency assessment [20, 21]. However, the development of APN competencies is widely heterogeneous, without a common practice [20].

Given the various dimensions of APN practice, the core competencies of APNs differ between organizations. The National Association of Clinical Nurse Specialists (NACNS) in the United States (US) began its efforts in 1995 to clarify the core competencies of CNSs and identified them in a statement issued in 1998 [22, 23]. The European Specialist Nurse Organisation (ESNO) identified competencies of the CNSs in 2015, including clinical role, patient relationship, patient teaching/coaching, mentoring, research, organization and management, communication and teamwork, ethic and decision making, leadership/policymaking, and public health [24]. In 2019, the most recent updated core competencies for CNSs were published by NACNS, which involves three domains: patient/client, nurses and nursing practice, and organizations and systems [23]. Recently, Finland also began its efforts in developing CNS core competency from four aspects: patient, clinical nursing leadership, organizational, and scholarship competencies [7]. Furthermore, Sastre-Fullana et al., [25] developed an APN competency assessment instrument in the Spanish context. The core competencies for NP were introduced by the National Organization of Nurse Practitioner Faculties (NONPF) in 1990 and updated in 2022, including nine competency areas: scientific foundation, leadership, quality, practice inquiry, technology and information literacy, policy, health delivery system, ethics, and independent practice [13]. The Canadian Nurse Association (CNA) identified the APN competencies in the first edition of Advanced Nursing Practice in 2000, which were divided into six categories: direct comprehensive care, health system optimization, education, research, leadership, and consultation and collaboration [26]. In the United Kingdom, the seven domains of competencies for NP were identified by the Royal College of Nursing (RCN) in 2002 based on those issued by NONPF, including management of patient health/illness status, the nurse-patient relationship, teaching-coaching function, professional role, managing and negotiating health care delivery systems, monitoring and ensuring the quality of health care practice, and cultural competence [27].

Overall, APN competency development is mainly concentrated in western countries, with limited description in Asian countries. In Singapore, the core competencies of APNs were organized into four domains, involving professional, legal and ethical nursing practice, management of care, leadership and management, and professional development [19]. The HKAN in Hong Kong described seven core domains of a competency framework for APNs, including managing clients with complex health conditions, enhancing therapeutic nurse-client relationships, demonstrating effective leadership and teamwork, enhancing quality assurance and improvement, managing and negotiating innovative and effective approaches to care delivery, enhancing professional attributes of general and advanced practice, and enhancing personal attributes [11].

Efforts have been spent on the development of core competencies for APNs worldwide. However, there are few validated APN core competencies within and across countries that are crucial to quantitatively assess the performance of APNs, guide the design of APN education curricula, and inform the policy. Existing valid APN competencies are restricted to a particular context like Canada [26], the US [28], Spain [25], and Finland [7]. Thus, this study was performed to evaluate an APN core competence scale (APN-CCS) in the Hong Kong context.

We performed a cross-sectional study using an online self-report survey, with data extracted from a large study comparing role activities amongst advanced practice nursing roles in Hong Kong. A 54-item self-reported APN-CCS was trialled using EFA [29]. This study was reported following the Strengthening the Reporting of Observation studies in Epidemiology (STROBE) checklist.

Although Master’s degree is a minimum requirement for APN recognition [30], some APNs may not meet this standard due to lack of formal credentialing processes and rather recent development of the educational standards of the APN in Hong Kong [8]. Therefore, to obtain an adequate and representative sample, the potential APN participants in study were those who (1) were working in a clinical role and (2) were registered nurses with a diploma or baccalaureate degree in nursing and certified in a professional practice area, or APNs with a master’s or doctoral degree. Having obtained ethics approval, an invitation to engage in the study along with study details and the online questionnaire link were sent to advanced practice nursing postgraduate students (part-time students, who were all in advanced practice role but continuing to a higher college to gain specific knowledge to advance in management policies) (n = 313) at a local university and members of HKAN (n = 2546). The aim of the inclusion of both APN students and the members of HKAN was to coverage various competencies of advanced practice nursing role. Participant recruitment and data collection occurred between mid-November and March 2021. A total of 192 APNs completed the questionnaire. Supported by previous studies, this sample size was adequate to execute factor analysis [31].

The original 54-item HKAN Competence Statements for Advanced Practice Nurses was used as APN-CCS [11]. The statements delineated seven core domains of APNs’ competence framework for: Managing clients with complex health conditions (11 items); Enhancing therapeutic nurse-client relationship (8 items); Demonstrating effective leadership and team work (6 items); Enhancing quality assurance and improvement (6 items); Managing and negotiating innovative and effective approaches to care delivery (7 items); Enhancing professional attributes of general and advanced practice (14 items); Enhancing personal attributes (2 items). The HKAN Competence Statement was originally developed based on Hong Kong and international literature [16]. In Hong Kong, the competencies of the nurse specialists in the 14 areas in alignment of the HKAN Colleges were reviewed. The international literature included those from Australia, United States and the United Kingdom. The local and international competences were compared and contrasted in the development. An expert panel composes of nurse specialists, nurse managers, and nurse academics met multiple times, discussed and deliberated to derive the set of competencies to reflect the actual practice locally and the standards internationally. The 54-item HKAN Competency Statement were validated by a panel of four experts to confirm if the items in the questionnaires were valid and relevant to the practice of APNs in the context where they practice. All items had an item content validity index (I-CVI) of 1 and the scale content validity index (SCVI) was also 1, which indicated total agreement. The APN-CCS was employed to measure the use of the APN competence in a typical month with a five-point, Likert-style scale (0 = Not at all, 1 = Little extent, 2 = Some extent, 3 = Great extent, 4 = very great extent). A higher score indicates greater extent of usage on the related competency. The Cronbach’s α of this 54-item scale was 0.811 in our study.

The University of Eastern Finland Committee on Research Ethics granted ethical approval of the study (statement number 22/2018), and The HKAN approved the conduction of the study through its membership platform. Data were kept strictly confidential and processed following the policies of the HKAN. No personal or identifying data were collected. The study was conducted under the principles described in the Declaration of Helsinki. Study information was provided, and informed consent was obtained before participants completed the questionnaire.

The KMO index was 0.948, and the p-value of Bartlett’s test of sphericity was < 0.001, suggesting that data were suitable for EFA [32]. Table 2 shows the actual eigenvalues of the study sample and the mean and 95th percentile of the generated eigenvalues from the parallel analysis. The results show that only the first three actual eigenvalues were larger than both the mean and 95th percentile of those generated by the parallel analysis. Therefore, the parallel analysis suggested that three factors could be extracted. However, the scree plot suggested a four-domain structure. Both three and four factors were thus tried to decide the finial structure. Fixing 3 or 4 factors to be extracted at the beginning of the data analysis finally led a three-factor structure of APN-CCS. This may due to the rule that items with factor loadings less than 0.4 on all the extracted factors were removed.

Three (items 29,39,53) out of 54 items of APN-CCS with loading values under 0.40 were deleted sequentially after the initial analysis. These three items were: “Manages complaints and monitors malpractice”, “Applies principles of epidemiology and demography in clinical practice”, and “Analyzes situation critically and draws relationship among issues.” Thereafter the PAF was re-conducted, which led to the final 51-item APN-CCS, without any cross-loading items. The final 51-item APN-CCS with a three-factor structure accounted for 69.27% of the total variance. The factor loadings of all items ranged from 0.412 to 0.917 (Table 3).

The results of EFA suggested that two original domains of competencies related to: “Managing clients with complex health conditions” and “Enhancing therapeutic nurse-client relationship” could be combined. The original nineteen items were loaded to this factor, with factor loading ranging from 0.615 to 0.905. Based on the contents, this factor was renamed as “client-related competencies” to account for the items in the factor.

Five items from the original domain of “Demonstrating effective leadership and team work”, together with six from “Enhancing professional attributes of general and advanced practice” were combined into the second factor. Based on the contents, this 11-item factor was renamed as “advanced leadership competencies” to tie these 11 items better. The factor loading ranged from 0.430 to 917.

For the last factor, the results of EFA suggested the combination of four original domains of competencies: “Enhancing quality assurance and improvement”, “Managing and negotiating innovative and effective approaches to care delivery”, “Enhancing professional attributes of general and advanced practice”, and “Enhancing personal attributes”. Twenty-one items were loaded to this factor, with factor loading ranging from 0.412 to 0.915. Based on the contents, this factor was renamed as “professional development and system-related competencies” to illustrate the items in the factor.

The Cronbach’s alpha of the 51-item APN-CCS was 0.980, indicating a robust internal consistency. For the three factors (sub-scale), factor 1 showed the highest value of 0.976, followed by factors 3 (α = 0.970) and factor 2 (α = 0.945).