Methods
Study design
This prospective observational cohort study was conducted to evaluate the application of the NANDA-I, NOC, and NIC (NNN) linkage framework in the postoperative management of liver transplant recipients. The study adhered to the STROBE guidelines to ensure methodological rigor.
Setting
Research is conducted within the liver transplantation unit of a major tertiary hospital in Eastern China.In this hospital, postoperative nursing outcomes (NOC) were assessed by the responsible nurse, reviewed by an advanced practice nurse (APN), and quality-checked by the head nurse. Nursing interventions (NIC) were finalized collaboratively by the APN and an informatics nurse at discharge, ensuring a comprehensive and patient-centered care plan.
Participants
The study employed consecutive sampling. We enrolled 49 liver transplant patients admitted between December 2022 and August 2023. Adult patients (≥ 18 years) who underwent deceased donor liver transplantation and provided informed consent were included. Patients were excluded if they met any of the following criteria: cognitive impairments, receipt of multiple organ transplants, lack of initial NOC assessments, hospitalization for less than 14 days post-transplant, or death due to surgical complications. Additionally, five patients were excluded as they participated in a preliminary trial phase to test the applicability of NOC indicators.
Sample size calculation
The sample size was calculated for paired-sample t-tests to evaluate differences in nursing outcome scores (NOC indicators). Assuming a medium effect size (d = 0.5), a significance level of 0.05, and 80% power, a minimum of 32 patients was required. This study included 44 patients, exceeding the required sample size and ensuring sufficient power for the multiple comparisons across time points.
Variables and data collection
In previous research, the NNN-link system was developed using care plans from 300 liver transplant patients (2019–2021). The Delphi process included two rounds of expert evaluations conducted in March and April 2022. The panel consisted of 30 liver transplant specialists and nursing informatics experts from 15 tertiary hospitals and academic institutions. There are three types of questions: general expert information, assessment of expert authority, and evaluation of a preliminary set of 15 nursing diagnoses, 91 outcomes, and 275 interventions. Panel members rated each item for importance and relevance using a 5-point Likert scale. Items were iteratively refined based on feedback, with scores for importance and relevance analyzed alongside expert suggestions. This process achieves high authority coefficients (0.83 > 0.8) and moderate Kendall’s coefficients [
20] (0.50, 0.38, 0.35), which reflected the complexity of liver transplant care. At last, the Delphi process identified 15 nursing diagnoses, 42 nursing outcomes, and 106 nursing interventions.
Based on these findings, an in-hospital expert panel provided objective, multidisciplinary perspectives to refine the NNN-link system and reach consensus [
21]. This study further aimed to validate and optimize the framework through its clinical application.
A multidisciplinary research team was established, including a nursing department deputy director (team leader), advanced practice nurses (APN) specializing in liver transplantation, nursing informatics specialists, postgraduate nursing students, and senior transplant center nurses. The team leader oversaw the research process, facilitated decision-making, and coordinated team efforts. APNs managed nurse training, quality control, and provided feedback on clinical practicality. Informatics specialists organized meetings and performed data analysis, while postgraduate students conducted literature reviews, data entry, and accuracy verification. The liver transplant nursing team, supervised by APNs, conducted patient assessments, identified nursing diagnoses, evaluated NOC indicators, and implemented nursing interventions with standardized documentation.
Before the study, we obtained approval and collaboration from the director and head nurse of the liver transplant unit. Nurses involved in the study were selected from the liver transplant ICU and inpatient wards and required to have at least 5 years of clinical experience. These nurses had structured training organized by the research team. The training is consisted of 3 h of theoretical instruction and 5 h of practical bedside rounds. It mainly focused on NNN linkage application, assessment protocols, and documentation standards. Competency assessments were conducted to ensure readiness before study implementation.
Initially, a trial phase was conducted to evaluate the suitability of the NOC indicators. From March to August 2023, eligible liver transplant patients were prospectively enrolled. The head nurse participated in preoperative discussions and identified eligible participants. Postoperatively, the responsible nurse performed nursing assessments and completed NOC baseline scoring within 10 a.m. on day of surgery, 3d, 7d, and 14d [
22], and discharge using the 15 NANDA-NOC linkage tables (covering 413 NOC indicators). A standardized five-point scale (1 = least favorable, 5 = most favorable) was used for scoring. Scores were reviewed by APNs, with discrepancies resolved through discussions. Persistent issues were escalated to the head nurse during rounds. Upon discharge, APNs conducted a final review of NOC scores to ensure completeness and accuracy.
Nursing interventions were evaluated by APNs and informatics specialists, who compared nursing records from the hospital information system (HIS) with standardized NIC interventions based on established guidelines. Matches were identified, and discrepancies were discussed with the team leader for final determination.
Bias
NOC scoring was conducted through bedside assessments, medical record reviews, patient surveys, and discussions with physicians. Rapport with liver transplant patients ensured trust and cooperation, with subjective data verified item by item to ensure accuracy and reliability.
Measurement
NOC indicators trial use
In November 2022, the research team developed NANDA-NOC linkage tables for liver transplant patients by matching 42 NOCs to 549 NOC indicators and corresponding measurement scale. Patients’ sociodemographic were collected through structured interviews conducted during the admission process.
The trial application involved two liver transplant patients (one male, one female), where advanced practice nurse(APN) and informatics nurses applied the NANDA-NOC linkage tables. If certain NOC indicators were not applicable, reasons were recorded, and the team discussed whether to delete or modify them. A total of 136 NOC indicators were removed, primarily due to inapplicability to adult liver transplant patients or hospital care settings.
In January 2023, the modified NANDA-NOC linkage tables were applied to another liver transplant patient, and no further modifications were needed. In February 2023, two more patients were scored using the revised NOC linkage tables by trained senior nurses. The consistency between different raters was analyzed using the Kappa coefficient [
23], which ranged from 0.773 to 0.871, indicating good agreement.
Statistical methods
Data were organized and analyzed using Excel and SPSS 25.0. Descriptive analyses were performed for demographic data: continuous variables were expressed as mean ± standard deviation (SD), while categorical data were presented as frequencies and percentages.
Differences in the nursing outcome scores for the liver transplant recipients’ postoperative NANDA-I, NOC, and NIC linkages were assessed using paired-sample t-tests and repeated measures analysis of variance (ANOVA). One-way repeated measures ANOVA was conducted to analyze changes in NOC scores across four postoperative time points (day of surgery, 3d, 7d, and 14d) for all 15 NANDA-NOC indicators. For indicators meeting the assumption of sphericity, standard ANOVA results were reported.
Seven NOC indicators violate the sphericity assumption, Greenhouse-Geisser correction was applied to ensure statistical rigor, which are Acute Rejection (W = 0.68, P < 0.001), Acute Pain (W = 0.45, P < 0.001), Activity Intolerance (W = 0.74, P = 0.03), Risk for Falls in Adults(W = 0.74, P = 0.03), Self-Care Deficit (W = 0.57, P < 0.001), Risk for Impaired Oral Mucous Membrane Integrity (W = 0.65, P < 0.001) and Potential Complication: Venous Thromboembolism (W = 0.48, P < 0.001).
To address the issue of multiple comparisons, Bonferroni correction was applied to post hoc pairwise comparisons between the time points. With six pairwise comparisons, the threshold for statistical significance was adjusted to P < 0.008 (0.05/6). Post hoc tests were performed for each indicator to identify specific time points with significant differences. No missing data occurred in this study due to the implementation of rigorous quality assurance measures.
Discussion
This study represents the first real-world clinical application of the NNN framework to evaluate its applicability and effectiveness [
24]. The research team utilized a tool validated through expert consensus and prior pilot studies [
21]. These findings, consistent with prior research [
25], highlight the need for real-world validation to confirm the practical utility of standardized nursing frameworks.
The NOC indicators offered a standardized framework for assessing liver transplant patients, enabling a comprehensive understanding of patient needs, promoting recovery, and improving quality of life [
26]. Significant differences in NOC scores for the 15 nursing diagnoses were observed between the day of surgery and the day of discharge, validating the feasibility of the NNN-linkage framework in measuring perioperative changes and evaluating nursing interventions at five predefined time points. These findings align with previous studies in other clinical areas [
27‐
28], which demonstrate the utility of NOC in identifying critical clinical changes and guiding effective nursing practices. For example Gencbas et al. [
29] reported significant improvements in incontinence-related outcomes and quality of life in elderly women using NNN linkages. In oncology, Mello et al. [
30] confirmed the applicability of NOC indicators in managing acute and chronic pain in cancer patients, “”.
In this study, Advanced Practice Nurses (APNs) played a pivotal role in ensuring the accuracy and implementation of the NNN framework. Irvine’s Nursing Role Effectiveness Model [
31] links specific outcomes to the independent, dependent, and interdependent roles of nurses. Diagnoses Risk for “Impaired Oral Mucous Membrane Integrity” (η² = 0.811), “Risk for Impaired Skin Integrity” (η² = 0.246) and “Disturbed Sleep Pattern” (η² = 0.090) fell under the independent role of nurses, requiring targeted interventions for which nurses were directly responsible. Prolonged mechanical ventilation, limited mobility, and physical restraints increased the risk of pressure injuries at multiple sites, while tracheal intubation and fasting before gastrointestinal recovery heightened the vulnerability of oral mucosa. These findings underscore the necessity of proactive preventive measures within the first 14 postoperative days to address oral and pressure injury risks [
32]. Similarly, “Disturbed Sleep Pattern"is prevalent among liver transplant recipients, significantly impacting recovery and quality of life [
33]. This highlights the critical need for targeted sleep care interventions during the early postoperative period to promote recovery and improve patient outcomes.
The dependent role of nurses involves clinical judgment and activities related to executing medical orders and treatments. In this study, diagnoses “Potential Complication: Hemorrhage”, “Potential Complication: Electrolyte Imbalance” (η² = 0.265), and “Potential Complication: Hyperglycemia/ Hypoglycemia” were identified as collaborative problems. Liver transplant patients face heightened bleeding risks within the first seven postoperative days due to reduced procoagulant pathways and impaired anticoagulation and fibrinolysis mechanisms [
34]. Electrolyte imbalances are attributed to intraoperative blood loss, stress responses, and hepatic dysfunction [
35], while early hyperglycemia often results from immunosuppressant and corticosteroid use [
36]. Nurses must closely monitor the occurrence and progression of these physiological complications, ensuring timely interventions to mitigate risks.
APNs were instrumental in promoting continuity, coordination, and integration of patient care. They can facilitate communication between nurses and other healthcare providers, guiding nurses to increase the frequency of NOC evaluations to proactively identify and address declining scores. Dynamic adjustments to nursing care plans, emphasizing high-frequency monitoring and tailored interventions during critical periods, were key recommendations. Furthermore, APNs can advocate for the integration of the NNN framework into electronic health systems (EHS), enabling real-time monitoring and alert systems.
Lower NIC utilization rates (17/106) were attributed to the lack of integration of NIC-based care plans into existing hospital practices, limiting documentation. This finding aligns with prior research [
37‐
38], indicating the need for training [
39] and integration efforts to improve documentation and implementation of NIC-based care plans. APNs can advocate for policies mandating the use of standardized frameworks such as NIC in clinical documentation and care planning. Collaborating closely with multidisciplinary teams, APNs can ensure NIC interventions become integral to patient care strategies, enhancing overall nursing practice.
Limitation
Firstly, this study was conducted at a single center in mainland China, which may limit the generalizability of the findings. Cultural and institutional factors specific to the study site, may further restrict the generalizability. Secondly, some indicators relied on patient self-reports, which may introduce reporting bias, as patients could underestimate or overestimate their actual conditions due to various factors. Thirdly, the absence of a control group limits the ability to compare outcomes against standard care or other interventions. This limitation underscores the need for future studies to incorporate controlled designs to better evaluate the effectiveness of the NNN framework. Finally, the observational nature of this study precludes causal inferences.
Conclusion
This study demonstrates the successful application of NANDA-I, NOC, and NIC (NNN) linkages in the postoperative management of liver transplant patients, with advanced practice nurses (APNs) playing a critical role in ensuring accuracy and implementation. The findings highlight the sensitivity of NOC indicators to patient condition changes and their role in improving nursing outcomes, providing insights for enhancing care protocols.
Future research should focus on identifying core NOC indicators, addressing NIC utilization barriers. With APN leadership, these findings can guide healthcare organizations and policymakers in standardizing nursing documentation, enhancing NNN training, and integrating the framework into electronic health records to improve care quality.
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.