2010: three week follow up
Three weeks after training demonstrated that there had been considerable improvement in knowledge, and change in some practices. For example, 24 (85.7%) and 25 (89.2%) RCH staff could recognize conjunctivitis and cataract from images after training compared with 14 (46.7%) and 2 (6.7%) respectively before training. Staff in 4 RCH facilities conducting deliveries had initiated Crede’s prophylaxis and all RCH staff reported delivering eye health education compared with 66.6% before training. All staff had put up their posters and had their manuals at work. There was also change in attitudes as trained RCH staff started to train other workers on child eye health using the poster and manual. The poster and manual were also used during health education sessions, to illustrate different aspects of eye health to mothers, and for reference. All staff thought the poster was more useful than the manual.
“We have displayed our poster at the outpatient department entrance and it is getting a lot of attention from patients and staff alike. Distribute it to all RCH clinics”.
“Nowadays we use this poster to illustrate eye conditions during health education”.
“Patients crowd around it, reading and asking us questions. They show a lot of concern about their children. They compare the appearances on the pictures and ask questions about themselves and their children”.
When asked why the poster had attracted so much attention, one clinical officer remarked:
“……. probably because the pictures are real as opposed to drawings”.
The following are quotes from RCH staff in relation to the manual:
“This simple manual is good for reference.....First we look at the poster then consult the manual for further information”.
“….when we came back from training, our colleagues wanted to know everything ……. All seven photocopied the manual for their reference”.
When asked whether the training had improved their knowledge of child eye health, one CO remarked:
“The training has been very beneficial. For me, I used to feel very incompetent when a patient with an eye condition came to the clinic. I just referred. Now I know and I am able to give medicine or refer as required……… But it was too short. May be one week would be better…”.
The RCH coordinator in one district commented that there had been a change in some practices in relation to eye care:
“In this RCH, whenever we see a child with eye problems, we refer to {staff name} (CO) because he had the training”.
Participants expressed appreciation for the training manual and poster:
“I look at the pictures and look at the patient then I know the condition…”.
In 2010, twenty one of the 30 untrained RCH staff reported the following beliefs in the community: spicy food during pregnancy causes red discharging eyes 11(36.6%), and eating clay 2 (6.7%) or eggs 1 (3.3%) during pregnancy causes blindness in children. Other causes included angering ancestors 2 (6.7%), a child looking at his/her naked parents 2 (6.7%) and witchcraft 1 (3.3%). Other reported beliefs were: painful swellings on eyelids of children (sties) were due to misbehavior of the mother towards her in-laws 2 (6.7%). Nine (30%) respondents did not know of any misconceptions. Local herbs (pounded, chewed, tree sap) and milk were the commonest home remedies for red eyes.
Reported barriers in identification and referral of children cited by untrained RCH staff included: inadequate knowledge and skills in child eye health, lack of diagnostic tools and drugs, lack of supervision, unclear roles and responsibilities, long distances to referral centers, and overwork, as shown by the following quotes:
“I have never been trained in eyes….We did not have an eye clinic at my hospital”.
(Even though we had some teaching on eye diseases, we have had no refresher training-------eye doctors should do like IMCI. IMCI…..send workers for refresher training).
“We have nothing to examine eyes with, I have seen a chart to examine eyes, we do not have one…….drugs to use in new born babies…”.
“It is only you who have visited us….. I have never seen an eye doctor visit us before. We don’t know or learn on eyes. If you want the eye program to continue, you should do what the HIV and TB doctors do. They visit the health centers and dispensaries regularly (CO)……”.
“Honestly, we used to clean and instill eye drops in new born babies. I do not know how and why we stopped. …….there is nobody reminding them, nobody follows up…. Probably just laziness (RCH coordinator)”.
“It is very sad to refer a patient who will not go for referral because sometimes it is too far (nurse)”.
“We are overburdened with work. Usually there is one enrolled nurse per shift and sometimes two or more mothers deliver within minutes of each other.. You have to concentrate on making sure they deliver safely and pay minimal attention onto issues like cleaning eyes (a nurse who used to work in a district hospital)….”.
2011 evaluation to compare trained and control staff
Characteristics of trained and untrained staff at the 2011 evaluation
Equal numbers of COs and nurses in the trained and control group took part in the study (i.e. 15 in each group) (Table
2) at both time points. Clinical Officers were more likely to be male than nurses in both groups (Z = 2.15, p = 0.03 trained group; Z = 2.19, p = 0.02 control group). The mean age of staff in the control group was 45.3 years compared with 42.9 years for those trained (Z = 0.79, p = 0.42). The mean number of years staff had worked in the RCH clinics was 5.6 and 4.0 years for the control and trained groups respectively but the difference was not statistically significant. COs in both groups were younger than nurses and had been in the post for a shorter period of time, but differences were not significant. The workload was similar between RCH clinics with trained and control staff.
Table 2
Demographic and professional characteristics of RCH staff who were trained (n = 30) and not trained (n = 30)
Age group | 26-35 | 3 | 2 | 5 (16.6) | 6 | 0 | 6 (20) | |
| 36-45 | 4 | 6 | 10 (33.3) | 6 | 6 | 12 (40) | |
| 46-55 | 8 | 7 | 15 (50) | 3 | 9 | 12 (40) | |
| Mean, SD | 45.4 (8.5) | 45.4 (7.6) | 45.3 (7.9) | 38.3 (8.1) | 47.5 (6.7) | 42.9 (8.7) | 0.4 |
Duration at RCH (yrs) | 1-3 | 7 | 4 | 11 (36.6) | 13 | 5 | 18 (60) | |
| 4-6 | 4 | 6 | 10 (33.3) | 2 | 5 | 18 (60) | |
| >6 | 4 | 5 | 9 (30.0) | 0 | 5 | 5 (16.6) | |
| Mean, SD | 5.0 (4.6) | 6.3 (5.5) | 5.6 (5.1) | 3.1 (1.4) | 4.9 (2.4) | 4.0 (2.1) | 0.6 |
Sex | Male | 6 | 0 | 6 | 7 | 0 | 7 | |
| Female | 9 | 15 | 24 | 8 | 15 | 23 | |
Highest qualification (yr) | 1979-89 | 3 | 6 | 9 (30) | 2 | 2 | 4 (13.3) | |
| 1990-99 | 2 | 2 | 4 (13.3) | 4 | 7 | 11 (36.6) | |
| 2000-09 | 10 | 7 | 17 (56.6) | 9 | 6 | 15 (50.0) | 0.3 |
Previous training* | Yes | 11 | 12 | 23 (76.7) | 13. | 12 | 23 (76.7) | |
| No | 4 | 3 | 7 (23.3) | 2. | 3 | 5 (23.3) | |
Refresher training* | Yes | 0 | 0 | 0 | 0 | 0 | 0 | |
| No | 15 | 15 | 30 (100) | 15 | 15 | 30 (100) | |
Number of children seen each day
|
| COs | Nurses | Register | COs | Nurses | Register | |
(Mean, SD) | 30 (17.8) | 89 (48.6) | 184 (73.5) | 35 (16.1) | 86 (48.2) | 178 (69.2) | |
Almost 80% of participants in both groups had received some primary eye care training during their basic professional training, but none had received refresher training. Both RCH coordinators were females and their ages were 45 and 49 years. The mean age of mystery mothers was 32 years.
All RCH facilities monitored the weight of children, undertook immunization with vitamin A supplementation, which are recorded on the RCH card and gave health education (Table
3). However, most clinics did not routinely examine the eyes of children, nor were all mothers supplemented with vitamin A immediately after delivery. None of the RCH clinics had torches for eye examination. Three weeks after training, all (100%) retained and used their torches while 9/28 (23.1%) had torches at one year. Three of those who had torches at one year had purchased them as personal property after the ones issued at the training broke down or were lost.
Table 3
Daily activities of RCH staff
Daily activities performed at RCH | | | |
Weight monitoring | 30 | 100% | 100% |
Immunization | 30 | 100% | 100% |
Health education | 30 | 100% | 100% |
Vitamin A supplementation – children | 30 | 100% | 100% |
Vitamin A supplementation – mothers | 30 | 86.7% | 100% |
Eye exam | 30 | 33.3% | 100% |
Children with eye problems seen/week | | N | % | N | % |
None | | 4 | 13.3 | 1 | 3.5 |
One or more | | 26 | 86.5 | 27 | 96.3 |
From a review of the MM Health Centre register, 108 (18 per month) children had been referred for tertiary eye care in the 6 months before training which increased to 135 (22 per month) in the 6 months after training. It was not possible to determine how many had attended tertiary facilities nor ascertain the diagnosis.
Experience and knowledge of eye diseases in children
Purulent discharge was the commonest condition seen by both groups (Table
4). Staff who had been trained were more likely to make the correct diagnosis and management decisions than staff who had not been trained. Three control COs said they would treat conjunctivitis with steroid eye drops.
Table 4
Conditions seen and management decisions
Purulent discharge | 10 | 11 | 21 (70) | 10 | 9 | 19 (67.8) | 0.14 |
Others | 5 | 2 | 7 (23.3) | 4 | 5 | 9 (32.1) | |
Did not remember | | 2 | 2 (6.6) | | | 0 | |
Management of purulent discharge:
|
Described symptoms did not know diagnosis | 3 | 5 | 8 (26.6) | 0 | 2 | 2 (7.1) | 0.16 |
Described symptoms but wrong diagnosis | 2 | 2 | 4 (13.3) | 0 | 0 | 0 | |
Described symptoms with correct diagnosis and treatment | 5 | 4 | 9 (30) | 10 | 7 | 17 (60.7) | 0.04 |
Did not remember the child they last saw | 0 | 2 | 2 (6.6) | 0 | 0 | 0 | |
Other actions | 5 | 2 | 7 (23.3) | 4 | 5 | 9 (32.1) | |
Trained staff could name more eye conditions of childhood than untrained staff (mean 3.2 +/-1.3; vs mean 1 +/- 1.0; z = 4.610, p < 0.0001). In both groups COs were more knowledgeable than nurses, with the difference being statistically significant for trained COs (t = 2.25, p < 0.02). Trained staff were also able to name more management options than untrained staff (2.16 +/- 1.2 vs 1.3 +/- 1.0; z = 2.34, p < 0.01). The mean number of management options known by untrained COs was higher than among untrained nurses but differences were not statistically significant (1.6 +/- 0.95 vs 1.3 +/- 0.9 respectively; t = 0.80, p < 0.2).
Only ten control RCH staff could correctly identify conjunctivitis from an image compared with 23 trained staff (33% vs 82.1%, z = 4.25, p < 0.001) (Table
5). Twenty five control staff did not know or misdiagnosed cataract compared with 11 trained staff (83.3% vs 39.3%, z = 3.45, p < 0.001). Management decisions for cataract and trauma were also significantly better among trained staff. Indeed, three control participants mentioned that cataract in children should be treated with vitamin A.
Table 5
Diagnostics skills and management decisions of trained and control RCH staff
Image of conjunctivitis:
|
Correctly identified | 6 | 4 | 10 (33.3) | 13 | 10 | 23 (82.1) | 0.00 |
Image of cataract:
| | | | | | | |
Correctly identified | 3 | 2 | 5 (16.6) | 9 | 8 | 17 (60.7) | 0.01 |
Management of cataract:
|
Refer for surgery | 3 | 3 | 6 (20.0) | 10 | 11 | 21 (70.0) | 0.00 |
Refer, did not know treatment | 6 | 7 | 13 (43.3) | 5 | 3 | 8 (28.5) | 0.4 |
Management not known | 6 | 5 | 11 (36.6) | 0 | 0 | 0 (0.0) | 0.00 |
Management of trauma:
|
Immediate referral | 2 | 1 | 3 (10.0) | 7 | 8 | 15 (53.5) | 0.00 |
Practices in relation to prevention
Seventeen RCH clinics had facilities for normal deliveries (10 with trained staff; 7 with control staff). Only 28.5% of control clinics were routinely performing Crede’s ocular prophylaxis (i.e. cleaning the eyes immediately after birth and instilling antibiotic eye drops) compared with 57.1% of clinics with trained staff. In control clinics some cleaned the eyes only while others instilled eye drops, but only if the mother had a sexually transmitted disease. Reasons for not performing Crede’s prophylaxis were lack of supervision, being overworked and lack of eye drops.
Training reinforced by the educational materials led to change of practice.
“After training, we conducted a clinical meeting and taught our colleagues what we had learnt. Honestly, we were not putting eye drops in newborn eyes. The practice had been forgotten….. Now we have set out a protocol to have antibiotic eye drops as one of the components of a delivery tray”.
Health education conducted in relation to the eye
Two health education methods were used: health talks by nurses three-four times a week to groups of mothers in the waiting area, and one to one counseling of mothers by nurses and COs. Nurses prepared a timetable of topics for the health talks, which were changed if there was a disease outbreak (e.g. measles). Almost half of untrained staff (43.3%) had never given health education on eye conditions but over three quarters of trained staff had held a session on eye conditions within a week of the evaluation visit (Table
6). There were also considerable differences in the topics covered, with trained staff being more likely to cover topics specifically related to eye conditions than untrained staff. Mystery mothers visited and reported that they had observed health education sessions in 15 out of 20 RCH clinics. Health education related to the eye was observed in 0/8 (0%) and 5/7 (71.4%) RCH clinics with untrained and trained staff respectively (Table
7).
Table 6
Health education relating to the eye delivered by RCH staff
When last eye health education was delivered:
|
Within last 7 days | 5 | 5 | 10 (33.3) | 11 | 11 | 22 (78.5) | <0.001 |
Within last 4 weeks | 4 | 2 | 6 (20.0) | 3 | 3 | 6 (21.4) | 0.4 |
Within last 1 year | 1 | 0 | 1 (3.3) | 0 | 0 | 0 | |
Never | 5 | 8 | 13 (43.3) | 0 | 0 | 0 | |
Content of health education:
|
Not specifically related to eye health
|
Facial hygiene | 6 | 3 | 9 (30) | 4 | 1 | 5 (16.6) | |
Delivery | 1 | 2 | 3 (10) | 0 | 0 | 0 | |
Infection during delivery | 2 | 2 | 4 (13.3) | 0 | 0 | 0 | |
Examine baby after delivery | 0 | 0 | 0 | 0 | 1 | 1 (3.5) | |
Specifically related to eye health
| | | | | |
Eye diseases | 1 | 0 | 1 (3.3) | 2 | 0 | 2 (7.1) | |
Importance of immunization | 0 | 0 | 0 | 0 | 3 | 3 (10.7) | |
Importance of vitamin A | 0 | 0 | 0 | 3 | 6 | 9 (32.1) | |
Identification referral of those with eye disease | 0 | 0 | 0 | 4 | 3 | 7 (25) | |
Do not use non-prescribed/traditional eye medicine | 0 | | | 1 | 0 | 1 (3.5) | |
Total
| 15 | 15 | 30 (100) | 14 | 14 | 28 (100) | |
Table 7
Mystery mothers report on health education delivered by RCH staff
Not specifically related to eye health:
| | | | |
Safe delivery | 2 | 20 | 1 | 10 |
Sexually transmitted diseases | 1 | 10 | 1 | 10 |
Lactation and good nutrition | 1 | 10 | 0 | 0 |
Measles and immunization | 4 | 40 | 0 | 0 |
Specifically related to eye health:
| | | | |
Vitamin A and the eye | 0 | 0 | 1 | 10 |
Measles immunization and the eye | 0 | 0 | 3 | 30 |
Identification of children with eye diseases | 0 | 0 | 1 | 10 |
None observed:
| | | | |
No health education session | 1 | 10 | 2 | 20 |
Arrived too late for health education session | 1 | 10 | 1 | 10 |
Trained nurses made the following comments:
“These days, we have scheduled eye disease topics on the health education timetable”.
“I used to counsel mothers to exclusively breast feed …., but I did not know that it prevents eye diseases.….now I feel more confident talking to mothers about it”.
Enthusiasm for eye health education was shown by a nurse who had visited a trachoma endemic area:
“These days I frequently see adults with destroyed corneas and in- turned eyelashes just like on the pictures! ….before the training, I never knew what was wrong with all these people. Oh, I feel like calling a big meeting to give a lecture…. I advise them to go to hospital”.
Mystery mothers reported that measles and measles immunization were the topics most frequently covered in health education sessions (7/15 sessions) (Table
7), but only trained nurses said that measles can affect the eye and that measles immunization can prevent blindness. Trained staff also gave talks on vitamin A and the eye and on other eye conditions in children, unlike untrained staff. All mystery mothers reported that RCH staff had instructed them to bring the affected child to the clinic for examination.