Background
Methods
Type of study
Place/sample of the study
Data collection forms
-
“Demographic characteristics question form”: There are four questions: age, gender, class, environment and participation in a course/conference/seminar related to nursing.
-
“Children’s Environmental Health Knowledge Questionnaire (ChEHK-Q)”: It consists of 26 items and has three answers: “True/False/Do not know”. To calculate the general knowledge score, one point is added to the correct answers for each item. Items 1, 3, 6, 8, 9, 11, 12, 14, 15, 16, 18, and 22 are correct, whereas the others are incorrect. The maximum score is 26 (knowledge index 100%). Several indices can be derived: the “knowledge index (overall score/26 × 100) and the ignorance index (number of ‘do not know’/26 × 100)”. The knowledge levels are categorized as follows: ‘Excellent knowledge level (> 90% correct answers), very good knowledge level (90–80% correct answers), good knowledge level (80–60% correct answers), inadequate knowledge level (60–40% correct answers), and poor knowledge level (< 40% correct answers)’. The Cronbach’s alpha of the original Spanish form is 0.98 [26].The original name was renamed the “Child Environmental Health Relationship Knowledge Scale” in terms of cultural meaning during the adaptation process.
-
“Children’s Environmental Health Skills Questionnaire (ChEHS-Q)”: There are 12 items on a 5-point Likert scale. Each item is evaluated with values ranging from “1 (strongly disagree) to 5 (strongly agree)”. The overall score is computed by “adding the points that each student assigns to each item”. A minimum score of 12 points and the highest score of 60 points can be obtained. The skill index is calculated as follows: skill index = total points/60 × 100. Skill levels are categorized as follows: ‘Excellent skill level (> 90% perceived skills), very good skill level (90–80% perceived skills), good skill level (80–70% perceived skills), poor skill level (70–50% perceived skills), and poor skill level (< 50% perceived skills)’. The Cronbach’s alpha of the original Spanish form is 0.87 [26]. The original name was renamed the “Child and Environmental Health Relationship Skills Scale” in terms of cultural meaning during the adaptation process.
Cultural adjustment of questionnaires
Psychometric test stages
-
Unidimensionality:This is the first assumption. A model consisting of one dimension was defined for both scales, and confirmatory factor analysis (CFA) was conducted to determine whether these hypothetical models fit the model data. In addition, the principal component analysis results of the residuals from the Rasch analysis outputs were examined to determine whether the scale had a one-dimensional structure. This method predicts that there should not be different relationships between items that indicate another dimension other than random relationships. Therefore, the ‘Contrasts’ obtained as a result of the analysis, which correspond to the residual variances outside the variance that can be explained by the model, were analysed. The ratio of the eigenvalue of the unexplained raw variance in Contrast 1 (1.56), which has the highest eigenvalue for ChEHK-Q, to the eigenvalue of the unexplained raw variance with the Rasch model (26.0) was found to be 0.07. Since this ratio is less than 1/3 (~ 0.33), the ChEHK-Q is unidimensional (it measures a single latent construct). A total of 32.7% of the total variance explained by the Rasch model comes from the measurements. The remaining 67.3% variance indicates the coincidental relationships in the measurements and indicates that there is no other significant dimension other than the characteristic measured by the scale. For the ChEHS-Q, the 1st contrast value of the unexplained variance was found to be 1.98, and since this eigenvalue was < 2, the items in the test corresponded to a single dimension, and the variance unexplained by the model did not point to another dimension. The ratio of the eigenvalue (1.98) of the unexplained raw variance in the 1st contrast with the highest eigenvalue to the eigenvalue (11.0) of the raw variance unexplained by the Rasch model was found to be 0.18, and since this ratio is less than 1/3 (~ 0.33), the ChEHS-Q is unidimensional; in other words, it measures a single latent construct. A total of 32.6% of the total variance explained by the Rasch model comes from the measurements. The remaining 67.4% of the variance represents random relationships in the measurements and indicates that there is no other significant dimension other than the characteristic measured by the scale [36, 37].
-
Local independence: This is one of the most fundamental assumptions. The response of each scale item should be independent of all other items along the ability continuum. When the assumption is not met, the unidimensionality of the scale is affected. For this reason, it was examined whether the inter-item residual correlations of the items of the ChEHK-Q and ChEHS-Q were below r ≤ 0.32. On the other hand, negative correlation coefficients do not make sense since the relationships between the related items are inversely related; negative correlation coefficients were excluded from the evaluation. For ChEHK-Q, no value exceeded 0.12. For the ChEHS-Q, the highest positive correlation between the standardized residuals was 0.30. The assumption of local independence was met for both scales [36, 37].
-
Differential Item Functioning (DIF): The fact that the measures contain DIF may also affect the data-model fit. When respondents in different groups (e.g., gender) within the sample who have equal ability levels in terms of the construct measured respond differently to an item, this indicates that the item contains DIF [36]. If DIF is observed, systematic error is introduced into the measurements, and the validity of the scale is lower than it should be. In this study, it was investigated whether the items of both scales contained DIF according to gender. The contrast of the between-group DIF measures of the ChEHK-Q was between − 0.65 and 0.98 logit values and was not statistically significant, and the probability values corresponding to the Mantel–Hanzel chi-square values of p ≥ 0.03 were interpreted as indicators that the items did not contain DIF [35, 38]. Similarly, the fact that the contrast of the ChEHS-Q’s between-group DIF measures was between − 0.19 and 0.28 logit values and was not statistically significant and that the probability values corresponding to the Mantel–Hanzel chi-square values were p ≥ 0.03 were interpreted as indicators that these scale items did not contain DIF [35, 38]. The difficulty levels of the items of both the ChEHK-Q and the ChEHS-Q do not differ significantly according to the gender of the individuals. In other words, the items in the tests did not contain item functions that varied according to participants from the same population but belonged to different subpopulations (e.g., male‒female). The results obtained in future applications at both scales should be interpreted by taking this situation into consideration. In this respect, DIF analyses provide evidence on whether the scales have cross-validation.
-
Model fit: Fit statistics of the data-model fit were evaluated for both scales. The log-likelihood chi-square value = 7821.89 for ChEHK-Q, with approximately 7831 degrees of freedom and p = 0.53. The log-likelihood chi-square value = 8163.31 for ChEHS-Q, with approximately 8714 degrees of freedom and p = 0.53. These statistics support the data-Rasch model fit. In addition, the item-fit residual values were in the range of ± 2.5, indicating that both scales fit the Rasch model well [35].
-
Reliability: For reliability analysis, values for items and subjects were calculated, and values of 0.80 and above were considered good. The model also considers the separation index, “which indicates whether respondents answered every question in the same rating group and refrained from responding in categories at either end of the scale.” Ideally, separation values should be greater than 2. In this study, the reliability coefficient of the ChEHK-Q in the Rasch model analysis was 0.76 (separation index = 1.86) for the subjects and 0.92 (separation index = 5.80) for the items. The reliability coefficients for the ChEHS-Q were 0.79 (separation index = 1.97) for the subjects and 0.94 (separation index = 4.09) for the scale. The items are enough to categorize students according to their knowledge and skills. For both scales, the number of people in the sample is very close to 2, and the person reliability is approximately 0.80, which can be considered a limitation [35].
Statistical analyses
Ethical considerations
Results
Demographic characteristics
Children’s environmental health knowledge questionnaire (ChEHK-Q)
Content validity
Construct validity
Rasch analyses
Items | Difficulty | SEa | Infitb | Outfitc |
---|---|---|---|---|
1. “The pediatric population is more susceptible to environmental threats due to their biological immaturity.” | -2.97 | 0.23 | 0.98 | 0.94 |
2. “The increased energy and metabolic consumption of the pediatric population protects children from environmental hazards.” | 0.29 | 0.13 | 1.03 | 0.99 |
3. “The higher rate of cell growth during the pediatric age increases the risk of health effects caused by environmental factors.” | -0.09 | 0.13 | 0.98 | 1.06 |
4. “Environmental factors do not influence hormonal secretion during puberty.” | -2.53 | 0.20 | 1.12 | 1.01 |
5. “Nitrogen oxide from fossil fuels in the home and tobacco smoke causes redness and burns on the skin.” | 2.59 | 0.21 | 0.99 | 0.83 |
6. “Particles from animals exacerbate asthma crisis.” | -1.36 | 0.14 | 1.01 | 1.17 |
7. “Increased humidity at home improves respiratory diseases in children.” | -0.38 | 0.13 | 0.98 | 0.99 |
8. “Passive smoking is associated with the development of acute leukemias in children.” | 0.52 | 0.13 | 0.99 | 0.97 |
9. “Childhood leukemia incidence rates are higher in the areas most exposed to radon.” | 0.59 | 0.13 | 1.02 | 1.00 |
10. “Overexposure to solar ultraviolet radiations can damage the skin of adults more severely than that of children.” | 0.50 | 0.13 | 0.94 | 0.88 |
11. “During childhood more than half of the expected lifetime solar ultraviolet radiation is absorbed.” | 0.99 | 0.14 | 1.01 | 0.98 |
12. “Lead accumulates in the body affecting the nervous system.” | -1.87 | 0.16 | 1.07 | 1.07 |
13. “Chronic dietary exposure to mercury (fish and shellfish) is less toxic to children’s central nervous system than to adults.” | 0.32 | 0.13 | 0.96 | 0.91 |
14. “Exposure to pesticides increases the risk of developing attention deficit problems in school-aged children.” | 0.32 | 0.13 | 1.02 | 1.09 |
15. “Children born to smoking mothers during pregnancy are at risk of lower intellectual capacity.” | -0.95 | 0.14 | 0.93 | 0.89 |
16. “Exposure to organic solvents during fetal development can cause learning disabilities in children.” | -0.72 | 0.13 | 0.96 | 1.02 |
17. “Water containing nitrates can only cause intoxication during childhood.” | 0.21 | 0.13 | 0.95 | 0.89 |
18. “Chlorination of water forms subproducts from the disinfection process that have been classified as carcinogenic.” | 0.57 | 0.13 | 0.96 | 1.01 |
19. “The major source of childhood exposure to pesticides is through ambient air.” | 3.19 | 0.26 | 1.00 | 1.06 |
20. “The main route of exposure to mercury is through cereal intake.” | -0.04 | 0.13 | 1.00 | 0.98 |
21. “Exposure to lead through diet occurs mainly through fish intake.” | 1.67 | 0.16 | 1.00 | 0.90 |
22. “Food colorings and preservatives are associated with central nervous system problems.” | 0.01 | 0.13 | 1.05 | 1.11 |
23. “Genetically modified foods cause fewer allergic reactions in children.” | -1.48 | 0.15 | 1.04 | 1.09 |
24. “Schools and nurseries are environmentally safe places.” | 1.34 | 0.15 | 1.01 | 1.11 |
25. “Children are exposed to higher concentrations of air pollutants at home than outdoors.” | -0.51 | 0.13 | 1.03 | 1.00 |
26. “Parks and gardens are the areas with the least environmental pollutants where children can play.” | -0.23 | 0.13 | 0.99 | 0.99 |
Children’s environmental health skills questionnaire (ChEHS-Q)
Content validity
Construct validity
Rasch analyses
Items | Difficulty | SEa | Infitb | Outfitc |
---|---|---|---|---|
1. “I am able to assess the main environmental risks to which a child is exposed.” | 0.02 | 0.07 | 0.82 | 1.01 |
2. “I am NOT able to identify the environmental risks that can cause respiratory diseases in a child.” | -0.03 | 0.07 | 1.11 | 1.14 |
3. “I am able to identify the environmental risks that can cause neoplastic diseases in a child.” | 0.54 | 0.06 | 0.87 | 0.86 |
4. “I am NOT able to identify the environmental risks that can cause neurological disorders in a child.” | 0.29 | 0.06 | 1.02 | 1.06 |
5. “I am able to provide health education to parents about the main contaminants in their child’s food.” | 0.25 | 0.06 | 0.95 | 0.95 |
6. “I am NOT able to identify the environmental risks in playgrounds.” | -0.56 | 0.07 | 1.17 | 1.16 |
7. “I am able to provide health education to parents about actions to minimize environmental risks to which a child is exposed when playing outdoors.” | -0.14 | 0.07 | 0.95 | 1.02 |
8. “I am NOT able to identify the environmental risks in a child’s home.” | -0.22 | 0.07 | 1.06 | 1.07 |
9. “I am able to provide health promotion to parents about environmental risks at home.” | 0.08 | 0.07 | 0.86 | 0.87 |
10. “I am able to identify the environmental risks in a child’s school.” | -0.12 | 0.07 | 1.19 | 1.19 |
11. “I am NOT able to identify the actions needed to combat environmental risks in a child’s school.” | -0.10 | 0.07 | 1.07 | 1.08 |
Likert category | Andrich Threshold Values-Logit (SE)a | INFIT | OUTFIT |
---|---|---|---|
0 | - | ||
1 | -1.28 (0.09) | 1.04 | 1.06 |
2 | -0.67 (0.05) | 0.86 | 0.91 |
3 | 0.27 (0.04) | 0.94 | 0.93 |
4 | 1.68 (0.05) | 0.94 | 0.95 |