Validation of a food frequency questionnaire for children and adolescents aged 4 to 11 years living in Salvador, Bahia

La validación de un cuestionario de frecuencia alimentaria para niños y adolescentes de 4 a 11 años que viven en Salvador, Bahía

S. M. A. Matos¹, M. S. Prado¹, C. A. S. T. Santos², S. D'Innocenzo¹, A. M. O. Assis³, L. S. Dourado¹, N. S. Oliveira¹, L. C. Rodrigues⁴ and M. L. Barreto¹

¹Institute: de Saúde Coletiva. Universidade Federal da Bahia. Salvador. Bahia. Brazil.
²Departamento de Ciências Exatas. Universidade Estadual de Feira de Santana. Feira de Santana. Bahia. Brazil.
³Escola de Nutrição. Universidade Federal da Bahia. Salvador. Bahia. Brazil. ]]> ⁴Department of Epidemiology and Population Health. London School of Hygiene and Tropical Medicine. London. United Kingdom.

Correspondence

ABSTRACT

Objective: To assess the validity of a food frequency questionnaire (FFQ) by applying it to children and adolescents living in Salvador, Bahia.
Methods: The validity of this FFQ with 98 food items was investigated among 108 children and adolescents who were selected from a sample of 1445 that had been planned for a study on the risk factors for asthma and other allergic diseases. The adults responsible for these children and adolescents gave responses for a 24-hour recall (R24h) and an FFQ. The average energy and nutrient values from the FFQ were compared with those from the R24h by means of the paired t test and Pearson correlation coefficients. The concordance was evaluated using the Bland-Altman method and kappa statistics.
Results: The energy and nutrient intake estimated using the FFQ was significantly higher than what was obtained using the R24h. The correlation coefficients adjusted for energy were statistically significant for protein, fat, vitamin C and zinc. The weighted kappa values ranged from 0.06 for vitamin A (p = 0.24) to 0.34 for energy (p < 0.00). The results from the Bland-Altman plots for lipid, protein and zinc showed the most significant validity parameters, and zinc was found to show the best concordance.
Conclusion: The results suggest that the FFQ showed satisfactory validity for use in studies involving children and adolescents.

Key words: Validity. Food frequency questionnaire. Children.

Objetivo: Evaluar la validez de un cuestionario de frecuencia de alimentos (QFA) aplicándolo a niños y adolescentes residentes en Salvador, Bahía.
Métodos: Se investigó la validez de este QFA con 98 ítems de alimentos en 108 niños y adolescentes seleccionados a partir de una muestra de 1.445 planificados para un estudio sobre los factores de riesgo para asma y otras enfermedades alérgicas. Los adultos responsables de estos niños y adolescentes proporcionaron respuestas para un recuerdo de 24 horas (R24h) y el QFA. Los valores promedio de energía y nutrientes procedentes del QFA se compararon con los del R24h mediante una prueba t de student y los coeficientes de correlación de Pearson. La concordancia se evaluó usando el método de Bland-Altman y el estadístico kappa.
Resultados: El consumo estimado de energía y nutrientes usando el QFA fue significativamente superior que el obtenido usando el R24h. Los coeficientes de correlación ajustados para la energía fueron estadísticamente significativos para proteínas, grasas, vitamina C y cinc. Los valores ponderados por kappa variaron desde 0,06 para la vitamina A (p = 0,24) hasta 0,34 para la energía (p < 0,00). Los resultados de las gráficas de Bland-Altman para los lípidos, proteínas y cinc mostraron los parámetros más significativos para la validez y se halló que el cinc tenía la mejor concordancia.
Conclusión: Los resultados sugieren que el QFA mostró una validez satisfactoria para ser usado en estudios con niños y adolescentes.

Palabras clave: Validez. Cuestionario de frecuencia de alimentos. Niños.

Abbreviations
FFQ: Food frequency questionnaire.
R24: 24-hour recall.
SCAALA: Social Changes, Asthma and Allergy in Latin America Programme. ]]> TACO: Tabela Brasileira de Composição de Alimentos.
ENDEF: Tabela de Composição de Alimentos.

Introduction

Epidemiological studies have often used food frequency questionnaires (FFQs) to evaluate the relationship between habitual diet and disease. In many investigations on food consumption among children and adults, FFQs have been shown to be good tools for assessing energy and macronutrient intake and reasonable tools for micronutrient intake.^1,2,3,4 Considering the complexity of individuals' diets and the substantial variability in food intake over time, measurement errors are inevitable.⁵ Validation of food intake measurement tools makes it possible to increase the accuracy of dietary information and diminish possible sources of bias.⁶ This validation is generally obtained through assessment of concordance in relation to a reference method, i.e. comparison between the method to be tested and another reference method that represents the real food intake of individuals or a population group. The statistical methods most used in validating dietary assessment tools are the following: comparison of mean nutrient measurements; correlation analyses on Pearson's or Spearman's correlation coefficient and kappa statistics; and comparative distribution according to quartiles or quintiles of nutrient intake.⁶ In FFQ validation studies, 24-hour recall (R24h) is the method used as the reference point, since this is inexpensive and quickly applied, does not interfere with the family's dietary behavior and does not require any minimum schooling level, unlike the dietary record method.⁵

In Brazil, there is still a scarcity of FFQ validation studies in relation to children aged 5 to 10 years.^7,8 In this respect, the present study makes it possible to qualitatively and quantitatively assess the diets of children and adolescents. During this stage of life, nutritional needs are greater because of growth and development, and this is also the time at which dietary habits are formed and consolidate. These are recognized to be influenced by cultural, economic, social and environmental factors.

Thus, the aim of this study was to validate an FFQ through applying it to a subsample of children and adolescents aged 4 to 11 years who were living in Salvador, Bahia.

Population and methods

A sample of 108 children and adolescents was randomly selected in order to validate the dietary assessment tool (i.e. the FFQ), using R24h as the reference method. These individuals came from a cohort composed of 1,445 children aged 4 to 11 years that had been set up to study risk factors for occurences of asthma and other allergic diseases (within the SCAALA program: Social Changes, Asthma and Allergy in Latin America). Further details on the methodology of this project can be obtained else-where⁹. To estimate the minimum sample size for the present study, the minimum expected correlation between the two methods was taken to be 0.30, the significance level used was 5% and the power was taken to be 80%.¹⁰

In the R24h, all the foods, drinks and preparations consumed on the previous day were recorded. The FFQ was composed of 98 food items. For both of the food intake assessment tools, the mothers or other adults responsible for the children provided the information on the frequencies and quantities of food and drinks consumed.

For both tools, the portions or home-cooking measurements reported were converted into grams or milliliters. To minimize possible sources of error (memory bias) originating from the food consumption information, an album with drawings of foods and utensils of different dimensions was used, and in addition, standard liquid measurements were presented to the mothers at the time of the interview.^11,12

The nutritional analysis on the food intake quantities recorded using the two tools (FFQ and R24h) was done using the Diet-Pro software,¹³ which was developed at the Federal University of Vicosa, Minas Gerais. Foods that did not form part of the database of this software were added, using information contained in the Brazilian Food Composition Table (TACO);¹⁴ Assessment Table for Food Consumption from Home-Cooking Measurements;¹⁵ ENDEF Food Composition Table¹⁶; and packaged food labels. It should be noted that to obtain the estimated nutritional value of the habitual daily food intake, from the FFQ, the frequency of consumption was transformed according to the number of times per day, by multiplying by the portion size in grams and dividing by the number of days of the month. Both dietary assessment tools provided data on total energy, carbohydrate, lipid, protein, vitamin A, vitamin C and zinc content.

Statistical analysis

The means and standard deviations for the energy and nutrient content estimated from the R24h and FFQ were calculated using the absolute values. The paired t test was used to assess the differences between the means for energy and nutrients derived from the two dietary tools. The data were firstly transformed into log values in order to produce normal distribution, and then the residual nutrient content was calculated, i.e. the portion of the nutrient intake that does not correlate with the total energy intake.¹⁷

To identify consumption correlations, Pearson's linear correlation coefficient was used, before and after adjustment for total energy intake. To assess the concordance between the results obtained using the two tools, the intake level of each nutrient was classified into quartiles and was tested using weighted kappa statistics. These statistics take into account the magnitude of discordances between the classifications, using the expression 1 - {(i - j)/(k - 1)}² for weighting. In this expression, i and j are respectively the lines and columns of the classifications obtained using the two associated dietary tools, and k is the maximum number of possible classifications¹⁸. The values obtained for the kappa coefficient were interpreted in accordance with the cutoff points proposed by Landis and Koch.¹⁸ Thus, kappa values of less than 0.21 were taken to indicate weak concordance; 0.21 to 0.40, fair concordance; 0.41 to 0.60, moderate concordance; 0.61 to 0.80 substantial concordance; and greater than 0.80, almost perfect concordance.

The plots proposed by Bland-Altman¹⁹ were also used to assess the degree of concordance between the values obtained from the two tools. In these, the paired differences in nutrient values obtained from the R24h and FFQ were plotted in relation to their respective means, with the lowest and highest intake limits represented by horizontal lines. The plot shows a trend if the variance of the FFQ tool is greater than the variance of the R24h tool and no trend if the variance of the two tools is the same. All the analyses were done using the STATA software (Stata Corporation, College Station, United States), version 9.0.

The protocol for this study was approved by the ethics committee for human research of the Institute of Public Health, Federal University of Bahia (CEP/ISC protocol no. 003-05). Data were only gathered after signed consent had been received from the children's guardians.

Among the 108 children who participated in the validation study, 57 (47.2%) were male and 51 (52.8%) were female. They were between 4 and 11 years of age (mean of 6.7 years; SD = 1.67), with a mean weight of 22.8 kg (SD = 6.04) and mean height of 120.8 cm (SD = 10.64).

Table I presents the means and their respective standard deviations for energy and nutrients, derived from the FFQ and R24h. Comparison of mean energy and nutrient intakes estimated using the FFQ and R24h showed that the FFQ overestimated the intake in relation to the result obtained using the R24h. The mean energy, vitamin A and vitamin C intakes were overestimated, respectively, by 315 kcal, 718.2 μg and 207.9 mg. Evaluation of the differences between these means using the paired t test showed statistically significant differences (p < 0.001) for energy and all the nutrients analyzed.

The crude correlation coefficients obtained ranged from 0.18 for vitamin A to 0.38 for carbohydrates. After adjustment for energy, all the values tended to decrease, and the largest reductions were observed in relation to carbohydrates and vitamin A, for which the adjusted r values came to have the same value (0.14), but did not show statistical significance. All the other adjusted values were lower and were statistically significant (proteins, lipids, vitamin C and zinc). After adjustment for dietary energy, the correlation coefficients between the estimated values from the FFQ and R24h ranged from 0.14 to 0.29 (table II).

The weighted kappa values ranged from 0.06 for vitamin A to 0.34 for energy, and were statistically significant for energy and most of the nutrients: proteins, lipids, carbohydrates, vitamin C and zinc. There was weak concordance (kappa values < 20) for vitamin A and carbohydrates. The nutrients that presented fair concordance (kappa from 0.21 to 0.34) were proteins, lipids, vitamin C and zinc, along with energy (table II).

Bland-Altman plots were used to assess the concordance between the mean energy and nutrient values estimated from the two tools. Figure 1 illustrates the results from the Bland-Altman analyses for lipids, proteins and zinc: these were the nutrients with the best validity parameters, and zinc was the nutrient with the best concordance (p = 0.059).

Discussion

The present study examined the validity of an FFQ for assessing food intake among children and adolescents aged 4 to 11 years. It was observed that after adjustment for energy, the correlation coefficient decreased for the majority of the nutrients. Similar results were observed by Fumagalli et al.,⁷ who examined the validity of an FFQ for children aged 5 to 10 years in Sao Paulo; and by Kobayashi et al.,²⁰ who studied the validity of an FFQ for Japanese children aged 3 to 11 years. The results from these studies showed that the intake quantities of energy and several nutrients shown by the FFQ were overestimates. In our study, comparing the differences between the mean values for energy availability and vitamin A and C intake estimated by the FFQ and R24h, it was also observed that the quantities found were overestimates. This was observed when the test for differences in means or the correlation coefficient adjusted for energy consumed was used.

It is possible that these results may be indicating that there was an error in the information on the quantity of nutrient portions consumed. This supposition may be justified by the comment made by Willett,¹⁷ who stated that the adjustment for total calories decreased the correlation coefficient when the variability of nutrient intake was related to systematic overestimation and/or underestimation errors. The explanation for this over-estimation that was identified in relation to the FFQ may be attributable to the number of foods contained in the study tool.

In this respect, it can be commented that even the method used in the present study as the gold standard has limitations regarding both overestimation and underestimation of the portions consumed. Like in other investigations, it can be understood that one of the main limitations of the present study was that it used the R24h as the reference method, given that like the FFQ, this method also depends on the interviewees' memories, which may result in either underestimation or overestimation of food intake.

Most of the nutrients studied were shown to present fair concordance according to the kappa coefficient. In this respect, our results are similar to those found in a study conducted on 91 children aged 6 to 10 years who were living in Porto Alegre⁸, or to the study by Fumagalli et al⁷, whose method for recording three days provided kappa coefficient estimates that were classified as weak for the majority of nutrients.

Nonetheless, in our study, the Bland-Altman plots showed that the dispersion between the mean intakes estimated from the two methods presented a good concordance trend for some nutrients like lipids, proteins and zinc. From visual analysis on the plots, it was noted that the points generated were very close to zero and the numbers of points outside of the lower and upper limits of the plot baseline were small, thus indicating that according to this approach, the concordance between the tools was adequate.¹⁹ In a study conducted with of children and adolescents living in southern Spain, the Bland-Altman plot was used to validate the FFQ and R24 h and was found correlation between the instruments for energy and macronutrients. The graphical presentation of our results for proteins and lipids are similar to those found by Spanish authors.²²

It has to be acknowledged that the capacity for comparisons of results between these validation studies is limited, particularly because of the differences in the reference methods used. These reference methods usually consist of the R24h or a food record, and may vary in terms of the number of days of data gathering, the reference periods used and the use made of nutrient intake estimates or the frequency of consuming foods or food groups, in assessing the diet.

Some validation studies conducted among children and adolescents in developed and developing countries have used the food record method as the gold standard^6,23. However, among populations with low schooling levels, which is the reality for a large proportion of the population in many regions of Brazil, it becomes impossible to use this method. Despite all the limitations of the R24h that have been mentioned, it has been indicated to be the most appropriate method for validation studies among populations with low income and low schooling levels, when it is conducted in several steps.²⁴ Use of this tool may minimize memory bias and standardize the interviews.

Even though no method can be considered to be a gold standard for directly assessing the validity of FFQs, the food record and R24h methods have been the ones most used for validations. The R24h method is less demanding than the food record method and is less liable to influence the subjects' real diet. Its sources of error tend to be more related to errors within the tool, such that responses to the questions asked depend on the interviewee's memory and motivation and the estimates of food portion sizes.

Thus, the results suggest that the FFQ presented satisfactory validity and can be used in studies for assessing the food consumption of children in the age range of 4 to 11 years. Nevertheless, for it to be used in different geographical areas, procedures for adapting the questionnaire before applying it will be necessary.

Acknowledgements

References

1. Rivas A, Mariscal M, Monteagudo C, Hernández J, Olea-Serrano F. Validation of questionnaires for the study of food habits and bone mass. Nutr Hosp 2009; 24: 521-8.         [ Links ]

2. Monsalve Álvarez JM, González Zapata LI. Development of questionnaire to assess food intake in the University of Antioquia, Colombia. Nutr Hosp 2011; 26:1333-44.         [ Links ]

3. Roumelioti M, Leotsinidis M. Relative validity of a semiquantitative food frequency questionnaire designed for schoolchildren in western Greece. Nutrition Journal 2009; 8:8 http://www.nutritionj.com/content/8/1/8. Accessed in 06/06/2011.         [ Links ]

4. Egami I, Wakai K, Kato K, Lin Y, Kawamura T, Tamakoshi A et al. A simple food frequency questionnaire for Japanese diet-part II. Reproducibility and validity for nutrient intakes. J Epidemiol 1999; 9: 227-34.         [ Links ]

5. Willett WC. Nutritional epidemiology. New York: Oxford University Press; 1998.         [ Links ]

6. Fisberg RM, Martini LA, Slater B. Métodos de inquéritos alimentares. In: Fisberg RM, Slater B, Marchioni DML, Martini LA. Inquéritos alimentares: métodos e bases científicos. Barueri/SP: Manole; 2005, pp. 1-29.         [ Links ]

7. Fumagalli F, Monteiro JP, Sartorelli DS, Vieira MNCM, Bianchi MLP. Validation of a food frequency questionaire for assessing dietary nutrients in Brazilian children 5 to 10 years of age. Nutrition 2008; 24: 427-32.         [ Links ]

8. Del Pino DL. Adaptação e validação de um questionário de frequência alimentar para crianças de 6 a 10 anos. (dissertação de mestrado). Porto Alegre: Faculdade de Medicina da UFRGS; 2009.         [ Links ]

9. Barreto ML, Cunha SS, Alcântara-Neves N, Carvalho LP, Cruz AA, Stein RT et al. Risk factors and immunological pathways for asthma and other allergic diseases in children: background and methodology of a longitudinal study in a large urban center in Northeastern Brazil (Salvador-SCAALA Study). BMC Pulm Med 2006; 6: 15.         [ Links ]

10. Cardoso MA. Desenvolvimento, validação e aplicação de questionários de frequência alimentar em estudos epidemiológicos. In: Kac G; Sichieri R; Gigante DP. editor. Epidemiologia nutricional. Rio de janeiro: Fio Cruz/Atheneu; 2007, pp. 201-212.         [ Links ]

11. Magalhães LP, Oliveira VA, Santos NS, Araújo CS. Guia prático para estimativa de consumo alimentar. Salvador: Escola de Nutrição, UFBA, 2000.         [ Links ]

12. Araújo MPM, Santos MPN. Método visual de alimentos como recurso para inquérito dietético. Salvador: Escola de Nutrição, UFBA, 1991.         [ Links ]

13. DietPro. Sistema de análise nutricional (programa de computador) versão 4.0, 2006.         [ Links ]

14. Núcleo de Estudos e pesquisas em Alimentação. Tabela de composição de alimentos, versão 2. Campinas: Universidade Estadual de Campinas; 2006.         [ Links ]

15. Pinheiro ABV, Lacerda EMA, Benzecry EH, Gomes MCS, Costa VM. Tabela para avaliação de consumo alimentar em medidas caseiras. 5^a ed. Rio de Janeiro: Atheneu; 2005.         [ Links ]

16. Estudos Nacional da Despesa Familiar- ENDEF. Tabelas de composição de alimentos. 4^a ed. Rio de Janeiro: Fundação Instituto Brasileiro de Geografia e Estatística; 1996.         [ Links ]

17. Willett WC, Stampfer MJ. Total energy intake: implications for epidemiologic analyses. Am J Epidemiol 1986; 124: 17-20.         [ Links ]

18. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33: 159-74.         [ Links ]

19. Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res 1999; 8: 135-60.         [ Links ]

20. Kobayashi T, Kamimura M, Imai S, Toji C, Okamoto N, Fukui M et al. Reproducibility and validity of the food questionnaire for estimating habitual dietary intake in children and adolescents. J Nutr 2011. http://www.nutritionj.com/content/10/1/27. Acesso: 2/05/2011.         [ Links ]

21. Freedman LS, Carroll RJ, Wax Y. Estimating the relation between dietary intake obtained from a food frequency questionnaire and true average intake. Am J Epidemiol 1991; 134: 310-20.         [ Links ]

22. Arcas-Mariscal M, Velasco J, Monteagudo C, Caballero-Plasencia MA, Lorenzo-Tovar ML, Olea-Serrano F. Comparison of methods to evaluate the quality of the Mediterranean diet in a large representative sample of young people in Southern Spain. Nutr Hosp. 2010; 25: 1006-1013.         [ Links ]

23. Andersen LF, Lande B, Trygg K, Hay G. Validation of a semi-quantitative food-frequency questionnaire used among 2 year old Norwegian children. Public Health Nutr 2004; 7:757-764.         [ Links ]

24. Vucic V, Glibetic M, Novakovic R, Ngo J, Ristic-Medic D, Tepsic J et al. Dietary assessment methods used for low-income populations in food consumption surveys: a literature review. Br J Nutr 2009; 101 (Suppl. 2): S95-101.         [ Links ]

Correspondence:
Sheila Maria Alvim Matos.
Instituto da Saúde Coletiva.
Universidade Federal da Bahia.
Rua Basilio da Gama, s/n.
Campus Universitario do Canela, 5.^o andar. ]]> 40-110-040 Salvador. Bahia. Brazil.
E-mail: sheilaalvim@hotmail.com

Recibido: 24-III-2012.
Aceptado: 27-III-2012.