Differences in accuracy of height, weight, and body mass index between self-reported and measured using the 2018 Korea Community Health Survey data
Article information
Abstract
OBJECTIVES
This study aimed to determine an effective survey method for the accurate calculation of obesity prevalence by comparing the self-reported and measured height, weight, and body mass index (BMI) using the 2018 Korea Community Healthy Survey (CHS) data.
METHODS
Raw data from the 2018 CHS were used to analyze the differences, correlation, and agreement between self-reported and measured height, weight, and BMI.
RESULTS
The self-reported height was over-reported than the measured height (0.59 cm greater for men and 0.71 cm greater for women), while the self-reported weight was under-reported than the measured weight (0.55 kg less for men and 0.67 kg less for women). Subsequently, the self-reported BMI was under-estimated (0.35 kg/m2 lower for men and 0.49 kg/m2 lower for women) compared with the measured BMI. The kappa statistic and agreement between measured and self-reported values per BMI category (underweight, normal, overweight, and obesity) were 0.82 and 79.6%, respectively.
CONCLUSIONS
The prevalence of obesity should be calculated using the measured values provided in the CHS in order to promote local health projects based on accurate evidence.
INTRODUCTION
Overweight and obesity are defined as abnormal or excessive accumulation of fat that may impair one’s health [1]. In general, obesity is indirectly measured based on the body mass index (BMI, kg/m2), which is calculated as weight in kilograms divided by height in meters squared. BMI is used to classify overweight (≥ 25 kg/m2) and obesity (≥ 30 kg/m2) in adults.
As of 2016, more than 1.9 billion adults worldwide aged ≥ 18 years were overweight, and more than 650 million of them, accounting for 13% of the world’s adult population, were obese (men: 11%, women: 15%). This number has increased almost three-fold compared with that reported in 1975 [1]. In Korea, as of 2019, the prevalence of obesity among adults (BMI ≥ 25 kg/m2) was 33.8% (≥ 19 years old, standardized), showing a continuous increase [2]. Obesity is a key risk factor for the development of non-communicable diseases such as type 2 diabetes, cardiovascular disease, hypertension, stroke, and various cancers, and the comorbidities of obesity not only increases the socioeconomic burden, but also decreases the quality of life [3]. The World Health Organization announced the “Global strategy on diet, physical activity, and health” during the 57th Annual Meeting in 2004. This agency is making continuous efforts to prevent and manage obesity, a global health problem [4]. As obesity is a preventable disease [1], continuous policies should be established to investigate the exact prevalence of obesity, and effective preventive strategies should be implemented.
In Korea, the National Health and Nutrition Examination Survey (NHANES) and Community Health Survey (CHS) were conducted to assess the regional and national prevalence of obesity. The data obtained from these surveys were used as evidence for the establishment and evaluation of the national and local government policies to prevent and manage obesity. In the NHANES, the prevalence of obesity was calculated by measuring the height and weight of 10,000 individuals. The CHS targeted 230,000 individuals in order to calculate the self-reported obesity rate since 2008 due to convenience and cost. However, in 2018, body measurements were obtained to calculate the prevalence of obesity.
According to several previous studies, BMI measurements based on self-reported data were used instead of the actual measurements in many large-scale epidemiological studies for their relative convenience and efficiency. However, such self-reported data were shown to be inaccurate as they contain errors such as underreported weight and overreported height by the participants [5-10]. In certain studies, the correlation coefficient between self-reported and actual values was greater than 0.8 [10-19]. In studies conducted in Korea examining the accuracy of self-reported height and weight, it was recommended that the actual measurement values should be used for evaluation of obesity [20] and the height, weight, and obesity rate must be calculated based on the actual data [10]. Additionally, other studies reported that the self-reported values were accurate for use in clinical and public health studies; however, the studies were only conducted in visitors and inpatients of hospital examination centers [19,21]. Therefore, this study conducted a comparative analysis of the prevalence of obesity calculated using the self-reported and measured values of height and weight from the data of the 2018 CHS to suggest a more accurate method for calculation of obesity prevalence.
MATERIALS AND METHODS
This study was conducted using raw data from the 2018 CHS. This survey was conducted in 254 public health centers nationwide. Each public health center visits 900 individuals for interviews every year from August to October in order to investigate the health of local residents. In the 2018 survey, a total of 228,340 individuals participated. Those who “refused to respond” or responded “do not know” and the outliers (height: < 50 or > 200 cm; weight: < 20 or > 130 kg; and BMI: < 10 or > 50 kg/m2) were excluded; hence, a total of 214,640 participants were included in the final analysis, of whom 183,211 participants obtained their own body measurements. Individuals who could not stand still and pregnant women were excluded from undergoing body measurements.
The 2018 CHS was the only survey in which self-reported and actual body measurements of height and weight were simultaneously investigated. Prior to the body measurements, the participants were asked the following question: “What are your height and weight?”
To measure the height and weight during household visits, convenient tools without a large range of error for measurements were selected. The ultrasonic extensometers (InLab S50; InBody Co., Seoul, Korea), and CAS HE-58 (CAS, Yangju, Korea) were used to evaluate height and weight, respectively. The height was measured twice with the participant in a standing position, and the mean value was used for analysis. The weight was measured once. The reliability and effectiveness of the ultrasonic extensometer have been previously demonstrated [22].
Statistical analysis
SAS version 9.4 (SAS Institute Inc., Cary, NC, USA) was used to perform all statistical analyses. In this complex sample study, a stratified analysis was conducted by gender and age groups (19- 29, 30-39, 40-49, 50-59, 60-69, and ≥ 70 years old). A p-value of less than 0.05 was considered significant. Paired t-test was conducted to calculate the mean and 95% confidence interval (CI) and compared the differences between self-reported and measured values of height, weight, and BMI. Pearson’s correlation analysis was conducted to determine the correlation between the self-reported and measured values, and Bland-Altman analysis was conducted to compare the differences between the two values. The participants were categorized into four BMI groups based on the self-reported and measured values ( < 18.5, 18.5-22.9, 23.0-24.9, and ≥ 25.0 kg/m2), and the kappa statistic was assessed to evaluate the agreement by a group. To compensate for the possible errors of measured values obtained using the ultrasonic extensometer, 0.4 cm was subtracted from the height for analysis.
Ethics statement
This study was not subject to deliberation by the research ethics committee because it was conducted directly or commissioned by the state or local government to review and evaluate public welfare or service programs (Enforcement Rule of Bioethics and Safety Act, Article 2).
RESULTS
Participants’ general characteristics
The general characteristics of individuals who participated in both the self-administered questionnaire survey and body measurements and those who participated in the self-administered questionnaire survey, but not in the body measurements were compared.
Young men participants who had high income, a high level of education, a professional or office occupation, were unmarried, dong area residents, had a second-generation household type, and were obese (based on self-report) were significantly more likely to complete the self-administered questionnaire and not participate in body measurements (Table 1).
Comparison of self-reported and measured height, weight, and body mass index values
The correlation coefficients between the measured and self-reported height, weight, and BMI values were 0.96, 0.98, and 0.93, respectively, showing high correlations (Figures 1-3).
The Bland-Altman plot comparing the difference between the measured and self-reported values showed the largest difference between the two values (measured values and self-reported values) when the average self-reported height was 125-150 cm. When the average self-reported height was greater than 150 cm, the difference tended to decrease. The mean of the difference (-0.97) between the measured and self-reported values was close to 0. The 95% CI (limits of agreement) were -6.26 to 4.31 using the formula of mean± 2*standard deviation (SD) and -8.91 to 6.96 using the formula of mean± 3*SD (Figure 1). The difference between the measured and self-reported weight values was the greatest when the mean of measured and self-reported height values was 75-100 kg. When the mean of the two values was less than 75 kg or greater than 100 kg, the difference tended to decrease. The mean of the difference (0.52) between the measured and self-reported values was close to 0. The 95% CI were -4.80 to 5.84 using the formula of mean ± 2*SD and -7.50 to 8.50 using the formula of mean± 3*SD (Figure 2). The difference between the measured and self-reported BMI values was the greatest when the mean of the measured and self-reported values was 30-40. When the mean of the two values was less than 30 or greater than 40, the difference tended to decrease. The mean of the difference (0.49) between the measured and self-reported values was close to 0. The 95% CI values were -1.20 to 2.98 using the formula of mean ± 2*SD and -3.24 to 4.23 using the formula of mean± 3*SD (Figure 3).
The self-reported height values were 0.59 cm and 0.71 cm greater than the measured values for men and women, respectively. In particular, both men and women tended to report height values greater than the actual measurements as the age increased. Men aged 30-39 years, 50-59 years, and ≥ 70 years reported height values 0.26 cm, 0.65 cm, and 1.70 cm greater than the actual measured height values, respectively. Women aged 30-39 years, 50-59 years, and ≥ 70 years reported height values 0.20 cm, 0.75 cm, and 2.17 cm greater than the actual measured height values, respectively. In men aged 19-29 years, the difference between measured and self-reported values was minimal. However, in women aged 19-29 years, the self-reported height was 0.11 cm lesser than the actual measured height (Table 2).
In men and women, the self-reported weight values were 0.55 kg and 0.67 kg lesser than the actual measured weight, respectively. The difference between self-reported and measured weight values was greater in middle-aged and older participants. The difference decreased significantly in participants aged ≥ 70 years. In men aged 30-39 years, 50-59 years, and ≥ 70 years, the self-reported weight values were 0.72 kg, 0.58 kg, and 0.06 kg lesser than the actual measured weight, respectively. In women aged 30-39 years, 50-59 years, and ≥ 70 years, the self-reported weight values were 0.74 kg, 0.75 kg, and 0.37 kg lesser than the actual measured weight, respectively. In all age groups, women self-reported lower weight than men (Table 2).
The self-reported BMI values were 0.35 kg/m2 and 0.49 kg/m2 lesser than the actual measured BMI for men and women, respectively. In both men and women, the self-reported values tended to be lesser than the actual measured BMI as the age increased. In men aged 30-39 years, 50-59 years, and ≥ 70 years, the self-reported BMI values were 0.31 kg/m2, 0.38 kg/m2, and 0.49 kg/m2 lesser than the actual measured BMI, respectively. In women aged 30-39 years, 50-59 years, and ≥ 70 years, the self-reported BMI values were 0.34 kg/m2, 0.53 kg/m2, and 0.83 kg/m2 lesser than the actual measured BMI, respectively (Table 2).
Agreement between the measured and self-reported body mass index values per category
Agreement between the measured and self-reported BMI values was analyzed by category (underweight, normal, overweight, and obesity). The kappa statistics of 0.82 and 79.6% agreement were observed. In the underweight category, a 73.8% agreement was found between the measured and self-reported BMI values. In normal, overweight, and obesity categories, the agreement rates were 81.8%, 67.3%, and 92.6%. The agreement between measured and self-reported BMI values was the highest in the obesity group. In addition, the agreement rates and kappa statistics were higher in men than in women (Table 3).
DISCUSSION
Herein, we observed that the self-reported height and weight were over-reported and under-reported than the measured value, respectively. As a result, the self-reported BMI was underestimated than the measured BMI. In particular, men and women showed opposite findings on the difference between the measured and self-reported height values. When men reach the age of 19 years, they undergo body measurement as part of the requirements for army enlistment and are updated on their latest height. By contrast, most women only measure their height in school, leading to differences and errors between the measured and self-reported height values. Additionally, the self-reported and measured values were only evaluated simultaneously during the CHS in 2018. In particular, the self-reported obesity rate increased by 3.2%p from 28.6% in 2017 to 31.8% in 2018 [23]. This increase was approximately four times greater than the average increase of 0.9%p in the last five years from 2013, which reflects the honest responses of the participants in the self-administered questionnaires.
Consistent with our finding, in a study of 2,198 participants on the accuracy of self-reported height, weight, and BMI in the CHS, Jeong et al. [10] showed that both men and women over-reported their height, (men: 0.48 cm, women: 0.38 cm), under-reported their weight (men: -0.74 kg, women: -1.23 kg), and under-reported their BMI (men: 0.39 kg/m2, women: 0.60 kg/m2). In a comparison of the self-reported results of the 2010 CHS and measured prevalence of obesity in the 2010 KNHANES, Park et al. [24] reported that obesity and overweight were underestimated by 8.6%p and 7.8%p, respectively, in the CHS. Ki et al. [25] compared the estimates of the CHS and measured values of the KNHANES from 2010 and 2015 and observed absolute differences between the two surveys (8.9%p in 2010, 8.7%p in 2011, 8.8%p in 2012, 8.3%p in 2013, 6.6%p in 2014, and 8.2%p in 2015). Additionally, Kim et al. [26] compared the differences between measured values in the 2018 KNHANES and CHS. Although no significant difference was found, height and weight were under-reported in the CHS than in the KNHANES, while not difference was observed in BMI values between the two surveys.
Among the Organization for Economic Cooperation and Development countries, only 20, including Korea, provided both the measured and self-reported prevalence of obesity, 4 provided the measured values alone, and 13 provided the self-reported values alone. In a comparison of obesity prevalence in countries that provided the measured and self-reported values, significant differences were observed in the prevalence of obesity [26]. In Korea, the prevalence of obesity, defined as BMI of ≥ 30 kg/m2, were 5.9% based on the measured values and 4.3% based on the selfreported values in 2018, showing a difference of 1.6%p. Similarly, in the United States, the prevalence of obesity were 40.0% based on the measured values and 30.2% based on the self-reported values in 2016, showing a difference of 9.8%p [27].
Based on these findings, in order to develop effective methods and standardized surveys for monitoring the prevalence of obesity in Korea, considering that the CHS was only used for establishing and evaluating the Community Health Plans, accurate regional statistics are essential; take into account the survey conditions and cost-effectiveness, measurement surveys with cycles need to be conducted. In particular, external quality control by experts must be implemented for measurement surveys in order to improve the accuracy and reliability. Our findings also showed that young men who had high income, had high levels of education, and were unmarried did not undergo body measurements. Thus, in future body measurement surveys, calculating the prevalence of obesity using the height and weight values from the National Health Insurance Service health examination data may also be considered. However, this must be preceded by an amendment of laws and regulations on the personal information collected for the use of resident registration numbers and review of consent for data link agreements between institutions.
In conclusion, there was a significant difference between selfreported and measured values of the CHS. The measured values, rather than the self-reported values, were similar to the KNHANES results. This study is meaningful as it compared the self-reported and measured height and weight values of the 2018 CHS to accurately calculate the prevalence of obesity and suggest an efficient survey method. Therefore, to accurately calculate the prevalence of obesity in the CHS, BMI may be assessed using the measured height and weight values. In large-scale surveys, use of self-administered questionnaires, which are cost-effective, may lead to the underestimation of results. However, continuous monitoring using consistent standards and survey methods may help collect meaningful statistical data to compare the time series trends in the obesity rate. As the CHS provides basic regional health statistic data for establishing and evaluating Community Health Plans, the prevalence of obesity should be calculated using the measured values for use by local governments to promote community health projects based on more accurate statistical data.
SUPPLEMENTARY MATERIALS
Korean version is available at https://www.e-epih.org/.
Notes
CONFLICT OF INTEREST
The authors have no conflicts of interest to declare for this study.
FUNDING
None.
AUTHOR CONTRIBUTIONS
Conceptualization: Lee YK, Ko Y, Choi S, Won J. Data curation: Won J, Ko Y. Formal analysis: Ko Y. Funding acquisition: None. Project administration: Kim DH, Lee YK, Lee SK. Visualization: Ko Y, Choi S. Writing – original draft: Choi S, Ko Y, Won J. Writing – review & editing: Choi S, Lee YK, Kim DH, Lee SK.
Acknowledgements
We are grateful to the CHS participants. We also thank the 17 cities and provinces, 254 public health centers and 35 responsible university for conducting the investigation and supporting for the survey.