OBJECTIVES Responses to health-related items on the Community Health Survey (CHS) provide evidence that is used to develop community-based health policy. This study aimed to assess the test-retest reliability of selected health behavioral items on the CHS according to item category, response period, and response scale.
METHODS
A sample of 159 men and women 20 to 69 years of age participated in a test-retest with an interval of 14 to 21 days. A total of 28 items relating to smoking, alcohol consumption, diet and weight control, and mental health were selected. We evaluated the test-retest reliability of the items using kappa statistics.
RESULTS
Kappa values ranged from 0.44 to 0.93. Items concerning habits had higher kappa values (mean, 0.7; standard error, 0.05) than items concerning awareness or attitudes (p=0.012). The kappa value of items with two- to four-point scales was 0.63, which was higher than the value of 0.59 for items with scales involving five or more points, although this difference was not statistically significant. Different kappa values were observed for each reference period, but no statistically significant differences were noted.
CONCLUSIONS
The test-retest reliability of the CHS items that we studied was associated with item category. Further study of the relationship between item category and reliability in domains other than health behaviors is required.
Summary
Korean summary
이 연구는 지역사회건강조사의 건강행태 문항 중 28개 문항에 대하여 문항의 특성, 준거기간, 보기의 척도에 따라 조사-재조사 신뢰도의 차이를 분석하였다. 전체 문항의 카파값의 범위는 0.44-0.93이었다. 문항의 특성별로는 인지 또는 태도에 비해 습관에 관한 문항의 신뢰도가 높았으며, 보기의 척도가 5점 척도 이상에 비해 2-4점 척도의 신뢰도가 높음을 확인하였다.
Citations
Citations to this article as recorded by
Change in Denture Procedures after Implementation of National Health Insurance Coverage for the Elderly in Korea: A Nationwide Database Ye Seol Lee, Juyeong Kim, Yoon Soo Choy, Eunkyong Kim, Jaehyun Yoo International Journal of Environmental Research and Public Health.2021; 18(5): 2283. CrossRef
Influence of dental insurance coverage on access to preventive periodontal care in middle-aged and elderly populations: analysis of representative Korean Community Health Survey Data (2011–2015) Young-Eun Jang, Chun-Bae Kim, Nam-Hee Kim International Dental Journal.2019; 69(6): 445. CrossRef
Assessment of the validity and reliability of an urban household health expenditure (HHE) questionnaire in Kuala Lumpur, Malaysia Murallitharan Munisamy, Tharini Thanapalan, Pattaraporn Piwong, Alessio Panza, Sathirakorn Pongpanich Journal of Health Research.2018; 32(1): 24. CrossRef
Effects of living alone versus with others and of housemate type on smoking, drinking, dietary habits, and physical activity among elderly people Seungmin Jeong, Sung il Cho Epidemiology and Health.2017; 39: e2017034. CrossRef
Tapering Practices of Strongman Athletes: Test-Retest Reliability Study Paul W Winwood, Hayden J Pritchard, Justin WL Keogh JMIR Research Protocols.2017; 6(10): e211. CrossRef
Low socioeconomic status and suicidal ideation among elderly individuals Yeong Jun Ju, Eun-Cheol Park, Kyu-Tae Han, Jae Woo Choi, Jeong Lim Kim, Kyoung Hee Cho, Sohee Park International Psychogeriatrics.2016; 28(12): 2055. CrossRef
<sec><title>OBJECTIVES</title><p>Our goal is to validate diagnosing and characterizing epilepsy based on a medical record survey by external reviewers.</p></sec><sec><title>METHODS</title><p>We reviewed medical records from 80 patients who received antiepileptic drugs in 2009 at two hospitals. The study consisted of two steps; data abstraction by certified health record administrators and then verification by the investigators. The gold standard was the results of the survey performed by the epileptologists from their own hospital.</p></sec><sec><title>RESULTS</title><p>The specificity was more than 90.0% for diagnosis and activity, and for new-onset seizures. The sensitivity was 97.0% or more for diagnosis and activity and 66.7-75.0% for new-onset epilepsy. This method accurately classified epileptic syndromes in 90.2-92.9% of patients, causes in 85.4-92.7%, and age of onset in 78.0-81.0%. Kappa statistics for inter-rater reliability and test-retest reliability ranged from 0.641-0.975, which means substantial to near-perfect agreement in all items.</p></sec><sec><title>CONCLUSIONS</title><p>Our data suggest that epilepsy can be well identified by external review of medical records. This method may be useful as a basis for large-scale epidemiological research.</p></sec>
Summary
Citations
Citations to this article as recorded by
The association between early childhood onset epilepsy and attention-deficit hyperactivity disorder (ADHD) in 3237 children and adolescents with Autism Spectrum Disorder (ASD): a historical longitudinal cohort data linkage study Lauren Carson, Valeria Parlatini, Tara Safa, Benjamin Baig, Hitesh Shetty, Jacqueline Phillips-Owen, Vibhore Prasad, Johnny Downs European Child & Adolescent Psychiatry.2023; 32(11): 2129. CrossRef
Risk of COVID-19 Infection and of Severe Complications Among People With Epilepsy Joonsang Yoo, Jee Hyun Kim, Jimin Jeon, Jinkwon Kim, Tae-Jin Song Neurology.2022;[Epub] CrossRef
The bumpy road to achieve reliability of clinical profile characteristics in psychosis and related disorders Steven Berendsen, Mirjam J. van Tricht, Amy Tedja, Thijs J. Burger, Mariken B. de Koning, Lieuwe de Haan International Journal of Methods in Psychiatric Research.2021;[Epub] CrossRef
Staging and profiling for schizophrenia spectrum disorders: Inter-rater reliability after a short training course Steven Berendsen, Jasper W. van der Paardt, Henricus L. Van, Marion van Bruggen, Hans Nusselder, Margje Jalink, Olav R. de Peuter, Jaap Peen, Mirjam J. van Tricht, Lieuwe de Haan Progress in Neuro-Psychopharmacology and Biological Psychiatry.2020; 99: 109856. CrossRef
The new definition and classification of seizures and epilepsy Jessica J. Falco-Walter, Ingrid E. Scheffer, Robert S. Fisher Epilepsy Research.2018; 139: 73. CrossRef
Presentation and management of community-onset vs hospital-onset first seizures Emma Foster, Sarah Holper, Zhibin Chen, Patrick Kwan Neurology Clinical Practice.2018; 8(5): 421. CrossRef
Estimating the Prevalence of Treated Epilepsy Using Administrative Health Data and Its Validity: ESSENCE Study Seo-Young Lee, Soo-Eun Chung, Dong Wook Kim, So-Hee Eun, Hoon Chul Kang, Yong Won Cho, Sang Do Yi, Heung Dong Kim, Ki-Young Jung, Hae-Kwan Cheong Journal of Clinical Neurology.2016; 12(4): 434. CrossRef
Early Antiretroviral Therapy Is Protective Against Epilepsy in Children With Human Immunodeficiency Virus Infection in Botswana David Bearden, Andrew P. Steenhoff, Dennis J. Dlugos, Dennis Kolson, Parth Mehta, Sudha Kessler, Elizabeth Lowenthal, Baphaleng Monokwane, Gabriel Anabwani, Gregory P. Bisson JAIDS Journal of Acquired Immune Deficiency Syndromes.2015; 69(2): 193. CrossRef
Clinical characteristics of patients with treated epilepsy in Korea: A nationwide epidemiologic study Dong Wook Kim, Seo‐Young Lee, Soo‐Eun Chung, Hae‐Kwan Cheong, Ki‐Young Jung Epilepsia.2014; 55(1): 67. CrossRef
Jae Jeong Yang, Ji Hyun Yang, Jimin Kim, Lisa Y. Cho, Boyoung Park, Seung Hyun Ma, Sang Hoon Song, Won-Ki Min, Sung Soo Kim, Man Suck Park, Sue K. Park
Epidemiol Health. 2011;33:e2011004. Published online May 19, 2011
<sec><title>OBJECTIVES</title><p>The aim of this study was to evaluate whether clinical test values from different laboratories in the Korean Genome and Epidemiology Study (KoGES) can be integrated through a statistical adjustment algorithm with appropriate intra- and inter-laboratory reliability.</p></sec><sec><title>METHODS</title><p>External quality control data were obtained from the Korean Society for Laboratory Medicine and quadruplicated standardized serological samples (N=3,200) were manufactured in order to check the intra- and inter-laboratory reliability for aspartic acid transaminase (AST), alanine transaminase (ALT), gamma-glutamyl transpeptidase (γ-GTP), blood urea nitrogen (BUN), creatinine, uric acid (UA), fasting blood sugar (FBS), cholesterol, and triglyceride (TG). As an index of inter- and intra-rater reliability, Pearson's correlation coefficient, intraclass correlation coefficients and kappa statistics were estimated. In addition, to detect the potential for data integration, we constructed statistical compensation models using linear regression analysis with residual analysis, and presented the R-square values.</p></sec><sec><title>RESULTS</title><p>All correlation coefficient values indicated good intra- and inter-laboratory reliability, which ranged from 0.842 to 1.000. Kappa coefficients were greater than 0.75 (0.75-1.00). All of the regression models based on the trial results had strong R-square values and zero sums of residuals. These results were consistent in the regression models using external quality control data.</p></sec><sec><title>CONCLUSION</title><p>The two laboratories in the KoGES have good intra- and inter-laboratory reliability for ten chemical test values, and data can be integrated through algorithmic statistical adjustment using regression equations.</p></sec>
Summary
Citations
Citations to this article as recorded by
METS-IR and all-cause mortality in Korean over 60 years old: Korean genome and epidemiology study-health examinees (KoGES-HEXA) cohorts Ha Eun Ryu, Dong Hyuk Jung, Seok-Jae Heo, Byoungjin Park, Yong Jae Lee Frontiers in Endocrinology.2024;[Epub] CrossRef
Healthful Plant-Based Diet and Incidence of Type 2 Diabetes in Asian Population Jihye Kim, Edward Giovannucci Nutrients.2022; 14(15): 3078. CrossRef
Urinary Sodium-to-Potassium Ratio and Incident Chronic Kidney Disease Young Su Joo, Hyung Woo Kim, Jong Hyun Jhee, Seung Hyeok Han, Tae-Hyun Yoo, Shin-Wook Kang, Jung Tak Park Mayo Clinic Proceedings.2022; 97(12): 2259. CrossRef
Association between Different Types of Plant-Based Diets and Risk of Dyslipidemia: A Prospective Cohort Study Kyueun Lee, Hyunju Kim, Casey M. Rebholz, Jihye Kim Nutrients.2021; 13(1): 220. CrossRef
Dietary Micronutrients and Risk of Chronic Kidney Disease: A Cohort Study with 12 Year Follow-Up Juyeon Lee, Kook-Hwan Oh, Sue-Kyung Park Nutrients.2021; 13(5): 1517. CrossRef
Association between Unhealthful Plant-Based Diets and Possible Risk of Dyslipidemia Sujin Song, Kyueun Lee, Soim Park, Nara Shin, Hyunju Kim, Jihye Kim Nutrients.2021; 13(12): 4334. CrossRef
Secondhand Smoke and CKD Jong Hyun Jhee, Young Su Joo, Youn Kyung Kee, Su-Young Jung, Seohyun Park, Chang-Yun Yoon, Seung Hyeok Han, Tae-Hyun Yoo, Shin-Wook Kang, Jung Tak Park Clinical Journal of the American Society of Nephrology.2019; 14(4): 515. CrossRef
Association between Dietary Mineral Intake and Chronic Kidney Disease: The Health Examinees (HEXA) Study Jeewoo Kim, Juyeon Lee, Kyoung-Nam Kim, Kook-Hwan Oh, Curie Ahn, Jongkoo Lee, Daehee Kang, Sue K. Park International Journal of Environmental Research and Public Health.2018; 15(6): 1070. CrossRef
Upper Normal Serum Creatinine Concentrations as a Predictor for Chronic Kidney Disease: Analysis of 14 Years’ Korean Genome and Epidemiology Study (KoGES) Jong Hyun Jhee, Seun Deuk Hwang, Joon Ho Song, Seoung Woo Lee Journal of Clinical Medicine.2018; 7(11): 463. CrossRef
Dairy Product Intake Is Inversely Associated with Metabolic Syndrome in Korean Adults: Anseong and Ansan Cohort of the Korean Genome and Epidemiology Study Hyehyung Shin, Yeong Sook Yoon, Yoonna Lee, Cho-il Kim, Sang Woo Oh Journal of Korean Medical Science.2013; 28(10): 1482. CrossRef
PURPOSE Our main goal is to test the reliability and validity of the Korean version of Baecke questionnaire on physical activity by using 507 men and women aged 20-70 years.
METHOD
This study was carried out using the cancer screening participants of the National Cancer Center. All subjects were sent the Korean version of Baecke questionnaire by mail to measure their physical activity.
RESULTS
The mean score on the sport index during leisure-time for men was significantly higher than that for women. In contrast, the mean score of the work index for men was significantly lower than that for women. Cronbach`s alphas for work, sport and leisure-time index were 0.75, 0.81 and 0.39 for men, respectively, and 0.67, 0.75 and 0.35 for women respectively. By a principal components analysis the three conceptually meaningful factors were distinguished, except for the leisure-time factor. Due to the low cronbach`s alphas and undistinguished factors, work and sports factors were used on the final analysis, excluding the leisure time factor, in the Korean version of Baecke`s questionnaire. Two-factor analysis was used to assess the validity of work items and sports items. Work factor and sports factor were definitely distinguished as two factors. Multiple regression analysis showed that lean body mass was significantly related the work index(p<0.0001) and sports index (p<0.05).
CONCLUSION
Our results suggest that the modified Korean version of Baecke`s questionnaire is appropriate to assess the physical activity in Koreans.
PURPOSE Since 1988, the annual or biannual survey was conducted by Korean Association of Smoking and Health (KASH) to examine the smoking rate, knowledge and attitude on smoking of students attending middle and high school in Korea. The objective of this study was to investigate the test-retest reliability of self-administered smoking questionnaire for Korean middle and high school students.
METHODS
For the test-retest study, we sampled 30 school among 106 schools which participated in annual survey on June of 2002. Among 30 schools, 26 schools (86.7%) were responded for this study.
RESULTS
1) For the subjects of 1st and 2nd surveys, there were no difference on smoking related variable including attitude, knowledge, perceived health status, father's smoking status, friend's smoking status, willingness to smoke, and readiness to quit smoking 2) For middle school students among male, current smoking rates were 3.5% for 1st survey and 3.0% for 2nd survey, which was statistically no significant. For high school students, however, current smoking rate of 1st survey was higher (21.1%) than that of 2nd (18.2%), although the rate was not significantly differed. 3) For middle school students among female, current smoking rates were 1.1% for 1st survey and 3.3% for 2nd survey, which was statistically no significant.
Corresponding rate for high school students were 9.8% and 11.4%, respectively.
CONCLUSION
The results indicated that smoking questionnaire has been conducted by KASH is reliable for use in estimation for prevalence of smoking for middle and high school students.