Abstract
 The objective of this study was to describe general approaches for intervention metaanalysis available for quantitative data synthesis using the R software. We conducted an intervention metaanalysis using two types of data, continuous and binary, characterized by mean difference and odds ratio, respectively. The package commands for the R software were “metacont”, “metabin”, and “metagen” for the overall effect size, “forest” for forest plot, “metareg” for metaregression analysis, and “funnel” and “metabias” for the publication bias. The estimated overall effect sizes, test for heterogeneity and moderator effect, and the publication bias were reported using the R software. In particular, the authors indicated methods for calculating the effect sizes of the target studies in intervention metaanalysis. This study focused on the practical methods of intervention metaanalysis, rather than the theoretical concepts, for researchers with no major in statistics. Through this study, the authors hope that many researchers will use the R software to more readily perform the intervention metaanalysis and that this will in turn generate further related research.

Keywords: Metaanalysis, Metaregression, Forest plot, Heterogeneity, Publication bias, R software
INTRODUCTION
 Metaanalysis systematically and objectively selects target literature, quantifies the results of individual studies, and provides the overall effect size thus enabling the right decision making for evidencebased medicine [15].
 Computer software applications that facilitate the approach to metaanalysis include STATA, R, SAS, MIX, comprehensive metaanalysis (CMA), Review Manager (RevMan), and MetaAnalyst.
 RevMan and CMA are adequate for beginners because they provide a graphic user interface, but their expandability is limited because they do not provide support for specific topics such as network metaanalysis, diagnostic test metaanalysis, doseresponse metaanalysis, and genome metaanalysis.
 In contrast, R and STATA have excellent expandability and support various analytical methods developed thus far ranging from intervention metaanalysis to diagnostic test metaanalysis.
 STATA is a standard and reliable commercial application with excellent expandability as most statistical modules are verified in the STATA Journal.
 R is a free application and supports a programming language for statisticians. While it does require a fair amount of learning, anyone can readily use R once they understand the basics of using packages, datasets and functions. Moreover, R Studio is very convenient to use as it offers a graphic user interface.
 In this paper, the previous metaanalysis studies performed by authors [13] are reviewed using the R software. Furthermore, this work considers the types and changes in effect sizes for calculating the overall effect size from the beginning, so it requires prior knowledge on the preliminary processes for metaanalysis such as systematic literature collection based on PICO (population, intervention, comparison, outcome), data extraction, and quality assessment.
UNDERSTANDING THE EFFECT SIZE
 One should first understand the effect size before performing metaanalysis. In simple terms, the effect size is the impact of a specific intervention. One example is the benefit (or deterioration) tied to a specific medicine or therapy. The effect size is usually expressed as a quantitative value [13].
 The effect size is expressed as a difference in means in continuous data, or as an odds ratio (OR), relative risk (RR), or hazard ratio for binary data or time to event data, and as a percentage for proportion or rate data. However, the correlation coefficient (r) between variables is not generally used as effect size because the specific effect size of treatments is considered important than correlation coefficient in healthcare metaanalysis.
 The OR and percentage can readily be used as effect size as they are already standardized across various datasets.
 However, the standardization of the effect size should be considered when the difference in means is used as the effect size for continuous variables. In Cochrane, the mean difference (MD) or difference in means can be used when individual studies use the same scale; it is straightforward to interpret as the unit can be accepted as is. Weighted mean difference or absolute mean difference is also same meaning with MD.
 The standardized mean difference (SMD) must be standardized for comparison if the individual studies use different units. Standardization here implies dividing each effect size by the underlying standard deviation (SD) [4,5].

Figure 1 provides a good illustration of the SMD, which is equal to the probability density corresponding to the zvalue of a standard normal distribution curve. For example, if the SMD is 1.96, it is located at 47.5% in the positive direction. It is worth noting that the SMD must be interpreted in a single direction according to the direction of the effect size, because the reference point of the reference group is zero. Therefore, an interpretation of a SMD of 1.96 is that “the treatment group is 95.0% better or poorer than the reference group.”
 Calculating the effect size
 This study addresses the calculation of the effect size and the standard error (SE), which both need to be understood for metaanalysis. An applicationbased study reveals that metaanalysis can help calculate the overall effect size using the raw data itself, and also obtain the overall effect size by using the summarized effect size and SE as well.
 Thus, it is critical to calculate the effect size and SE in individual studies, and one must be able to compute them before approaching the specific topics of metaanalysis below.
Continuous data example
 For a treatment group and a control group, m1 is the difference between the means before treatment (pre_mean1) and after treatment (post_mean1) in the treatment group, and m2 is the difference between the means before and after treatment in the control group. Thus, s1 and s2 are the SDs of m1 and m2, respectively.
 “MD” is simply the difference in means between the treatment and control groups (m1m2, the direction of MD, is set as intended by the researcher), and the pooled SD and SE are calculated as follows:
 The SMD is determined by dividing MD by the pooled SD (SMD=MD/SD), and the SE equals SD multiplied by the square root of the sum of the inverse of each number of samples.
 The SMD here is Cohen’s d. If the number of samples is small, the overall effect size tends to be overestimated. To correct this, Hedges’ g is used.
Binary data example
 The binary data example is often expressed as a 2×2 table according to the existence or absence of a treatment and a disease. We consider the following elements in the table: there is treatment and the condition improves (true positive, tp), there is treatment and the condition does not improve (false positive, fp), there is no treatment and the condition improves (false negative, fn ), and there is no treatment and the condition does not improve (true negative, tn). The effect size OR and SE can be calculated as follows:
 INTERVENTION METAANALYSIS USING THE R “meta” PACKAGE

Figure 2 shows the general flow for intervention metaanalysis. First, in data encoding, variable names must be modified in accordance with the corresponding function. Next, a metaanalysis model is selected (fixed or random), the overall effect size is presented, the heterogeneity is checked, and the publication bias is checked and reported.
 The R packages for metaanalysis largely include “meta”, “metafor”, and “rmeta.” They both have strengths and weaknesses. They should be installed in advance as follows [6]:
 · install.packages(“meta”)
 · install.packages(“metafor”)
 · install.packaqes(“rmeta”)
 Key explanations will be provided regarding the “meta” package, which is generally easy to use. We mark R commands with a dot (‘· ’) in front of them, to distinguish them from the main text. When long commands are extended to the next line, there is no dot at the beginning of the next line. Thus, when you enter the command in the R software, you must type them without the dot (‘· ’) in front of them.
Continuous data example
Data encoding and loading
 A study on the metaanalysis of the effect of stem cell therapy on the bladder function in an animal model with a spinal cord injury is used as an example, and the voiding pressure is used as the result index. The total number of studies was 11, comprising 94 subjects in the experimental group and 93 subjects in the control group. The subgroup 1 is the contusion model and the subgroup 0 is the transection and hemisection model (Supplementary Material 1).
 We first load the “meta” package to perform the metaanalysis:
 · library(meta)
 Then, we load the example file to the R memory from the working folder with the following command. It is worth noting that R prefers the commaseparated values (csv) file format. Thus, you should save Supplementary Material 1 as “shim_con.csv” in the specified working folder.
 ·data_con < read.csv(“shim_con.csv”, header=TRUE)
 “read.csv” is a function for loading a csv file. The above command implies loading the file “shim_con.csv” and use the first variable name (header=TRUE) as is. This loaded file is saved as “data_con” in the R memory.
Overall effect size
 The meta package includes various functions. Among them, the “metacont” function calculates the overall effect size when all the raw data consists of continuous data as follows:
 · ma_con < metacont(n1, m1, s1, n2, m2, s2, sm=“SMD”, method.smd=“Hedges”, study, byvar=g ,data=data_con)
 · print(ma_con, digits=3)
 For continuous data, we sequentially enter the number of samples, mean, and SD of the treatment group and the control group; alternatively we can enter them the in opposite direction as intended.
 To calculate the effect size without standardization when the individual studies have the same unit, smd=“MD” can be entered. However, the standardized effect size is usually expressed as the SMD, and there are several methods to calculate it. The most basic method is Cohen’s d which is determined by dividing the effect size by the SD. However, it tends to overestimate the overall effect size when the number of samples is small. Thus, the use of Hedges’ g is recommended to correct it (method.smd=“Hedges” or “Cohen”). Hedges’ g is calculated by multiplying the correction index J by Cohen’s d.
 To select a fixed or random effect model, enter comb.fixed=TRUE or FALSE, and comb.random= TRUE or FALSE. If no model is selected, the metacont function shows the results for both models.
 “study” represents the name of individual studies, and “data=data_con” assigns the “data_con” data loaded in the R memory. “byvar=g” is entered to show the result of each subgroup, where g is a variable name representing a subgroup. The results of the “metacont” function are assigned to ma_con, and are shown in Figure 3.
 In the following, we examine the results in ma_con, shown in Figure 3, one by one.
 ① indicates the overall effect size of all 11 studies. The SMD of the fixed effect model is 1.456 (95% confidence interval [CI], 1.831 to 1.081) and the pvalue is lower than 0.0001, indicating that the treatment achieved a statistically significant improvement. The SMD of the random effect model is 1.973 (95% CI, 2.897 to 1.048) and the pvalue is lower than 0.0001, pointing to an identical result.
 ② and ③ indicate the result corresponding to the subgroup as a fixed and random effect model. In the random model, a difference between the subgroups (0 vs. 1) is suspected.
 ④ shows the heterogeneity of all studies. The Higgins’ I^{2} of heterogeneity is determined by subtracting the degrees of freedom from the Cochrane Q statistics and then dividing the resulting value by the Cochrane Q statistics again. Thus, heterogeneity is quantified in a consistent manner. Values between 0% and 40% indicate that heterogeneity might not be very pronounced; values between 30% and 60% indicate moderate heterogeneity, values between 50% and 90% indicate substantial heterogeneity, and values between 75% and 100% point to considerable heterogeneity. The significance of the Cochrane Q statistics is based on the pvalue of 0.1, which is a slightly wide range [4]. In this continuous data example, the Higgins’ I^{2} is 82.7% and the pvalue of the Cochrane Q statistics is lower than 0.0001, which suggests the existence of heterogeneity. Therefore, the random effect model must be given priority in the aggregate model.
 In addition, the calculation process for the results is indicated at the bottom of Figure 3. Inverse variance is a basic metaanalysis method that uses the inverse variance of the relevant study to calculate the weights of individual studies. The DerSimonianLaird estimator (DL) is a method for using the tau value to calculate the betweenstudy variance in the random effect model. Hedges’ g means that the current result used the Hedges’ g correction to the Cohen’s d.
 You can freely adjust the detailed calculation method while referring to the “meta” package.
Forest plot

Figure 3 is effective in providing detailed information, but its overall readability is low. Therefore, the understanding of readers can be improved by drawing a forest plot as follows (Figure 4).
 · forest(ma_con, comb.fixed=TRUE, comb.random=TRUE,digits=3,rightcols=c(“effect”, “ci”))
 We enter the corresponding metaanalysis model (ma_con) in the “forest” function. Then we can enter various options to enhance the appearance of the graph. “comb.fixed=TRUE” and “comb.random=TRUE” can be used to display both models, “digits=3” is used to round down the display to only three decimal places, and “rightcols=c(“effect”,”ci”))” is used to show the effect size and 95% CI only while omitting the weight on the right side of the forest plot.

Figure 4 provides the same information as the overall effect size mentioned above. Furthermore, withinstudy and betweenstudy variations can readily be identified through the graphic representation of the effect size of individual studies.
 For example, it can be seen that there are large withinstudy variations in Mitsui2005_and Mitsui2003, while there are large betweenstudy variations in Mitsui2005_a, WBPark2010_1 and WBPark2010_2.
Heterogeneity
 To properly interpret the overall effect size obtained from metaanalysis, the existence or absence of heterogeneity between studies should be checked and any significant moderator should be tested and reported. There are many potential causes for this heterogeneity, such as chance, differences in study design, research environment, and the demographic factors of the sample population.
Visual verification: forest plot and subgroup analysis
 Withinstudy and betweenstudy variations can easily be verified visually to explore heterogeneity.
Measuring heterogeneity: Higgins’ I^{2} and Cochrane Q statistics pvalue
 The heterogeneity of the studies was explained in detail with respect to Figure 3. The degree of heterogeneity is quantified, and the statistical test is shown as well.
Identifying the cause of heterogeneity: metaregression
 If heterogeneity is doubted during the visual verification using a forest plot and the heterogeneity values using the Cochrane Q statistics and Higgins’ I^{2}, meta regression analysis can be performed to statistically test and identify the cause of heterogeneity, as follows:
 ·metareg(ma_con,g, method.tau=”REML”, digits=3)
 The selected metalanalysis model must be entered in the “metareg” function, and the method.tau=”REML”(restricted maximumlikelihood estimator or “ML”(maximumlikelihood estimator), or “DL”(DerSimonianLaird estimator) must be selected in accordance with the method of assigning weights to meta regression analysis. The values may be changed depending on the weight calculation method, but the statistical direction is almost same.
 Based on the random effect model, the overall effect size of subgroup 1 is 2.139 (95% CI, 3.410 to 0.867) and the overall effect size of subgroup 0 is 1.610 (95% CI, 2.413 to 0.808). Thus, this variable seemed to be a moderator, but the result of the meta regression analysis pointed to its statistical insignificance, with pvalue=0.711.
 · bubble(metareg(ma_con, g, method.tau=”REML”))
 The result of the meta regression analysis can be plotted as shown in Figure 5. The straight line on this graph indicates a regression line, and the statistical test for the slope of this line is the pvalue of the meta regression analysis mentioned above.
Checking publication bias
 The publication bias means the error in connection with whether a study is published or not depending on the characteristics and result of individual studies. This error is caused because statistically significant study results generally have a higher likelihood of being published. One should check whether the result of the metaanalysis is overestimated or underestimated considering this publication bias.
Visual verification: funnel plot
 To examine the publication bias, the existence of asymmetry between studies needs to be verified visually (Figure 6) as follows:
 · funnel(ma_con, comb.fixed=TRUE, comb.random=FALSE)
 The selected metalanalysis model must be entered in the funnel function and comb.fixed=TRUE or FALSE, and comb.random=TRUE or FALSE must be entered subsequently.
 The yaxis of the funnel plot indicates the sample size (SE) and the xaxis indicates the effect size. In general, smallscale studies are distributed widely at the bottom, whereas largescale studies are distributed narrowly at the top within the funnel. Therefore, when the studies are distributed symmetrically at the top within the funnel, the publication bias can be considered to be small.
 For the continuous data example, there are three studies on the left and two studies on the right outside the funnel, and four studies on the left and two studies on the right within the funnel. Thus, it is apparent that a publication bias exists (Figure 6).
Statistical test of publication bias
 General methods to statistically test the publication bias include Egger’s linear regression method test (Egger’s test) and Begg and Mazumdar’s rank correlation test (Begg’s test). It has been reported that Egger’s test estimates the effect size more accurately than Begg’s test. However, Cochrane does not recommend a statistical test because the accuracy of the test is more sensitive to the number of small studies (small study effect) than to the publication bias.
 ■ Egger’s linear regression method test
 Egger’s test represents as a regression equation the relationship between the SE of the intervention effect and the effect size of individual studies. The null hypothesis in Egger’s test is that the slope of the linear regression model is zero. If the null hypothesis cannot be rejected, there is no evidence of publication bias.
 · ma_con < metacont(n1, m1, s1, n2, m2, s2, sm=”SMD”, method.smd=”Hedges”, study,data=data_con)
 ·metabias(ma_con, method.bias=”linreg”)
 It is likely that the “metabias” function will not be carried out because the overall effect size is calculated separately for each subgroup. Therefore, the overall effect size for all studies is calculated once again and then the “metabias” function is used immediately. The selected metaanalysis model must be entered in the “metabias” function with the option method.bias=”linreg” to perform Egger’s test.
 For continuous data, the coefficient of the bias is 9.23, indicating the initial value (intercept) and the pvalue is lower than 0.0001. Thus, the null hypothesis is rejected, and the existence of a publication bias can be confirmed.
 ■ Begg and Mazumdar’s rank correlation test
 The correlation between the standardized effect size and the SE of individual studies is tested through corrected rank correlation. An insignificant rank correlation test is consistent with the absence of publication bias.
 ·metabias(ma_con, method.bias=”rank”)
 The selected metalanalysis model must be entered in the metabias function with the option method.bias=”rank” for performing Begg’s test.
 As with the result of Egger’s test, the pvalue is 0.0024, indicating that there is a publication bias.
 Thus, when the publication bias is statistically significant, one needs to verify the overall effect size once again by including and excluding studies that appear to hold a publication bias. In other words, sensitivity analysis should be performed for publication bias and to report the characteristics of the studies. If heterogeneity is found, a statistical test should also be performed through meta regression analysis.
 Binary data example
 The commands for metaanalysis are almost identical to those in the continuous data example. Refer to the reference [2] and appedix commands for detailed descriptions for binary data (Supplementary Material 2).
 Metaanalysis regardless of data type
 So far we have examined the overall effect size in raw data from continuous data and binary data and methods to evaluate related heterogeneity.
 However, this delineation in the data is simply linked to a delineation in commands (functions) for user convenience. If the effect size and SE of individual studies are already known, metaanalysis can be performed regardless of the data type.
Data encoding and loading
 When the raw data from continuous and binary data (Supplementary Material 1) is loaded, the effect size and SE are already input as variables.
 ·data_con < read.csv(“shim_con.csv”, header=TRUE)
 ·data_bin < read.csv(“hwang_bin.csv”, header=TRUE)
Overall effect size
 The meta package includes several functions. Among them, the “metagen” function calculates the overall effect size by effect size and SE of individual studies.
 Calculating the effect size and standard error for continuous data
 · ma_con_es < metagen(cohen_d, cohen_se, sm=”Cohen(SMD)”, study, byvar=g, data=data_con)
 · print(ma_con_es, digits=3)
 · forest(ma_con_es, comb.fixed=TRUE, comb.random=TRUE, digits=3, rightcols=c(“effect”, “ci”))
 Cohen_d, and cochen_se, respectively the effect size and the SE in the metagen function, must be entered. The metaanalysis model determined with the effect size and SE of continuous data is saved as ma_con_es.
 In chapter 1 of continuous data example mentioned above, if Cohen’s d is used as an option for SMD [method.smd=”Cohen”], we can obtain the same effect size as the metaanalysis model ma_con_es that was just calculated.
 Calculating the effect size and standard error of binary data
 · ma_bin_es < metagen(lnor, orse, sm=”OR”, study, data=data_bin)
 · print(ma_bin_es, digits=3)
 · forest(ma_bin_es, comb.fixed=TRUE, comb.random=TRUE, digits=3, rightcols=c(“effect”, “ci”))
 In “ma_bin_es” data, lnor and orse variable, respectively the effect size and the SE, must be entered in the “metagen” function. The metaanalysis model determined by the effect size and the SE of the binary data is set to ma_bin_es.
 It is apparent that this is identical to the effect size In chapter 2 of binary data example mentioned above.
CONCLUSION
 This study deemphasized statistical theory and instead focused on the actual performance of metaanalysis so that researchers with no statistics major can easily perform metaanalysis.
 Researchers interested in performing metaanalysis by referring to this study should firmly establish the concepts for effect size calculation. We hope that this study will facilitate the use of R by researchers to perform metaanalysis and generate related research.
SUPPLEMENTARY MATERIALS
NOTES

^{} The authors have no conflicts of interest to declare for this study.
ACKNOWLEDGEMENTS
None.
Figure 1.Effect size of standardized mean difference (SMD).
Figure 2.Flow chart of intervention metaanalysis using R "meta" package. ^{1} Recommend.
Figure 3.Overall effect size of continuous example. SMD, standardized mean difference; CI, confidence interval; g, subgroup.
Figure 4.Forest plot of continuous example. SD, standard deviation; SMD, standardized mean difference; CI, confidence interval; g. subgroup .
Figure 5.Metaregression bubble plot of continuous example.
Figure 6.Funnel plot of continuous example.
REFERENCES
 1. Hwang SD, Shim SR. Metaanalysis: from forest plot to network metaanalysis. Seoul: Hannarae; 2018. p 12178 (Korean).
 2. Shim SR. Intervention metaanalysis using R software. Gwacheon: SDB Lab; 2019. (Korean).
 3. Shim SR, Shin IS, Bae JM. Intervention metaanalysis using STATA software. J Health Info Stat 2016;41:123134 (Korean).ArticlePDF
 4. Higgins JP, Green S. Cochrane handbook for systematic reviews of interventions. Version 5.1.0; 2011 [cited 2019 May 1]. Available from: http://www.cochranehandbook.org.
 5. Borensein M, Hedges LV, Higgins JP, Rothstein HR. Introduction to metaanalysis. West Sussex: John Wiley & Sons; 2019. p 2028.
 6. Institute of Medical Biometry and Statistics. R packages. [cited 2019 Mar 1]. Available from: http://www.imbi.unifreiburg.de/lehre/lehrbuecher/metaanalysiswithr/rpackages.
Citations
Citations to this article as recorded by
 Longterm efficacy of total versus posterior partial fundoplication in patients with gastrooesophageal reflux disease: a systematic review and metaanalysis
DV Peristeri, H Room, D Tsironis, G Vasilikostas, A Wan
The Annals of The Royal College of Surgeons of England.2024; 106(7): 569. CrossRef  Increased risk of hearing loss associated with macrolide use: a systematic review and metaanalysis
Sung Ryul Shim, YungJin Lee, Seung Min In, Ki‐Il Lee, Ikhee Kim, Hyoyeon Jeong, Jieun Shin, JongYeup Kim
Scientific Reports.2024;[Epub] CrossRef  Effects of Continuous Glucose Monitoring on Glycemic Control in Type 2 Diabetes: A Systematic Review and MetaAnalysis
SeungYeon Kong, MiKyoung Cho
Healthcare.2024; 12(5): 571. CrossRef  Efficacy of noninvasive brain stimulation combined with antidepressant medications for depression: a systematic review and metaanalysis of randomized controlled trials
Yuan Tao, Qian Liang, Fenghong Zhang, Shaofan Guo, Lingyun Fan, Fei Zhao
Systematic Reviews.2024;[Epub] CrossRef  Intraoperative imageguidance during robotic surgery: is there clinical evidence of enhanced patient outcomes?
Stefano Tappero, Giuseppe Fallara, Francesco Chierigo, Andrea Micalef, Francesca Ambrosini, Raquel Diaz, Andrea Dorotei, Edoardo Pompeo, Alessia Limena, Carlo Andrea Bravi, Mattia Longoni, Mattia Luca Piccinelli, Francesco Barletta, Luigi Albano, Elio Maz
European Journal of Nuclear Medicine and Molecular Imaging.2024; 51(10): 3061. CrossRef 
The Effect of Socioeconomic Drivers on Underfive Mortality Rates: A Survey Bayesian Metaanalysis Study
Welcome J. Dlamini, Sileshi F. Melesse, Henry G. Mwambi
The Open Public Health Journal.2024;[Epub] CrossRef  Current updates relating to treatment for interstitial cystitis/bladder pain syndrome: systematic review and network metaanalysis
Jae Joon Park, Kwang Taek Kim, Eun Ji Lee, Joey Chun, Serin Lee, Sung Ryul Shim, Jae Heon Kim
BMC Urology.2024;[Epub] CrossRef  Surgical Treatment for Endometrial Cancer, Hysterectomy Performed via Minimally Invasive Routes Compared with Open Surgery: A Systematic Review and Network MetaAnalysis
Purushothaman Natarajan, Gayathri Delanerolle, Lucy Dobson, Cong Xu, Yutian Zeng, Xuan Yu, Kathleen Marston, Thuan Phan, Fiona Choi, Vanya Barzilova, Simon G. Powell, James Wyatt, Sian Taylor, Jian Qing Shi, Dharani K. Hapangama
Cancers.2024; 16(10): 1860. CrossRef  Management for degenerative lumbar spondylolisthesis: a network metaanalysis and systematic review basing on randomized controlled trials
Hao Jia, Zhuo Zhang, Jianpu Qin, Lipei Bao, Jun Ao, Hu Qian
International Journal of Surgery.2024;[Epub] CrossRef  Effects of robotassisted percutaneous kyphoplasty on osteoporotic vertebral compression fractures: a systematic review and metaanalysis
Haoqian Chen, Jia Li, Xin Wang, Yanming Fu
Journal of Robotic Surgery.2024;[Epub] CrossRef  Effectiveness and safety of acupuncture modalities for overweight and obesity treatment: a systematic review and network metaanalysis of RCTs
Youngjin Kim, Haim Park, Hongmin Chu, Hanbit Jin, Jungtae Leem
Frontiers in Medicine.2024;[Epub] CrossRef  Effectiveness of Reading Interventions on Literacy Skills for Chinese Children with and Without Dyslexia: a Metaanalysis of Randomized Controlled Trials
Yijun Ruan, Urs Maurer, Catherine McBride
Educational Psychology Review.2024;[Epub] CrossRef  Association of systemic immune biomarkers with metabolic dysfunctionassociated steatotic liver disease: a crosssectional study of NHANES 2007–2018
Yong Wang, Shude Chen, Chen Tian, Qi Wang, Zhihua Yang, Wieqi Che, Yike Li, Yang Luo
Frontiers in Nutrition.2024;[Epub] CrossRef  Efficacy of different analgesic strategies combined with conventional physiotherapy program for treating chronic shoulder pain: a systematic review and network metaanalysis
Fangjie Yang, Xinmin Li, Jing Wang, Qian Gao, Mengyang Pan, Zhenfei Duan, Chunlin Ren, Pengxue Guo, Yasu Zhang
Journal of Orthopaedic Surgery and Research.2024;[Epub] CrossRef  Tofacitinib treatment for plaque psoriasis and psoriatic arthritis: A metaanalysis of randomised controlled trials
Tao Wang, Wei Wu, Xiaoqing Zhang, Bin Gan, Yanfang Zhou, Xiaoyan Cheng
Indian Journal of Dermatology, Venereology and Leprology.2024; 0: 1. CrossRef  TMS and tDCS as potential tools for the treatment of cognitive deficits in Parkinson’s disease: a metaanalysis
Andreina Giustiniani, Lorenza Maistrello, Valentina Mologni, Laura Danesin, Francesca Burgio
Neurological Sciences.2024;[Epub] CrossRef  Text Network Analysis to Develop a Search Strategy for a Systematic Review
Subeen Leem, Jieun Shin, JongYeup Kim, Sung Ryul Shim
Applied Sciences.2024; 14(19): 8909. CrossRef  Highflow nasal cannula in adults with chronic respiratory diseases during physical exercise: a systematic review and metaanalysis
Eduardo MoyaGallardo, Jeniffer FajardoGutiérrez, Karol Acevedo, Francisca VerdugoPaiva, Rocío BravoJeria, Luis OrtizMuñoz, Felipe ContrerasBriceño, Maximiliano EspinosaRamírez
BMJ Open Respiratory Research.2024; 11(1): e002431. CrossRef  A Systematic Review and MetaAnalysis of Randomized Controlled Trials for Intimate Partner Violence: The Effects of the Programs Based on Their Purposes
Sihyun Park, SinHyang Kim
Trauma, Violence, & Abuse.2023; 24(4): 2115. CrossRef  Association between age and efficacy of combination systemic therapies in patients with metastatic hormonesensitive prostate cancer: a systematic review and metaanalysis
Pawel Rajwa, Takafumi Yanagisawa, Isabel Heidegger, Fabio Zattoni, Giancarlo Marra, Timo F. W. Soeterik, Roderick C. N. van den Bergh, Massimo Valerio, Francesco Ceci, Claudia V. Kesch, Veeru Kasivisvanathan, Ekaterina Laukhtina, Tatsushi Kawada, Peter Ny
Prostate Cancer and Prostatic Diseases.2023; 26(1): 170. CrossRef  The Effect of Testosterone Replacement on Sexual Function in the Elderly: A Systematic Review and MetaAnalysis
Hee Jo Yang, Ki Hong Kim, Doo Sang Kim, Chang Ho Lee, Youn Soo Jeon, Sung Ryul Shim, Jae Heon Kim
The World Journal of Men's Health.2023; 41(4): 861. CrossRef  Effects of Sexual Rehabilitation on Sexual Dysfunction in Patients with Cardiovascular Disease: A Systematic Review and MetaAnalysis
Jae Joon Park, Seung Whan Doo, Allison Kwon, Do Kyung Kim, Won Jae Yang, Yun Seob Song, Sung Ryul Shim, Jae Heon Kim
The World Journal of Men's Health.2023; 41(2): 330. CrossRef  Diagnostic, clustering, and immune cell infiltration analysis of m6A regulators in patients with sepsis
Fenghui Li, Yuan Zhang, Zhiyun Peng, Yingjing Wang, Zhaoshang Zeng, Zhongxiang Tang
Scientific Reports.2023;[Epub] CrossRef  Effects of robotassisted minimally invasive surgery on osteoporotic vertebral compression fracture: a systematic review, metaanalysis, and metaregression of retrospective study
Haoqian Chen, Jia Li, Xin Wang, Yanming Fu
Archives of Osteoporosis.2023;[Epub] CrossRef  The status of phosphorus levels in Iranian agricultural soils — a systematic review and metaanalysis
Mohsen Jalali, Wolfram Buss, Fatemeh Parviznia, Mahdi Jalali
Environmental Monitoring and Assessment.2023;[Epub] CrossRef  Combination of Chinese herbal medicine and conventional western medicine for coronavirus disease 2019: a systematic review and metaanalysis
Lei Tong, Zhenyu Ma, Yixiao Zhou, Shuping Yang, Yalin Yang, Jingran Luo, Junbo Huang, Fucai Wang
Frontiers in Medicine.2023;[Epub] CrossRef  Deviation of behavioural and productive parameters in dairy cows due to a lameness event: a synthesis of reviews
Luisa Magrin, Barbara Contiero, Giulio Cozzi, Flaviana Gottardo, Severino Segato
Italian Journal of Animal Science.2023; 22(1): 739. CrossRef  Effectiveness of family interventions for patients with schizophrenia: A systematic review and meta‐analysis
Sin‐Hyang Kim, Sihyun Park
International Journal of Mental Health Nursing.2023; 32(6): 1598. CrossRef  AlcoholContaining Versus AqueousBased Solutions for Skin Preparation in Abdominal Surgery: A Systematic Review and Metaanalysis
Dimitra V. Peristeri, Hussameldin M. Nour, Amiya Ahsan, Sameh Abogabal, Krishna K. Singh, Muhammad Shafique Sajid
Journal of Surgical Research.2023; 291: 734. CrossRef  Robotassisted laparoscopic repair in hiatal hernia with kyphosis: A case report with metaanalysis
Qi Liu, Dianchen Wang, Zhao Sun, Jianwu Jiang, Yang Fu
International Journal of Abdominal Wall and Hernia Surgery.2023; 6(2): 92. CrossRef  Medical Application of Big Data: Between Systematic Review and Randomized Controlled Trials
Sung Ryul Shim, JoonHo Lee, Jae Heon Kim
Applied Sciences.2023; 13(16): 9260. CrossRef  Oral Nutritional Supplements Reduce Body Weight Loss after Gastrectomy in Patients with Gastric Cancer: A Systematic Review and MetaAnalysis of Randomized Controlled Trials
Mijoo Choi, JongYeup Kim, HyunHi Kang, Eunju Park, Sung Ryul Shim
Nutrients.2023; 15(18): 3924. CrossRef  Systematic review and metaanalysis: a critical examination of the methodology
S. Yu. Martsevich S.Yu., A. R. Navasardyan, K. V. Lobastov, M. V. Mikaelyan, E. V. Mikhaylenko, A. Yu. Suvorov, I. V. Schastlivtsev, O. N. Dzhioeva, V. V. Matveev, E. S. Akimova, V. V. Sytkov, E. Dubar, O. M. Drapkina
Rational Pharmacotherapy in Cardiology.2023; 19(4): 382. CrossRef  Effects of ThrombinBased Hemostatic Agent in Total Knee Arthroplasty: MetaAnalysis
JungWee Park, Tae Woo Kim, Chong Bum Chang, Minji Han, Jong Jin Go, Byung Kyu Park, WooLam Jo, YoungKyun Lee
Journal of Clinical Medicine.2023; 12(20): 6656. CrossRef  The Effects of Auricular Therapy in Patients with Type 2 Diabetes: A Systematic Review and MetaAnalysis
Hyejin Lee, Bomi Kim, Hyojung Park
Journal of Korean Academy of Fundamentals of Nursing.2023; 30(4): 415. CrossRef  Unveiling the Therapeutic Potential and Healthcare Applications of Marine Therapy: A Systematic Review with MetaAnalysis and MetaRegression
Sung Ryul Shim, Dayeon Shin, SeongJang Kim, Young Kook Kim, Kyung Ju Lee
Marine Drugs.2023; 21(12): 604. CrossRef  Molecular subtyping of ependymoma and prognostic impact of Ki67
Ka Young Lim, Kwanghoon Lee, Yumi Shim, Jin Woo Park, Hyunhee Kim, Jeongwan Kang, Jae Kyung Won, SeungKi Kim, Ji Hoon Phi, ChulKee Park, ChunKee Chung, Hongseok Yun, SungHye Park
Brain Tumor Pathology.2022; 39(1): 1. CrossRef  Heavy metal profile of surface and ground water samples from the Niger Delta region of Nigeria: a systematic review and metaanalysis
Francis Uchenna Umeoguaju, Joyce Oronne Akaninwor, Eka Bassey Essien, Benjamin A. Amadi
Environmental Monitoring and Assessment.2022;[Epub] CrossRef  Effects of cognitive rehabilitation in Parkinson disease: a metaanalysis
Andreina Giustiniani, Lorenza Maistrello, Laura Danesin, Elena Rigon, Francesca Burgio
Neurological Sciences.2022; 43(4): 2323. CrossRef  Effect of Auriculotherapy on Musculoskeletal Pain: A Systematic Review and MetaAnalysis
Sun Yeob Choi, Yeo Ju Kim, Bomi Kim
Journal of Korean Academy of Nursing.2022; 52(1): 4. CrossRef  Comparative Efficacy and Safety of 11 Drugs as Therapies for Adults With Neuropathic Pain After Spinal Cord Injury: A Bayesian Network Analysis Based on 20 Randomized Controlled Trials
HaiQian Ling, ZiHao Chen, Lei He, Feng Feng, ChuangGui Weng, SiJin Cheng, LiMin Rong, PeiGen Xie
Frontiers in Neurology.2022;[Epub] CrossRef  Effects of lowintensity pulsed ultrasound on knee osteoarthritis: A systematic review and metaanalysis of randomized controlled trials
Haoqian Chen, Zheng Wang, Xinan Zhang, Mingli Sun
Clinical Rehabilitation.2022; 36(9): 1153. CrossRef  Risk of Adverse Events in Cancer Patients Receiving Nivolumab With Ipilimumab: A MetaAnalysis
Xin Zhao, Fengwei Gao, Jie Yang, Hua Fan, Qingyun Xie, Kangyi Jiang, Jie Gong, Benjian Gao, Qian Yang, Zehua Lei
Frontiers in Oncology.2022;[Epub] CrossRef  Using the forest plot to compare citation achievements in bibliographic and metaanalysis studies since 2011 using data on PubMed Central: A retrospective study
JianWei Wu, TsairWei Chien, YaChing Tsai, HsienYi Wang, WeiChih Kan, LinYen Wang
Medicine.2022; 101(27): e29213. CrossRef  Acupotomy for Carpal Tunnel Syndrome: A Systematic Review and MetaAnalysis
JaeMin Jeong, JaeUk Sul, SeonJong Kim, YunGwon Seon, JiMin Choi, HuiJeong Noh, JinBong Choi
Journal of Korean Medicine Rehabilitation.2022; 32(3): 55. CrossRef  Efficacy and Safety of Ketamine vs Electroconvulsive Therapy Among Patients With Major Depressive Episode
Taeho Greg Rhee, Sung Ryul Shim, Brent P. Forester, Andrew A. Nierenberg, Roger S. McIntyre, George I. Papakostas, John H. Krystal, Gerard Sanacora, Samuel T. Wilkinson
JAMA Psychiatry.2022; 79(12): 1162. CrossRef  Research features between Urology and Nephrology authors in articles regarding UTI related to CKD, HD, PD, and renal transplantation
KengKok Tan, TsairWei Chien, WeiChih Kan, ChenYu Wang, Willy Chou, HsienYi Wang
Medicine.2022; 101(41): e31052. CrossRef  Perspectives on the Psychological and Physiological Effects of Forest Therapy: A Systematic Review with a MetaAnalysis and MetaRegression
Sung Ryul Shim, JinKyung Chang, JooHee Lee, WooJin Byeon, Jeongwon Lee, Kyung Ju Lee
Forests.2022; 13(12): 2029. CrossRef  Association of Statin Use with the Risk of Incident Prostate Cancer: A MetaAnalysis and Systematic Review
MengYao Xu, Ye An, ChenQian Liu, JinZhou Xu, XingYu Zhong, Na Zeng, JianXuan Sun, QiDong Xia, ShaoGang Wang, Ruhai Bai
Journal of Oncology.2022; 2022: 1. CrossRef  Possible Association between Differences in Nasalance Scores and Early Spread of COVID19 Based on Linguistic Analysis
Konghee Lee, Sung Ryul Shim, Jae Heon Kim
Soonchunhyang Medical Science.2022; 28(2): 96. CrossRef  A novel microRNAbased signature predicts prognosis among nasopharyngeal cancer patients
Tianyu Wang, Jian Wu, Yun Wu, Yin Cheng, Yue Deng, Jianchun Liao, Huanhai Liu, Hu Peng
Experimental Biology and Medicine.2021; 246(1): 72. CrossRef  Impact on AllCause and Cardiovascular Mortality Rates of Coronary Artery Calcifications Detected during Organized, LowDose, ComputedTomography Screening for Lung Cancer: Systematic Literature Review and MetaAnalysis
Sébastien Gendarme, Helene Goussault, JeanBaptiste Assié, Cherifa Taleb, Christos Chouaïd, Thierry Landre
Cancers.2021; 13(7): 1553. CrossRef  Longterm mortality of living kidney donors: a systematic review and metaanalysis
Jae Joon Park, Kyeongmin Kim, Jin Yong Choi, Sung Ryul Shim, Jae Heon Kim
International Urology and Nephrology.2021; 53(8): 1563. CrossRef  Efficacy of testosterone replacement therapy for treating metabolic disturbances in lateonset hypogonadism: a systematic review and metaanalysis
Si Hyun Kim, Jae Joon Park, Ki Hong Kim, Hee Jo Yang, Doo Sang Kim, Chang Ho Lee, Youn Soo Jeon, Sung Ryul Shim, Jae Heon Kim
International Urology and Nephrology.2021; 53(9): 1733. CrossRef  A Systematic Review and Metaanalysis on the Impact of Proficiencybased Progression Simulation Training on Performance Outcomes
Elio Mazzone, Stefano Puliatti, Marco Amato, Brendan Bunting, Bernardo Rocco, Francesco Montorsi, Alexandre Mottrie, Anthony G. Gallagher
Annals of Surgery.2021; 274(2): 281. CrossRef  Research and scholarly methods: Meta‐analysis
William L. Baker, Diana M. Sobieraj
JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY.2021; 4(9): 1170. CrossRef  Cancer Risk After Radioactive Iodine Treatment for Hyperthyroidism
Sung Ryul Shim, Cari M. Kitahara, Eun Shil Cha, SeongJang Kim, Ye Jin Bang, Won Jin Lee
JAMA Network Open.2021; 4(9): e2125072. CrossRef  Antibiotic Prophylaxis in the Prevention of Postoperative Infections in Mandibular Third Molar Extractions: Systematic Review and MetaAnalysis
Saturnino Marco Lupi, Giorgia Olivieri, Jessica Landini, Andrea Ferrigno, Plinio Richelmi, Claudia Todaro, Ruggero Rodriguez y Baena
Applied Sciences.2021; 11(20): 9449. CrossRef  Effects of Taekwondo Training on Body Composition: A Systematic Review and MetaAnalysis
Seunghui Baek, JongBeom Park, SangHwan Choi, JaeDon Lee, SangSeok Nam
International Journal of Environmental Research and Public Health.2021; 18(21): 11550. CrossRef  Proficiency Based Progression (PBP) training the future model for dental operative skills training?: A systematic review and metaanalysis of existing literature
Elaine Kehily, Elio Mazzone, Niamh Coffey, Finbarr Allen, Anthony Gallagher, Anthony Roberts
Journal of Dentistry.2021; : 103906. CrossRef  Prostate cancer specific mortality after 5αreductase inhibitors medication in benign prostatic hyperplasia patients: systematic review and metaanalysis
Jae Joon Park, Hyun Young Lee, Sung Ryul Shim, Sang Wook Lee, Kwang Taek Kim, Jae Heon Kim
The Aging Male.2021; 24(1): 80. CrossRef  Adverse events of video capsule endoscopy over the past two decades: a systematic review and proportion metaanalysis
YuanChen Wang, Jun Pan, YaWei Liu, FengYuan Sun, YangYang Qian, Xi Jiang, WenBin Zou, Ji Xia, Bin Jiang, Nan Ru, JiaHui Zhu, EnQiang Linghu, ZhaoShen Li, Zhuan Liao
BMC Gastroenterology.2020;[Epub] CrossRef  Factors associated with Burden of Family Caregivers of Homedwelling Elderly People with Dementia: A Systematic Review and Metaanalysis
Eun Kyung Kim, Heeok Park
Korean Journal of Adult Nursing.2019; 31(4): 351. CrossRef