 Research article
 Open Access
 Open Peer Review
 Published:
Standardizing effect size from linear regression models with logtransformed variables for metaanalysis
BMC Medical Research Methodology volume 17, Article number: 44 (2017)
The Erratum to this article has been published in BMC Medical Research Methodology 2017 17:91
Abstract
Background
Metaanalysis is very useful to summarize the effect of a treatment or a risk factor for a given disease. Often studies report results based on logtransformed variables in order to achieve the principal assumptions of a linear regression model. If this is the case for some, but not all studies, the effects need to be homogenized.
Methods
We derived a set of formulae to transform absolute changes into relative ones, and vice versa, to allow including all results in a metaanalysis. We applied our procedure to all possible combinations of logtransformed independent or dependent variables. We also evaluated it in a simulation based on two variables either normally or asymmetrically distributed.
Results
In all the scenarios, and based on different change criteria, the effect size estimated by the derived set of formulae was equivalent to the real effect size. To avoid biased estimates of the effect, this procedure should be used with caution in the case of independent variables with asymmetric distributions that significantly differ from the normal distribution. We illustrate an application of this procedure by an application to a metaanalysis on the potential effects on neurodevelopment in children exposed to arsenic and manganese.
Conclusions
The procedure proposed has been shown to be valid and capable of expressing the effect size of a linear regression model based on different change criteria in the variables. Homogenizing the results from different studies beforehand allows them to be combined in a metaanalysis, independently of whether the transformations had been performed on the dependent and/or independent variables.
Background
A metaanalysis is a systematic review of the literature that uses statistical methods to combine the results of two or more eligible studies [1]. It is useful because it provides a more accurate effect estimate by identifying clinically important effects, which, because of their size, may not have been detected in the primary studies. Furthermore, with metaanalyses it is possible to obtain a higher level of precision thanks to a larger sample size.
The type of measurement used to calculate effect size depends on the estimators used in the studies included in the metaanalysis [2]. Therefore, one of the possible limitations in a metaanalysis is that published studies report results that were obtained through different analytical approaches and measures of association. When performing a metaanalysis of an effect size estimated with linear regression models, this limitation can be (at least to a certain extent) overcome by using different transformations. Consequently, variables in linear regression models are usually transformed to achieve the principal assumptions of i) linearity of the relationship, ii) independence of the residual values, iii) homoscedasticity (constant variance) of the residuals, and iv) normal distribution of the residuals [3, 4]. Depending on the transformation applied in each case (natural logarithm, base 2 logarithm, base 10, etc.), and whether it is performed on an independent variable, dependent variable or both, the regression coefficient is interpreted differently [3, 4].
In a linear relationship between two untransformed variables, we quantify the absolute change in one of them by an absolute change in the other. However, when a variable is transformed logarithmically, the absolute variation in the logarithm equals a relative variation of the original variable (Fig. 1) For example, an increase of one unit in the logarithmically transformed variable is equivalent to multiplying the original variable by the base of the logarithm used. The existence of these transformations will, therefore, affect the interpretation of the effect size.
Thus, before performing a metaanalysis, some preprocessing procedure to homogenize the magnitude of effect observed in each study is required. This means that recalculating each effect to express it as a change in the dependent variable that corresponds to the same change in the independent variable is required. These changes, depending on the absence or presence of logarithmic transformation, can be expressed in either absolute or relative terms. Recent studies have applied a methodology to standardize the results of linear regression models through the logarithmic transformation of the independent variable in different bases for their inclusion in a metaanalysis [5].
This study aimed to develop a set of formulae to express results from linear regression models with different logtransformations of independent and/or dependent variables as the same effect size to be included in a metaanalysis.
Methods
The linear regression model, a commonly used statistic tool, establishes a linear relation between two variables and estimates its association. The simplest linear regression models can be written as
where α is the ordinate at the origin of the straight line that relates X to Y, β is the slope of the straight line that relates X to Y, and ε is the random error.
If we call \( \widehat{\alpha} \) and \( \widehat{\beta} \) the estimates of α and β by the least squares approach (that is, minimizing the squared distance between the estimation and the observed value), then we can write the following equation:
The estimator \( \widehat{\beta} \) measures the strength of association between X and Y, as this represents the absolute change in the mean of Y for an increase of one unit in X. However, the meaning of \( \widehat{\beta} \) is not as intuitive when variables are transformed.
All possible regression models with all possible combinations of logtransformations for the dependent or independent variables were considered. Thus, the following models were formulated: (i) no transformation (model A), (ii) only the independent variable transformed (model B), (iii) only the dependent variable transformed (model C), and (iv) both the dependent and independent variables transformed (model D) (see Fig. 1). Logtransformations were expressed in a general base a for the dependent variable and in base b for the independent variable. Absolute change in a variable was set as c units and relative change was considered to be a ratio k between values.
Table 1 shows all possible scenarios based on the model (A to D) considered and the combination of absolute or relative change in the dependent or independent variables. The effect size and the 95% confidence interval (CI) are shown in each cell. The diagonal line in the table indicates the expression of the effect size and the 95% CI that directly corresponds to that particular model [3]. The other formulae proposed express effects that differ from those obtained directly from the model. The formulae stem from basic transformations to express absolute changes as relative changes and vice versa:
 Equivalent absolute change c in X for a relative change k in X.
The objective was to obtain the equivalent of an absolute change of c units in the independent variable for a relative change equal to k in the independent variable. For that purpose, we approximated the absolute change that would occur in the independent variable as a relative change equal to k in the mean of its distribution.
 Equivalent relative change k in X for an absolute change c in X.
Similarly, the relative change corresponding to an absolute change of c units in the independent variable was approximated as follows:
 Equivalent relative change k′ in Y for an absolute change c′ in Y.
In the case of the nontransformed dependent variable, the regression model provided the absolute change in Y (c′ = c · β) for an absolute or relative change in X. Analogously to Eq. (2), the following approximation was performed to obtain the equivalent relative change in Y:
 Equivalent absolute change c′ in Y for a relative change k′ in Y.
When the dependent variable was logtransformed, the model provided the relative change in Y(k′ = a ^{c · β}) for an absolute or relative change in X. Analogously to Eq. (1), the following approximation was performed to obtain an equivalent absolute change in Y:
Thus, with these transformations the formulae in Table 1, based on the combinations of the different models and effect expressions, were obtained (see Additional file 1 for derivations).
Simulation
To evaluate the error resulting from the approximations, we built each of the four models and ran simulations. A database with random samples of 500 values from standard distributions of probability (normal and lognormal distributions) was generated. Natural logarithm transformed and untransformed variables were used, and the real values of the regression coefficient and the standard errors from each model A to D were estimated (Tables 2, 3, 4 and 5). Next, the formulae in Table 1 were applied to these values to obtain the effect size from the different change expressions. The simulation was performed for four different scenarios, depending on the following distributions of dependent and independent variables: when the two variables are normally distributed, when the two variables have asymmetric distributions, and when one of the variables has a normal distribution and the other has an asymmetric distribution. In all cases, the mean value of the dependent variable was equal to 50 and the mean value of the independent value was equal to 10. The variables were generated in such a way that the increase of a unit in X was associated with an increase of approximately one unit in Y.
For the simulations, the parameters c = 1 and k = 1.1 were fixed to reflect the effect of an absolute change in one unit or a relative change of 10% in the independent variable (equivalent to one unit given that the mean value of X is 10). Tables 2, 3, 4 and 5 show the results of the simulations. The diagonal positions in these tables correspond to the real effect size, which is obtained from the regression coefficient and the standard error of the specific model. The remainder of the values in each row represents the estimated effect size when using the formulae.
Results
In all of the scenarios, the effect size estimated from the formulae, based on different change criteria, was equivalent to the real effect size. In the model without transformation (model A), the variation of a unit in X is associated with a variation of 0.995 units in Y. When the formula to express a variation of X in relative terms was applied (i.e. an increase of 10% in X as equivalent to one unit), the same result (beta = 0.995) was produced. On the other hand, the estimated effect on Y in relative terms was 1.0199, i.e. a variation of 1.99%. Given that the mean value of Y is 50 units, that variation is equivalent to an increase of 0.995 units, which is equal to the real effect observed (Table 1).
For the other models, the result was the same. In model B, the real absolute change was 0.914, whereas the estimated relative change was 1.0183 (1.83% or 0.914 units), while in model C, the real relative change of 1.0201 equaled the estimated absolute change of 1.006 units, and in model D the real relative change of 1.0186 was equivalent to the estimated absolute change of 0.928. This equivalence, based on the different distributions of variables X and Y (Tables 2, 3, 4 and 5), was maintained in all the scenarios contemplated.
The variation in effect size between the various models differed depending on the shape of the distribution of variables. For the relationship between normally distributed variables, the range of variation in the absolute effect was 0.914 to 1.006, and 1.0183 to 1.0201 in the relative effect. When the independent variable only was skewed, the absolute effect varied between 0.133 and 0.288 and the relative effect between 1.0027 and 1.0058, while when the dependent variable only was skewed, the absolute effect varied between 0.493 and 0.625 and the relative effect between 1.0099 and 1.0125, and when both variables were skewed, the absolute effect varied between 0.551 and 0.997 and the relative effect between 1.0110 and 1.0199.
Empirical example
The method proposed in this study was successfully used in a systematic review that performed a metaanalysis on the potential effects on neurodevelopment in children exposed to arsenic (As) and manganese (Mn) [5]. Additional details on the search strategy, target population, inclusion and exclusion criteria, and assessment of methodological quality have been previously reported [5]. Studies that evaluated neurodevelopment using the same scale (the Wechsler scale [6]) and linear regression techniques to estimate the effect were included in a metaanalysis. Three independent metaanalyses were performed as per the metallic element studied and the sample type: arsenic in urine (five studies included) [7–11], arsenic in drinking water (four studies) [8–11] and manganese in hair (four studies) [12–15]. To assess the association of metal exposure with the fullscale intelligence quotient (IQ) from the Wechsler scale, all the studies used model A (without transformations) or model B (with logtransformed independent variable), with metal exposure as the independent variable and intelligent quotient as the dependent variable. Table 6 shows the type of transformation on X, original regression coefficients and transformed effect sizes, in accordance with the formulae proposed in this study. All effect sizes were expressed as the absolute change in the dependent variable (Y) for an increase of 50% in the independent variable (X), which is equivalent to a coefficient k = 1.5. Thus, transformed effect sizes express the absolute change in the intelligence quotient for a 50% increase in the metal levels.
For example, results from RochaAmador in the metaanalysis of As in urine are from a regression model with natural logarithmic transformation of the independent variable (model B). To obtain the absolute change in the outcome for a relative increase of 1.5 times in the exposure, we apply the formulae in model B for that scenario (see Additional file 1, formulae (13) and (14)):
To obtain the equivalent effect size from von Ehrenstein’s results (which used model A without transformation) formulae (7) and (8) from Additional file 1 must be used:
The results of the metaanalysis suggested that for every 50% increase in arsenic levels (either in urine or in regular drinking water) there could be an approximately 0.5 decrease in the IQ of children aged 5–15 years. Moreover, a 50% increase in manganese levels in hair would be associated with a decrease of 0.7 points in the IQ of children aged 6–13 years [5].
This approach allowed the results from regression models using different formulations to be combined, and, thus obtain a pooled measure of association that included all available results.
Discussion
To establish causality, wellconducted and freeofbias systematic reviews that include a metaanalysis have been proposed as the epidemiological design at the top rank of the evidencebased medicine pyramid [16]. However, the main bias in such design is publication bias and while there are statistical methods that can be used to study the presence of this error, it cannot be controlled [17].
Another problem in metaanalyses is the difficulty of including all the studies dealing with the research topic, either because of a specific transformation performed on the variables of the model or because the effect measurements in said study were not relevant to the research question. When all studies on a specific topic cannot be included, the metaanalysis loses external validity. This difficulty would be solved if it were possible to access the original data (not only the results) that the authors had amassed. However, in almost all cases, accessing this kind of information is practically impossible.
An alternative would be to contact the author of the published study and request the results that were obtained from the original data but which do not appear in the publication. Occasionally this strategy provides a way to access the data required for the study to be included in the metaanalysis. However, such efforts are generally not successful, as positive responses are rare; particularly if the study had been conducted several years beforehand.
On the other hand, there are other initiatives that allow access to anonymized original data obtained in other studies. A relevant example of this is the datasharing policy of the BMJ journals [18]. In fact, after 2013, the publication of the results from any clinical trial on drugs or medical devices requires the authors to make the relevant patientlevel data available (on reasonable request) to other researchers.
In the absence of this type of strategy being consolidated and expanded, there is the urgent need to develop procedures that can be used to standardize results obtained with different methodological approaches so that they can then be validly combined in a metaanalysis. Such procedures would optimize metaanalyses as they would make it possible to include a maximum number of results, even when the analyses carried out were not identical. This would not only increase the statistical potential of the metaanalysis, but would also reduce the risk of any selection bias that might occur if some of the studies identified in the systematic review had to be excluded.
This study proposes a procedure to homogenize the estimated effect sizes with linear regression models that use different transformations of dependent and/or independent variables. The application of these transformations to express all the effect sizes based on the same change criterion enables the results from studies that have built their regression models with different transformations to estimate the effect to be combined. Furthermore, the generalization of the method also allows the effect size to be recalculated, independent of the logarithm base applied in the transformation. Simply reflecting the same change in the independent variable is all that is required.
The simulation results showed that this procedure provided an estimation of the effect that was equal to that obtained with the original model. Moreover, the approximation was not affected by the form of the distribution of the variables. Nevertheless, it is also important to compare the effects of the four models since, from a practical perspective, this procedure will be used to compare the results of different regression models.
As can be observed in the simulation, the effect estimate obtained by using a model without transformations is not the same as that obtained with a model that uses some type of transformation. In other words, if an author presents the result of a model with the logtransformed dependent variable and we then apply the procedure described to recalculate the effect based on a model without transformation, we would not obtain the same result as the author would from their own data in a model without transformation.
This limitation can produce a certain degree of bias in the effect estimate. Based on the simulation results, the size of this bias basically depends on the symmetry of the independent variable (X). When X and Y have a normal distribution, the variation of the effect size in regard to model A is, at most, 8%. When Y has an asymmetric distribution and X a normal distribution, the variation is approximately 10%. However, when the independent variable is asymmetric, the bias can be as high as 50% of the value of the effect estimated with model A.
To apply this model, the standard should be regarded as the most generalized model of all the results, and then the effect should be transformed for those results that use a different model. To apply the proposed formulae featured, an Excel spreadsheet is available as Additional file 2.
Conclusions
In conclusion, the method proposed in this study was shown to be valid and capable of expressing the effect size of a linear regression model consistent with different change criteria in the variables involved. The previous homogenization of the results from different studies allows them to be combined in a metaanalysis, independent of the transformations performed on the dependent and/or independent variables. However, in order to avoid biased effect estimates, this procedure should be used with caution in the case of independent variables with asymmetric distributions that significantly differ from normal ones.
Abbreviations
 As:

Arsenic
 CI:

Confidence interval
 IQ:

Intelligent quotient
 Mn:

Manganese
References
 1.
Glass GV. Primary, secondary, and metaanalysis of research. Educ Res. 1976;5(10):3–8.
 2.
Ferreira González I, Urrútia G, AlonsoCoello P. Revisiones sistemáticas y metaanálisis: bases conceptuales e interpretación. Rev Esp Cardiol. 2011;64(8):688–96.
 3.
BarreraGomez J, Basagana X. Models with transformed variables: interpretation and software. Epidemiology. 2015;26(2):e16–7.
 4.
Elswick Jr RK, Schwartz PF, Welsh JA. Interpretation of the odds ratio from logistic regression after a transformation of the covariate vector. Stat Med. 1997;16(15):1695–703.
 5.
RodriguezBarranco M, Lacasana M, AguilarGarduno C, Alguacil J, Gil F, GonzalezAlzaga B, RojasGarcia A. Association of arsenic, cadmium and manganese exposure with neurodevelopment and behavioural disorders in children: a systematic review and metaanalysis. Sci Total Environ. 2013;454–455:562–77.
 6.
Wechsler D. WISCIV administration and scoring manual. San Antonio: Harcourt Assessment; 2003.
 7.
Hamadani JD, GranthamMcGregor SM, Tofail F, Nermell B, Fangstrom B, Huda SN, Yesmin S, Rahman M, VeraHernandez M, Arifeen SE, et al. Pre and postnatal arsenic exposure and child development at 18 months of age: a cohort study in rural Bangladesh. Int J Epidemiol. 2010;39(5):1206–16.
 8.
RochaAmador D, Navarro ME, Carrizales L, Morales R, Calderon J. Decreased intelligence in children and exposure to fluoride and arsenic in drinking water. Cad Saude Publica. 2007;23 Suppl 4:S579–87.
 9.
von Ehrenstein OS, Poddar S, Yuan Y, Mazumder DG, Eskenazi B, Basu A, HiraSmith M, Ghosh N, Lahiri S, Haque R, et al. Children’s intellectual function in relation to arsenic exposure. Epidemiology. 2007;18(1):44–51.
 10.
Wasserman GA, Liu X, Parvez F, Ahsan H, FactorLitvak P, Kline J, van Geen A, Slavkovich V, Loiacono NJ, Levy D, et al. Water arsenic exposure and intellectual function in 6yearold children in Araihazar, Bangladesh. Environ Health Perspect. 2007;115(2):285–9.
 11.
Wasserman GA, Liu X, Parvez F, Ahsan H, FactorLitvak P, van Geen A, Slavkovich V, LoIacono NJ, Cheng Z, Hussain I, et al. Water arsenic exposure and children’s intellectual function in Araihazar, Bangladesh. Environ Health Perspect. 2004;112(13):1329–33.
 12.
Bouchard MF, Sauve S, Barbeau B, Legrand M, Brodeur ME, Bouffard T, Limoges E, Bellinger DC, Mergler D. Intellectual impairment in schoolage children exposed to manganese from drinking water. Environ Health Perspect. 2011;119(1):138–43.
 13.
MenezesFilho JA, Novaes Cde O, Moreira JC, Sarcinelli PN, Mergler D. Elevated manganese and cognitive performance in schoolaged children and their mothers. Environ Res. 2011;111(1):156–63.
 14.
RiojasRodriguez H, SolisVivanco R, Schilmann A, Montes S, Rodriguez S, Rios C, RodriguezAgudelo Y. Intellectual function in Mexican children living in a mining area and environmentally exposed to manganese. Environ Health Perspect. 2010;118(10):1465–70.
 15.
Wright RO, Amarasiriwardena C, Woolf AD, Jim R, Bellinger DC. Neuropsychological correlates of hair arsenic, manganese, and cadmium levels in schoolage children residing near a hazardous waste site. Neurotoxicology. 2006;27(2):210–6.
 16.
Rosner AL. Evidencebased medicine: revisiting the pyramid of priorities. J Bodyw Mov Ther. 2012;16(1):42–9.
 17.
Rothstein HR, Sutton AJ, Borenstein M. (Eds.). Publication bias in metaanalysis: Prevention, assessment and adjustments. New York: John Wiley & Sons; 2006. p. 9–49. ISBN 0470870141.
 18.
Godlee F, Groves T. The new BMJ policy on sharing data from drug and device trials. BMJ. 2012;345:e7888.
Acknowledgements
The authors would like to thank Begoña Martínez at the Andalusian School of Public Health, for her comments on and suggestions for the manuscript.
Funding
No specific funding.
Availability of data and materials
The datasets used for simulations are available from the corresponding author upon reasonable request.
Authors’ contributions
MRB and AT conceived of the study. MRB developed the method and formulae. DR and EM generated databases, ran the simulations and designed the Excel template. MJS and MRB drafted the original manuscript. All authors contributed to the writing of the final manuscript. All authors have approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Not applicable.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author information
Additional information
An erratum to this article is available at http://0dx.doi.org.brum.beds.ac.uk/10.1186/s128740170365x.
Additional files
Additional file 1:
Derivation of formulae in Table 1. (DOCX 19 kb)
Additional file 2:
Excel template to transform original effect size using the proposed formulae. (XLSX 19 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
RodríguezBarranco, M., Tobías, A., Redondo, D. et al. Standardizing effect size from linear regression models with logtransformed variables for metaanalysis. BMC Med Res Methodol 17, 44 (2017) doi:10.1186/s1287401703228
Received
Accepted
Published
DOI
Keywords
 Metaanalysis
 Systematic review
 Logtransformation
 Linear regression
 Effect size
 Regression coefficients