Thongchai Thailand

Spurious Correlations in Climate Science

Posted on: May 27, 2018

FIGURE 1: CLIMATE SCIENTISTS

 

 

FIGURE 2: FEAR OF MELTING ICE AND SEA LEVEL RISE 

 

 

FIGURE 3: SPURIOUS CORRELATIONS

 

 

 

 

[LIST OF POSTS ON THIS SITE]

 

 

  1. DETRENDED CORRELATION ANALYSIS OF TIME SERIES DATA: Correlation between  x and y in time series data derive from responsiveness of y to x at the time scale of interest and also from shared long term trends. These two effects can be separated by detrending both time series as explained by Alex Tolley in the video frame of Figure 3. When the trend effect is removed only the responsiveness of y to x remains. This is why detrended correlation is a better measure of responsiveness than source data correlation as explained very well by Alex Tolley in the video. The full video may be viewed on Youtube [LINK] . That spurious correlations can be found in time series data when detrended analysis is not used is demonstrated with examples at the Tyler Vigen Spurious Correlation website [LINK] . Spurious correlations are common in climate science where many critical relationships that support the fundamentals of anthropogenic global warming (AGW) are found to  be based on spurious correlations.
  2. EXAMPLE 1:  For example, climate science assumes that changes in atmospheric CO2 concentration since pre-industrial times are due to fossil fuel emissions of the industrial economy. This attribution is supported by a strong correlation between the rate of emissions and the rate of increase in atmospheric CO2 concentration in the time series of the source data. However, when the two time series are detrended, the correlation is not found. This result of detrended correlation analysis implies that the correlation seen in the source data derives from shared trends and not from responsiveness at an annual time scale. Details of this test are presented in a related post  [LINK] .
  3. EXAMPLE 2: A similar relationship is found in the ocean acidification hypothesis which claims that changes in the inorganic carbon concentration of oceans are driven by fossil fuel emissions. There, too the source data do show a strong correlation but that correlation vanishes when the two time series are detrended. As before, this pattern implies that the correlation in the source data derives from shared trends and not from responsiveness at an annual time scale. [LINK] .
  4. EXAMPLE 3: It is claimed that the observed rise in atmospheric methane concentration is due to human caused methane emissions in activities such as cattle ranching and dairy farming as well as rice cultivation and oil and gas production. Here too, a strong correlation is found in the time series of the source data but this correlation does not survive into the detrended series. This result implies that the correlation between human caused methane emissions and the rise in atmospheric methane derives from shared trends and not from responsiveness at an annual time scale. Such responsiveness is a necessary, though not sufficient, condition for causation.  Details of this work may be found in a related post at this site [LINK] .
  5. EXAMPLE 4: A cornerstone of climate science is the effectiveness of proposed climate action in the form of reducing fossil fuel emissions. That the rate of warming can be attenuated by reducing fossil fuel emissions requires that the rate of warming must be responsive to the rate of emissions at the appropriate time scale for this causation to occur (thought to be a decade or perhaps longer (Ricke&Caldeira 2014). And in fact, we find a strong correlation between the rate of warming and the rate of emissions in the time series of the source data at five different time scales (10, 15, 20, 25, & 30 years). Both of these source time series show an upward trend such that the shared trend can create spurious correlations as in the Alex Tolley lecture. When the two time series are detrended, the correlation disappears. The absence of detrended correlation implies that the observed correlation was a faux relationship driven by shared trends and not by responsiveness at the time scales tested in the analysis as demonstrated in a related post [LINK] . Thus no evidence is found in the data that reducing emissions will slow down the rate of warming.
  6. EXAMPLE 5: It is also claimed in climate science that reducing emissions will slow down the rate of sea level rise. This relationship requires a responsiveness of the rate of sea level rise to the rate of emissions at the appropriate time scale for this causation. And in fact, we find a strong correlation between the rate of sea level rise and the rate of emissions in the time series of the source data at five different time scales ranging from 30 to 50 years. Both of these source time series show an upward trend such that the shared trend can create a faux correlation. When the two time series are detrended, the correlation disappears. The absence of detrended correlation implies that the observed correlation was a spurious relationship driven by shared trends and not by responsiveness at the time scales tested in the analysis. This work may be found in a related post [LINK] .
  7. EXAMPLE 6: Climate science supports the greenhouse gas heat trapping theory of atmospheric CO2 and the relevance of their climate models with a strong correlation between model projections of surface temperature and actual observations (see for example Santer 2019). However, this correlation is also between two time series with rising trends. In a related post it is shown that there is indeed a strong correlation between the source data but this correlation is not found in the detrended series [LINK]
  8. EXAMPLE 7: Arctic sea ice extent has played an important role in climate change fear based activism because of periods of diminishing summer minimum sea ice extent in September and the forecasts of “ice free Arctic” that these trends have engendered. The underlying fear of human caused climate change causing Arctic sea ice melt was thus created. The evidence for the causal connection for this causation is a correlation between the rate of warming and the rate of summer sea ice decline; but detrended correlation analysis shows that this correlation is spurious as no year to year responsiveness of September Arctic sea ice extent to the rate of warming is found in the detrended series [LINK] .
  9. EXAMPLE 8: With the assumption that the observed rise in atmospheric CO2 concentration is driven by fossil fuel emissions (discussed in example 1) the effect of higher atmospheric CO2 concentration on climate is then established in terms of climate sensitivity, that is the responsiveness of surface temperature to the logarithm of atmospheric CO2 concentration. The validity of the climate sensitivity function can be shown with strong and statistically significant correlations between the climate model temperature series and observations. However, as shown in a related post [LINK] , this correlation does not survive into the detrended series and is therefore a spurious correlation, similar to the Tyler Vigen examples, that derives from shared trends and not from responsiveness at an annual or other fixed and finite time scale.
  10. EXAMPLE 9: The theory of the greenhouse gas effect of atmospheric CO2 predicts that as the CO2 concentration rises, it will cause tropospheric temperatures to rise and at the same time will cause lower stratospheric temperatures to fall. Thus we expect that that the lower stratospheric temperature will be responsive to mid-tropospheric temperature at an annual time scale and climate scientists claim that this is exactly what we find in the observational data. The evidence presented is a strong correlation between tropospheric temperature and lower stratospheric temperature. However, detrended correlation shows that this correlation derives from shared trends and not from a responsiveness of lower stratospheric temperature to mid tropospheric temperature at an annual time scale. The details of this analysis is described in a related post  [LINK] .
  11. EXAMPLE 10:  An additional argument for the attribution of increases in atmospheric CO2 to fossil fuel emissions is presented by climate science in terms of the observed dilution of the 14C isotope fraction of carbon in atmospheric CO2. It is claimed that this dilution proves that fossil fuel emissions accumulate in the atmosphere because fossil fuel carbon is known to contain low or no 14C having been dead and underground for millions of years. A test of this hypothesis shows that the correlation presented by climate science as empirical evidence in support of this theory is spurious. Details in a related post [LINK] .
  12. MOVING AVERAGES AND OTHER PRE-PROCESSED TIME SERIES DATA. When moving averages or moving sums of a time series are used to construct a derived time series, care must be taken to correct for the effective sample size (EFFN) in hypothesis tests because multiplicity (the use of the same data point more than once) reduces the effective sample size. When the reduction in degrees of freedom is not taken into account faux statistical significance can lead to spurious findings . This issue is discussed in some detail in a related post [LINK] and an example of this statistical error in climate science is presented in another related post [LINK] .
  13. A TIME SERIES OF THE CUMULATIVE VALUES OF ANOTHER TIME SERIES: An extreme case of such multiplicity is the construction of a time series of the cumulative values of another time series. In these cases it can be shown that the effective sample size is always EFFN=2 so that the degrees of freedom in hypothesis tests is DF=0. This relationship is described in an online paper [LINK] with the relevant text reproduced in paragraph#8 below. It should also be noted that the time series of the cumulative values of another time series does not contain a time scale. Thus, without either time scale or degrees of freedom, it is not possible to test for the statistical significance of any statistic for a time series of the cumulative values of another time series. The spuriousness of such correlations is demonstrated with Monte Carlo simulation in paragraph#9 below.
  14. EFFECTIVE SAMPLE SIZE OF THE CUMULATIVE VALUES OF A TIME SERIES. If the summation starts at K=2, series cumulative values of a time series X of length N is computed as Σ(X1 to X2), Σ(X1 to X3), Σ(X1 to X4), Σ(X1 to X5) … Σ(X1 to XN-3), Σ(X1 to XN-2), Σ(X1 to XN-1), Σ(X1 to XN). In these N-K+1 cumulative values, XN is used once, XN-1 is used twice, XN-2 is used three times, XN-3 is used four times, X4 is used N-3 times, X3 is used N-2 times, X2 is used N-1 times , X1 is used N-1 times. In general, each of the first K data items will be used N-K+1 times. Thus, the sum of the multiples for the first K data items may be expressed as K*(N-K+1). The multiplicities of the remaining N-K data items form a sequence of integers from one to N-K and their sum is (N-K)*(N-K+1)/2. The average multiplicity of the N data items in the computation of cumulative values may be expressed as AVERAGE-MULTIPLE = [(K*(N-K+1) + (N-K)*(N-K+1)/2]/N. Since multiplicity of use reduces the effective value of the sample size we can express the effective sample size as: EffectiveN = N/(AVERAGE-MULTIPLE) = N2/(K*(N-K+1) + (N-K)*(N-K+1)/2). To be able to determine the statistical significance of the correlation coefficient it is necessary that the degrees of freedom (DF) computed as effectiveN -2 should be a positive integer. This condition is not possible for a sequence of cumulative values that begins with Σ(X1 to X2). Effective-N can be increased to values higher than two only by beginning the cumulative series at a later point K>2 in the time series so that the first summation is Σ(X1 to XK) where K>2. In that case, the total multiplicity is reduced and this reduction increases the value of effectiveN somewhat but not enough to reach values much greater than two.
  15. MONTE CARLO SIMULATION OF SPURIOUS CORRELATION BETWEEN CUMULATIVE VALUES OF TIME SERIES DATA
  16. EXAMPLE 1: An example of the use of cumulative values in climate science is the so called TCRE or Transient Climate Response to Cumulative Emissions. It is the correlation between cumulative emissions and cumulative warming (note that temperature = cumulative warming). This relationship shows a nearly perfect proportionality that is thought to provide convincing evidence of a causal relationship between emissions and temperature and provides a convenient metric for the computation of the so called remaining “carbon budget”, that is the amount of additional emissions possible for a given constraint on the amount of warming. The spuriousness of the TCRE proportionality is described in a related post on this site [LINK] and its spuriousness is further supported with a parody of the procedure that shows that UFO visitations are the real cause of global warming [LINK] . A related post shows that when a finite time scale is inserted into the TCRE, the correlation disappears [LINK] .
  17. EXAMPLE 2: A paper by Peter Clark of Oregon State University extended the TCRE methodology to sea level rise to provide empirical evidence that fossil fuel emissions cause sea level rise and that climate action in the form of reducing fossil fuel emissions should moderate the rate of sea level rise. (Clark, Peter U., et al. “Sea-level commitment as a gauge for climate policy” Nature Climate Change 8.8 2018: 653). In a related post on this site it is shown that this correlation is spurious [LINK] . In another, we show that when finite time scales are inserted so that both time scale and degrees of freedom are available for carrying out hypothesis tests, the correlation seen in the cumulative series is not found [LINK] .
  18. EXAMPLE 3: It is claimed that a correlation between cumulative values provides evidence that the decay in atmospheric 13C/12C isotope ratio is related to fossil fuel emissions and proves that the observed increase in atmospheric CO2 is driven by fossil fuel emissions. This claim and spurious correlation are addressed in a related post [LINK] .
  19. EXAMPLE 4: Climate science claims that dilution of the 13C isotope of carbon in atmospheric CO2 provides evidence that the observed increase in atmospheric CO2 concentration is caused by fossil fuel emissions. A strong correlation is presented as evidence but the correlation is between cumulative values and therefore spurious. When that error is corrected, no correlation is found [LINK] .
  20. THE INTERPRETATION OF VARIANCE IN CLIMATE SCIENCE STATISTICS. A related issue in statistical analysis methods of climate scientists is the way variance is interpreted. In statistics and also in information theory, high variance implies low information content. In other words, the higher the variance the less we know. In this context high variance is undesirable because it degrades the information we can derive from the data. However, high variance also yields large confidence intervals making it possible for high variance to be interpreted not as absence of information but as information about a danger of how extreme it could be. This interpretation of variance is common in climate science. In conjunction with the precautionary principle, it leads to a perverse interpretation of uncertainty such that uncertainty about the mean becomes transformed into certainty of extreme values. For example if the mean value of empirical climate sensitivity is found to have no statistical significance because of a large variance over a range of λ=2 to λ=6, the conclusion drawn by climate science from these data is not that we don’t really know what the value of λ is or even whether this concept can be verified with empirical evidence, but an obsession with the high value of λ=6 along with the alarming fear of the highest possible value in a range that actually implies that we don’t know. This interpretation of variance is aided by the use of the precautionary principle which holds that if a possible value of something that is harmful is high it is better to take precaution against that possibility than to interpret the data in a strictly rational way. In other words, the less you know the more extreme it COULD be and this use of the word “could” is common in climate science in the use of ignorance in the form of high variance to create fear.
  21. THE USE OF CIRCULAR REASONING IN CLIMATE SCIENCE STATISTICS:  In carrying out the flow accounting of the carbon cycle as a way of determining the effect of carbon in fossil fuel emissions on the carbon cycle, climate science is faced with the impossibility of measuring the much larger flows of carbon to and from the atmosphere in the carbon cycle. This difficulty is overcome by using the time series of atmospheric CO2 concentration from the Mauna Loa observatory that shows atmospheric CO2 concentration rising over time. By attributing the changes in atmospheric CO2 to fossil fuel emissions, a flow account of the unmeasurable carbon cycle can be inferred. The inferred flow account is then used to determine that the observed rise in atmospheric CO2 concentration is explained in terms of fossil fuel emissions.  This issue is presented in detain in two related posts [LINK] [LINK] .

 

 

 

[LIST OF POSTS ON THIS SITE]

\

58 Responses to "Spurious Correlations in Climate Science"

[…] time series are detrended. The details of the instability issue are described in a related post Spurious Correlations in Climate Science and a downloadable paper posted on SSRN Validity and Reliability of Charney Climate Sensitivity. […]

[…] Spurious Correlations in Climate Science Elevated CO2 and Crop Chemistry […]

[…] RELATED POST: SPURIOUS CORRELATIONS IN CLIMATE SCIENCE […]

[…] Regarding the IPCC AR5 sentence: “The atmosphere and ocean have warmed, the amounts of snow and ice have diminished, sea level has risen, and the concentrations of greenhouse gases have increased”, it should be noted that it implies that these similar changes imply correlation and therefore causation. This interpretation contains serious statistical errors as described in the post on SPURIOUS CORRELATIONS IN CLIMATE SCIENCE. […]

[…] surface temperature and cumulative emissions. The TCR is described in three related posts here SPURIOUS CORRELATIONS , here GREENHOUSE EFFECT OF ATMOSPHERIC CO2 and here TRANSIENT CLIMATE […]

[…] “The planet’s average surface temperature has risen about 0.9C driven largely by increased carbon dioxide”. This claim assumes that the observed increase in atmospheric CO2 is driven by emissions and that the observed increase in surface temperature is driven by atmospheric CO2 concentration. These relationships exist in climate models because they have been programmed into them but they are not found in the observational data as shown these two related posts: HUMAN CAUSED CLIMATE CHANGE, THE GREENHOUSE EFFECT OF ATMOSPHERIC CO2. No evidence exists outside of climate models that relate warming to emissions outside of climate models and without the use of spurious correlations as discussed in this related post: SPURIOUS CORRELATIONS IN CLIMATE SCIENCE. […]

[…] fossil fuel emissions cause ocean acidification. The related post on spurious correlations is here SPURIOUS CORRELATIONS IN CLIMATE SCIENCE and the ocean acidification issue presented here HUMAN CAUSED CLIMATE CHANGE shows that […]

[…] J. (2018). Spurious Correlations in Climate Science. Retrieved from chaamjamal.wordpress.com: https://chaamjamal.wordpress.com/2018/05/27/spurious-correlations-in-climate-science-2/ NSIDC. (2018). NSIDC DATA. Retrieved from National Snow and Ice Data Center: http://nsidc.org/data/ […]

[…] Yet statistical analysis of the observational data do not show the correlations that would exist if this chain of causation to be true were true. The correlation argument is presented in more detail in two related posts. HUMAN CAUSED CLIMATE CHANGE, SPURIOUS CORRELATIONS IN CLIMATE SCIENCE. […]

[…] RELATED POST: SPURIOUS CORRELATIONS IN CLIMATE SCIENCE […]

[…] Spurious Correlations in Climate Science […]

[…] Spurious Correlations in Climate Science […]

[…] Spurious Correlations in Climate Science […]

[…] Spurious Correlations in Climate Science […]

[…] Spurious Correlations in Climate Science […]

[…] and not under a controlled experiment. This issue is discussed at length in a related post on SPURIOUS CORRELATIONS IN CLIMATE SCIENCE. In short, correlations between time series of field data require extreme caution to separate out […]

[…] in a moving 30-year window. These issues are discussed in greater detail in related posts on Spurious Correlations in Climate Science and ECS: Equilibrium Climate Sensitivity. In short, unstable correlations are normally spurious […]

[…] need for detrended correlation in time series analysis is explained in a related post Spurious Correlations in Climate Science . In brief, correlations in time series data derive from two sources – that due to long term […]

[…] and Cumulative Sea Level Rise  TCRE: Transient Climate Response to Cumulative Emissions  Spurious Correlations in Climate Science . It is derived from a source document that presents a study of total globally averaged […]

[…] and Cumulative Sea Level Rise  TCRE: Transient Climate Response to Cumulative Emissions  Spurious Correlations in Climate Science . It is derived from a source document that presents a study of total globally averaged […]

[…] based has no interpretation without correlation. This relationship is explained in a related post [Spurious Correlations in Climate Science] . That leaves us with statistically significant 50-year ECS values in the range ECS=[0.36-2.93] […]

[…] Spurious Correlations in Climate Science […]

[…] Spurious Correlations in Climate Science […]

[…] a time scale of interest, create illusory correlations. This issue is discussed in a related post [LINK] . It is for this reason that the usual argument that “the theory that X causes Y is supported […]

[…] This anomalous result reveals real and possibly serious issues and weaknesses in empirical sensitivity research in climate science in terms of statistics.The weaknesses likely have to do with overlooked OLS linear regression assumptions as well as flawed interpretation of source data correlation in time series data without consideration for the the effect of shared trends on correlation. This consideration is necessary before source data correlation in time series field data are interpreted in terms of causation at a finite time scale. The uncertainty problem in empirical climate sensitivity research likely arises from inadequate attention to whether regression coefficients are supported by correlation at the time scale of interest. Without such support, though regression coefficients may be computed from the data, they have no interpretation in terms of causal relationships. This issue is discussed in detail in related posts [LINK] [LINK] […]

[…] To insert a time scale and finite degrees of freedom into the TCRE model, we use five different time scales for this analysis from 10 years to 30 years at 5 year increments. For each time scale we compute the cumulative emissions in the duration of the time scale and the rate of warming within the time scale across the full span of the data. For example, in the 10-year time scale, cumulative emissions is computed as the total emissions in a moving 10-year window that moves one year at a time through the full span of the data. Likewise, the rate of warming is computed within a moving 10-year window that moves through the full span of the data one year at a time. We then compute the detrended correlation net of the contribution to source data correlation by shared long term trends. The rationale for detrended analysis is described in a related post [LINK] […]

[…] that CO2 in fossil fuel emissions accumulate in the atmosphere and cause warming  (related post  [LINK] ) the low concentration argument in and of itself is not sufficient even though 400 ppm seems like […]

[…] Conclusion: Climate in general and Holocene climate in particular appear to exhibit properties of non-linear dynamics and deterministic chaos. Glaciation is not a linear and well behaved period of cooling and ice accumulation and interglacials are not a linear and well behaved period of warming and ice dissipation. Rather, both glaciation and deglaciation are chaotic events consisting of both processes differentiated only by a slight advantage to ice accumulation in glaciation and a slight advantage to ice dissipation in interglacials. In this context, the Holocene must be studied and understood as a chaotic system with multiple episodes of warming and ice dissipation and multiple episodes of cooling and ice accumulation. Viewed in this way, the current warming trend, when compared with the HCO, BAW, RWP, MWP, and in the context of alternating mini glaciations, can be understood as a natural recovery from the Little Ice Age [LINK] . The Industrial Revolution falls conveniently in the middle and it is tempting to see it as causal in the context of the study of human impacts on nature. However, it is just as credible if not more so to describe it as coincidental rather than causal when seen in the context of the warming and cooling dynamics of the Holocene. With regard to the principle of Occam’s razor, the simpler explanation in terms Holocene dynamics is superior to the the complicated AGW explanation particularly so in terms of the many vexing issues in AGW that have not been resolved and that may never be resolved [LINK] .  […]

[…] at the time scale of interest net of the effect of shared trends as described in a related post [LINK] . We conclude from Figure 6 that no correlation is found at the annual time scale and that […]

[…] is shown in a related post [LINK]  that in statistical procedures that use source data repeatedly, a loss in effective sample size […]

[…] is shown in a related post [LINK]  that in statistical procedures that use source data repeatedly, a loss in effective sample size […]

[…] the trends and not by responsiveness at any finite time scale less than the full span of the data [LINK] . Detrended correlation is used to remove the spurious shared trend effect so that responsiveness […]

[…] in climate science is that it is a product of errors in statistics as explained in a related post [LINK] . If climate scientists themselves can’t get the science right, how can we expect elementary […]

I really enjoyed your spurious correlations. In my years, I made some erroneous judgements, based on too little data. Mine were not as different as those examples but perhaps were no better. I did learn to capture as much information as i could and rerun my programs. But the field of possible actors when trying to straighten out some ragged operation of a distillation tower were a tiny fraction compared to the many factors involved when dealing with atmosphere, the oceans, the sun , etc..
So I do not think the correlation of CO2 and global temperature is not sufficiently supported by actual measurements.

Thank you. My work does not address the temperature issue. My view is that the foundation of agw science is the causal relationship between emissions and atmispheric composition. My correlation studies address that issue.

[…] between phenomena even when they do not have a causal relationship.  It is usually recommended to de-trend the data and see if there is still a correlation.  I do that below with this […]

[…] correlations between phenomena even when they don’t have a causal relationship.  It is often recommended to de-trend the information and see if there may be nonetheless a correlation.  I do this beneath […]

[…] correlations between phenomena even when they do not have a causal relationship.  It is usually recommended to de-trend the data and see if there is still a correlation.  I do that below with this CO2 […]

[…] between phenomena even when they do not have a causal relationship.  It is usually recommended to de-trend the data and see if there is still a correlation.  I do that below with this CO2 […]

[…] correlations between phenomena even when they do not have a causal relationship.  It is usually recommended to de-trend the data and see if there is still a correlation.  I do that below with this CO2 […]

[…] zu beobachten, selbst wenn sie nicht in einem kausalen Zusammenhang stehen. In der Regel empfiehlt es sich, den Trend der Daten aufzuheben und zu prüfen, ob noch eine Korrelation besteht. Ich mache […]

[…] zu beobachten, selbst wenn sie nicht in einem kausalen Zusammenhang stehen. In der Regel empfiehlt es sich, den Trend der Daten aufzuheben und zu prüfen, ob noch eine Korrelation besteht. Ich mache […]

[…] zu beobachten, selbst wenn sie nicht in einem kausalen Zusammenhang stehen. In der Regel empfiehlt es sich, den Trend der Daten aufzuheben und zu prüfen, ob noch eine Korrelation besteht. Ich mache […]

[…] trends and not by responsiveness at any finite time scale less than the full span of the data [LINK] . Detrended correlation is used to remove the spurious shared trend effect so that […]

Leave a comment


  • Richard A. O'Keefe: I should think that an understanding of time series analysis would also promote scepticism. And many older people (like me) lived through the 1970s "
  • Anne Kadeva: Thank you forr sharing
  • François Riverin: If only 30 % of CO2 stay in that form in the ocean, does it change your conclusions? Thank you for this research