Euan Mearns: UK temperatures since 1933 – Part 1.

Posted: November 11, 2013 by tallbloke in Analysis, atmosphere, Clouds, cosmic rays, Cycles, Dataset, Natural Variation, solar system dynamics

Repost of a repost by Clive best, shamelessly stolen because it’s so good. This adds to the several posts already here at th talkshop comparing sunshine hours to temperature regionally and globally. How long can the mainstream climate scintists ignore this growing body of evidence which demonstrates a link between solar activty levels, albedo cloud amount levels and surface temperature? H/T to A.C. Osborn

This is a repost written by Euan Mearns and is an introduction to the work we consequently did this summer concerning cloud and CO2 radiative effects on UK temperatures. Two more posts will follow describing the radiative model in more detail.

Summary

  • Terrestrial sunshine records provide an inverse proxy for cloud cover. Sunshine at surface means cloud free line of sight between the point on the surface and the Sun.
  • We present concordant sunshine and temperature records for 23 UK Met Office weather stations. Data is available for a handful of stations from 1908 but it is only from 1933 that there are a sufficient number of stations to provide representative cover of the UK.
  • Data from 1933 to 1956 is believed to be affected by air pollution from burning coal for home heat and power generation, therefore our main analysis focusses on the time interval 1956 to 2012.
  • Both temperature (Tmax) and sunshine hours show cyclic variation, both showing a tendency to rise in the period 1980 to 2000 in keeping with global warming that has been documented in many studies.
  • In the UK there is a high degree of covariance between sunshine and Tmax, sunny years tend to be warmer. The correlation coefficient (R2) between sunshine hours and Tmax is 0.8 whilst R2 for CO2 and Tmax is 0.66 (calculated on 5 year means). A significant portion of warming observed in the UK may be attributed to temporal variations in sunshine and cloud cover.
  • This post presents a summary of the raw data in 14 charts. Next week we will present a combined net cloud forcing and radiative forcing model with the aim of quantifying the relative contributions of dCloud and dCO2.

Figure 1 Maximum daily temperature (Tmax, red, LH scale) and minimum daily temperature (Tmin, blue, RH scale) from the Leuchars weather station. The red and blue lines are annual averages. The black lines are centred 5y moving averages. Note high degree of co-variation between Tmax and Tmin. Also note how temperatures drifted higher during the 1990s and 2000s but recently are drifting down again, in keeping with the global temperature trend.

Figure 2 Average annual hours of sunshine at Leuchars (blue columns) with a 5y centred moving average in red. Note how the 1990s and early 2000s were clearly sunnier than the preceding decades and how more recently the amount of sunshine seems once again to be in decline and this broadly mirrors the temperature evolution (Figure 1).

Preamble

For more times than I care to recall I have sat down to write a book on energy and climate change. On each occasion my endeavour foundered early on through being distracted by detail. And so it was earlier this year. I had written down my lifelong recollections of climate change in Scotland – cold snowy winters in the 1970s, getting sunburned working in the fruit fields of Perthshire in the 1980s, frost free winters in the 2000s, cold snowy winters today – and I wanted to check my recollections against data – a fatal mistake. I stumbled upon the UK Met Office climate station database, a wonderful resource, and downloaded data from Leuchars, Braemar and Nairn, the three stations closest to where I grew up in Kirriemuir and where I now live in Aberdeen.

Some of this “raw data” from Leuchars is shown in Figures 1 and 2 and from looking at a few charts like these I observed cyclical changes in temperature with time that seemed to be matched by cyclical changes in the amount of sunshine. Warm years were sunnier than colder years. This led me to compile data from 23 UK stations (Figure 3) from which a clear picture of co-variance between sunshine and temperature emerged.

I wanted to be able to quantify the relationship between sunshine and temperature and contacted physicist Dr Clive Best who seemed pre-eminantly qualified to help. This has led to a 3 month collaboration and writing two papers, one on UK and the other on Global variations in cloud cover and its impact on temperature trends. The UK paper was rejected twice by Nature and by one other journal and so we have decided to hang the establishment and publish this work on our blogs. The Global paper is still out for review. This is the first of three posts on UK climate records starting with a simple description of the database. If there are any editors or academics out there who want to see this published in peer reviewed literature then please get in touch (read the Blog Rules).

Database

All Met Office stations record maximum daily temperature (Tmax) and minimum daily temperature (Tmin), rainfall and the number of frost free days. A subset of stations also record sunshine hours and it was stations with lengthy sunshine records that formed the basis for station selection. The data are reported as monthly means. The records are not 100% complete (I’d estimate >99% complete) and where data is missing it has been patched with data from the preceding year. If there was no preceding year, the succeeding year was used.

The selected sites are shown in Figure 3 and the distribution of records in Figure 4.

Figure 3 Met Office climate stations used in this study.

Figure 4 The time distribution of records. A handful of Met Office stations have sunshine records from 1908 but this small number fails to provide statistically representative cover of the UK. It is only from 1933 that a large enough number of stations were reporting both sunshine and temperature records to provide representative geographic cover. Hence all data presentations and analysis are based on the 1933 to 2010 time interval. Since we use 5y centred means in our analysis, data from 1931 to 2012 is captured. Over this period the number of operating stations varies, with a peak in the 1980s.

Variance in Sunshine and Tmax

Looking at 100 years of records from 23 stations represents a huge amount of data that presents challenges in how best to display it. Figures 5 and 6 show 5y running averages of Tmax and sunshine for all 23 stations. The most northerly station, Lerwick on the Shetland Islands, is shown in bold blue and one of the most southerly stations, Southampton is shown in bold red. The key observations:

  • There is a large variation in temperatures from N to S produced by 10? of latitude separation. Lerwick is, on average, about 5?C colder than Southampton (Figure 5).
  • There is also a large N-S range in sunshine received. Note that over a year, every point on the globe should receive the same hours sunshine with a spherical horizon. That is (365.25*24)/2 = 4383 hours per year. The variance in hours sunshine therefore reflects N-S trends in cloud cover. Southampton receives about 600 more hours sunshine each year than Lerwick. Eastbourne is anomalously sunny (Figure 6).
  • There is a high degree of cyclic co-variance in Tmax across the country. Note how spikes and troughs in Lerwick match spikes and troughs in Southampton (Figure 5).
  • The N-S variance in sunshine / cloud cover is more chaotic, and lacks the strong co-variation seen in the Tmax data (Figure 6).

Figure 5 Tmax, 5y running averages for 23 UK stations.

Figure 6 Sunshine, 5y running averages for 23 UK stations.

Figure 7 The mean Tmax and sunshine from all 23 stations, 1y average

Averaging the data for all 23 stations shows a degree of co-variance between temperature and sunshine although there are instances of negative correlations where spikes down in Tmax are matched by spikes up in sunshine (Figure 7). This may reflect annual variations in sunshine distribution, for example, some years may have sunny summers while others have sunny winters. It is also evident that temperatures where higher in the 1930s and 1940s, lower in the 1950s to 1980s and higher again in the 1990s and 2000s and this decadadal structure in Tmax is also reflected in sunshine / cloud cover. If this is not obvious, then further smoothing of the data using a 5y mean shows clearly that cyclic change in Tmax is mirrored by cyclic change in sunshine hours (Figure 8).

Figure 8 The data shown in Figure 7 smoothed further by applying a 5 year running average.

The degree of correlation between sunshine and temperature is quite striking though imperfect. At the beginning of the time series it is evidently lacking altogether and this is surprising since co-variance in sunshine and temperature is intuitively expected. To explain this we call on the introduction of clean air legislation in the UK in 1956. Prior to this date, coal was burned in open hearths throughout UK cities and power stations were also located in cities, for example the iconic Battersea Power Station in central London (inset photograph). Burning all this coal produced dense and lethal smogs, and we suggest that this pre-1956 pollution has perturbed the expected correlation between sunshine and temperature. Looking at seasonal data we see that the link between temperature and sunshine holds good for the summer months, pre-1956, when burning coal was at a minimum. This will be the subject of the third post in this series.

Tmax and Tmin

The radiative and CO2 forcing models that we will present next week will consider only Tmax. That is because when considering the impact of sunshine and cloud cover on the temperature record it is daily Tmax that is most relevant. However, it transpires that there is a very high degree of co-variance between Tmax and Tmin (Figures 9 and 10), hence, conclusions drawn for Tmax may equally apply to Tmin and daily average temperatures.

Figure 9 Tmax, left hand scale and Tmin right hand scale. In the UK Tmin is typically 6.5?C cooler than Tmax

Figure 10 Cross plot of data shown in Figure 9 showing an exceptional degree of correlation between Tmax and Tmin. By and large night time temperatures have a memory of the day before.

Figure 11 Tmax minus Tmin

Figure 11 shows the difference between Tmax and Tmin over time. The trend is perceptibly down by about 0.2?C over a 70 year period and it seems possible this may be due to increased radiative heating at night.

Tmax – correlations with sunshine and CO2

Figure 12 Comparison of Tmax varaiance in the UK with CO2 smoothed from Moana Loa data.

Figure 12 shows the correlation between CO2 and Tmax (compare with Figure 8) and highlights a key problem with all models that seek to explain troposphere warming by CO2 alone ± other natural forcing such as volcanoes and variance in solar insolation. CO2 is periodically discordant with cooling trends, e.g 1933 to 1963 and with cyclic ups and downs in the temperature record. In contrast, cyclical change in sunshine / cloud cover can explain the cyclical variance in Tmax (Figure 8).

Figure 13 Overall, CO2 and Tmax shows reasonable correlation. But there are 5 periods of marked negative correlation where temperature is falling as CO2 is rising.

Figure 14 Data from Figure 8 cross plotting Tmax and sunshine hours has a better correlation than CO2

There is a correlation between Tmax and CO2 with R2=0.66 (Figure 13). But the correlation between Tmax and sunshine is stronger with R2=0.80 (Figure 14).

This is as far as I (EM) was able to take the empirical analysis but recognised that a physicist should be able to calculate from these data the component of Tmax variation attributable to sunshine and cloud cover and that attributable (if any) to CO2. At this point Dr Clive Best offered his assistance that led on to 3 months of fruitful collaboration. In a post next week we will present the results of combined net cloud forcing and radiative forcing models. The analysis does show that a significant portion of warming in the UK may be attributable to a decline in cloud cover and any global climate model that does not take variance in natural cloud forcing into account will overestimate the role of CO2.

Comments
  1. Roger Andrews says:

    When you look at the monthly data you find that sunshine hours lead t_max and t_min by about a month. The portion of the Leuchars record shown below is a typical example.

  2. tallbloke says:

    Roger A: That tells us something about the lag between ocean absorption of solar energy and the atmospheric temperatures.

  3. vukcevic says:

    Roger & TB
    Yes, it is exactly a month, between max insolation and the max for the CET’s 20 year average
    http://www.vukcevic.talktalk.net/CET-dMm.htm
    You might be tempted to conclude from the graph above that forthcoming winter may be less cold than the last one.

  4. Roger Andrews says:

    TB:

    Air temps lag sunshine hours by a month and SSTs (in the North Sea between 5W-5E and 54-59N) lag sunshine hours by two months:

    Hmmmmm.

  5. Roger Andrews says:

    Vuk:

    If air temperatures track sunlight with a one-month lag the implication is that solar heat is being stored somewhere and then released. What’s it being stored in, the ground?

  6. A C Osborn says:

    You guys may be interested in a Forum where someone has already explored this topic for Australia.
    See this
    http://gustofhotair.blogspot.co.uk/

  7. Doug Proctor says:

    Fig 14: identifying the year of the datapoint is how I determined that there was a time signal in the Tmax and Sunshine Hours data.

    The trendline as shown I showed to be the contribution of sunshine; the variation from trend, when the time element was considered, reflected the oceanic contribution.

  8. tallbloke says:

    Roger A: That tells me the circulation to the North Sea from the places in the major ocean basins which acquire solar energy is slow. Cloud related datasets. Don’t forget prevailing wind in UK is west to east.

  9. ren says:

    To lock the Bering Sea (visible in the stratosphere), which brought to the U.S. winter.

  10. ren says:

    The level of cosmic rays decreased temporarily. However, I predict that solar activity will decline, contrary to the assertions of NASA. Polar vortex clearly accelerated, but at lower levels of the stratosphere above 30 hPa circulation is visible lock.

  11. Euan Mearns says:

    Hi Tallbloke – ideally you should have asked our consent to post this in its entirety, we’ll let you off this once;-) I can confess to seeing a comment of yours once on Clive’s site referring to sunshine and temperature in Germany somewhere, its difficult to keep track of everything. There is an interesting debate to be had about temperature memory and time lags. And atmospheric circulation. The land up north is of course still warming up from The Ice Age. Best Euan

  12. Rog,

    Thanks for the repost! We will soon have two more posts concerning UK temperature trends which show clearly that changes in cloud cover can explain most of the trends in climate. Clouds are really just a reflection of natural variations in Atlantic weather. There has been a net reduction in clouds (increase in sunshine) from 1956 until around 2003. Consequently it has reduced and so have average temperatures in the UK.

    The Met Office also keep a long term archive of Central England Temperatures dating from 1650 which cover a triangular area from Lancashire, Bristol and London. The data show very similar trends to that we found for the whole of the UK. What is also interesting is that there is also an underlying linear warming trend dating right back to 1650 of about 0.03C/decade. Superimposed on this are excursions quite similar to that observed since 1950.

    We have also done a global study of cloud forcing which I think is also really interesting. This will be the fourth post in the series as it is currently under review for publication.

    sorry for time lag replies. I am actually in Brisbane right now !

    cheers

  13. Brian H says:

    “because it’s so good” indeed.

  14. Bloke down the pub says:

    After applying Sod’s law, I predict that having installed solar panels there will now be a steady reduction in the number of sunshine hours.

  15. […] UK temperatures. Two more posts will follow describing the radiative model in more detail. – Click here to read the full article […]

  16. Roger Andrews says:

    “Roger A: That tells me the circulation to the North Sea from the places in the major ocean basins which acquire solar energy is slow. Cloud related datasets. Don’t forget prevailing wind in UK is west to east.”

    Here’s the way it works. Maybe:

    The clouds go away and the sun shines.

    The sun warms the air AND the ground.

    The solar heat stays in the ground for about a month before being released back to the atmosphere, hence the one-month lag between sunshine and air temperature. (Seasonal variations in ground-to-air heat flux can exceed 100 watts/sq m according to Jiménez et al. https://www.bgc-jena.mpg.de/bgc-mdi/uploads/Publ/Jimenez_et_al_2011.pdf )

    The sun also warms the sea, but because of the higher specific heat of water it takes longer to warm it, hence the two-month lag between sunshine and sea temperature.

    There’s no evidence to suggest that heat released from the sea during the seasonal cycle warms the air. If this were the case SST would lead or coincide with SAT, not lag it. (Prevailing winds don’t have any impact either. SST over the North Atlantic west of the UK lags UK air temperature by a month too.)

    There is in fact no evidence to suggest that seasonal heat releases from the sea warm the air anywhere outside ENSO areas, where SAT and SST are coincident (and where the heat releases are dominantly seasonal too). Everywhere else, or at least everywhere I’ve looked, SAT leads SST by a month.

    And what about the long-term? Difficult to say because we don’t have any reliable SST data before 1950 (once again, modelers take note) but if we believe what we do have then North Hem SAT leads the AMO by about five years.

  17. tchannon says:

    The article here prompted me to publish a long waiting article which is of interest given certain comments about lead/lag, delay.

    Actually two articles, one the guff, the other a real data demonstration.

    Fractional dataset delay (subsample resolution) in a spreadsheet

    and

    Demonstration of fractional delay function on real data

  18. tallbloke says:

    Ulric thinks “Using annual data is the wrong approach as more UK cloud in winter can raise temperatures while in summer time reduce temperatures.”

  19. Clive Best says:

    Ulric,

    For that exact reason we also did a summer only analysis covering June, July and August (JJA). We averaged the data for each station correcting for summer daylight hours and increased insolation. The cloud forcing matches the data back to 1933 because in summer months smoke pollution in cities was not present.

    In a couple of hours we will post the cloud forcing and CO2 forcing model showing fitted results for the annual data. Then in a day or so we will publish the seasonal summer data.

    Clive

  20. tallbloke says:

    Clive,
    Thanks for the update. I hope you’ll give us permission to repost here so the work reaches a wider audience.

  21. Clive Best says:

    Yes of course you can !

    The global results are potentially dynamite – so hopefully I can post those soon as well.

    cheers

    Clive

  22. Euan Mearns says:

    @ Ulric, I wouldn’t say annual data was the wrong approach, but looking at monthly data is a good alternative. The seasonal data Clive refers to is in fact complex, very strong correlation in Summer, zero correlation in winter. Roger Andrews posted some interesting data on Leuchars showing 1 to 2 month time lags between sunshine and temperature – which would have to be taken into account looking at monthly data. All the while, our empirical approach has been to match Tcalc (from dCloud) to Tmax (observed) and to do this we need to have an initial strong correlation between Cloud and Temperature.
    By all means cross post, but i’d prefer it if you waited at least one day. best Euan

  23. Roger Andrews says:

    Euan

    Sunshine hours are a proxy for cloud cover when averaged over annual intervals or longer but monthly sunshine hours aren’t, or at least not at high latitudes. The Leuchars record, for example, shows sunshine hours ranging from ~50 hours in the winter months to ~200 in the summer months, but it turns out that this is purely a result of length of day and sun strength. Median cloud cover at Leuchars stays about the same at 82-85% all through the year:

    http://weatherspark.com/averages/28764/12/Leuchars-Scotland-United-Kingdom

    But that of course doesn’t stop you using the monthly sunshine hours, which are a more robust metric than cloud cover anyway and also more directly related to surface air temperatures.

  24. Euan Mearns says:

    Andrew, the shortest time interval we looked at was quarterly . Clive is going to report on that, but I’m pretty sure we adjusted dSunshine for length of day and latitude when converting to dCloud.

  25. Euan Mearns says:

    That should have been Roger:-)

  26. Roger Andrews says:

    Been called worse 🙂

    I applied LOD corrections to Leuchars sunshine hours and still got a strong seasonal component which according to the weatherspark cloud data doesn’t exist. I think what’s happening is that we get a lot of hours in the winter when the sun is just too weak to burn a hole in the CS recorder paper. The building just southeast of the Leuchars recording site may block winter sunlight too (h/t to Tim Channon for the picture):

    https://tallbloke.wordpress.com/?s=leuchars

  27. Euan Mearns says:

    The other important variable to take into account is that using sunshine hours we are looking only at daytime cloud and temps – hence the focus on Tmax. There is a large diurnal cloud effect.

  28. tallbloke says:

    Euan: no problem, will leave a lag of a few days between posts. Interesting work, and comments.

  29. tchannon says:

    Ah right Rog, that would be an old lag.

    Large diurnal cloud effect? Please explain.

  30. Euan Mearns says:

    tchannon over on Tallbloke’s Talkshop had a question about diurnal cloud effect. Our analysis using sunshine as a cloud proxy is applicable to day time cloud only. It is well established that cloud cover at night time is significantly different to cloud cover during the day.

    Since we have also been looking at global cloud, one of the things I thought it would be cool to do is to compare the ISCCP satellite data over the UK with our ground based inferences. The results are shown in the chart below. There are 8 satellite nodes over the UK.

    I wasn’t sure what to make of the data at first – compare red a blue lines. Cloud cover was in the same range and seemed to be showing a degree of co-variance. Then I subtracted one curve from the other and was pretty surprised at the result. The satellite data is 24 hours and is clearly biased towards higher cloud level for most of the year – i.e. more cloud at night (24 our) than during the day (sunshine based) which is expected. In the winter months, the relationship is reversed.

    Not sure what HTML works here. If it doesn’t work, the chart is here:

    http://euanmearns.com/uk-temperatures-since-1956-physical-models-and-interpretation-of-temperature-change/#comment-220

    Rog, our second post is scheduled to fly on Climate etc Friday – so if you wanted to cross post today, be our guest.

  31. tallbloke says:

    Thanks Euan. Two paced threads are good. Those overwhelmed by volume and rhetoric at C.E. can come here for a more leisirely pace of thoughtful consideration.

  32. tchannon says:

    I can’t comment at Euans, server kicks up a fuss about duplicates (new one on me). Might try again later.

  33. Jerry Lundry says:

    Comments from the USA

    I have done a study based on the USHCNv2 data set, available online from our NOAA. That data set covers the 48 contiguous states with 1218 weather stations. It is complete back to 1912, and is missing an increasing number of stations going back to 1895, where there are about 78 missing stations. One can look at temperatures 1912-2012 for 1218 stations or 1895-2012 for about 1140 stations. The data set has monthly averages for maximum, minimum, and average temperatures at each stations. It is in an apparently ancient data format. For example, all numbers are integers, with tempertures in tenths of a degree. Station number, year, state number, and an integer indicating maximum, minimum, or average are compressed into a single 11-digit integer. This just tells me stirgae and processing speed were serious considerations when this data set was first formed. I have no issues with processing using Excel 2003 in a 2006 PC.

    The annual averages for the average temperature data set show minima in roughly 1911-1914 and 1973-1975 and maxima in roughly 1943-1945 and 2002-2004, as determined by a sixth-order Excel polynomial. These extremes corresponding to a so-called 30-year cycle (I think of it as a 60-year cycle) that seems to correlate with the Atlantic Multi-decadal Osscilation. They also show an apparent increase over both periods that seems to correspond to the 1400-year cycle. This cycle had maxima in roughly 200 BC and 1000, and minima in 400 and 1700. This indicates a current increase that will continue until 2400.

    I have identified 13 temperature cycles from the literature, ranging in period from the obvious one-day out to 140M years. The latter comes from geological surrogates for temperature and is (apparently) caused by the passage of the solar system through the spiral arms of the Milky Way Galaxy. The magnitude is 10 deg C (we are in a cool period currently). In the spiral arms, cosmic radiation is substantially higher than elsewhere. Cosmic radiation causes the formation of tiny particles in the atmosphere, which serve to collect moisture, thus forming clouds. It is the increase in cloud cover that is thought to cause the reduction in temperture through, in part, reflection of more solar radiation.

    JLL

  34. Brian H says:

    Jerry;
    +1

  35. J Martin says:

    Jerry, can you post a link to the graph ?

  36. Jerry Lundry says:

    J Martin

    I have two Excel 2003 files of interest with data and plots for USHCNv2. One is the data set of annual averages with slightly fewer reporting station that is complete for 1895-2011. The other data set is for the years in which all reporting stations have temperature data. It covers the years 1908 and 1912-2011.

    Despite having worked with digital computers since 1958, I do not know how to set up a site for posting these two files. I don’t see an obvious way to attach them to this Comment. So, I have dragged both file names to this open Comment window. Both were processed in some way, but I see no evidence they are actually attached. Please check to see if you can find them embedded in this comment.

    If not, I can easily attach them to an email if you can provide your email address.

    Jerry

    If not, I can easily email them to you if you will provide your email address.

  37. J Martin says:

    Jerry,

    Perhaps your work would provide the basis for a post, and so if you were to use the contact form for Rog / Tim they could then provide you with an email address to send to them.

    TT admin contact

  38. tchannon says:

    Co-moderator has noticed.
    I’m sorting out contacts.

    Going to snip some comments which are too revealing.

  39. […] post from Roger Andrews, who says: ” This is a review that extends Euan Mearns’ article on sunshine hours, cloud cover and SAT in the UK over mainland Europe and the North Atlantic. It […]