The Threat of a Good Example

09. May 2013 · Write a comment · Categories: Actuarial, Economics, Pensions, Regulation

The interests of the UK’s private sector defined benefit (DB) pension scheme members, and the security of their vested benefits (ie the ones they are entitled to keep), were weakened this week. The Pensions Regulator, slow to act in many cases, bureaucratic and inconsistent in others, did at least have a coherent set of objectives which allowed it to focus on reducing the fragility of the pensions system overall. However this is not an example of how the Government wants its regulators to behave it seems. The announcement in the Budget in March that the Regulator is to get an additional statutory objective to encourage “sustainable growth” amongst scheme sponsors, following sustained lobbying from the National Association of Pension Funds and the Confederation of British Industry, led to a swift consultation on, and acceptance of, the proposals. It also appears to have led to an equally swift exit for the Regulator’s chief executive Bill Galvin (he leaves next month) who had had dared to reject calls for such an objective, pointing out reasonably that the existing arrangements required the Regulator and trustees to balance the interests of business, the pension scheme and the Pension Protection Fund.

So here it is, the Pensions Regulator’s first statement on DB pension schemes since the new objective was announced. The Regulator looks to have been very mindful of the not-yet-quite-existing objective in framing this statement and, although the precise wording of the objective is not expected until later in the year, has obviously already decided which way the wind is blowing. The key word that jumps out at you on a first skim is “flexibility”, which seems to be the new code for weakening regulation now that “light touch” has been discredited. This contrasts with last year’s statement, when the use of the word was accompanied by a warning that “we will consider whether the flexibility in the funding framework has been used appropriately”, ie emphasising the limits of flexibility rather than its possibilities.

There are also a number of areas where the position taken by the Regulator on funding appears to have noticeably weakened since 12 months ago. Here, in my view, are some of the main ones (italics are mine):

Section

Pension scheme funding in the current environment – April 2012

Section

Defined benefit annual funding statement – May 2013

17

In the regulator’s view, investment outperformance should be measured relative to the kind of near-risk free return that would be assumed were the scheme to adopt a substantially hedged investment strategy.

7

Trustees can use the flexibility available in setting the discount rates for technical provisions…to adopt an approach that best suits the individual characteristics of their scheme and employer.

19, 14

The regulator views any increase in the asset outperformance assumed in the discount rate to reflect perceived market conditions as an increase in the reliance on the employer’s covenant. Therefore, we will expect trustees to have examined the additional risk implications for members and be convinced that the employer could realistically support any higher level of contributions required if the actual investment return falls short of that assumed.

…Where appropriate the use of actual post valuation experience is acceptable.

 

8

The assumptions made for the relative returns of different asset classes may rise or fall from preceding valuations reflecting changes in market conditions and the outlook for future returns. Trustees should ensure that they document their reasons for change and have due consideration to any increase in risk this might bring.

2

As a starting point, we expect the current level of de­ficit repair contributions to be maintained in real terms, unless there is a demonstrable change in the employer’s ability to meet them.

 

12

Where there are significant affordability issues trustees may need to consider whether it is appropriate to agree lower contributions and this may also include a longer recovery plan. Trustees should ensure that they document the reasons for any change and indicated that they have had due consideration of the risks.

Finally, under the heading what you can expect from us, the Regulator also mentions that it has discarded any triggers it had for subjecting schemes to further scrutiny “on individual items such as technical provisions”.

Unfortunately the combined impact of the changes in emphasis, specific wording and the ditching of the triggers would appear to directly conflict with two of the Pensions Regulator’s definitely-still-existing objectives, namely:

  • to protect the benefits under occupational pension schemes of, or in respect of, members of such schemes; and
  • to reduce the risk of situations arising which may lead to compensation being payable from the Pension Protection Fund.

The House of Lords Select Committee on Regulators in 2007 concluded that:

  • Independent regulators’ statutory remits should be comprised of limited, clearly set out duties and that the statutes should give a clear steer to the regulators on how those duties should be prioritised.
  • Government should be careful not to offload political policy issues onto unelected regulators.

We will have to wait and see exactly where this new objective is to be pitched, but, on the evidence of this funding statement from the Regulator, there must now be considerable doubt that either of the select committee principles will be met.

Set any organisation conflicting objectives and no clear way of prioritising between them and the chances are they won’t achieve any of them. The Pensions Regulator has already started to run this risk.

Needles and Pins 3 May 2013

03. May 2013 · Write a comment · Categories: Cartoons, Prediction

 

Spreadsheets and the Under Toad

29. April 2013 · Write a comment · Categories: Actuarial, Economics

In The World According to Garp, John Irving describes how Garp’s son mishears the word “undertow” as a source of danger at the seaside as a child, and spends the rest of his life in fear of the “Under Toad”.  This word now appears in dictionaries as referring to a general fear and anxiety about the unknown and mortality. It sounds like a word almost designed for actuaries, and never more so than when dealing with spreadsheets.

Spreadsheets are of course currently in the news because Thomas Herndon, a graduate student at the University of Massachusetts, was set an exercise to choose an economics paper and replicate its results. He chose Growth in a Time of Debt, a paper by Professors Reinhart and Rogoff, which had been cited by George Osborne more than any other in defence of his policy of austerity.

He couldn’t replicate any of it, and when the professors sent him the spreadsheet they had used, the reasons why became apparent. Only 15 of the 20 countries with high public debt in the analysis had been included in the calculation of average GDP growth. The As to Ds had been missed off. The paper had not been peer reviewed.

This particular error, when combined with other criticisms Herndon and his professors had of the methodology used in the paper, provided considerable challenge to the original conclusions of the analysis and was therefore widely reported due to its implications for UK economic policy in particular. However errors of this kind in Excel spreadsheets are very common.

The European Spreadsheet Risks Interest Group, or EuSpRIG (“yewsprig”) for short, is an organisation sponsored by a group of heavy spreadsheet users which runs conferences and forums designed to pool users’ experiences and suggest best practice in spreadsheet use. EuSpRIG are therefore connoisseurs of the spreadsheet error. They helpfully include a list of spreadsheet horror stories on their website, including the GDP growth one.

Perhaps the most significant spreadsheet foul up on their list is described in the Report of JP Morgan’s Management Task Force regarding billions of losses in 2012 in its chief investment office, which cited a number of spreadsheet errors. However, my personal favourite is the one involving the London 2012 organising committee (Locog) confirming in January 2012 that an error in its ticketing process had led to four synchronised swimming sessions being oversold by 10,000 tickets. Locog said the error occurred when a member of staff made a single keystroke mistake and entered “20,000” into a spreadsheet rather than the correct figure of 10,000 remaining tickets.

It is tempting to think that our technological advancement and exponentially increasing computer power have made some kind of computational HD within our grasp, with every wart and blemish of the object of investigation now detectable by our ever more sophisticated tools. But EuSpRIG estimate that over 90% of spreadsheets contain errors. Most of these will never be found, but lurk beneath the surface threatening the accuracy of any calculations carried out by the spreadsheets concerned. In other words, the Under Toad.

Carveth Read once said (although only famously when it got attributed to Keynes): “It is better to be vaguely right than exactly wrong.” However, when most spreadsheets contain Under Toads, it is clear that a lot of the supposed precision with which information is provided to us is illusory. That exponential increase in computer power has made even the very measurement of precision in the more complicated spreadsheets virtually unknowable. We may never be more than vaguely right, but often have no real idea how wrong we are.

So we check, to ensure that the numbers coming out of the spreadsheets and other models we use are within a tolerable distance of what we would expect. Some of us use pen and paper. The GDP growth Under Toad might for instance happen when a formula which adds up a column in one worksheet is copied to another worksheet where the columns have a different number of rows in them, and the formula is not adjusted. I have certainly done that before now, and only found it when I checked it against a number of other sources. For this reason, I am always a bit nervous about model results being checked by spreadsheet. It doesn’t seem sufficiently unlikely to me that the two could be acceptably close to each other but, perhaps due to entirely different errors, many miles from the truth.

There is a generation of actuaries, of which I am one, that experience almost physical pain when we see students carrying out even the simplest calculations using spreadsheets, knowing that each new one on the block is almost certainly adding to the unknown unknowns of the Under Toad. I know there are just as many mistakes in my biro scrawls, but I also know it will be a lot easier to find them later.

A GDP increase of 0.3% on Thursday was greeted with relief at a triple dip averted, when a fall of just 0.1% would have been met with anguish. Tiny movements in the FTSE 100 are described as “up” and “down”, as if the direction were more important than the amount and when “broadly unchanged” would be a more informative description.

We are obsessed with tiny movements which contain no information and which, thanks to the Under Toad, we cannot meaningfully calculate. This obsession distracts us from seeing the bigger picture, the fuzzy connections that only become apparent when we look up from our HD sharp tiny piece of detail. And our spreadsheets won’t help us with that.

Relax Luther, it’s much worse than you think

24. April 2013 · Write a comment · Categories: Actuarial, EIOPA

On 9 April, the European Insurance and Occupational Pensions Authority (EIOPA) published the preliminary findings of the quantitative impact study on its proposed changes to the Institutions for Occupational Retirement Provision Directive (or IORP II as some have started to call it). That sentence might not mean much to many people. But once you understand that EIOPA is the pensions regulator for the whole EU and that IORP is the European word for pension scheme you will probably be expecting bad news. And you would be right.

The study showed that the combined deficits of the 6,432 defined benefit pension schemes in the UK as at 31 December 2011 would have increased from £300bn (the UK Pensions Regulator’s calculated figure) to £450bn (based on methodology designed to bring pension funding more in line with insurance company reserving).

The National Association of Pension Funds warned that this move would put a “huge burden” on remaining UK defined benefit pension schemes and the businesses that run them.  Steve Webb warned that “The EU’s latest figures show the extremely high cost its plans would place on UK defined benefit pension schemes.”

Others were less positive about the proposed changes.

However, I am reminded every time this story is reanimated by the latest stage in the unending dance of death of the European insurance and pensions legislative process, of the line Tom Cruise uses in Mission Impossible to calm objections to his scheme to break into CIA Headquarters. It really is much worse than you think.

IORP II was set in motion with 3 main aims:

  • to make cross border schemes more widely used (which are avoided by most UK employers as they require an immediate increase in funding level in most cases);
  • to create a level playing field between pensions and insurance; and
  • to make sure that this level playing field includes a common supervisory system at EU level which is risk-based.

Which all adds up to a lot more than just a new funding requirement.

Therefore, quite apart from any proposals on extra funding, in over 500 pages of advice to the European Commission last year, EIOPA recommended:

  • The same governance requirements for pension schemes as for insurers. Getting governance and the documentation of it right has and continues to be a challenge for insurers with all of the resources available to them. Can trustees of pension schemes realistically be expected to do the same?
  • Fit and proper requirements for pension scheme trustees equivalent to the requirements of boards of insurance companies. The implication is that the current trustee toolkit might not cut it any more. Might this mean the end of the non-professional trustee?
  • Similar risk management requirements for pension schemes to those of insurers. This would include the possibility of pension schemes needing to set up contingency funds for “operational risks”, eg errors made in administering the scheme that might lead to losses, for the first time.
  • The requirement to conduct an Own Risk and Solvency Assessment (ORSA) for pension schemes. Again, these are very demanding exercises for insurance companies who have whole departments devoted to conducting them.

I could go on. Unfortunately the one thing that is certain is that EIOPA will go on. They have demonstrated through the tortuous nature of the process to date that their tolerance of bureaucracy is almost unlimited. There is a principle of proportionality referred to in the recommendations, which is supposed to mean that no organisation has requirements foisted on it totally out of proportion to the risks it poses to the financial system, but this has yet to be properly tested.

My fear therefore is that what we might have assumed would be regarded as unreasonable requirements of groups of mainly volunteer trustees trying to look after member benefits in their pension schemes will be viewed by the European institutions who will vote on these recommendations as nothing of the sort.

Hopes over Experience

19. April 2013 · Write a comment · Categories: Economics, Prediction

“IMF slashes UK growth forecast”. Does this sound familiar? It should. Every 9 or 10 months the headline seems to return to the newspapers in an almost identical form. September 2011, July 2012 and now “IMF slashes” is back this month. This occurs every time the IMF’s world economic output report (full reports every April, updates every October) happens to adjust down one of its predictions for UK growth.The latest is entitled Hopes, Realities, and Risks and is notable for its Oxford comma.

According to Stephanie Flanders, the BBC Economics Editor, the IMF rarely gives direct advice on the back of these reports, preferring to give discreet prompts. However this time the report says about the UK: “Greater near-term flexibility in the path of fiscal adjustment should be considered in the light of lacklustre private demand.”

Olivier Blanchard, the IMF’s chief economist, even singled out the UK in response to a question while launching the latest report: “There are a few countries where there is enough fiscal space to go further – one example is the UK. In the face of weak demand it is really time to consider an adjustment to the initial fiscal consolidation plans.”

So there you are, we are all doomed unless we change policy. You would imagine that an institution would have a fairly solid track record of understanding countries’ economies and making reasonably accurate predictions on the back of this expert knowledge for it to feel able to lecture us all quite so authoritatively. Unfortunately, they don’t.

As you can see, compared to the stacks of predictions the IMF have given us over the last 4 years on growth in world output alone, the actual growth figures are unfortunately fairly clearly outliers. The one thing we can take from the latest report with any confidence is that the current projections for 2013, 2014 and 2018 will not only be wrong, but probably by miles.

So it would be very difficult to justify a change in economic policy on the basis of a world economic output report. Which is a pity, because I agree that many of us will be doomed to a life of fewer opportunities and less economic independence if the current contractionary policies continue, scrabbling around for our share of a crumbling welfare state while the few of us already immunised from society by money feel very little pain at all. For a proper description of why austerity is a very bad idea, read Paul Krugman’s End This Depression Now or read his blog. Read the account of the Great Capitol Hill Baby Sitting Co-op crisis on page 26, which originally appeared in a 1977 article by Joan and Richard Sweeney. The means for ending the double dip, soon to be triple dip and probably ultimately corrugated recession are in our hands and have been known about for decades. Your spending is my income, and my spending is your income, so we need to stop contracting our economy.

And we also need to stop reading IMF reports.

 

NEW vs England and Wales

18. April 2013 · Write a comment · Categories: Demographics

The land of the four score and ten and over looks a bit different from the rest of the country

My grandfather used to say that he had had his three score and ten (that’s 70 for those brought up in a decimal age) and was now quite content to die when the time came. He said this with increasing frequency and some bewilderment before his final death at the age of four score and ten in 1991. This bewilderment was understandable: there were 222,820 over 90 year olds in 1991, already over 40% up on the 1981 total. However the changes since his death have been even more dramatic, with 440,290 over 90 year olds in 2011.

The Office for National Statistics (ONS) has recently published a statistical bulletin entitled Estimates of the Very Old (including Centenarians), 2002-2011, England and Wales, which summarises how the proportions living to four score and ten and beyond have changed over the 30 years since 1981. It shows us a population living within a population: Nonagenarian (ie the over 90s) England and Wales (NEW) within the full population of England and Wales.

Imagine for a moment NEW viewed as a different country, where people are “born” as they reach 90 and we ignore (as the ONS have done in compiling these statistics) immigration and emigration.

The first thing to notice about NEW is that the age structure looks very different to that of England and Wales. We can see this by comparing the “population pyramids”, as they are known, below, with the number of people at each age shown on a graph, males to the left in blue and females to the right in red:

The numbers fall away much faster of course at the older ages, although the shape still shows the biggest falls between ages 91 and 92 reflecting the impact on birth rates at ages (in 2011) from 92 to 97 of the First World War and its immediate aftermath. There are far more women than men in NEW, although the overall ratio has reduced from 4:1 in 1981 to around 2.7:1 in 2011. By comparison, the England and Wales population is much more balanced (there are 4% more women than men). The NEW population is somewhere between the sizes of Malta’s and Cape Verde’s full population.

Your chances of living to 100 in NEW as a newly arrived 90 year old are about the same as those of a new born in England and Wales qualifying for entry into NEW one day.

The world to which NEW belongs looks very different from that which England and Wales or the UK are used to. The largest country is not China or India, but the United States. Japan, whose overall population is about a tenth that of India has an over 90 population over twice that of India’s.

Finally, the population of NEW is growing far more quickly than that of England and Wales, or indeed the UK, with a 26% increase between 2002 and 2011, almost four times the UK rate over the same period.

My grandfather only spent a few months in NEW but, by 2011, 570 people had spent over 15 years in this land. It is going to become a much more familiar place to many of us.

Actuaries and Science Fiction

18. April 2013 · Write a comment · Categories: Actuarial, Prediction, Science Fiction

Brian Aldiss told me a story the other week (at the Birmingham Science Fiction Group, where he is an honorary president) about Margaret Thatcher and her attitude towards science fiction. Kingsley Amis had been invited to a party at Downing Street and had decided to take along an inscribed copy of his latest book Russian Hide and Seek. Mrs Thatcher, a little suspicious about what she was being handed, had apparently asked what it was about.

Amis had explained that it was set in the future when the UK had been under Russian occupation for 50 years.

“Can’t you do any better than that?” the Prime Minister is reported to have said. “Get yourself another crystal ball.”

Aldiss recounted this story as he felt it illustrated how Mrs Thatcher totally misunderstood what science fiction was about. It was not about prediction of the future, but for people who “liked the disorientation” (the essence of science fiction in Aldiss’s view) of portraying an unfamiliar landscape and trying to work out what would hold true under different circumstances.

It seems to me that this is also what being an actuary is about. Actuaries are not about prediction either, but they are prepared to embrace the disorientation of asking what ifs and exploring maybes, and, by so doing, try to quantify what different currently unfamiliar landscapes might look like.

Science fiction has many forms but two main camps politically: the camp which believes a more enlightened form of society is possible (although what that means might vary considerably between different campers); and the camp which doesn’t but instead believes that all we can hope to do is survive a remorseless universe governed by nothing more than the laws of physics and evolutionary biology.

I think actuaries may have leaned more towards the second of these world views, particularly in fulfilling their statutory roles in recent years. We have worked within the remorseless universe of regulators and assumed that increasingly complex systems will make us safer in a Darwinian financial world. However the group think this has inevitably promoted has made us all less safe. As a result, we have heard many voices in the discussions about the financial crisis, including many what ifs and maybes, but few of these voices have been actuaries’. To quote Bob Godfrey (admittedly he was talking about animation at the time), the professionals are in a rut and the amateurs aren’t good enough.

Actuaries need to put themselves about as much as the amateurs do. Sometimes that will be uncomfortable. Sometimes we may look a little foolish for a while. But in my view it is the only way we are going to contribute meaningfully to the construction of a better society. And we might even produce some decent science fiction in the process.

Newer articles »