Tuesday, May 11, 2010

It’s the electoral system, stupid!

Contrary to most (Tory?) commentators, I’ve found the last few days to have been chock-full of interesting and engaging politics. What we’ve seen is politicians focusing their attention of issues of policy, which, after all, (and in spite of what said commentators might have you believe) must be the basis for any ‘mandate’ achieved by the next coalition government, whatever its colour. This is an opinion which I suspect is unlikely to be shared with many MPs, none of whom seem to be particularly enamoured with the will of the people as expressed at last Thursday’s ballot box.

Yesterday’s much-anticipated resignation of Gordon Brown seemingly widened the conceptual scope where the next government is concerned. I won’t be the first to note that the timing of this announcement suggests it had more to do with the prospects for a Lib-Lab coalition than it does with the good of the nation, no matter how grand the PM’s oratory. What has received less attention however is how this potential coalition – and the future of the Labour party in general in this new political landscape – may play a crucial role in the selection of a new party leader.

Naturally, the press has been keeping a beady eye on the usual suspects: the Milibands, Ed Balls, Jon Cruddas and Alan Johnson to name but a few. The problem is that these personalities all threw their hat into the ring in very different circumstances than we face today, and I have my doubts if any of these could fit the bill as a leader of a potentially very divided coalition government. Certainly Ed Balls would suffer by his association with the Brown faction of the Labour party whose influence is still very much resented by colleagues on other wings of the party. Likewise it is difficult to see Jon Cruddas ameliorating his leftist stance with Labour’s more centrist partners in government. Alan Johnson would no doubt play his ‘safe pair of hands’ card if – and it is a big if – he decides to run, but having previously intimated that he feels that he isn’t equal to the job, I wonder whether he will command the respect and gravitas that will be needed to hold this progressive alliance together. Hatty Harman has seemingly ruled herself out, so does that leave Ed Miliband with a clear run at the job? He has less ideological baggage than his potential rivals (and this has been decisive in leadership contests of the last couple of decades), and unlike his brother, is part of the team negotiating with the Lib Dems, so may hold more clout with the party’s yellow cousins.

All of this, of course depends very much upon the decision that is reached by the Liberal Democrats. So, which way should Nick Clegg jump? I imagine the question will probably hinge around electoral reform. Having held such high hopes for Thursday’s election, they will have been devastated to have lost seats, which will no doubt strengthen their resolve to introduce a more proportional system of voting. The trouble is, it is by no means clear how this would be achieved. The Tory offer of AV falls short of the sort of proportionality that Lib Dems crave, but they can be fairly sure that a bill on a referendum would safely progress through Parliament with support from the Conservative whips. Whether they can win the argument during the referendum campaign in the face of opposition from their partners in government and the Tory pitbulls in the press remains to be seen. Furthermore, details on the proposed referendum are scarce: will it be binding, and if so, on what turnout and majority? These are questions that could prove vital.

On paper, the Labour offer seems much more lucrative – instant legislation on AV with the promise of a further referendum on STV. I’m sure many Lib Dem hearts will be aflutter at that thought, but doubts about the feasibility of the offer remain a major stumbling block. Let us not forget that there are many in Labour that object to electoral reform – Jack Straw was amongst those who shot down the recommendations of the Jenkins Commission in 1997 – and there have been plenty of backbenchers surfacing to voice concerns on the news channels in the past day to suggest that the Labour negotiating team may have overstepped its remit.

But this is not to say that a deal cannot be reached with Labour to push through electoral reform. Much will depend upon how effective the Labour whipping operating is, and how far its hostile parliamentary members will recognise its expediency in the present predicament. It might also be true to say that whilst Labour dissenters on reform might sound-off with impunity whilst there remains a deal on the table to influence, there might be a change of mood if the Lib-Lab knot is finally tied. When the chips are down, how many Labour MPs will really break ranks when the likely alternatives will be a Tory administration or a crushing election defeat? Timing could also prove crucial as electoral reform legislation will need to be introduced before cracks are given time to appear in the rainbow coalition. Never before has the Leader of the House been such a position of responsibility!

The overarching question, however, is whether or not such a deal would be in the interests of Labour and the Lib Dems, quite apart from the country. AV and STV, as every Tory will tell you, certainly do favour the progressive parties, and so could leave a lasting impression in the Commons that is likely to make the kind of spells in government enjoyed by Thatcher (and indeed Blair) an anachronism. This is important because, as Mervyn King has noted, the scale of cuts required by the next administration is likely to make it unelectable come 2014/5. Under a reformed electoral system however, a Tory-lead government might only last a term, rather than a generation. If AV can be achieved under the Tories however, there is a good argument for Labour to recuperate in opposition in anticipation of a good stint at the helm after the next election, and I suspect this is the sentiment that is being expressed by John Reid and others.

The signs are that a Lib-Lab government would face an uphill struggle to assert its legitimacy in the public consciousness. The arguments currently being expounded in the Tory press are of course tired and spurious: we don’t vote directly for a prime minister, we vote for a local representative standing on a platform of a specific programme for government, and if no overall programme is accepted parties are well within their rights to negotiate on producing a ‘hybrid’ legislative agenda. The fact that there seems to be such an impression of presidential government is perhaps the consequence in the stylistic changes introduced to Number 10 by Blair. But I digress, there is little doubt in terms of policy that Labour and the Lib Dems have more fertile areas for collaboration, so with a share of the vote that exceeds 50% - more than that which is usually enjoyed by a government – a rainbow coalition should be seen to be at least as legitimate as any other form of executive. But, back in the real world, this will count for nothing: the popular impression will be one of parties colluding for partisan benefit, and this is likely to result in electoral failure when the country next goes to the polls. Whether or not this will be worth it will again hinge on the extent of the political and electoral reform that is achieved.

Tuesday, May 4, 2010

'Choices' and the Future of Progressive Politics

We have been told an awful lot about the choices of this election campaign, be it David Cameron’s choice between himself and ‘five more years of Gordon Brown’ or the PM’s choice between public service investment and ‘Tory cuts’. And, perhaps because the campaign is the closest we have seen for decades, the decision that will be put before the electorate on Thursday does seem to be more pressing than any in recent electoral memory. Left-leaning publications such as The Guardian, Indie and New Statesman have spent many column inches in recent weeks proclaiming this election to be centred on a ‘republican moment’ or a ‘progressive alliance’, so much so that these ‘progressives’ seem to be getting carried away with themselves, predicting that the next parliament could be a reforming institution to rival that of 1832. Somewhat typically however, I feel that the choices that determine the future of progressive politics in this country are rather more complicated than this analysis suggests.

Electoral reform has, or course, been the touchstone behind the decisions of The Guardian and Indie to advocate a Lib/Lab coalition, and these are sentiments that have been echoed in this blog. As part of wider reforms to parliament, such as fixed electoral cycles, an end to hereditary peers and right of recall, electoral reform proposals could indeed make a huge impact on the democratic culture of this country. Moreover, these are reforms that would, on the face of it, seem to benefit ‘progressive’ parties, with Labour and Lib Dems likely to hold the balance of power in most Parliaments elected under a truly representative system. I would hope that gains would also be made by the Green Party to cancel out any advances by UKIP, or worse, the BNP, and that consequently the terms of reference for future debates would be broader than the often stilted, quasi-consensual politics that has dominated recent Parliaments.

But whilst the potential of these changes is undoubted, progressives seem to have been blind to the manifold difficulties of realising it, even if a Lib-Lab government is in power come May 18th. Firstly, Labour and the Lib Dems have very different ideas about what electoral reform constitutes. In the last Parliament, the Lib Dems were largely supportive of Labour’s proposals to ballot the electorate on switching to AV. This is a system that has the potential to distort vote shares to an even greater extent than FPTP (as I’ve noted before), and far from ushering in a new dawn for progressive politics, could give the Conservatives greater power to form governments in spite of a clear anti-Tory consensus than they have enjoyed throughout the 20th Century. However I suspect that following the Lib Dem surge and the presumed increase in clout they now wield as kingmakers in the next Parliament, there might be a concerted push for STV to be included in any future referendum on reform. Whilst this is clearly a more proportional system, it (ironically) won’t necessarily help reformers to have this plurality of opinion amongst its proponents. Whilst polling has shown electoral reform to be backed by a narrow majority, a referendum still needs to be won to institute the changes, and dividing or complicating the case for reform might make this task all the more difficult.

Whilst this may seem like a worst case scenario, there have been increasing suggestions that Nick Clegg might side with the Tories on May 18th, negating electoral reform as pre-requisite for his party’s support. His denial in an FT interview that he had any demands set in stone and his claim that he would work with a Tory administration must’ve sent shivers down the spines of those at The Guardian and co who had backed him with such ‘enthusiasm’ on the strength of this one policy. Whilst it is impossible to really gauge where the party stands on any future coalition whilst we’re still in the ‘fog of war’ that is the election campaign, this writer at least is prepared to give such notions at least some credence. Rumours continue to surface regarding Mr Clegg’s membership of the Cambridge University Conservative Association – something that Clegg rather unconvincingly claims to have ‘no recollection of’ – as do stories that the Lib Dem leader is keener to replace the Labour Party as one of the two titans of British politics than he is to prevent a Conservative government. The saving grace in this case may be his party – whether the ranks of former SDPers and liberal lefties could stomach an unholy alliance with the Tories is another matter entirely.

Electoral reform would clearly have the potential to rewrite the political landscape for future elections, but with so much still uncertain, progressives might also be tempted to heed Mervyn King’s reported claim that the party that leads the government through the next Parliament could be out of power for a generation come 2014/15 due to the scale of the economic difficulties that it will face. Couple this with the fact that make-up of any conceivable government on May 18th is likely to be the weakest and most fractured for decades and the case for ‘sitting this one out’ becomes more convincing.

This might be a benefit to the Labour Party in particular. Many commentators and increasing numbers of grassroots activists have noted that government has apparently wearied the party, with the sense of narrative seemingly becoming more and more blurred under Gordon Brown. The once well-oiled party machine is also losing its sheen, and has often given the impression of a chaotic and haphazard institution of late. Partly of course, this is an entirely natural result for a party that has governed for 13 years through difficult circumstances. But there is also a sense that the raison d’etre of the New Labour enterprise is losing its relevance in this brave new economic world. New Labour was all about tying increased investment in public services with economic growth from deregulated financial markets. Whilst this has served the party well between 1997 and 2008, it doesn’t sit pretty with present circumstances. Financial regulation is now very much de rigeur, cuts (or at least ‘efficiency savings’) are an unavoidable necessity and the scope for economic growth is very limited. Whilst Brown has tried to reposition the party to respond to these circumstances by championing greater state intervention in the economy, and whilst this is undoubtedly a crucial change needed to protect the less privileged echelons of society, the Prime Minister has yet to convince that he can square this with the New Labour legacy. The so-called ‘Blair plus’ manifesto is a prime example: rather than reinventing the party to face-down these new challenges, Brown is still trying to hammer the round New Labour peg into this square economic hole. A new leader, new intake of parliamentary representatives and a brief stint in opposition might help the party to regain its far-reaching vision, and perhaps even the trust of the electorate.

Admittedly, whether all these concerns will be enough to prevent progressives from voting to keep the Tories out is unlikely. The choices of 2014/5 are far too remote to change many crosses in boxes come Thursday, and I, like other progressives, will be hoping that the Tories don’t cross the 326 seat mark in the early hours of Friday morning. But whatever the outcome, there will be cause for consolation or concern. The next Parliament may well be the most exciting for generations, but it will also face some of the toughest challenges in living memory. The stakes will be high, and the price of failure even higher.

Wednesday, April 28, 2010

"Bigotgate": Some Initial Toughts

Three weeks in to the general election campaign and we finally have an incident worthy of the name ‘gaffe’. The cheers from the news channels are audible from here. Gordon Brown, safely ensconced in his getaway car, has been caught calling a voter who confronted him during a walkabout a “bigoted woman”, only to then realise his Sky TV microphone was still on, and his comments were being recorded by salivating producers in Wapping. As is customary, the incident must hitherto be appended with a ‘-gate’ suffix. ‘Bigotgate’ gets my vote. (The irony here of course is that whilst the original Watergate scandal was precipitated by a premier hiding recordings unbeknownst to others, here the politician is being recorded without his knowledge. It’s meta).

What impact, if any, will this have a week tomorrow? Well Labour can anticipate some awkward viewing in the evening news broadcasts for sure, but I doubt that this will leave a lasting impression.

Firstly the timing is very fortunate for Labour. Friday’s papers and tomorrow’s broadcast coverage will be dominated by the final leaders’ debate, which should stop any lasting fallout from the incident gaining a wider airing. The rules of the debate don’t allow for it to become an issue of discussion, and it would be risky for either Clegg or Cameron to score points with any swipes at Brown on the subject, as analysis of the debates so far has shown this to be a major turn-off for viewers. It’s been noticeable that both the Tories and Lib Dems have both been muted in their musings on the gaffe, which would suggest that they recognise the need not to be seen to ‘bully’ Brown.

Labour has also responded very well to the slip-up. Brown was quick to apologise on air, and the party line portraying Brown as ‘letting off steam’ is a good one. It’s obviously not the way the party would have like to do it, but it does allow them to show Brown in a more ‘human’ light. Some commentators have suggested that Brown may even benefit from the incident, much as he emerged from attacks on his letter-writing and ‘bullying’ left him strengthened. I think this might be stretching things a little: most people have seen enough of the PM to have already formed an opinion one way or another, and it seems likely to me that voters will use either the comments or Brown’s displays of contrition to reinforce their existing position. Images of Brown with his head in his hands on the Jeremy Vine show can only help to raise some sympathy for the PM, however.

I think a more dispassionate analysis of the whole incident will also help Brown to recover. Whilst it is undoubtedly a mistake, I suspect that in the cold light of day Labour advisers will admit that it could have been a lot worse. Brown didn’t swear, fly off the handle or attack the lady concerned on a personal level. It will be possible for the party to spin the incident as the PM displaying his passion for his immigration policies, and Ms Duffy’s use of phrases such as “I know you can’t attack immigrants, but…” are hardly the subtlest of dog-whistles. I actually suspect any lasting damage will stem from his attempts to blame “Sue” [Nye, Brown’s adviser] for the encounter. This seems to show Brown as incapable of taking responsibility for his own campaign. The irony is that the PM actually handled the incident reasonably well, and really shouldn’t have perceived a threat in Ms Duffy’s jibes (“all these eastern Europeans – where are they coming from?” being a rather hilarious case in point). Perhaps the Labour hierarchy will be regretting the decision not to blood their prize-fighter on the soap box earlier in the campaign: these sort of encounters really should be bread-and-butter to most seasoned campaigners.

Tuesday, April 27, 2010

Alarm Bells For Labour, But No Death Knell

Whilst it now seems likely that the polling bounce achieved by the Liberal Democrats since the first televised leaders’ debate is more than simply a flash-in-the-pan, the exact consequences what is anticipated to be a strong showing on May 6th are still something of an unknown. Nevertheless, many in the media – particularly in the Tory press - have been quick to foresee a variety of exciting post-May 7th scenarios with far reaching implications. Take Rachel Sylvester writing in this morning’s Times for example. Here the Labour Party is a spent political force staring down the barrel of electoral extinction. The apocalyptic overtones will be familiar to Tory voters with slightly longer memories than Ms Sylvester, having had to endure similar predictions for their party after the 1997 landslide. Now as then, it is best to treat these oracles with a modicum of caution.

To be fair to Ms Sylvester, she does acknowledge the similarities to 1997 herself, but argues that the rise of the Lib Dems as a challenger to Labour’s ‘progressive’ mantle means that these circumstances are exceptional. Whilst the underlying logic of this argument is sound, it is nevertheless something of a conceit that disguises a worrying reality for the Conservatives and their cheerleaders. 1983 and even 1918 have been bandied around as historic comparisons for the low-water mark of Labour’s share of the popular vote, but what has slipped by almost unnoticed is the fact that on current polling, the Tories are struggling to match their vote share to the notional 2005 result of 32.3%. Whilst the Lib Dem surge has undoubtedly hit the Labour vote, the fact that the Tories have been similarly dented underlines the fact that the centre-ground agenda is shifting more towards these ‘progressives’ than the Conservative Party would like.

That Labour would lose votes at this election was always inevitable. History shows that government has a corrosive effect on a party’s popularity over time, as the electorate hungers for fresh faces and new ideas. The fact that the last two Conservative and Labour administrations have survived so long owes as much to the Opposition veering towards their respective ideological fringes as it does to any enduring admiration for the government. Where a credible opposition has been offered, it has done well. The fact that Mr Cameron has successfully navigated his party back towards the political centre ground, and yet may still find himself barred from Downing Street proves that this election is as much of a watershed for the Conservatives as it is for either the Lib Dems or Labour.

Herein lies another important distinction between Labour’s present predicament and any worrying precedents set in 1997 and 1983. Firstly the shift in boundaries and Labour support since 1983 will mean that even if the share of the vote is comparable this time around, Labour will see enough MPs returned to Westminster to form an effective Opposition, if not a minority of coalition government. This is not to be sniffed at, even if it falls short of Labours target. Privately certain Labour MPs have been briefing that this may not be a bad election to lose, with the threat of a high budget deficit, energy shortages and ever more pressing environmental concerns likely to give the next Opposition plenty of ammunition. Secondly, it is testament to the ideological shift achieved by Blair that the MPs that are elected to the Labour benches are likely to come from the party’s moderate centre rather than its more extreme wings. This is in marked contrast to the fate suffered by the Tories in 1997, where the stripping of its marginal seats exposed a hardened Thatcherite core to the party. Consequently, whilst the Tories went through a series of right-leaning leaders under Hague, IDS and Howard, Labour can expect to find itself under the direction of a more centrist commander. That the ‘leftist’ candidate for the leadership – Jon Cruddas – earned his political spurs as deputy political secretary to Tony Blair shows just how far the party has come in making the centre ground its own. This is not something that can necessarily be said for the Tories. Whilst Cameron has worked hard to usher more moderate candidates into safe seats, there remains a lively right-wing on the Conservative back benches, and the inquest into the Cameron experiment should the Tories find themselves once again in Opposition is sure to be fierce.

Another worry that will be furrowing Tory brows at the moment will be the spectre of electoral reform. Nick Clegg has done well to bring this issue to the fore in the past week, to the extent that he now seems to be extracting concessions from both the other leaders with some regularity. Whilst David Cameron has done his best to mount a defence of FPTP, his refusal to rule out electoral reform suggests that some form of change – likely AV – may be on the table. Whilst this in itself would go some distance to undermining many traditional Conservative justifications of FPTP, more worrying for Tories will be the possibility that the reform may go even further. If a deal is struck between a third-placed labour and the Lib Dems to form the first coalition government since 1974, then a referendum on AV is unlikely to placate those who, like Clegg, take umbrage at a system that amplifies Labour’s vote share to quite such a degree. Let us not forget that under AV Labour would have actually won an even bigger majority in 2005. The Lib Dems' preferred electoral system – STV – may yet come up for discussion if the Labour Party feels the need legitimise its continuance in government. Whilst STV would, on the notional 2005 results, actually dent the Tory vote to a lesser extent that AV, it will worry Tories, as it makes it much harder for the party to overcome the ‘progressive’ Labour, Lib Dem and Green bloc that will benefit from the reform.

So whilst the current polling should be ringing alarm bells in Labour’s Victoria Street headquarters, and should invigorate what has been a flat Labour campaign thus far, it should not yet be seen as the death knell for the party. Whereas the readiness of Tory commentators to read the polling evidence in this light is, in the context of an election campaign, entirely understandable, Conservatives should not feel immune to the fallout of the Lib Dem squeeze. If anything, the implications for them could be even more dire.

Thursday, April 22, 2010

This Brave New World

If ever proof were needed for Harold Wilson’s famous adage that ‘a week is a long time in politics’, surely we have been given it by the lorry-load since last Thursday. Indeed it now seems more appropriate to note that 90 minutes is a long time in politics. The energy, unpredictability and sheer bloody excitement that has been leant to the campaign trail in the wake of Nick Clegg’s meteoric rise - afforded by the first ever televised leaders’ debate – has had politicians and commentators alike scrabbling for ‘meaning’, whilst a torrent of lazy volcano metaphors fly from the pen’s of the lobby press pack.

But how do we analyse this apparent sea-change in British politics? Whilst it is untrue to claim as some have done that the Liberal Democrats have never topped the polls before – they did in fact lead some in the wake of their stunning capture of Brent East at a 2003 by-election – it has certainly never happened this close to an election before. Couple this to an already very tight race, and we do indeed find ourselves in uncharted territory. So where to begin? Well we can start by being reasonably confident in asserting that the Lib Dems are not going to form a majority government. Indeed despite the fact that a number have polls placed them at the top of the pile, they are unlikely to get many more than 100 seats at best, and will remain in a fairly distant third. Looking through the list of Lib Dem targets, you notice that the truly marginal seats are rather thin on the ground. The number of seats requiring a swing of less than 5% for a Lib Dem gain it is just 32, which compares to 87 for the Tories and even 50 for Labour. But that doesn’t mean that this ‘surge’ (as it is now uniformly known) is insignificant, even under our archaic voting system. In particular it will dent Tory hopes of making significant progress in the South West, something that was widely seen as a pre-requisite for a Conservative majority come May 7th. Labour strategists warn that this could be nullified by a number of losses to the ‘yellow peril’ in the north of England, but on the face of it at least, the current turn of events would seem to harm the Tories more than Labour. I say this with caution, as much depends on how these national polling trends (the uniform national swing) translate on the ground. It would seem to make sense, for instance, to say that the Lib Dems might receive less of a boost in the South West, where the party is already well established and their profile relatively high, than in other areas of the country. With that caveat duly noted, it is also true to say that only eight of the Lib Dems top 25 target seats are currently held by Labour, a statistic that will no doubt haunt CCHQ.

Despite criticisms from all quarters, Gordon Brown has actually played this new political field reasonably well. He has moved to present himself in a similar ‘progressive’ mould to Clegg in order to shore up any waverers in his party’s core vote, whilst allowing the Lib Dem pretender to steal Cameron’s mantle of ‘change’, dividing the vote for what is a tough crowd to win back to the government’s cause. The polls haven’t necessarily reflected this, with Labour falling back almost as much as the Tories have, but it might yet prove influential in shaping the electorate’s lasting impressions of the three men. Naturally this will infuriate Labour MPs in Lib Dem marginals, but given the concerted effort being made in the Tory press to tarnish Clegg’s reputation, there remains enough room for candidates to manoeuvre in these seats.

These attacks on Clegg and his party are themselves an interesting phenomenon, not least because of their timing. In the aftermath of the first few polling results after the first leaders’ debate, there was much speculation in the media about how long this Lib Dem ‘bounce’ would last. The fact that one week on the Lib Dems still find themselves in the mix is perhaps as surprising as the initial jump itself, and the current bout of mud-slinging in the right-wing press testament to the concern this is causing senior Tories. Whether these slurs stick or not – and there is already a successful Twitter campaign parodying the hysteria – I’m doubtful whether the Lib Dems can maintain their current lofty status. However it is worth noting that with postal ballots due to be sent out soon, now is not a bad time at all for the party to find itself en vogue.

The reason for my doubts is the remaining two televised debates: that which giveth doth also taketh away, to paraphrase one best-seller. Brown and Cameron will no doubt have learned the lessons from last week, and we can be sure that all questioners will now be addressed by name, whilst responses will be delivered to the camera. Clegg will also find himself under much greater scrutiny not just from his two adversaries, but also the viewing public, with whom his novelty will have waned in a week of wall-to-wall press coverage. And Lib Dem policies on foreign affairs – the subject of tonight’s debate – are hardly populist tub-thumpers. Greater EU integration, any one? Unilateral nuclear disarmament, perhaps? Clegg will have to be at his best to prevent a tabloid bloodbath. The economy debate on the 29th will of course allow him to play the ‘Vince’ card, until recently the Lib Dems’ trump. But the danger here is that they’ll appear too close to Labour on policy, allowing Cameron to play the ‘outsider’. That would be a disaster for Clegg with polling day only a week away.

So whilst the current volatility makes predicting the make up of the next Parliament something of a folly, pundits do seem to be agreed that as the polls stand, we’re heading into hung parliament territory. This throws up yet more intrigue. When the campaign kicked off, there was something approaching a consensus on the Lib Dem and Labour benches backing a referendum on the adoption of the Alternative Vote electoral system, although this was widely seen as a ‘first step’ on the reform path by Lib Dems rather than an end in itself. But if Labour do remain the largest party in the Commons on a share of the vote in line with their current third position, will the Lib Dems sense their moment to push through a more radical proposal for their preferred Single Transferable Vote? This could have absolutely monumental repercussions for the Conservatives, who have historically benefited from a less divided vote in the centre-right. Could the advent of Cameron, who was until last week the saviour of the modern Tories, actually be the party’s swan song as the ‘natural party of government’?

All of these questions will become clear in 14 days time. But with so much still up in the air, a week in politics suddenly feels like no time at all.

Wednesday, April 14, 2010

TV Debates: It's Not The Swinging Sixties Anymore

With the ritualised policy briefing that is the modern manifesto launch out of the way for the three main parties, the collective attention of the Wetminster-village-in-diaspora is now firmly fixed on the forthcoming TV leaders' debates. Or to properly prefix them, the 'historic TV leaders' debates'. Obviously these have been hotly anticipated by politicos, amongst whom they are often assumed to be an electoral game-chager. Being a novelty in British politics, it is difficult to know whether or not this will be the case, but I can think of some good reasons to be more cautious in evaluating their potential influence.

The first port of call for many feature writers in the media has naturally been to look across the water to our North American and European cousins, where TV debates are an established part of the electoral process. And more often than not, this will lead to an anectdote about the 1960 Presidential debate, where a youthful JFK outshone the sweaty, grey Richard Nixon. It is taken as a given that this was a pivotal moment in the race to the White House, and rightly so. But that doesn't mean we can make a direct comparison with the 2010 British General Election. Firstly Nixon displayed a basic ignorance of the medium - his refusal of make-up famously contributing to his deathly palour on the box - that none of today's leaders could ever be accused of. Even criticisms of Gordon Brown's manufactured, knee-jerk telly smile are the result of over-engineering his media presence, not the reverse. Whilst Brown might claim that he is meeting 'ordinary people' to prepare for the debate, it is nevertheless safe to assume that all three participants will have had hour upon hour of training from their aides to cover every conceivable eventuality thrown up by the debates. Secondly one must factor in the different circumstances in which these debates are taking place. The reason Nixon's appearance played such a pivotal role in the 1960 election was that many people weren't used to seeing politicians on TV. Today, we are saturated with media appearances by politicians of every persuasion, and viewers are unlikely to be surprised by what they see. The novelty of these debates is found in the format, rather than the medium itself.

So, how do I see the debates going? Early exchanges in the campaign thus far have indicated that skirmishes might be centred around figures and 'costed promises'. All the parties will attempt to show that the others can't pay for their policies. The Conservatives have the most to lose on this front, as current polling indicates that they are the party seen as the most 'honest' by voters. The Lib Dems have been bold in including detailed financial projections in an appendix to their manifesto, which has so far backfired as commentators present their front bench representatives with all sorts of awkward sums that undermine some of the grander claims they make for the policies. The details of these economic promises will probably go over the heads of most voters, but if the accusations of 'reckless' and 'uncosted' spending sticks to all parties, it could be Labour that stands to gain the most. If the electorate fins itself with a collective economic headache come polling day, they might yet stick with the policies that have hauled the country out of recession.

Friday, March 12, 2010

A (not so) quick guide to polling in the 2010 election

You know that election season is close when the weekend papers begin to fill their front pages with talk of ‘swings’ and ‘top-line figures’, whilst those in Westminster begin to talk in reverent tones of those quasi-mythical oracles of modern politics: the pollsters. But the art of reading political tea leaves is a difficult one. With different polling companies often producing divergent results, and different analysts offering conflicting opinions on what each poll means, it can often be difficult to know who to believe. This guide is intended to help you navigate the treacherous waters of the opinion poll, and equip you with the knowledge required to make your own informed judgements.

A very short introduction:

Polling is usually carried out by a specialist company, more often than not under the direction of a commissioning organisation, such as a newspaper, political party or pressure group. Most polling companies will have their own methodology for gathering responses and selecting a representative sample for analysis, although the questions asked vary depending on the demands of the commissioner. The largest polling companies in Britain are YouGov, ICM, Ipsos-MORI, Populus and ComRes, although the field contains a number of newcomers since the last general election, including BPIX, Angus Reid and Harris. Many national newspapers have long-standing relationships with a particular polling company, such as The Guardian’s with ICM, The Independent’s with ComRes and that between YouGov and The Sun and The Telegraph.

Methodology:

Polling is an inexact science which can often produce contrary results. For example, Angus Reid polls have consistently shown a Conservative lead of between 12 and 16 points since the turn of the year, whilst YouGov has placed the Tory lead between 2 and 12 points over the same period. What can account for this difference?

At heart, of course, polling companies all have a common objective: to gather opinion from a representative sample on a given topic in order to highlight underlying trends. However the ways in which the pollsters approach this goal differs from company to company.

The first major dividing line is drawn in the ways in which different pollsters gather their data. Certain companies, including YouGov, Harris and Angus Reid, use online surveys completed by a registered panel to form their sample. Other companies, such as ComRes and Populus, use telephone interviews, and a declining number still use face-to-face interviews, including TNS BMRB. Still others, ICM included, use a mix of online, telephone and face-to-face interviews to inform their polls. Ipsos-MORI switched from a face-to-face methodology to a telephone-based research method after the London mayoral election of 2008, citing criticisms that the face-to-face technique gave disproportionate weighting to public-sector workers.

A more complicated difference is found in the ways in which different companies ‘weight’ their samples. Weighting is the process through which the opinions collected in a poll are exaggerated or underplayed depending upon the stated allegiances and demographics of the respondent, in order to bring the sample in line with the nationwide equivalents, thus producing a ‘representative sample’. All pollsters do this, but the factors that are chosen to weight the sample vary from company to company.

Most companies will use demographic data - such as age, race, sex, income, and employment status - collected from their panel to weight their responses. This helps to iron out any anomalies that might be thrown up by their sampling methods. For example, it would probably be accurate to assume that a face-to-face survey conducted during the daytime might catch a disproportionately high number of unemployed people, as those in work are not available to be questioned. Equally, online surveys might over-represent higher income groups, as they might be presumed to have better access to the requisite technology.

Given that this sort of weighting is fairly standard however, it is unlikely that this is a major source of divergence between polling companies. More contentious is the use of political data as a weighting factor. Political weighting – which uses factors such as party membership, voting history and newspaper readership to balance the sample – is applied differently by most polling organisations, and has evolved in order to address discrepancies observed between the data collected by pollsters and historical actualities. Political weighting became widespread after pollsters suffered a disastrous 1992 General Election campaign, where predictions of a Labour victory were all but unanimous across the companies. A subsequent Market Research Society (MRS) inquiry found that respondents were more likely to refuse to reveal their voting history and intention if they associated themselves with ‘unfashionable’ parties (a phenomenon known as the ‘Spiral of Silence’ in polling circles). Another common problem is deciding upon how to include the opinions expressed by those who are uncertain whether or not they will vote; they often represent a significant proportion of the sample, but their responses are clearly not as valuable as those who are certain of their intention to vote.

The methods used to address these challenges vary depending on the polling organisation. Populus, ComRes and ICM all use a respondent’s vote at the last election to determine their weight in relation to voting intention. ICM, MORI, ComRes and Populus also all use the stated likelihood to vote as a weighting factor, whilst YouGov and Angus Reid factor in newspaper readership.

However weighting on these terms is not as simple as it might seem. Statisticians have noticed an undeniable tendency for ‘false recall’ amongst a significant proportion of any given survey panel. False recall is the collection of inaccurate data due to the respondent’s inability to remember their own voting history, or their desire to distort their previous voting record. A good example of the latter is a hypothetical Conservative supporter, who voted tactically for the Lib Dems at the previous election, but wishes to express their support for the Tories. False recall can therefore also compound the differences between survey methods, as online polling can store data pertaining to an individual’s responses over long periods without fear of inaccuracy, whereas telephone and face-to-face interviews rely to a much greater extent upon the honesty and memory of their respondents. ICM, Populus and ComRes all adjust their survey results to account for false recall. Furthermore, all polling companies test their methodologies against historical data.

A final methodological point to bear in mind is the order in which different pollsters place their questions. Although notoriously difficult to quantify, research has shown that responses to a given question can be shaped by whether it is placed at the beginning, middle or end of a survey. Of particular note in this respect is the placement of the voting intention question. All companies aside from Angus Reid ask this ‘headline question’ first, which could explain why Angus Reid has returned such divergent results.

So who should I believe?

The somewhat predictable response to this commonly-asked question is that there is no simple answer.

However in the two most recent national elections, YouGov has had the most success by final polling, judging the eventual 2008 London mayoral result perfectly when most other pollsters had predicted a victory for Livingstone, and getting the 2009 European election result to within an average margin for error of 1%, compared to second-placed Populus’ 1.6%.

Past form is not a fail-proof yardstick for measuring likely success in the up-coming election however, for a couple of reasons. Firstly, YouGov, like most other polling companies, have made tweaks to their methodology which has not yet been tested against a real election result. The different constituencies and boundary changes can also disrupt the local weighting done by pollsters in a general election campaign, especially where this changes the rules of engagement for tactical voters.

It’s also worth noting that a general election campaign is a different beast to the local and European equivalents, where shifts in focus between emerging policies, scandals and intrigue can produce a much more pronounced swing in the polls. Having duly noted this, YouGov has nevertheless been widely credited with producing the most accurate voting intention figures ahead of the 2001 and 2005 elections.

Ipsos-MORI’s policy of only including respondents who describe themselves as certain to vote in their samples mean that their top-line figures are often more volatile than other pollsters. Although their most recent return of a 5 point Tory advantage is broadly in-line with other polls, since 2008 they have recorded a 28 point lead for the Conservatives, and have seen successive month-on-month swings of 11 points over the last six months.

However MORI did enjoy a very successful 2005 election, getting the Conservative and Liberal Democrat vote shares spot on, and missing both Labour and Others by 2 points. Similarly, Populus correctly predicted Labour and Lib Dem vote shares in their final 2005 poll, placing the Conservatives to within a 1% margin of error. ICM has historically overstated Labour support during general election campaigns.

A word of caution:

You can, to paraphrase George Canning, prove anything with statistics except the truth. Many an over-enthusiastic commentator has eagerly extrapolated headline-friendly conclusions from opinion polls, only to find that on closer inspection the detail does not bear them out. The pitfalls in polling are numerous – here are some of the more common snares to avoid.

The golden rule for analysts is to make sure that in charting the fortunes of parties through the polls, one only ever compares like for like. Given the differences in methodology outlined above, it would be extremely misleading to describe, for example, Labour support moving from 28% in one ICM poll to 34% in a later YouGov offering as a jump of 6 points for the party. ICM polls should only be compared to earlier ICM polls, and YouGov to preceding YouGov polls. Quite apart from anything else, this should give a much less volatile picture of poll movements, and make it easier to chart the long-term trends.

It would also be a mistake to read voting intention figures as directly comparable to the make up of any future Parliament. Due to the mysteries of the boundaries system, Labour requires a much smaller share of the popular vote to secure a working majority than the Tories do. Broadly speaking, the Conservatives need a lead of around 9 points in the polls to be confident of forming a majority government, and even then they are susceptible to being scuppered by a strong Lib Dem showing. The reasons for this apparent bias can be found in the over-representation of certain areas, notably Wales, the often ‘clustered’ nature of Tory support, and the greater propensity for Lib Dem and Labour voters to vote tactically against the Tories.

To complicate matters further, top-line figures fail to take account of the regional variations that often decide elections. Polls are weighted to reflect national data, when in fact it is usually a relatively small number of marginal seats that decide the eventual outcome of a general election. This is particularly pertinent in the 2010 election, where the Conservatives have invested vast sums – controversially backed by Michael Ashcroft’s donations - in campaigning in marginal seats. If this strategy were to pay off, the Tories could notionally win enough seats to form a government with a narrower lead than might be expected in the national polls. The key piece of data here is the swing in voting intention against the swing required by the challenger to unseat the incumbent. In 2010, the bulk of Labour’s key marginals are in the south east of England, whilst the Tories will also need to make in-roads into a number of target seats held by Lib Dems in the south west if they are to enjoy a healthy majority. Top-line figures therefore often fail to reflect the nuances at a regional level that can have a profound effect upon the eventual result.

It’s perhaps not surprising that the voting intention by party figures should grab the headlines, but it is also worth taking these within some kind of context. For instance, whilst voting intention figures widely predicted a Labour victory prior to the 1992 general election, John Major retained a lead over Neil Kinnock in his personal approval ratings throughout the campaign, mirroring the eventual result much more accurately. Similarly, party ratings in individual policy areas can prove a useful barometer should a single area come to dominate the election coverage, as the economy threatens to do in 2010. Whilst it is undoubtedly easier to spot these trends with the benefit of hindsight, looking beyond the top-line figures can help analysts spot anomalous figures.

Another bugbear for pollsters is the leading question; often a favourite of pressure groups with an agenda to push. Examples of such shady dealings include prompting - offering the respondent an option where it isn’t merited, and artificially shifting the weight of possible answers in order to favour a given outcome (as in ‘would you say this issue is extremely important, very important, important, not important’). Mercifully these false positives are easily spotted with a quick glance through the polling tables, but this is unlikely to stop the commissioning organisation from formulating some sensationalist headlines, which are often regurgitated without thought in the media.