Saturday, March 29, 2014

Is a Nuclear Weapons-Free World Possible?



November 2013

The Nuclear Non-proliferation Treaty (NPT) (UN Office for Disarmament Affairs, 2013) recognises only five ‘nuclear states’—the U.S., UK, France, Russia and China. Since 1967, India, Pakistan, North Korea and Israel have also developed nuclear weapons, almost doubling the size of the group. South Africa stands alone as the only country to develop atomic weapons and give them up (Nuclear Threat Initiative, 2013). There has been a slow, steady reduction of the number of nuclear warheads in the world to between 10,000 (Kristensen & Norris, 2013) and 25,000 (Daalder & Lodal, 2008: 82), with, according to some, 90% of nuclear warheads produced since 1945 now out of service (Kristensen & Norris, 2013). However, there are still more than enough warheads to destroy civilisation as we know it.

We live in a world today with an increasing number of nuclear states, not decreasing. Nonetheless, the picture is not as bleak as it may seem. President John F. Kennedy predicted that by 1964 the world would see as many as 10-20 nuclear powers (Carnegie Endowment for International Peace, quoting Kennedy, 2003). There are not even that many today, 50 years later. Since 2007 world leaders have shown renewed interest in nuclear disarmament. With a practical view of nuclear disarmament, an agreement with proper control, verification and enforcement mechanisms, and the necessary political will, it is possible to achieve a nuclear weapons-free world.

‘Abolition’ v. ‘Disarmament’
O’Hanlon (2010) correctly points out an important difference in vocabulary in what one means by ‘a world without nuclear weapons’. ‘Abolishing’ nuclear weapons means not only dismantling all existing weapons, but outlawing their testing, use, reconstruction, development, proliferation and make them wholly illegal in all circumstances. This differs from dismantling or demilitarising all currently existing nuclear arsenals in the world and agreeing an international framework to monitor progress and fissile materials, verify disarmament and mediate disputes, but not totally outlawing them forever in all circumstances. It would also eliminate all current atomic weapons. Both would constitute a ‘nuclear weapons-free world’, but disarmament is more realistic and achievable.

The NPT attempts to prevent nuclear proliferation and elicits an agreement in Article VI (UN Office for Disarmament Affairs, 2013) from nuclear states to cease the nuclear arms race, dismantle their nuclear weapons and agree a treaty leading to ‘general and complete disarmament’ under international control, something they have yet to do. Article I (ibid.) stops ‘nuclear states’ from transferring nuclear weapons technology to non-nuclear states while Article II (ibid.) prevents signatories which did not already possess nuclear weapons from obtaining them. States which have developed atomic weapons after the NPT have done so as non-members of the treaty. The NPT does not seek to ‘abolish’ nuclear technology in the world. It recognises, at Article I (ibid.), the right of ‘nuclear states’—America, Britain, France, China and Russia—to possess them. NPT Article IV (ibid.) in fact recognises and encourages the development and sharing of the ‘inalienable right’ to peaceful nuclear technology among nuclear and non-nuclear states. NPT Article X (ibid.) gives members the right to leave the treaty in circumstances where they believe it is contrary to their national interest.

Individuals and groups who call for the ‘abolition’ or banishment of nuclear weapons stand on firm moral ground. However, groups such as Greenpeace (2013) and iCan (International Campaign to Abolish Nuclear Weapons, 2013) focus on campaigning to motivate individuals at ‘grassroots’ level to apply pressure on officials to abolish atomic weapons, which, while also an important part of the effort, does not address the perennial underlying political and security issues which cause states to cling to or seek to acquire nuclear weapons. These groups have been critical of the 1970 NPT (UN Office for Disarmament Affairs, 2013) as legitimising a system of nuclear ‘haves and have-nots’ by giving special recognition to the 5 original nuclear states, charge it has been ineffective in applying pressure to disarm (Brehm et al., 2013: 12-16), and point to a complete ban on nuclear weapons along the same path as treaties for landmines and biological weapons as a better goal. Nonetheless, even some critical of the NPT and piece-meal bilateral agreements acknowledge that forever ‘dis-inventing’ nuclear weapons is not possible and that if one state reconstitutes a nuclear programme, there may be no alternative but for others to do so to confront that threat (Blechmann & Bollfrass, 2010; 583).

The distinction between disarmament and abolition of nuclear weapons is not clearly articulated, even by those familiar with nuclear issues. Abolition involves what some have called ‘putting the genie back in the bottle’—(Gusterson, 2008) requiring all states to simultaneously disclaim and disown nuclear weapons for good, an idea that becomes difficult to achieve if even one state refuses to agree or comply, thus causing all others to consider doing so as well. It is unrealistic because it does not take into account the underlying (in)security conditions, discussed by countless security scholars over the last several decades (e.g., Sagan & Waltz, 2013), which lead states to acquire atomic weapons to begin with. If these are not addressed, even incremental steps toward disarmament become difficult and a comprehensive agreement becomes impossible. This differs from nuclear disarmament built on the back of the trust, agreements and institutions of the existing NPT, specifically the Article VI (UN Office for Disarmament Affairs, 2013) agreement to pursue a treaty leading to ‘general and complete disarmament’. NPT Article VII (ibid.) also allows states to conclude bi- or multi-lateral agreements relating to nuclear disarmament, something the U.S., Russia/USSR and other members have used to positive effect to agree nuclear reduction treaties, such as SALT, START, SORT, and New START. Nuclear disarmament under the NPT means states continuing (finally) to seriously pursue something they have already agreed to do, making nuclear disarmament more possible than nuclear abolition. Though progress has been slow under the NPT, it still has made progress.

Control, Verification and ‘Virtual Deterrence’
In considering whether a nuclear weapons-free world is possible it must also be considered how any nuclear disarmament agreement, once reached, would be verified, how fissile materials would be controlled and how noncompliance would be confronted. An agreement without such ‘teeth’ would be doomed from the start.

Tracking and controlling nuclear material is the only way to ensure new atomic weapons cannot be developed (Daalder & Lodal, 2008: 87). However, environmental, market and economic pressures have brought about the need for energy from a clean, reliable source such as nuclear power. The IAEA itself has called for 1,400 new nuclear reactors to be built worldwide by 2050 to meet world energy demand (ibid.: 88). NPT Article IV upholds the ‘inalienable right’ of states to pursue peaceful nuclear technology (UN Office for Disarmament Affairs, 2013). Even if a comprehensive international nuclear disarmament agreement is reached, fissile material will still be available and remain a growing issue. To simultaneously meet the growing international demand for energy and confront the issue of controlling fissile materials, multi-national nuclear power facilities could be built. No single nation would ‘own’ the plant or materials and the facility and nuclear fuel could be easily inspected by an organisation such as the IAEA (Drell & Goodby, 2008: 26-7). A similar solution has been put forward to settle the controversy over Iran’s nuclear programme (Forden & Thompson, 2009: 11).

Counterintuitively, none of the nine states known to possess nuclear weapons is currently subject to IAEA inspections. The five NPT ‘nuclear states’ are exempt and the four non-NPT states—India, Israel, Pakistan, North Korea—are not subject to them (Daalder & Lodal, 2008: 88). This means the overwhelming bulk of nuclear weapons and material in the world is only tracked by these governments. We have to take their word for it. Any comprehensive treaty would have to include control, verification and inspection measures by an organisation, such as the IAEA, which apply to all countries equally. The IAEA, “should be given the authority to inspect any facility, at any time, and anywhere on the territory of every signature state” (Blechmann & Bollfrass, 2010: 571).

Even if all nuclear weapons are demilitarised, fissile material closely controlled and an inspection regime instituted, there will always be the chance that one or more states will reconstitute nuclear weapons at some point in the future. The first steps could be similar to those taken today against states such as North Korea and Iran—sanctions, negotiations and possible military action. However, such a process may take too long to stop the reconstitution of nuclear weapons and allowing it to be subject to a UN Security Council veto could further complicate matters (ibid.: 573). The fear a foe would secretly maintain nuclear weapons or rebuild them is an obstacle to convincing current nuclear-armed states to agree to give them up.

The concept of ‘virtual deterrence’ has been put forward both to calm the security fears of current nuclear states regarding disarmament and as an enforcement and deterrence mechanism against rogue states that would start or reconstitute a nuclear weapons programme after achieving nuclear disarmament (Paloczi-Horvath, 1998). Briefly, the idea is that current nuclear states, such as the P5, could maintain the threshold ability to reconstitute their nuclear programmes in a matter of months in such circumstances in order to confront the threat (ibid.: 3). Nuclear ‘abolitionists’ would object, however nuclear weapons technology cannot be ‘dis-invented’ and the threat will always exist. Nuclear disarmament is possible; abolition of nuclear weapons forever is not.

Political Will
One of the most important factors, if not the most important, in arriving at a world without nuclear weapons is political will. In 2007, U.S. senior policy leaders Henry Kissinger, Sam Nunn, William Perry and George Shultz breathed new life into the movement toward ‘Global Zero’ beginning with a series of opinion pieces in major American newspapers (Kissinger et al., 2007; 2008; 2010; 2011) as part of the Nuclear Security Project. They succeeded in making nuclear disarmament an issue in the 2008 U.S. presidential campaign, supported by both then-Senator Barack Obama and Senator John McCain (Daalder & Lodal, 2008: 81; Ferguson, 2010: 88).

As President, Barack Obama named nuclear disarmament one of the priorities of his administration and promised in his 2009 Prague Speech that America would take ‘concrete steps toward a world without nuclear weapons’ (White House Press Office, 2009). In October 2009, President Obama was awarded the Nobel Peace Prize for his commitment to eliminating nuclear weapons (Nobel Prize, 2009). In April 2010, the U.S. Department of Defense released a Nuclear Posture Review (NPR) in which it reiterated America’s commitment to the elimination of nuclear weapons, committed to ‘reducing the role of U.S. nuclear weapons in U.S. national security strategy’ and to ‘maintaining strategic deterrence and stability at reduced nuclear force levels’ as key priorities (U.S. Department of Defense, 2010: iii). In April 2010, President Obama also signed New START with Russian President Dmitry Medvedev, reducing and limiting both nuclear arsenals to 1,550 warheads and between 700-800 delivery platforms (U.S. Department of State, 2010). In May 2010 the 5-yearly NPT review conference was held in New York. The final document included recommitment of members to the NPT, specific action-plans regarding nuclear disarmament and proposed steps for creating a ‘WMD-free’ zone in the Middle East (Choubey, 2010). The U.S. National Security Strategy, released in May 2010, also reiterated U.S. commitment to ‘pursue the goal of a world without nuclear weapons’ and strengthening the NPT (White House, 2010: 23).

Senior UK policymakers also got behind the renewed push. In June 2007 Foreign Secretary Margaret Beckett spoke in support of the effort by Kissinger, Nunn, Perry and Schultz (Beckett, 2007), as did Douglas Hurd, Malcolm Rifkind, David Owen and George Robertson in 2008, calling for support of New START, a strengthening of the NPT and ratification of the Comprehensive Test Ban Treaty (CTBT) (Hurd et al., 2008). Prime Minister Gordon Brown (Brown, 2008) and Defence Minister Des Browne shifted UK policy from that under Tony Blair where non-proliferation was the sole focus as opposed to now pursuing both non-proliferation and disarmament (Campaign for Nuclear Disarmament, 2008). The United States and United Kingdom have both continued to engage with North Korea and Iran on their nuclear programmes, strengthening sanctions and leading talks alongside allies, culminating in the recent multilateral agreement between the ‘P5 + 1’ nations and Iran to slow development of their nuclear programme (Borgher & Dehghan, 2013).

These events of the past seven years have shown a renewed commitment on behalf of most of the major nuclear states to nuclear disarmament, but it hasn’t all been easy or good news. The U.S. and Russia did sign New START in 2010, though it was only just barely ratified by Congress in 2011 over objections by hawkish Republican Senators (Oliphant, 2010), such as Sen. John McCain, who had had claimed to support nuclear disarmament in his 2008 presidential campaign (Daalder & Lodal, 2008: 81; Ferguson, 2010: 88). After agreeing a 2008 deal with the P5+1 to end its nuclear programme, North Korea destroyed the cooling tower of its nuclear facility at Yongbyon. However the IAEA claims it has restarted work at the facility in recent days (Reuters, 2013).

However, the renewed push for nuclear disarmament since 2007 has been overtaken by other domestic and international events in key states. The 2008 economic downturn, economic crises in EU states, government ‘austerity’ policies in the UK and political fights over tax and fiscal policies and domestic political issues such as ‘Obamacare’ and the ‘debt ceiling’ in the United States continue to absorb much of the world’s political energy and capital. Since 2008 there have been changes in national leadership in the U.S., UK, France, Russia, China, North Korea, India, Pakistan and Israel—every nuclear state. The 2012 conference called for in the 2010 NPT review to devise a ‘WMD-free zone’ in the Middle East was cancelled as it was unclear whether Israel, having just begun a military incursion into Gaza (Gladstone & Kershner, 2012), or Iran would fully participate and Arab states were angered by further delays in a discussion which began 15 years before at the 1995 NPT review (Malin & Miller, 2013: 1-2). The 2010 Arab Spring uprisings have caused political and national security concerns for the P5 states and others. The U.S., UK and France have clashed with Russia and China in their response to the Syria conflict. The use of chemical weapons in Damascus on 21 August, most-probably by the Assad regime (Gladstone & Chivers, 2013), has focused the world’s attention on the Chemical Weapons Convention (CWC) and a different ‘weapon of mass destruction’.

The reinvigorated campaign for nuclear disarmament shows that the political will to push forward the agenda for a nuclear-free world exists, however it is also constantly being stretched to the limit and attention is divided by other world events. O’Hanlon (2010) points out that timing is also crucial on this issue and real progress may not be possible until some of the world’s other major problems which often cause security concerns which complicate the nuclear disarmament issue—Taiwan, Kashmir, Russia and its neighbours, Israel-Palestine—are resolved first. As President Obama acknowledged in his 2009 Prague Speech, “This goal will not be reached quickly—perhaps not in my lifetime. It will take patience and persistence. But we, too, must ignore the voices who tell us the world cannot change” (White House, 2009). The political will is there, but the attention and timing must also be right and they all must coincide in order for there to be any realistic chance of achieving a world free of nuclear weapons.

Do We Really Want a World Free of Nuclear Weapons?
Though the accepted dilemma seems to be how to achieve a world free of nuclear weapons and whether it is possible, there is not much in-depth discussion as to whether a nuclear weapons-free world would provide security and peace as asserted. Arguably the most famous analysis of this question is the debate in book form between Scott Sagan and the late Ken Waltz (2013).

Briefly, as a Realist, Waltz believes that the world consists of states in global anarchy which must find ways to create security for themselves through the two separate ideas of ‘defence’, the ability to repel an attack, and ‘deterrence’, the ability to inflict enough punishment on an opponent to create a disincentive for them to attack (ibid.: 5). Simply put, possession of nuclear weapons greatly bolsters a state’s ability to defend and deter and when two nuclear states stand opposed to one another, these weapons have an equalising effect which causes them to proceed in a much more considered manner because of what they risk in a nuclear exchange and the knowledge that the other side, rationally, must be proceeding in the same manner creates a more secure condition (ibid.: 5-8). He asserts nuclear weapons allow states to meet the need to provide their own security and secure states do not fight wars (ibid.: 37). When confronted with the question if ‘global zero’ would be better Waltz answers that, “Abolishing the weapons that have caused sixty-seven years of peace would certainly have effects. Such an action would, among other things, make the world safe for the fighting of World War III” (ibid.: 221).

Also briefly, Sagan responds by arguing that nuclear weapons make the world less secure because they are military objects and, institutionally, military organisations are concerned with achieving ‘military victory’ by defeating opponents in war and because nuclear weapons provide unmatched potential to do that, military organisations will always seek to obtain advantage by building more nuclear weapons and will, as all institutions do, seek ever more resources to do so. Many states do not have sufficient civilian control over their military apparatus to counter these tendencies. More states will seek nuclear weapons and states that already possess them will build more, the end state being that they will not provide security for anyone, just more nuclear weapons. He also shows empirically that political and military leaders cannot always be counted on to act rationally in the severe emotional circumstances high-level conflict creates (ibid.: 41-3). On the question of global zero, Sagan answers that the need for nuclear deterrence ended with the Cold War and the threat of loose nuclear weapons falling into the hands of terrorist organisations is greater because they do not fear nuclear retaliation, making the need to reach zero a pressing issue (ibid.: 215-19).

As the title of the book suggests, this is An Enduring Debate. The world was a violent place before nuclear weapons and will still be one if ever we are without them, as Sagan recognises (ibid.: 219), and still be fraught with conflict and the state quest for security, as Waltz asserts (ibid.: 5-7). Unless and until the world arrives at that point, there can be no answer.

Conclusion
It is possible to achieve a nuclear weapons-free world. It must be recognised that nuclear weapons cannot be ‘dis-invented’ and the knowledge and technology will always exist even if global zero is achieved. Nuclear disarmament is achievable; nuclear ‘abolition’ is not. The political will to pursue disarmament must be there and there is good evidence it has been renewed since 2007. However, political will must coincide with the right time, when international attention and political capital is not being focused elsewhere on other problems. To succeed, any comprehensive international nuclear disarmament agreement would have to address issues of verification, control of fissile material and mechanisms to confront states in noncompliance. If all of these concerns are addressed, it is indeed possible to reach a nuclear weapons-free world. The question if that world will actually be the one we have envisioned is one that will have to be answered when we get there.



BIBLIOGRAPHY
Beckett, M. (2007) “Toward a Nuclear Free World?” Carnegie Endowment for International Peace. http://carnegieendowment.org/2007/06/25/keynote-address-world-free-of-nuclear-weapons/kc0 [Accessed 2 December 2013].

Blechman, B., and Bollfrass, A. (2010) “Zero Nuclear Weapons.” The Nonproliferation Review 17 (3): 569–575. http://dx.doi.org/10.1080/10736700.2010.517008 [Accessed 5 December 2013].

Borger, J., and Dehghan, K. (2013) “Secret Talks Helped Forge Iran Nuclear Deal.” The Guardian, November 25, sec. World News. http://www.theguardian.com/world/2013/nov/24/secret-usa-iran-talks-nuclear-deal [Accessed 3 December 2013].

Brehm, M., Moyes, R., and Nash, T. (2013) “Banning Nuclear Weapons”. Article 36. http://www.article36.org/wp-content/uploads/2013/02/Report_web_23.02.13.pdf [Accessed 3 December 2013].

Brown, G. (2008) “Remarks by British Prime Minister Gordon Brown at the Delhi Chamber of Commerce.” Federal News Service, January 21. http://www.lexisnexis.com/uk/nexis/docview/getDocForCuiReq?lni=4RR0-4NN0-TWK7-H0B3&csi=8104&oc=00240&perma=true [Accessed 2 December 2013].

Campaign for Nuclear Disarmament (2008) “CND Welcome’s Des Browne’s Call for Summit on Destruction of Nuclear Weapons.” Campaign for Nuclear Disarmament. http://www.cnduk.org/cnd-media/item/522-cnd-welcomes-des-brownes-call-for-summit-on-destruction-of-nuclear-weapons [Accessed 3 December 2013].

Carnegie Endowment for International Peace (2003) “JFK on Nuclear Weapons and Non-Proliferation.” Carnegie Endowment for International Peace. http://carnegieendowment.org/2003/11/17/jfk-on-nuclear-weapons-and-non-proliferation/3zcu [Accessed 3 December 2013].

Choubey, D. (2010) “Understanding the 2010 NPT Review Conference.” Carnegie Endowment for International Peace, June 3. http://carnegieendowment.org/2010/06/03/understanding-2010-npt-review-conference/594#2 [Accessed 2 December 2013].

Daalder, I., and Lodal, J. (2008) “The Logic of Zero: Toward a World Without Nuclear Weapons.” Foreign Affairs 87 (6): pp. 80–95.

Drell, S., and Goodby, J. (2008) “The Reality: A Goal of a World without Nuclear Weapons Is Essential.” The Washington Quarterly 31 (3): pp. 23–32.

Ferguson, C. (2010) “The Long Road to Zero.” Foreign Affairs 89 (1): pp.86–94.

Forden, G., and Thomson, J. (2009) Iran as a Pioneer Case for Multilateral Nuclear Arrangements. 4th ed. Massachusetts Institute of Technology: The Science, Technology, and Global Security Working Group. http://web.mit.edu/stgs/pdfs/IPCPublicationMay2009.pdf [Accessed 26 November 2013].

Gladstone, R., and Chivers, C. (2013) “Forensic Details in UN Report Point to Assad’s Use of Gas.” New York Times, September 16, sec. Middle East. http://www.nytimes.com/2013/09/17/world/europe/syria-united-nations.html [Accessed 2 December 2013].

Gladstone, R., and Kershner, I. (2012) “Israel and Hamas Step Up Air Attack in Gaza Clash.” New York Times, November 15, sec. Middle East. http://www.nytimes.com/2012/11/16/world/middleeast/israel-gaza-assault.html?_r=0 [Accessed 3 December 2013].

Greenpeace (2013) “Abolish Nuclear Weapons.” Greenpeace. http://www.greenpeace.org/international/en/campaigns/peace/abolish-nuclear-weapons/ [Accessed 2 December 2013].

Gusterson, H. (2008) “The New Nuclear Abolitionists.” Bulletin of the Atomic Scientists (Online). http://www.thebulletin.org/new-nuclear-abolitionists [Accessed 3 December 2013].

Hurd, D., Rifkind, M., Owen, D., and Robertson, G. (2008) “Start Worrying and Learn to Ditch the Bomb.” The Times (London), June 30, sec. Features.

International Campaign to Abolish Nuclear Weapons (2013) “The Case for a Ban Treaty.” International Campaign to Abolish Nuclear Weapons. http://www.icanw.org/why-a-ban/the-case-for-a-ban-treaty/ [Accessed 2 December 2013].

Kissinger, H., Nunn, S., Perry, W., and Shultz, G. (2007) “A World Free of Nuclear Weapons.” Wall Street Journal, January 4. http://www.nti.org/media/pdfs/NSP_op-eds_final_.pdf?_=1360883065 [Accessed 26 November 2013].

———. (2008) “Toward a Nuclear-Free World.” Wall Street Journal, January 15. http://www.nti.org/media/pdfs/NSP_op-eds_final_.pdf?_=1360883065 [Accessed 26 November 2013].

———. (2010) “How to Protect Our Nuclear Deterrent.” Wall Street Journal, January 20.
http://www.nti.org/media/pdfs/NSP_op-eds_final_.pdf?_=1360883065 [Accessed 26 November 2013].

———. (2011) “Deterrence in the Age of Nuclear Proliferation.” Wall Street Journal, March 7. http://www.nti.org/media/pdfs/NSP_op-eds_final_.pdf?_=1360883065 [Accessed 26 November 2013].

Kristensen, H., and Norris, R. (2013) “Global Nuclear Weapons Inventories, 1945-2013.” Bulletin of the Atomic Scientists (Online). http://www.thebulletin.org/2013/september/global-nuclear-weapons-inventories-1945-2013 [Accessed 2 December 2013].

Malin, M., and Miller, S. (2013) “A WMD-Free Zone in the Middle East: Regional Perspectives.” Edited by Foradori, P. and Malin, M., pp. 1–5. Cambridge, MA: Belfer Center for Science and International Affairs, Harvard University. http://belfercenter.ksg.harvard.edu/files/dp_2013-09.pdf [Accessed 3 December 2013].

Nuclear Threat Initiative (2013) “South Africa: Country Profile.” Nuclear Threat Initiative. http://www.nti.org/country-profiles/south-africa/nuclear/ [Accessed 3 December 2013].

O’Hanlon, M. (2010) “Is a World Without Nuclear Weapons Really Possible?” Brookings. http://www.brookings.edu/research/opinions/2010/05/04-global-zero-ohanlon [Accessed 26 November 2013].

Oliphant, J. (2010) “Republicans Stiffen Opposition to Nuclear Treaty with Russia.” Los Angeles Times, December 20, sec. News. http://articles.latimes.com/2010/dec/20/nation/la-na-start-20101220 [Accessed 4 December 2013].

Paloczi-Horvath, G. (1998) “Virtual Nuclear Capabilities and Deterrence in a World without Nuclear Weapons”. 3. London: Verification Research, Training and Information Centre. http://www.vertic.org/media/Archived_Publications/Research_Reports/Research_Report_3_Paloczi-Horvath.pdf [Accessed 4 December 2013].

Reuters (2013) “North Korea ‘Restarts’ Nuclear Reactor, Atomic Watchdog Warns.” The Guardian, November 28, sec. World News. http://www.theguardian.com/world/2013/nov/28/north-korea-restarts-nuclear-reactor-warns-iaea-pyongyang [Accessed 2 December 2013].

Sagan, S., and Waltz, K. (2013) The Spread of Nuclear Weapons: An Enduring Debate. 3rd ed. New York: Norton & Co.

The Nobel Prize (2009) “The Nobel Peace Prize 2009.” The Nobel Prize. http://www.nobelprize.org/nobel_prizes/peace/laureates/2009/ [Accessed 2 December 2013].

The White House (2010) “National Security Strategy of the United States: May 2010.” http://www.whitehouse.gov/sites/default/files/rss_viewer/national_security_strategy.pdf [Accessed 3 December 2013].

U.S. Department of Defense (2010) “Nuclear Posture Review Report: April 2010”. U.S. Department of Defense. http://www.defense.gov/npr/docs/2010%20nuclear%20posture%20review%20report.pdf [Accessed 2 December 2013].

U.S. Department of State (2010) “Treaty Between the United States of America and the Russian Federation on Measures for the Further Reduction and Limitation of Strategic Offensive Arms.” U.S. Department of State. http://www.state.gov/documents/organization/140035.pdf [Accessed 2 December 2013].

UN Office for Disarmament Affairs (2013) “Treaty on the Non-Proliferation of Nuclear Weapons (NPT).” UN Office for Disarmament Affairs. http://www.un.org/disarmament/WMD/Nuclear/NPTtext.shtml [Accessed 2 December 2013].

Weiss, L. (2010) “India and the NPT.” Strategic Analysis 34 (2): pp. 255–271.

White House Press Office (2009) “Remarks by President Barack Obama: Hradcany Square, Prague, Czech Republic.” White House Press Office. http://www.whitehouse.gov/the_press_office/Remarks-By-President-Barack-Obama-In-Prague-As-Delivered [Accessed 2 December 2013].

Tuesday, March 18, 2014

The Inevitability of Intelligence Failure: Sources, Locations and Causes



November 2013

Intelligence failure can be defined as ‘a misunderstanding of the situation that leads a government (or its military forces) to take actions that are inappropriate and counterproductive to its own interests’ (Schmitt & Shulsky, 2002: 62). Explorations of what could or should have been done differently form the basis for millions of pages of government investigations, newspaper articles, books, journals and entire academic careers.

A uniting factor which leads an event to be considered an intelligence failure is that it was or came close to a national disaster, whereas ‘the record of success is less striking because observers tend not to notice disasters that do not happen’ (Betts, 1978: 62). If one takes this definition of intelligence failure and turns it around, an ‘intelligence success’ occurs when a situation is understood properly and leads a government (or its military forces) to take actions appropriate and productive to its own interests. Concern with intelligence failures always far outstrips that of any intelligence successes, which may not become known until long after the event, if ever.

Intelligence failures are inevitable because there are limits to what intelligence can accomplish. Its proponents are often guilty of overselling its capabilities and its ‘consumers’ and observers are guilty of misunderstanding them (Gill & Phythian, 2006: 104-5). This essay will use a framework based upon the work of Betts, Schmitt and Shulsky, and Gill and Phythian, among others, to outline the different ‘sources’ or ‘locations’ of intelligence failure, where they occur in the ‘intelligence cycle’, their ‘causes’ and other factors, followed by the use of the 2003 Iraq WMD controversy as a case study to briefly illustrate real-world examples to show why intelligence failures are inevitable.

Sources & Causes
There are three general locations which can be identified as sources of intelligence failure: ‘Collection’, ‘Analysis’ and ‘Decision-Makers’ (Gill & Phythian, 2006: 103-4, citing Betts, 1978). These categories broadly separate persons involved in the ‘Intelligence Cycle’ by their positions or functional roles within it. CIA defines the Intelligence Cycle as the ‘process by which information is acquired, converted into intelligence, and made available to policymakers’ (Johnson & Wirtz, 2008: 49).
Collection

The first step in the Intelligence Cycle is to develop directions as to what information is necessary, known as ‘requirements’, and how it will be collected based upon the needs of the eventual consumers of the intelligence, usually senior policymakers (ibid.). Based upon this guidance, intelligence agencies then begin Collection, also known as ‘espionage’, which can be defined as, ‘the practice of using spies to collect information about what another government or company is doing or plans to do’ (Williams, 2011: 1165). Put simply, Collection involves obtaining the information or ‘raw intelligence’ which is required to meet Requirements developed at the first step in the Intelligence Cycle. Collection is performed by all means available to intelligence agencies, including human intelligence, signals intercepts, imagery and scientific and technical measurement, among others, and relates to one or more ‘types’ of intelligence, including military, political, economic or cultural intelligence (Johnson & Wirtz, 2008: 51).

Collection Failure
Collection Failure can be seen as the ‘unavailability of information when and where needed’ (Hatlebrekke & Smith, 2010: 151, citing Schmitt & Shulsky, 2002: 64-7;) or part of Betts’ ‘Pathologies of Communication’–the lack of timely collection of information (Betts, 1978: 62-3). Essentially, Collection Failure occurs because the information necessary to respond successfully to the situation was not collected or not when needed.

Inevitability?
Planning and directing intelligence requirements and Collection must still deal with the fact that, in the famous words of U.S. Defence Secretary Donald Rumsfeld, ‘There are no "knowns." There are thing we know that we know. There are known unknowns. That is to say there are things that we now know we don't know. But there are also unknown unknowns. There are things we don't know we don't know’ (North Atlantic Treaty Organisation, 2002), a sentiment similar to one expressed earlier by CIA’s Sherman Kent when he stated there are ‘Things which are knowable but happen to be unknown to us, and…things which are not known to anyone at all’ (Kent, 1964). Simply put, Collection Failure can occur when necessary information, known to exist and known to be needed, is not available due to some limitation. Or it can occur because it was not even considered, dismissed or there were no indicators it was necessary to gather such information. Nonetheless, as Betts (1978: 61) states, ‘In the best-known cases of intelligence failure, the most crucial mistakes have seldom been made by collectors of raw information’.

Analysis
Station three in the Intelligence Cycle is the ‘processing’ of the collected information, followed by the fourth step of Analysis and creation of intelligence ‘products’, such as reports, findings and estimates. This is followed by the fifth step, Dissemination—distributing the intelligence product to decision-makers in a proper format in a timely manner (Johnson & Wirtz, 2008: 49).

The analysis stage begins with an evaluation of the truth of the collected material and the validity of the process which acquired it (Butler Panel, 2008: 527-8). For some forms, such as imagery and signals intelligence, this will be easy; for others, especially human intelligence (usually obtained second-hand from an informant by a case officer) it is more onerous to establish. There may be the wish of the collecting officer to have his source believed, giving rise to the need for an independent appraisal of the information (ibid.). Accuracy in reporting or quoting the information from the source to the analyst must be ensured. It must be checked that the source has actual access to the information or an acceptable explanation of how it was obtained. It must be considered if the source has some ulterior motive for providing the information or if they are involved in a counter-intelligence operation. Their previous track record must also be considered (ibid.). If the veracity of the information is not thoroughly tested and established, anything that follows may be derived from false information and will be fruit from a poison tree.

Actual Analysis of the information, after its validity has been established, involves appraising the value of the information in its own right, deciding how much weight should be assigned to it and compiling it into ‘meaningful strands’ based upon what it relates to. These ‘strands’, compiled from all available sources of related information, are then further used to develop ‘estimates’ (‘assessments’ in the UK) of a particular international situation or set of circumstances (ibid.: 528). They can be rapid, low-level appraisals or they can be the premier product composed of the collective wisdom of the entire intelligence community, as with America’s National Intelligence Estimates (Johnson, 2008: 344). The product is then disseminated and/or briefed to decision-makers in an appropriate format.

Collecting information is difficult enough; deciding what should be done in light of it and how it should be presented creates even more problems. Sherman Kent, ‘father figure of CIA analysis’, felt that estimates consist of, ‘knowledge, reasoning and guesswork’ (Johnson, 2008: 344). The pitfalls of analysing information to attempt to piece together accurate appraisals, predictions and/or advice based upon information of varying types and of contestable accuracy or value, often in a short amount of time, in order to develop an intelligence product are apparent. Estimates are used to develop national policy regarding situations vital to national security. If information, analysis or estimates are wrong or wrongly presented, the policy response will be wrong as well, with serious consequences (Gill & Phythian, 2006: 106-112).

Analysis Failure
Analysis Failure is a broader category. It includes ‘Tendency to concentrate on ‘usual suspects’ for ideological or practical purposes’ (Gill & Phythian, 2006: 104), ‘Opinion governed by “conventional wisdom” without supporting evidence’, ‘”mirror imaging”, in which unfamiliar situations are judged upon the basis of the familiar’ (Hatlebrekke & Smith, 2010: 151, citing Schmitt & Shulsky, 2002, 64-67) and the ‘Paradox of Perception’—failure to properly balance pre-conceived notions based upon previous and historical experience against an unbiased look at information and failure to balance sensitivity of warnings between insufficiency and alarmism (Betts, 1978: 62-3). It also includes failure in ‘effectively communicating with Decision-Makers’, Betts’ other entry under ‘Pathologies of Communication’ (ibid.).

In sum, Analysis Failure can be located in the Processing, Analysis and Production, or Dissemination stages of the Intelligence Cycle. Essentially, Analysis Failure occurs because information is not properly validated or it is improperly dismissed; the wrong degree of emphasis is placed on collected information; opinion developed through collected information is skewed by practical, ideological, or some other cognitive bias, or; where intelligence products do not effectively communicate the necessary information collected to Decision-Makers, either through an ineffective portrayal of the information collected or untimely dissemination to them.

Inevitability?
Writing in defence of the wrongly-concluded 1962 NIE on the likelihood of Soviet nuclear missiles being stationed on Cuba, Sherman Kent (1964) explained the process of estimates thus:

“If NIEs could be confined to statements of indisputable fact the task would be safe and easy. Of course the result could not then be called an estimate. By definition, estimating is an excursion out beyond established fact into the unknown--a venture in which the estimator gets such aid and comfort as he can from analogy, extrapolation, logic, and judgment. In the nature of things he will upon occasion end up with a conclusion which time will prove to be wrong. To recognize this as inevitable does not mean that we estimators are reconciled to our inadequacy; it only means we fully realize that we are engaged in a hazardous occupation.”

If the circumstances for which Decision-Makers require intelligence were unambiguous, then intelligence services could hand them Kent’s ‘indisputable facts’ and leave them to it. However, there are few circumstances in international politics today which possess such clarity that Decision-Makers, often elected officials with little or no security experience, can decide on their own with ‘raw intelligence’. Today the problem may be too much information, as opposed to not enough, when one considers the mass amounts of imagery and signals information collected, processed and analysed (Irwin, 2012). Intelligence analysis remains a necessity.

Schmitt and Schulsky (2002: 72) argue, ’The heart of the problem of intelligence failure, [is] the thought processes of the individual analyst.’ Attempts to counteract the human element in analysis through systemic or procedural reforms, rather than fixing these flaws, may actually serve to build overconfidence in them afterwards through a belief that the problem has been solved and won’t recur (Betts, 1978: 61). However, history shows that the same mistakes continue to be made. At bottom, intelligence analysis is still a flawed human process and will always be as flawed as the human beings conducting the analysis. So long as there are ambiguous situations requiring, as Kent (1964) puts it, ‘guesswork’, there will inevitably be Analysis Failures.
Decision-Makers

In the final step of the Intelligence Cycle, the product, having been disseminated, has been received by its ‘consumers’ and they have informed themselves of the intelligence. They may have further questions or desire more information. This leads to the development of new Requirements, leading back to the first stage of the Intelligence Cycle, which begins anew (Johnson & Wirtz, 2008: 49).

Decision-Makers, a mix of high-level elected officials, executive appointees and military officials, then actually use the intelligence produced to inform their decisions. Making decisions that are vital to protecting a nation’s security are inherently difficult, with or without accurate intelligence. Historically, intelligence failures are most frequently located with Decision-Makers (Betts, 1978: 62-3). Policymakers often make one of Johnson’s ‘seven sins of strategic intelligence’—ignoring intelligence that which does not conform to their view of a situation (Johnson, 1982: 182-4). If intelligence is misunderstood or ignored, the policy decision-makers pursue may lead to an intelligence failure.

Decision-Maker Failure
‘Decision-Maker Failure’ is the ‘subordination of Intelligence to policy’ (Schmitt & Shulsky, 2002: 64-67; Hatlebrekke & Smith, 2010: 151) and may influence the initial Planning and Direction stage of the Intelligence Cycle or be exhibited in how or if Decision-Makers use intelligence to make policy. It also occurs when pressure from Decision-Makers is brought to bear on those involved in analysis at the Processing, Analysis and Production or Dissemination stages. According to Betts (1978: 61), ‘In the best-known cases of intelligence failure, the most crucial mistakes have seldom been made by collectors of raw information, occasionally by professionals who produce finished analyses, but most often by the decision-makers who consume the products of intelligence services.’

Decision-Maker Failure often occurs as a result of ‘Politicisation’, one of the central problems of intelligence. In the words of Robert M Gates as Director of Central Intelligence (Gates, 1992):

“Politicization can manifest itself in many ways, but in each case it boils down to the same essential elements: almost all agree that it involves deliberately distorting analysis or judgments to favor a preferred line of thinking irrespective of evidence. Most consider `classic' politicization to be only that which occurs if products are forced to conform to policymakers' views. A number believe politicization also results from management pressures to define and drive certain lines of analysis and substantive viewpoints. Still others believe that changes in tone or emphasis made during the normal review or coordination process and limited means for expressing alternative viewpoints, also constitute forms of politicization."

Essentially, Decision-Maker Failure most often occurs because of some form of ‘politicisation’ by Decision-Makers where intelligence is deliberately distorted, ignored or selectively applied.

Inevitability?
According to Johnson (1983: 182), ‘No shortcoming of strategic intelligence is more often cited than the self-delusion of policymakers who brush aside-or bend-facts that fail to conform with their Weltanschauung.’ In Western democracies, Decision-Makers are either elected officials or senior civil servants influenced by elected officials. Politics is their job and it affects all aspects of it, including making security decisions based upon intelligence. Politics affects every form of government, from totalitarian dictatorships to communist collectives. As von Clausewitz is often quoted, ‘War is the continuation of politics by other means.’ Attempting to totally remove politics from war and national security is an impossible task. As stated above, Decision-Maker Failure through politicisation is the most common reason for intelligence failure. So long as politics are involved in security decisions, there will inevitably be intelligence failures.


Other Factors

Systemic Factors
Systemic Factors which may lead to intelligence failure include internal bureaucratic obstacles and failure to share information or cooperate with other agencies (Gill & Phythian, 2006: 104). Garciano and Posner (2005: 159) describe this as, ‘lack of prompt and full sharing of intelligence information within intelligence agencies, between different agencies, and between federal, state and local government levels.’ These Systemic Factors may occur at any phase of the Intelligence cycle and lie within Collection, Analysis or with Decision-Makers. If Collection resources or collected information is not shared it cannot be properly analysed and will not make its way to Decision-Makers, leading to intelligence failure.

External Factors
‘External Factors’ are always present. They include the, ‘Intrinsic difficulty in identifying targets’ and the fact that states or organisations which are or may be the target of intelligence agencies cannot be expected to remain passive to intelligence operations against them (Gill & Phythian, 2006: 104-5). Simply put, sometimes it is difficult or impossible to collect some forms of information, or, as Kent (1964) puts it, ‘Something literally unknowable by any man alive.’ Knowing the intent of an adversary before even he has formed it is an example of this impossibility. An intelligence failure for one state is often the result of an intelligence success by another. External Factors most often affect Collection, but they may also affect Analysis and Decision-Makers at any stage of the Intelligence Cycle, especially if the particular intelligence failure is the active effort of a foreign intelligence service, such as infiltration, double-agents, strategic deception or a counter-intelligence operation.

Case Study: Iraq WMD
The false belief and assertion by the U.S. and UK governments that Saddam Hussein’s Iraq possessed WMD capabilities in the lead up to the 2003 Iraq War is an instructive case which illustrates examples of each of the different causes of intelligence failure. Some of these are explored here, though there are more which could be cited.

Collection Failure
According to Morrison (2011: 520), one of the reasons for the intelligence failure relating to the existence of Iraq’s WMD capabilities was a failure to set a Requirement for Collection of political intelligence to place in context technical information on Saddam’s WMD programs. Collection was instead focused on gathering information about the existence of the programs themselves. This led to failure to consider the question in light of Saddam’s ‘political system, fears, and intentions’ (Jervis, 2006: 41). Collecting such information could have offered an explanation as to why Hussein would refuse to disavow WMD programs and cooperate with UN inspections despite not having active WMD programs. Setting this Requirement may have served to balance the dominant presumption that Iraq had WMD, the justification for the war which turned out to be false.

Analysis Failure
UK and U.S. analysis of Iraq’s WMD relied heavily upon unreliable human intelligence sources which were not properly vetted and, in some cases, have since proven to be fabrications. Information was also being quickly disseminated to policymakers without being properly validated or analysed first (Morrison, 2011: 520). In his study of the major U.S. and UK post-mortems on Iraq, Jervis (2006) cites many examples of Analysis Failure: ‘ICs’ judgments were stated with excessive certainty’ (ibid.: 14), ‘no general alternative explanations for Saddam’s behavior were offered’ (ibid.: 15), ‘lack of imagination’ to develop these alternative views (ibid.: 17), ‘failure to challenge assumptions’ regarding existence of WMD programs and a situation ‘whereby assessments were based on previous judgments without carrying forward the uncertainties’ (ibid.: 22), among others. These examples illustrate just some of the places where analysis went wrong.

Decision-Maker Failure
The case of Iraq’s WMD provides a clear example of politicisation of intelligence. The Pentagon’s Office of Special Plans (OSP) was specifically established by the Bush administration to develop assessments based upon the assumption that Iraq had WMD and its products were used in preference to other Intelligence Community assessments that contradicted that hypothesis (Ryan, 2006: 304-5). A ‘Red Team’ analysis conducted by CIA’s WINPAC, designed only as an initial ‘devil’s advocate’ view in the face of evidence Iraq did not have WMD, was also selectively used by the administration despite strong evidence from the rest of the Intelligence Community its conclusion was wrong. Assessments by agencies such as U.S. Department of Energy and the State Department’s Bureau of Intelligence Research provided strong, clear arguments against the central argument made in assessments preferred by the Bush administration, but they were pushed aside by Decision-Makers (Conway, 2012: 490-1).

Systemic Factors
Garciano and Posner (2005: 149) point out the WMD Commission’s finding that there was not enough cooperation or information sharing between agencies, specifically in regard to reports that called into question the credibility of the information by the source ‘Curveball’, whose assertion that he had been involved in active WMD programs in Iraq became a central piece of evidence in the Bush administration’s push for war. Curveball (Rashid al-Janabi) himself has since admitted his evidence was a fabrication (NBC News, 2011). If more than one agency had access to these reports, there may have been more questions asked. However, bureaucratic obstacles and security standards stood in the way. There is a lack of information sharing between U.S. intelligence and law enforcement agencies, seen to have separate functions, which may have led to vital information not being shared and considered (Cilluffo et al, 2002: 70-1).

External Factors
Saddam Hussein and his regime were not inactive players in their fate. There was a systematic denial and deception campaign by the regime and their failure to cooperate with and eventual ejection of UN inspectors supported the belief that Iraq had something to hide regarding its WMD programs. Wherever evidence was not available to prove or disprove hypotheses, Saddam and his regime could be blamed for blocking attempts to collect the necessary intelligence (Jervis, 2006: 27-8). In his debriefing by the FBI, Saddam admitted that he wanted to maintain the fa├žade of possessing WMD to counter enemies, especially Iran (Federal Bureau of Investigation, 2008). Of course, had Saddam been open regarding WMD and cooperated with UN inspections, the likelihood of war would have been greatly reduced. Intelligence is, ‘a game between hiders and finders, and the former usually have the easier job’ (Jervis, 2006: 11).

Conclusion
As Gill and Phythian (2004: 105) point out, ‘the limits of intelligence dictate that intelligence failure is inevitable. Partly, this is a consequence of the impossibility of perfect predictive success; partly it is a consequence of decision-makers’ (politicians with regard to states) natural tendency to err on the side of caution by subscribing to worst-case scenarios, or to simply ignore intelligence that does not fit their own preferences.’ As discussed, there are other locations within the Intelligence Cycle where things can go wrong and there are other possible causes and factors leading to intelligence failure. The debacle of Iraq’s WMD provides many real-world illustrations.

Jervis (2006: 11) makes clear that, ‘Any specific instance of intelligence failure will, by definition, seem unusual, but the fact of the failure itself is quite ordinary’. If the result of the failure is a great national disaster, it will seem to be a great failure. However, factual examinations of how failures occur inevitably show common, ordinary failures by people and organisations that often occur in situations outside of the intelligence context. Jervis usefully compares the Iraq WMD investigations to enquiries into the 1986 Challenger shuttle disaster and abuse allegations in the Catholic Church (ibid.: 4-5). It is only the consequences of intelligence failure that make them appear much larger than they are—the stakes are simply much higher (Betts, 1978: 62). Despite all of the post-mortems conducted on intelligence failures, there is little evidence their conclusions or the reforms enacted afterwards as a result have translated into an elimination or even significant reduction of failures (ibid.).
These human failures are impossible to ever eliminate for good, especially those of a political or cognitive nature. Intelligence failures are inevitable because they seek to make clear ambiguous, complex situations using information that may be difficult to obtain, validate and understand, either through the resistance of the target or the nature of the information itself, and then present information in a digestible manner to Decision-Makers, who may do as they wish with the intelligence produced. Even minor errors at any point in the Intelligence Cycle may throw off the entire enterprise. The fallible and flawed nature of human beings attempting to put together some unknown puzzle with an incomplete picture means mistakes will inevitably occur at some point in the process. There is an old military maxim: ‘what can go wrong, will go wrong.’ Betts (1978) and Gill and Phythian (2006: 105) believe we must accept that intelligence failures are inevitable. Indeed, given the nature of the work of intelligence and all that can go wrong, it would be more extraordinary if intelligence failures did not occur.





BIBLIOGRAPHY
Barrett, D. (2010) “Why Intelligence Failures Are (Still) Inevitable.” Diplomatic History 34 (1): pp. 207–213.

Betts, R. (1978) “Analysis, War, and Decision: Why Intelligence Failures Are Inevitable.” World Politics 31 (1): pp. 61–89.

———. (2002) “Fixing Intelligence.” Foreign Affairs 81 (1): pp.43–59.

———. (2007) “Two Faces of Intelligence Failure: September 11 and Iraq’s Missing WMD.” Political Science Quarterly 122 (4): pp. 585–606.

Butler Panel of Inquiry (2008) “The British Experience with Intelligence Failure.” In Intelligence and National Security: The Secret World of Spies, edited by Johnson, L. and Wirtz, J., 2nd ed., pp. 526–536. Oxford: Oxford University Press.

Cilluffo, F., Marks, R., and Salmoiraghi, G. (2002) “The Use and Limits of U.S. Intelligence.” Washington Quarterly 25 (1): pp. 61–74.

Conway, P. (2012) “Red Team: How the Neoconservatives Helped Cause the Iraq Intelligence Failure.” Intelligence and National Security 27 (4): pp. 488–512.

Federal Bureau of Investigation (2008) “Interviewing Saddam: FBI Agent Gets to the Truth.” Federal Bureau of Investigation – Stories. http://www.fbi.gov/news/stories/2008/january/piro012808 [Accessed 4 January 2014].

Garciano, L., and Posner, R. (2005) “Intelligence Failures: An Organizational Economics Perspective.” The Journal of Economic Perspectives 19 (4). http://www.jstor.org/stable/4134960 [Accessed 4 January 2014].

Gates, R. (1992) “Guarding Against Politicization.” Central Intelligence Agency. https://www.cia.gov/library/center-for-the-study-of-intelligence/kent-csi/volume-36-number-1/html/v36i1a01p_0001.htm [Accessed 5 January 2014].

Gill, P., and Phythian, M. (2006) “Why Does Intelligence Fail?” In Intelligence in an Insecure World, 1st ed., pp. 103–124. Cambridge: Polity.

Hatlebrekke, K., and Smith, M. (2010) “Towards a New Theory of Intelligence Failure? The Impact of Cognitive Closure and Discourse Failure.” Intelligence and National Security, 25 (2): pp. 147–182.

Irwin, S. (2012) “Too Much Information, Not Enough Intelligence.” National Defense Magazine. http://www.nationaldefensemagazine.org/archive/2012/May/Pages/TooMuchInformation,NotEnoughIntelligence.aspx [Accessed 6 January 2014].

Jackson, P., and Scott, L. (2004) “The Study of Intelligence in Theory and Practice.” Intelligence and National Security 19 (2): pp. 139–169.

Jervis, R. (2006) “Reports, Politics, and Intelligence Failures: The Case of Iraq.” Journal of Strategic Studies 29 (1): pp. 3–52.

Johnson, L. (1983) “Seven Sins of Strategic Intelligence.” World Affairs 146 (2): pp. 176–204.

———. (2008) “Glimpses into the Gems of American Intelligence: The President’s Daily Brief and the National Intelligence Estimate.” Intelligence and National Security 23 (3): pp. 333–370.

Johnson, L., and Wirtz, J. (2008) “Part II: Collection.” In Intelligence and National Security, 2nd ed., pp. 49–55. Oxford: Oxford University Press.

Kent, S. (1964) “A Crucial Estimate Relived.” Studies in Intelligence (Central Intelligence Agency). https://www.cia.gov/library/center-for-the-study-of-intelligence/kent-csi/vol8no2/html/v08i2a01p.htm [Accessed 4 January 2014].

Morrison, J. (2011) “British Intelligence Failures in Iraq.” Intelligence and National Security 26 (4). http://dx.doi.org/10.1080/02684527.2011.580604 [Accessed 6 January 2014].

NBC News (2011) “‘Curveball’: I Lied about WMD to Hasten Iraq War.” NBC News. http://www.nbcnews.com/id/41609536/ns/world_news-mideast_n_africa/t/curveball-i-lied-about-wmd-hasten-iraq-war/#.Us12Fp5_u8A [Accessed 5 January 2014].

North Atlantic Treaty Organisation (2002) “Press Conference by US Secretary of Defence, Donald Rumsfeld.” NATO HQ. http://www.nato.int/docu/speech/2002/s020606g.htm [Accessed 5 January 2014].

Renshon, J. (2009) “Assessing Capabilities in International Politics: Biased Overestimation and the Case of the Imaginary ‘Missile Gap.’” Journal of Strategic Studies 32 (1). http://dx.doi.org/10.1080/01402390802407475 [Accessed 5 January 2014].

Roman, P. (1995) “Strategic Bombers over the Missile Horizon.” Journal of Strategic Studies 18 (1): pp. 198–236.

Ryan, M. (2006) “Filling in the ‘Unknowns’: Hypothesis-Based Intelligence and the Rumsfeld Commission.” Intelligence and National Security 21 (2): pp. 286–315.

Schmitt, G., and Shulsky, A. (2002) Silent Warfare: Understanding the World of Intelligence. Washington, D.C.: Brassey’s.

Williams, R. (2011) “(Spy) Game Change: Cyber Networks, Intelligence Collection, and Covert Action.” George Washington Law Review 79 (4): pp. 1162–1200.