Skip to main content
  • Research Article
  • Open access
  • Published:

Long-term cost-effectiveness of interventions for loss of electricity/industry compared to artificial general intelligence safety

Abstract

Extreme solar storms, high-altitude electromagnetic pulses, and coordinated cyber attacks could disrupt regional/global electricity. Since electricity basically drives industry, industrial civilization could collapse without it. This could cause anthropological civilization (cities) to collapse, from which humanity might not recover, having long-term consequences. Previous work analyzed technical solutions to save nearly everyone despite industrial loss globally, including transition to animals powering farming and transportation. The present work estimates cost-effectiveness for the long-term future with a Monte Carlo (probabilistic) model. Model 1, partly based on a poll of Effective Altruism conference participants, finds a confidence that industrial loss preparation is more cost-effective than artificial general intelligence safety of ~ 88% and ~ 99+% for the 30 millionth dollar spent on industrial loss interventions and the margin now, respectively. Model 2 populated by one of the authors produces ~ 50% and ~ 99% confidence, respectively. These confidences are likely to be reduced by model and theory uncertainty, but the conclusion of industrial loss interventions being more cost-effective was robust to changing the most important 4–7 variables simultaneously to their pessimistic ends. Both cause areas save expected lives cheaply in the present generation and funding to preparation for industrial loss is particularly urgent.

Introduction

Civilization relies on a network of highly interdependent critical infrastructure (CI) to provide basic necessities (water, food, shelter, basic goods), as well as complex items (computers, cars, space shuttles) and services (the internet, cloud computing, global supply chains), henceforth referred to as industry. Electricity and the electrical infrastructure that distributes it plays an important role within industry, providing a convenient means to distribute energy able to be converted into various forms of useful work. Electricity is one component of industry albeit a critical one. Industry provides the means to sustain advanced civilization structures and the citizens that inhabit them. These structures play a critical role in realizing various futures by allowing humanity to discover and utilize new resources, adapt to various environments, and resist natural stressors.

Though industry is capable of resisting small stressors, a sufficiently large event can precipitate cascading failure of CI systems, resulting in a collapse of industry. If one does not temporally discount the value of future people, the long-term future (thousands, millions, or even billions of years) could contain an astronomically large amount of value [18]. Events capable of curtailing the potential of civilization (existential risks, such as human extinction or an unrecoverable collapse) would prevent such futures from being achieved, implying reducing the likelihood of such events is of the utmost importance [100]. Reducing the prevalence of existential risks factors; events, systemic structures, or biases which increase the likelihood of extinction but do not cause extinction by themselves is also highly valuable. Complete collapse or degraded function of industry would drastically reduce humanity’s capacity to coordinate and deploy technology to prevent existential risks, representing an existential risk factor. Consequently, interventions preventing loss of industry, reducing the magnitude of impacts, or increasing speed of recovery could be extremely valuable.

Existential risk research is, by nature, future focused, requiring the investigation of events that have not yet occurred. Futures studies methodologies are often applied to uncover salient trends or events, and explore potential causal structures [54, 123]. Probabilistic modeling techniques can then be used to determine the likelihood of such events occurring, including adequate treatment of uncertainty [101]. The cost-effectiveness modeling approach outlined in this paper is an example of this, attempting to assess the marginal utility of losing industry interventions on improving the long-term future. This approach could guide future efforts to assess the relative cost-effectiveness of interventions for different risks, existential or otherwise. More practically, this research can inform prioritization efforts of industrialized countries by providing estimates of the cost of global industrial collapse, and the utility of resilience interventions. This is relevant to the European Union which has a highly industrialized economy, providing $2.3 Trillion USD of the $13.7 Trillion USD global total of value add manufacturing [122]. The EU has shifted toward a more proactive foresight approach about natural and man-made disasters, noting the importance of rare high-impact events, systemic risks, and converging trends requiring better data and forecasting to drive a more ambitious crisis management system [47]. Still, it is clear that most academic and institutional emphasis has been on “ordinary” rather than extreme disasters, and risks from industry to the public and environment rather than widespread failures of industrial services causing harm.

The integrated nature of the electric grid, which is based on centralized generation makes the entire system vulnerable to disruption.Footnote 1 There are a number of anthropogenic and natural catastrophes that could result in regional-scale electrical grid failure, which would be expected to halt the majority of industries and machines in that area. A high-altitude electromagnetic pulse (HEMP) caused by a nuclear weapon could disable electricity over part of a continent [16, 48, 66, 93]. This could destroy the majority of electrical grid infrastructure, and as fossil fuel extraction and industry is reliant on electricity [49], industry would be disabled. Similarly, solar storms have destroyed electrical transformers connected to long transmission lines in the past [117]. The Carrington event in 1859 damaged telegraph lines, which was the only electrical infrastructure in existence at the time. It also caused Aurora Borealis that was visible in Cuba and Jamaica [70]. This could potentially disable electrical systems at high latitudes, which could represent 10% of electricity/industry globally. Though solar storms may last less than the 12 h that would be required to expose the entire earth with direct line of sight, the earth’s magnetic field lines redirect the storm to affect the opposite side of the earth [117].

Lastly, both physical [6, 8, 69, 89, 111] and cyber attacks [3, 63, 90, 96, 118, 128, 130] could also compromise electric grids. Physical attacks include traditional acts of terrorism such as bombing or sabotage [130] in addition to EMP attacks. Significant actors could scale up physical attacks, for example by using drones. A scenario could include terrorist groups hindering individual power plants [126], while a large adversary could undertake a similar operation physically to all plants and electrical grids in a region.

Unfortunately, the traditional power grid infrastructure is simply incapable of withstanding intentional physical attacks [91]. Damage to the electric grid resulting in physical attack could be long lasting, as most traditional power plants operate with large transformers that are difficult to move and source. Custom rebuilt transformers require time for replacement ranging from months and even up to years [91]. For example, a relatively mild 2013 sniper attack on California’s Pacific Gas and Electric (PG&E) substation, which injured no one directly, was able to disable 17 transformers supplying power to Silicon Valley. Repairs and improvements cost PG&E roughly $100 million and lasted about a month [10, 102]. A coordinated attack with relatively simple technology (e.g., guns) could cause a regional electricity disruption.

However, a high-tech attack could be even further widespread. The Pentagon reports spending roughly $100 million to repair cyber-related damages to the electric grid in 2009 [57]. There is also evidence that a computer virus caused an electrical outage in the Ukraine [56]. Unlike simplistic physical attacks, cyber attackers are capable of penetrating critical electric infrastructure from remote regions of the world, needing only communication pathways (e.g., the Internet or infected memory sticks) to install malware into the control systems of the electric power grid. For example, Stuxnet was a computer worm that destroyed Iranian centrifuges [73] to disable their nuclear industry. Many efforts are underway to harden the grid from such attacks [51, 63]. The U.S. Department of Homeland Security responded to ~ 200 cyber incidents in 2012 and 41% involved the electrical grid [103]. Nations routinely have made attempts to map current critical infrastructure for future navigation and control of the U.S. electrical system [57].

The electric grid in general is growing increasingly dependent upon the Internet and other network connections for data communication and monitoring systems [17, 112, 118, 127, 135]. Although this conveniently allows electrical suppliers management of systems, it increases the susceptibility of the grid to cyber-attack, through denial of webpage services to consumers, disruption to supervisory control and data acquisition (SCADA) operating systems, or sustained widespread power outages [3, 72, 118, 120]. Thus global or regional loss of the Internet could have similar implications.

A less obvious potential cause is a pandemic that disrupts global trade. Countries may ban trade for fear of the disease entering their country, but many countries are dependent on imports for the functioning of their industry. If the region over which electricity is disrupted had significant agricultural production, the catastrophe could be accompanied by a ~ 10% food production shortfall as well. It is uncertain whether countries outside the affected region would help the affected countries, do nothing, or conquer the affected countries.

Larger versions of these catastrophes could disrupt electricity/industry globally. For instance, it is possible that multiple HEMPs could be detonated around the world, due to a world nuclear war [105] or due to terrorists gaining control of nuclear weapons. There is evidence that, in the last 2000 years, two solar storms occurred that were much stronger than the Carrington event [85]. Therefore, it is possible that an extreme solar storm could disable electricity and therefore industry globally. It is conceivable that a coordinated cyber or physical attack (or a combination) on many electric grids could also disrupt industry globally. Many of the techniques to harden the electric grid could help with this vulnerability as well as moving to more distributed generation and microgrids [23, 29, 75, 76, 103, 114]. An extreme pandemic could cause enough people to not show up to work such that industrial functioning could not be maintained. Though this could be mitigated by directing military personnel to fill vacant positions, if the pandemic were severe enough, it could be rational to retreat from high human contact industrial civilization in order to limit disease mortality.

The global loss of electricity could even be self-inflicted as a way of stopping rogue artificial general intelligence (AGI) [124]. As the current high agricultural productivity depends on industry (e.g., for fertilizers), it has been assumed that there would be mass starvation in these scenarios [107].

Repairing these systems and re-establishing electrical infrastructure would be a goal of the long term and work should ideally start on it immediately after a catastrophe. However, human needs would need to be met immediately (and continually) and since there is only a few months of stored food, it would likely run out before industry is restored with the current state of preparedness. In some of the less challenging scenarios, it may be possible to continue running some machines on the fossil fuels that had previously been brought to the surface or from the use microgrids or shielded electrical systems. In addition, it may be feasible to run some machines on gasified wood [31]. However, in the worst-case scenario, all unshielded electronics would be destroyed.

The aim of this paper is to assess the relative cost-effectiveness of preventing loss of industry as compared to AGI safety research. Results will inform global and regional decision makers (government, business) in prioritization of resilience interventions for industrial collapse. AGI was selected due to being considered the greatest existential risk [100], receiving the largest amount of resources of any existential risk from philanthropic organizations associated with the existential risk communityFootnote 2 (though overall, biosecurity receives more resources) [77, 97, 132]. A favorable cost-effectiveness compared to AGI safety would make a strong case for loss of industrial civilization to be considered in the portfolio of existential risk reduction interventions. Also, the units of cost-effectiveness from the perspective of the long-term future are not intuitive, so a comparison to another cause makes the results more understandable. This paper focuses on catastrophes that only disrupt electricity/industry, rather than catastrophes that could disable industry and obscure the sun [39] or catastrophes that only obscure the sun (or affect crops directly in other ways) [33], analyzing the cost-effectiveness of interventions from a long-term perspective. First, this study will review interventions to both avoid a loss of electricity, but also to feed everyone with this loss. Then the benefits of AGI safety on the long term future will be reviewed and quantified. Next, two loss of industry interventions submodels are developed. The cost for an intervention based on alternative communication is also estimated. The development of a mathematical model also provides value by formalizing a causal structure and underlying assumptions concerning relevant phenomena, uncovering potential relations and dependencies between the two existential risks and facilitating further discourse in the literature.

Background

Review of potential solutions

An obvious intervention for HEMP is preventing a nuclear exchange, which would be the best outcome. However, it is not neglected, as it has been worked on for many decades [13, 32, 36, 37, 64, 84, 125] and is currently funded at billions of dollars per year quality adjusted [84, 85]. Other obvious interventions for HEMP that would also work for solar storms, and coordinated physical or cyber threats would be hardening the electrical grid against these threats. However, hardening just the U.S. electrical grid against solar storm and HEMP would cost roughly $20 billion [104]. Therefore globally, just from these two threats, it would be around $100 billion. Furthermore, adding hardening to cyber threats would be even more expensive. Again, preventing the collapse of electricity/industry would be the preferable option, but given the high cost, it may not happen. Even if it occurs eventually, it would still be preferable to have a backup plan in the near term and in the case that hardening is unsuccessful at stopping loss of industry.

A significant problem in loss of industry catastrophes is that of food supply [28]. One intervention is storing years worth of food, but it is too expensive to have competitive cost-effectiveness (and it would take many years so it would not protect humanity right away, and it would exacerbate current malnutrition) [15]. Furthermore, if electricity/industry is disabled for many years, food storage would be impractical. Stockpiling of industrial goods could be another intervention, but again it would be much more expensive than the interventions considered here.

Interventions for food production given the loss of industry include burning wood from landfills to provide fertilizer and high use of nitrogen fixing crops including legumes (peas, beans, peanuts, etc.) [28]. Also, nonindustrial pest control could be used. Despite pre-industrial agricultural productivity (~ 1.3 dry tons per hectare per year) [28], this could feed everyone globally. However, not everyone would be nearby the food sources, and losing industry would severely hamper transportation capability. Solutions for this problem include backup plans for producing more food locally, including expanding planted area (while minimizing impact to biodiversity, e.g., by expanding into the boreal forest/tundra enhanced by the nutrients from tree decomposition/combustion) and favoring high calorie per hectare foods such as potatoes, yams, sweet potatoes, lentils, and groundnuts [95]. Though clearing large areas of forest with hand saws would not be practical, it is possible to girdle the trees (remove a strip of bark around the circumference), let the trees dry out, and burn them. This has the advantage of releasing fertilizer to the soils. Another option involves producing “alternative foods,” which were proposed for sun-blocking catastrophes [32]. Some of these alternative foods would require industry, but producing non-industrial lower cost ones such as extracting calories from leaves [43] could be feasible. For transporting the food and other goods, ships could be modified to be wind powered and animals could pull vehicles [1]. A global network of shortwave radio transmitters and receivers would facilitate disseminating the message that there is a plan and people need not panic, and also allow for continuing coordination globally (see below).

Current awareness of interventions given loss of electricity/industry (hereafter “interventions”) is very low, likely in the thousands of people. Also, many of the interventions are theoretical only and need to be tested experimentally. There may be a significant amount of shortwave radio systems that are shielded from HEMP and have shielded backup power systems, but likely some addition to this capacity would be beneficial. This paper analyzes the cost-effectiveness of interventions from a long term perspective. It is unlikely that the loss of industry would directly cause human extinction. However, by definition, there would be a loss of industrial civilization for the global catastrophes. Furthermore, there could be a loss of anthropological civilization (basically cities or cooperation outside the clan). One definition of the collapse of civilization involves short-term focus, loss of long distance trade, widespread conflict, and collapse of government [27]. Reasons that civilization might not recover include (i) easily accessible fossil fuels and minerals are exhausted [88] (though there would be minerals in landfills), (ii) the future climate might not be as stable as it has been for the last 10,000 years [58], or (iii) technological and economic data and information might be lost permanently because of the trauma and genetic selection of the catastrophe [19]. If the loss of civilization were prolonged, a natural catastrophe, such as a super volcanic eruption or an asteroid/comet impact, could cause the extinction of humanity. Another way to far future impact is the trauma associated with the catastrophe making future catastrophes more likely, e.g., global totalitarianism [21]. A further route is worse values caused by the catastrophe could be locked in by artificial general intelligence (AGI) [20], though with the loss of industrial civilization, the advent of AGI would be significantly delayed, so the bad values could have decayed out by then.

Hypothetical scenario: severe pandemic-induced loss of industry

A severe pandemic represents a potential initial stressor capable of causing cascading failures through CI systems; these failures can be tightly dependent (< 24 h) or loosely dependent (taking days or months). As a result of the increasing number of infections from a novel pathogen, there could be a sharp decline in CI staff availability to work due to illness, fear, quarantine, or death. Over a period of weeks, electricity utilities could experience several small blackouts being unable to repair storm impacted grids components quickly. Unbalanced power supply and demand could eventually trigger power station shutoff protocols, and the power plants would not be able to be restarted due to insufficient staff, precipitating a large blackout. In turn, electricity-dependent infrastructure, such as ICT (internet, phone), water utilities, and fossil fuel (oil and gas) extraction would fail, which in turn would precipitate failure of logistics and distribution required to obtain replacement parts for the grid repair. Without preparation, people would be unable to obtain food and water in urban areas, and civil unrest and mass migrations would undermine social cohesion, reduce coordination, and cause splintering into smaller and smaller groups, precipitating the collapse of large-scale civilization (Fig. 1). (See Appendix 1 for extended qualitative case study).

Fig. 1
figure 1

Causal diagram showing how a novel virus causing a pandemic could cause failure of critical infrastructure leading to loss of industrial civilization. The stabilizing influence of two potential interventions is highlighted in green

Several potential low-cost interventions exist in the pandemic case: a government/social media/search engine message could be sent out once small power failures occurred informing citizens larger power outages are likely within 2 days and advising storing water and minimizing food consumption, for the large power outages. When a large outage occurs, a backup radio network (see Appendix 2 for details) could ascertain the magnitude of the outage (local, regional, global) and anticipate the severity of cascading effects. For severe events, e.g., a major grid failure leading to drastically reduced fuel production capacity, this network could be utilized to initiate predetermined response plans, such as relocation of urban citizens to rural areas to relieve pressure on food system logistics and provide assistance in harvesting of crops in the event fuel availability further diminishes mechanized agricultural production.

Artificial general intelligence

AGI itself represents a major, independent risk. The artificial intelligence available now is narrow AI, i.e., it can generally only do a specific task, such as playing Jeopardy! [113]. However, there are concerns that as AI systems become more advanced, AGI will eventually be achieved [20]. Since AGI could perform all human tasks as well as or better than humans, this would include reprogramming the AGI. This would enable recursive self-improvement, so there could be an intelligence explosion [55]. Since the goals of the AGI may not be aligned with human interests [20] and could be pursued with great power, this implies a potentially serious risk [55]. AGI safety is a top priority in the existential risk community that seeks to improve humanity’s long term future [125]. Though there is uncertainty in when and how AGI may be developed, there are concrete actions that can be taken now to increase the probability of a good outcome [9].

We seek to compare the cost-effectiveness of losing industry interventions with AGI safety to discover whether these interventions should also be a top priority. Comparisons to other risks, such as asteroids [83], climate change [61], and pandemics [86], are possible, though these are generally regarded by the existential risk community as lower priority and therefore less informative.

Methods

Given the large uncertainties in input parameters, cost-effectiveness was modeled using probabilistic sampling methods, producing a probability distribution of cost-effectiveness. Probabilistic uncertainty analysis is used widely in insurance, decision-support, and cost-effectiveness modeling [50]. In these models, uncertain parameters are represented by samples drawn from defined distributions that are combined into output samples that form a resultant distribution. Sampling methods used were: Monte Carlo (MC) in which N randomly selected points are independently drawn from input distributions; and Median Latin Hypercube (MLH) in which probability distributions are divided into M equiprobable intervals, independently shuffled and selected, with the median of the interval providing the sample point.

MC and MLH were selected because the probability distributions for various parameters do not come in a form that provides analytically tractable combinations. It also allows exploring parameter sensitivity.

The open source software called GuesstimateFootnote 3 was originally used to implement the models, and they are available online (Guesstimate uses MC sampling). However, to enable more powerful analysis and plotting, the models were also implemented on the software Analytica 5.2.9. Analytica combines the uncertainties in all the inputs utilizing a Median Latin Hypercube analysis (similar to Monte Carlo, but better performing [67]) with the maximum uncertainty sample of 32,000 (run time on a personal computer was seconds). The results from the two software agreed within uncertainties due to the finite number of samples, giving greater confidence in the results.

The models consist of a loss of industry submodel estimating the risk and mitigation costs of industrial loss, and an AGI risk submodel estimating risk and mitigation costs of AGI scenarios. These two submodels then allow us to estimate the ratio and confidence of cost-effectiveness.

Figures 234, and 5 illustrate the interrelationships of the nodes for model 1; model 2 is identical with the following exception. The input variable mitigation of far future impact of industrial loss from ALLFED so far for 10% industrial loss node was removed from model 1 due to the poll question not requiring this input.

Fig. 2
figure 2

Model overview

Fig. 3
figure 3

Global industry loss submodel (10% industry loss is nearly identical)

Fig. 4
figure 4

AGI safety cost-effectiveness submodel

Fig. 5
figure 5

Overall cost-effectiveness ratios

Loss of industry interventions submodel

Table 1 shows the key input parameters for model 1 (largely Denkenberger and conference poll of effective altruists) [40] and model 2 [38]) (Sandberg inputs).3 Though the authors here are associated with research on loss of industry, two out of four also published in AGI safety. Also, opinions outside of the loss of industry field have been solicited for one of the models. Therefore, we believe the results are representative. All distributions are lognormal unless otherwise indicated. The absolute value of the long term future is very difficult to quantify, so losses are expressed as a percent.

Table 1 Losing industry interventions input variables

The potential causes of the disabling of 1/10 of global industry include Carrington-type solar storm, single HEMP, coordinated physical or cyber attack, conventional world war, loss of the Internet, and pandemic disrupting trade. We are not aware of quantitative estimates of the probability of a coordinated cyber attack, loss of the Internet, a pandemic that significantly disrupts trade, or a conventional world war that destroys significant industry and does not escalate to the use of nuclear weapons. Quantitative model estimates of the probability of full-scale nuclear war between the USA and Russia such as [13]) may give some indication of the probability of HEMP. HEMP could accompany nuclear weapons destroying cities, and this would be a combination losing industry/losing the sun scenario, which would benefit from the preparation considered here. Asymmetric warfare, where one country is significantly less powerful than another, could use HEMP because it only requires one or two nuclear weapons to disable an entire country. There are significantly more nuclear pairs that could result in HEMP than could result in full-scale nuclear war (the latter is basically the dyads between USA, Russia, and China). And yet one quantitative model estimate of the probability of full-scale nuclear war only between the USA and Russia was 1.7% per year (mean) [13]. In 2012, there was a near miss of a solar storm similar size to the Carrington event [11]. One probability estimate of a Carrington-sized event is ~ 0.033% per year [109]. However, an estimate of the probability per year of a superflare 20 times as powerful as the Carrington event is 0.1%/year [79], which disagrees by orders of magnitude for the same intensity. Another study proposes that a Carrington-sized event recurrence interval is less than one century [62]. Given the large uncertainty of solar storms and significant probability of single EMP, pandemic, and regional cyber attack, model 1 uses a mean of 3% per year. Model 2 uses a mean of 0.4% per year.

Intuitively, one would expect that the probability of near-total loss of industry would be significantly lower than 10% loss of industry. Complete loss of industry may correspond to the superflares that may have occurred in the first millennium A.D. (~ 0.1% per year). We are not aware of quantitative estimates of the probability of multiple EMP, industry-halting pandemic, or global cyber attack. Model 1 mean is 0.3% per year for near-total loss of industry. Model 2 mean is 0.09% per year.

At the Effective Altruism Global 2018 San Francisco conference, with significant representation of people with knowledge of existential risk, a presentation was given and the audience was asked about the 100% loss of industry catastrophes. The questions involved the reduction in far future potential due to the catastrophes with current preparation and if ~ $30 million were spent to get prepared. The poll questions and results are available in Table 6 (Appendix 3). The data from the poll was used directly instead of constructing continuous distributions for input nodes. The n responses per probability range were converted to point values equal to the geometric mean (rounded to one significant figure) of the probability range to create a list of values for each input node, which was randomly drawn from each run.

To determine the marginal impact of additional funding, the contribution due to work so far should be quantified. The Alliance to Feed the Earth in Disasters (ALLFED) [4] (and ALLFED researchers before the organization was officially formed) have published several papers on interventions for losing industry. They have a website with these papers and summaries. They have also run workshops to investigate planning for these interventions. However, we expect the contribution of ALLFED to reducing the long term impact of loss of industry to be significantly lower than in the case of obscuring of the sun because the loss of the Internet may be immediate if there are multiple simultaneous EMPs. However, the loss of electricity may not be simultaneous globally due to cyber-attack. Furthermore, there may be several days warning for an extreme solar storm. The other reason why current work may be less valuable in a global loss of industry scenario is that fewer people know about the loss of industry work of ALLFED than the food without the sun work. Model 1 estimates a reduction in long-term future potential loss from a global loss of industry due to ALLFED so far as a mean of 0.1%. Model 2 uses 0.004% due to emphasizing lack of communication scenarios.

In the case of a 10% loss of industry, with the exception of the scenario of loss of Internet everywhere, the Internet in most places would be functioning. Even if the Internet is not functioning, mass media would generally be functioning. Therefore, possible mechanisms for impact due to work so far include the people already aware of the interventions getting the message to decision makers/media in a catastrophe, decision makers finding the three papers [1, 39, 28] on these interventions, or the people in the media who know about these interventions spreading the message. However, even though people outside of the affected countries could get the information, it may not be feasible to get the information to the people who need it most. Model 2 estimates a reduction in long-term future potential loss from a global loss of industry due to ALLFED so far as a mean of 0.004%, again due to the likely lack of communications in the affected region. Model 1 does not use a value in its calculation.

The mean estimate of the conference participants was 16% reduction in the long-term future of humanity due to loss of global industry with current preparedness. Model 2 estimate mean was 7%.

The 10% industry loss catastrophes could result in instability and full scale nuclear war or other routes to far future impact. Though the poll was not taken for this level of catastrophe, a survey of GCR researchers estimated a mean of 13% reduction in long-term potential of humanity due to a 10% food shortfall [42]. Confidence in estimates solicited in the survey were not incorporated into the model (relevant survey question and responses are attached as Appendix 4). Some 10% loss of industry catastrophes could cause a ~ 10% global food shortfall. However, if the affected area were largely developed countries, since they would likely need to become near vegan to survive, human-edible food demand could fall 10% because of the reduction of feeding animals. Still, given the possible overlap of these catastrophes, this analysis uses the survey estimate for model 1. Model 2 estimate mean is 0.4% reduction in long-term potential due to 10% loss of industry.

The means of the percent further reduction in far future loss due to global loss of industry due to spending ~ $30 million were 40% for the poll and 3% for model 2. Note that in model 1, the poll did not ask for the further reduction in far future loss from spending money, but instead a new far future loss after the money was spent. Therefore, the 40% mean further reduction is a calculated value and does not appear in Table 1. For the 10% industrial shortfalls, our estimate of the mean reduction is 12% for model 1 because the contribution of additional spending on the aid from outside the affected region would be smaller. On the other hand, it was 5% for model 2 because he thought the likelihood of success would be greater than for the global loss of industry given the outside aid.

Moral hazard would occur if awareness of interventions makes catastrophes more likely or more intense. Global use of EMP or coordinated cyber attack could be perpetrated by a terrorist organization trying to destroy civilization. However, if the organization knew of backup plans that could maintain civilization, the terrorist might actually be deterred from attempting such an attack. This would result in negative moral hazard (additional benefit of preparation). However, it is possible that knowledge of a backup plan could result in people expending less effort to harden systems to EMP, solar storm, or cyber attack, creating moral hazard. Therefore, model 1 uses a mean moral hazard of zero, and model 2 uses a point value of zero.

For the 10% loss of industry scenarios, the same moral hazard values are used as for the global loss of industry.

Costs of interventions

The costs of the proposed interventions are made up of a backup communication system, developing instructions, and testing them for distributed food production, and making response plans at different levels of governments.

Currently, the long distance shortwave radio frequencies are used by government and military stations, ships at sea, and by amateur (ham) radio operators. Because of security considerations, data on the number of government/military stations is difficult to compile. The use by ships has declined because of the availability of low cost satellite phones but there are an estimated three million ham operators worldwide [115]. Not all of those are licensed to use the shortwave bands, however. In the USA, about half of the approximately 800,000 American ham operators do hold the necessary license. Assuming such a pattern worldwide that would mean potentially about 1.5 million ham radio shortwave stations globally.

However, this analysis conservatively ignores the possibility that there would be existing ham radios that are disconnected with unplugged backup power systems. Therefore, the cost of the backup communication system of 5 million USD is based on the cost of 10 larger two-way shortwave communication systems (with backup power) that can transmit across oceans (see Appendix 2). Then there would be 4000 smaller one-way shortwave receivers (with backup power) that, when connected to a laptop computer and printer, would have the ability to print out information. This could be called REtaining Civilization Using Radio (RECUR). This would cover 80% of the world’s population within 1 day nonmotorized transportation distance (~ 40 km) according to geographical information systems (GIS) analysis (Fist et al., unpublished results). It is critical to very quickly get the message out that there is a plan and not to panic. Subsequent communication would be instructions for meeting basic needs immediately like food, shelter, and water. This initial planning would be considered open-loop control because it would not have immediate feedback [80].

In the ensuing months, as reality always deviates from plans, feedback would be required. This could be accomplished by coordinating additional undamaged shortwave and electrical generation equipment to allow two-way communication for many cities. Also, depending on distance, some messages could be communicated through non-electronic means such as horses, smoke signals, and sun reflecting heliographs of the kind that were used in the Western USA before telegraphs [108, 119].

Instructions would include how to get safe water or treat it (e.g., by filling containers including cleaned bathtubs with water in water towers and treating with bleach for a limited amount of time, solar water pasteurization [22], or boiling. Additional instructions would be on how to keep warm if it is cold outside [1]. Other instructions would be how to retrofit a light duty vehicle to be pulled by a large animal. Because cattle and horses can eat food that is not edible to humans and because the wheel is so efficient, this would be a much more effective way of moving people than people walking. Additional instructions would be how to create wood-burning stoves and hand and animal farming tools, e.g., from repurposed or landfill materials. A similar project is Open Source Ecology, where blueprints have been developed of essential equipment for civilization that can be made from scratch [98]. All of this should be tested on realistically untrained people and the instructions should be modified accordingly.

Planning involves determining where different people would need to be relocated in order to have their basic needs met. The critical short-term factors are shelter and water, while food is slightly longer term. The economically optimal plan could be achieved with GIS analysis. However, in order for this to be politically feasible, there would need to be negotiations and precommitments. This may have similar cost to the government planning for food without the sun of $1 million to $30 million [34].

Overall, model 1 estimates the communications, instructions/testing, and planning for global industry loss would cost roughly 30 million USD (see Table 1). For the regional loss of industry, it is difficult to predict where it might occur, so generally communications and planning should be done for the entire world, and thus the instructions/experiments would be similar. Therefore, there is a high correlation of preparation for the two catastrophes, so this is assumed to be the cost of the preparation to both scales of catastrophe. Model 2 has somewhat higher costs ($50 million mean).

The time horizon of effectiveness of the interventions would depend on the intervention. Modern shortwave radio communications equipment has few moving parts (chiefly cooling fans and motors to rotate directional antennas) and serviceability measured in decades.Footnote 4

Furthermore, these systems need to be disconnected from the grid to be protected from HEMP. This would reduce wear and tear, but regular testing would be prudent. Some of the budget could be used for this and for repair of the units. As for the instructions, since the hand and animal tools are not changing, directions should stay relevant. Planning within governments is susceptible to turnover, but some money could be used to transfer the knowledge to new employees. Model 1 estimates a 25 year mean for the time horizon. Model 2 has a slightly shorter time horizon mean of 20 years driven by a conservative estimate of the communications equipment lifetime.

Artificial intelligence submodel

The submodel for AGI safety cost-effectiveness was based on work of the Oxford Prioritization Project, Owen Cotton-Barratt and Daniel Dewey (both while at the Future of Humanity Institute at the University of Oxford) [41, 78]. We modified it with major changes including increasing the cost of an AGI safety researcher, making better behaved distributions, removing one method of calculation, and changing the analysis from average to marginal for the number of researchers. These changes increased the cost-effectiveness of AGI safety by roughly a factor of two and increased the uncertainty considerably (because the method of calculation retained had much greater uncertainty than the one removed). The cost-effectiveness was found at the margin assuming $3 billion expenditure.

Results and discussion

Results

In order to convert average cost-effectiveness to marginal for interventions, we use logarithmic returns [30], which results in the relative marginal cost-effectiveness being one divided by the cumulative money spent. An estimate is needed of the cumulative money spent so far for interventions. Under $100,000 equivalent (mostly volunteer time) has been spent so far directly on this effort, nearly all by ALLFED. A very large amount of money has been spent on trying to prevent nuclear war, hardening military installations to HEMP, and on cyber security. However, note that even though US military infrastructure is supposedly hardened to EMP, it may not be able to withstand a “super” EMP weapon that some countries may possess [105] or sophisticated cyber attacks. More relevant, money has been spent on farming organically and less industrially for traditional sustainability reasons. Also, Open Source Ecology has developed instructions for critical equipment. These could be tens of millions of dollars that would have needed to be spent for catastrophe preparation. So this would be relevant for the marginal $30 million case. However, there are still very high value interventions that should be done first, such as collecting instructions for producing hand/animal farm tools without industry and giving them to at least some governments and owners of disconnected shortwave radios and backup power sources. Though the interventions would not work as well as with ~ $30 million of research/communications backup, simply having some critical people know about them and implement them in their own communities/countries without trade could still significantly increase the chance of retaining anthropological civilization. The cost of these first interventions would be very low, so they would have very high cost-effectiveness.

Table 2 shows the ranges of the far future potential increase per $ due to loss of industry preparation average over ~ $30 for million model 1, average over ~ $50 million for model 2, and AGI safety research at the $3 billion margin. The distributions are shown in Fig. 6. The ratios of the 95th and 5th percentiles of model 1, model 2, and AGI safety are 8000, 80, and 600, respectively. Because the variance of model 1 is very high, the mean cost-effectiveness is high, partly driven by the small probability of very high cost-effectiveness.

Table 2 Cost-effectiveness comparison
Fig. 6
figure 6

Far future potential increase per $ due to loss of industry preparation average over ~ $30 million model 1, due to loss of industry preparation average over ~ $50 million model 2, and AGI safety research at the $3 billion margin. Further to the right is more cost-effective

With logarithmic returns, cost-effectiveness of the marginal dollar now (100,000th dollar) and of the last dollar are about 50 times greater than, and 6 times less than, the average cost-effectiveness of spending $30 million, respectively. For model 2, the corresponding numbers are about 70 times greater than and 6 times less than the average cost-effectiveness of spending $50 million. Ratios of mean of the distributions of cost-effectiveness are reported in Table 3.Footnote 5 Comparing to AGI safety at the margin, model 1 yields the 30 millionth dollar on losing industry being 20 times more cost-effective, the average $30 million on interventions being 100 times more cost-effective, and the marginal dollar now on interventions being 5000 times more cost-effective (Table 3). Model 2 yields the last dollar on interventions being 0.05 times as cost-effective, the average ~ $50 million on interventions being 0.2 times as cost-effective, and the marginal dollar now on interventions being 20 times as cost-effective. Given orders of magnitude uncertainty and sensitivity of these ratios to the relative uncertainty of the interventions, likely more robust are the probabilities that one is more cost-effective than the other. Comparing to AGI safety at the margin, model 1 finds ~ 88% probability that the 30 millionth dollar on interventions is more cost-effective, ~ 95% probability that the average $30 million on interventions is more cost-effective, and ~ 99+% probability that the marginal dollar now on interventions is more cost-effective (see Table 3). Model 2 finds ~ 50% probability that the 50 millionth dollar on interventions is more cost-effective than AGI safety, ~ 76% probability that the average $50 million on interventions is more cost-effective, and ~ 99% probability that the marginal dollar now on interventions is more cost-effective. Note that the greater than 50% probability for the average cost effectiveness despite the ratio of the means of cost-effectiveness being less than one is due to the relatively smaller variance of model 2 cost-effectiveness estimate (see Fig. 6).

Table 3 Key cost-effectiveness outputs of losing industry interventions

Overall, the mean cost-effectiveness of model 1 is about 2.5 orders of magnitude higher than model 2. However, due to the smaller variance in model 2 distributions, there was similar confidence that losing industry interventions at the margin now are more cost-effective than AGI safety. Another large difference is that model 1 found that 10% loss of industry scenarios are similar cost-effectiveness for the far future as global loss. This was because the greater probability of these catastrophes counteracted the smaller far future impact. However, model 2 rated the cost-effectiveness of the 10% industry loss as ~ 1.5 orders of magnitude lower than for global loss. Given the agreement of high confidence that further work is justified at this point, some of this further work could be used to resolve the significant uncertainties to determine if more money is justified: value of information [12].

Being prepared for loss of industry might protect against unknown risks, meaning the cost-effectiveness would increase.

According to model 1, every year acceleration in preparation for losing industry would increase the long-term value of humanity by 0.00009% to 0.4% (mean of 0.07%). The corresponding model 2 numbers are 0.00006% to 0.0004% (mean of 0.00017%). Either way, there is great urgency to get prepared.

It is not necessary for interventions to be more cost-effective than AGI safety in order to fund losing industry interventions on a large scale. Funding in the existential risk community goes to other causes, e.g., an engineered pandemic. One estimate of cost effectiveness of biosecurity was much lower than for AGI safety and losing industry interventions, but the authors were being very conservative [86]. Another area of existential risk that has received investment is asteroid impact, which again has much lower cost-effectiveness than for losing industry interventions [83].

The importance, tractability, neglectedness (ITN) framework [45] is useful for prioritizing cause areas. The importance is the expected impact on the long-term future of the risk. Tractability measures the ease of making progress. Neglectedness quantifies how much effort is being directed toward reducing the risk. Unfortunately, this framework cannot be applied to interventions straightforwardly. This is because addressing a risk could have many potential interventions. Nevertheless, some semi-quantitative insights can be gleaned. The importance of AGI is larger than industry loss catastrophes, but industry loss interventions are far more neglected.

Though these interventions for the loss of industry are not compared directly to food without the sun interventions, they are both compared to the same AGI safety submodel. Overall, model 2 indicates that spending $50 million on interventions for the loss of industry is competitive with AGI safety. However, model 1 here and both models for the food without sun indicate that significantly larger than the proposed amount to be spent (~ $100 million) would be justified from the long-term future perspective.

The AGI safety submodel was used to estimate the cost-effectiveness of saving expected lives in the present generation, finding $16–$12,000 per expected life saved (Author et al., unpublished results). This is generally more cost-effective than GiveWell estimates for global health interventions: $900–$7000 [52]. Food without the sun is significantly better ($0.20–$400 per expected life) for only 10% global food production shortfalls [34] and generally better only considering one country ($1–$20,000 per expected life) and only nuclear winter [34]. Model 2 for interventions for losing industry has similar long-term future cost-effectiveness to AGI safety, indicating that the lifesaving cost-effectiveness of interventions for losing industry would likely be competitive with AGI safety and global health, but this requires future work. Model 1 for interventions for losing industry has similar long-term future cost-effectiveness to food without the sun, indicating that loss of industry preparations may save lives in the present generation less expensively than AGI safety and global health. Since AGI safety appears to be underfunded from the present generation perspective, it would be extremely underfunded when taking into account future generations. If this were corrected, then in order for interventions for losing industry to stay similar cost-effectiveness to AGI safety, more funding for losing industry interventions would be justified.

Timing of funding

If one agrees that interventions for losing industry should be a significant part of the existential risk reduction portfolio, there remains the question of how to allocate funding to the different causes over time. For AGI safety, there are arguments both for funding later and funding now [99]. For interventions for losing industry, since most of the catastrophes could happen right away, there is significantly greater urgency to fund interventions for losing industry now. Furthermore, it is relatively more effective to scale up the funding quickly because, through requests for proposals, the effort could co-opt relevant existing expertise (e.g., in shortwave radio). Since we have not monetized the value of the far future, we cannot use conventional cost-effectiveness metrics such as the benefit to cost ratio, net present value, payback time, and return on investment. However, in the case of saving expected lives in the present generation for the global case and 10% food shortfalls, the return on investment was from 100 to 5,000,000% per year [34] based on monetized life savings. This suggests that the $40 million or so for interventions for losing industry should be mostly spent in the next few years to optimally reduce existential risk (a smaller amount would maintain preparedness into the future).

Uncertainty and parameter sensitivity

Parameter sensitivities of model 1 and model 2 were investigated using the Analytica importance analysis function. This uses the absolute rank-order correlation between each input and the output as a measure of the strength of monotonic relations between each uncertain input and a selected output, both linear and otherwise [25, 87]. Analysis was focused on the loss of industry submodels, i.e., global loss of industry and 10% industry loss. Parameter sensitivity within AGI safety was not investigated as this submodel was adapted from previous work by the Oxford Prioritization Project, which discussed uncertainties within the AGI safety cost effectiveness submodel ([41, 78]).

The key outputs nodes in Table 3 were unable to be investigated directly using the importance analysis function due to the node outputs being point values, a result of calculating the confidence or ratio of means (the Analytica importance analysis function requires the variable be a chance variable to perform absolute rank-order correlation). Therefore, the previous node in the models’ far future potential increase per $ overall was used to investigate the importance of input variables of the alternate foods submodel.

Importance analysis of node: far future potential increase per $ due to loss of industry preparation showed model 1 had greatest sensitivity to input variables reduction in far future potential due to 10% industrial loss with current preparation closely followed by reduction in far future potential due to global loss of industry with current preparation (Fig. 7). Model 2 showed greatest sensitivity to input variable cost of interventions ($ million) (global loss of industry) (Fig. 7).

Fig. 7
figure 7

Importance analysis results for Far future potential increase per $ due to loss of industry preparation for model 1 and model 2

Successive rounds of parametric analysis were performed to determine combinations of input parameters sufficiently unfavorable to losing industry interventions, until cost-effectiveness ratios (Table 3) switched to favoring AGI safety. Unfavorable input values were limited to 5th or 95th percentile values of original input distributions. Model 1 required 7 unfavorable input parameters to switch to AGI safety being more cost-effective than losing industry interventions at the margin now while model 2 required 4 input variables (see Table 4).

Table 4 Combination of input variables resulting in AGI safety being more cost effective than losing industry interventions at the margin now

A robustness analysis was not performed for the confidence values of one type of intervention being likely to be more cost-effective than the other. This would be less sensitive to the variance in the distributions than the ratios of the mean cost-effectiveness. Since the variance in model 1 is so large, it would require fewer variables to be made pessimistic in order for it to be less than 50% confident that it is more cost-effective than AGI safety (than the number of variables required for the ratio of the means in Table 4). Conversely, since the variance in model 2 is smaller than for AGI safety, it would require fewer variables to be made pessimistic in order for it to be less than 50% confident that it is more cost-effective than AGI safety.

Conclusions and future work

There are a number of existential risks that have the potential to reduce the long-term potential of humanity. These include AGI and electricity/industry disrupting catastrophes including extreme solar storm, EMP, and coordinated cyber attack. Here, we present the first long-term future cost-effectiveness analyses for interventions for losing industry. There is great uncertainty in both AGI safety and interventions for losing industry. However, the models have 99–99+% confidence that funding interventions for losing industry now is more cost effective than additional funding for AGI safety beyond the expected $3 billion. In order to make AGI safety more cost effective than losing industry interventions according to the mean of their distributions, this required changing four variables in model 2 to the 5th percentile on the pessimistic end simultaneously. For model 1, it required changing seven variables. Therefore, it is quite robust that a significant amount of money should be invested in losing industry interventions now. There is closer to 50–88% confidence that spending the ~ $40 million on interventions for losing industry is more cost effective than AGI safety. These interventions address catastrophes that have significant likelihood of occurring in the next decade, so funding is particularly urgent. Both AGI safety and interventions for losing industry save expected lives in the present generation more cheaply than global poverty interventions, so funding should increase for both. The cost-effectiveness at the margin of interventions for the loss of industry is similar to that for food without the sun (for industry versus sun, model 1 is ~ 1 order of magnitude more cost effective, but model 2 is ~ 1 order of magnitude less cost effective). Because the electricity/industry catastrophes could happen immediately and because existing expertise relevant to food without industry could be co-opted by charitable giving, it is likely optimal to spend most of this money in the next few years.

Since there may be scenarios of people eating primarily one food, micronutrient sufficiency should be checked, though it would be less of an issue than for food without the sun [35, 59]. Higher priority future research includes ascertaining the number and distribution of unplugged shortwave radio systems with unplugged power systems that could be utilized in a catastrophe. Additional research includes the feasibility of the continuation of improved crop varieties despite loss of industry. Further research is estimating the rapidity of scale up of hand and animal powered farm tools. Estimating the efficacy of pest control without industry would be valuable. Better quantifying the capability of using fertilizer based on ash would be aided by GIS analysis. Additional work is surveying whether there have been experiments of the agricultural productivity produced by people inexperienced in farming by hand.

Another piece of future work would be to analyze the cost-effectiveness of AGI safety and preparation for the loss of industry in terms of species saved. Rogue AGI could cause the extinction of nearly all life on earth. If there were mass starvation due to the loss of electricity/industry, humans would likely eat many species to extinction. Therefore, being able to meet human needs would save species. These cost effectiveness could be compared to the cost effectiveness of conventional methods of saving species. Finally, additional future work involves better quantifying the cost of preparedness to the loss of industry. Furthermore, research for the actual preparedness should be done, including estimating the amount of unplugged communications hardware and backup power, testing the backup communications system, experiments demonstrating the capability to quickly construct hand/animal farm tools and developing quick training to use them. Also investigating alternative food sources that do not require industry would be beneficial, such as seaweed.

Availability of data and materials

Guesstimate models can be accessed via links available in the reference section of the manuscript. Analytica models are available from the corresponding author on reasonable request.

Notes

  1. This vulnerability can be addressed with distributed generation and microgrids (S. M [7, 65, 103, 136]), but these technologies are still far from ubiquitous.

  2. Between 2015 and 2021 Open Philanthropy’s grantmaking to the “Potential Risks from Advanced Artificial Intelligence” cause area comes to a total of $156,488,525 USD, as compared to $92,634,721 USD granted to “Biosecurity and Pandemic Preparedness” [97].

  3. One can change numbers in viewing mode to see how outputs change, but alterations will not save. If one wants to save a new version, one can make a copy of the model. Click View, visible to show arrows of relationships between cells. Drag mouse over cells to see comments. Click on the cell to show the equation.

  4. On any given day, Ebay lists numerous used shortwave radio transmitter/receivers still in fully operational condition, some of them manufactured in the 1960s.

  5. Ratios of means require manual changes in Guesstimate, which we note in all caps in the model.

  6. COVID - 19 significantly decreased global trade in 2020 [129].

References

  1. Abdelkhaliq M, Denkenberger D, Griswold M, Cole D, Pearce J (2016) Providing Non-food Needs if Industry is Disabled. hal-02113489

  2. Adegun O (2014) The effects of Ebola virus on the economy of West Africa through the trade channel. IOSR J Hum Soc Sci 19(10):48–56. https://doi.org/10.9790/0837-191044856

  3. Aitel D (2013) Cybersecurity Essentials for Electric Operators. Electricity J 26(1):52–58. https://doi.org/10.1016/j.tej.2012.11.014

    Article  Google Scholar 

  4. ALLFED. (2019). Home. Retrieved April 10, 2019, from ALLFED website: http://allfed.info/

    Google Scholar 

  5. Alouche J (2015) Ebola and extractive industry. Institute of Development Studies

  6. Amin M (2002) Security challenges for the electricity infrastructure. Computer 35(4):supl8–supl10. https://doi.org/10.1109/MC.2002.1012423

    Article  Google Scholar 

  7. Amin SM (2010) Electricity infrastructure security: toward reliable, resilient and secure cyber-physical power and energy systems. IEEE PES General Meeting. IEEE, pp 1–5

  8. Amin M (2005) Energy infrastructure defense systems. Proc IEEE 93(5):861–875. https://doi.org/10.1109/JPROC.2005.847257

    Article  Google Scholar 

  9. Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016). Concrete Problems in AI Safety. ArXiv:1606.06565 [Cs]. Retrieved from http://arxiv.org/abs/1606.06565

    Google Scholar 

  10. Avalos G (2014) PG&E substation in San Jose that suffered a sniper attack has a new security breach. Retrieved August 8, 2019, from The Mercury News website: https://www.mercurynews.com/2014/08/27/pge-substation-in-san-jose-that-suffered-a-sniper-attack-has-a-new-security-breach/

  11. Baker DN, Li X, Pulkkinen A, Ngwira CM, Mays ML, Galvin AB, Simunac KDC (2013) A major solar eruptive event in July 2012: Defining extreme space weather scenarios. Space Weather 11(10):585–591. https://doi.org/10.1002/swe.20097

    Article  Google Scholar 

  12. Barrett, A. M. (2017). Value of GCR Information: Cost Effectiveness-Based Approach for Global Catastrophic Risk (GCR) Reduction. Forthcoming in Decision Analysis.

    Google Scholar 

  13. Barrett AM, Baum SD, Hostetler KR (2013) Analyzing and reducing the risks of inadvertent nuclear war between the United States and Russia. Sci Glob Secur. 21(2):106–133. https://doi.org/10.1080/08929882.2013.798984

    Article  Google Scholar 

  14. Bar-Yam, Yaneer. 2016. Transition to extinction: pandemics in a connected world. New England Complex Systems Institute.

  15. Baum SD, Denkenberger DC, Pearce JM (2016) Alternative Foods as a Solution to Global Food Supply Catastrophes. Solutions

  16. Bernstein A, Bienstock D, Hay D, Uzunoglu M, Zussman G (2012) Sensitivity analysis of the power grid vulnerability to large-scale cascading failures. ACM SIGMETRICS Performance Eval Rev 40(3):33–37. https://doi.org/10.1145/2425248.2425256

    Article  Google Scholar 

  17. Bessani AN, Sousa P, Correia M, Neves NF, Verissimo P (2008) The CRUTIAL way of critical infrastructure protection. IEEE Secur Privacy 6(6):44–51. https://doi.org/10.1109/MSP.2008.158

    Article  Google Scholar 

  18. Bostrom N (2003) Astronomical Waste: The Opportunity Cost of Delayed Technological Development. Utilitas 15(3):308–314. https://doi.org/10.1017/S0953820800004076

    Article  Google Scholar 

  19. Bostrom N (2013) Existential Risk Prevention as Global Priority. Glob Policy 4(1):15–31. https://doi.org/10.1111/1758-5899.12002

    Article  Google Scholar 

  20. Bostrom N (2014) Superintelligence: paths, dangers, strategies, 1st edn. Oxford University Press, Oxford

    Google Scholar 

  21. Bostrom N, Cirkovic MM (2008) Global catastrophic risks. Oxford University Press, New York

    Book  Google Scholar 

  22. Burch JD, Thomas KE (1998) Water disinfection for developing countries and potential for solar thermal pasteurization. Solar Energy 64(1-3):87–97. https://doi.org/10.1016/S0038-092X(98)00036-X

    Article  Google Scholar 

  23. Che, L., & Shahidehpour, M. (2014). DC microgrids: economic operation and enhancement of resilience by hierarchical control. IEEE Transact Smart Grid, 5(5), 2517–2526.

    Article  Google Scholar 

  24. Chekani-azar S, Mombeni EG, Birhan M, Yousefi M (2020) CRISPR/Cas9 gene editing technology and its application to the coronavirus disease (COVID-19), a review. 10:1–9. https://doi.org/10.36380/scil.2020.jlsb1

  25. Chrisman L, Henrion M, Morgan R, Arnold B, Brunton F, Esztergar A, Harlan J (2007) Analytica user guide. Lumina Decision Systems, Los Gatos

    Google Scholar 

  26. Cirillo P, Taleb NN (2020) Tail Risk of Contagious Diseases. Nat Phys 16(6):606–613. https://doi.org/10.1038/s41567-020-0921-x

    Article  Google Scholar 

  27. Coates JF (2009) Risks and threats to civilization, humankind, and the earth. Futures 41(10):694–705. https://doi.org/10.1016/j.futures.2009.07.010

    Article  Google Scholar 

  28. Cole DD, Denkenberger D, Griswold M, Abdelkhaliq M, Pearce J (2016) Feeding Everyone if Industry is Disabled. Proceedings of the 6th International Disaster and Risk Conference. Presented at the 6th International Disaster and Risk Conference, Davos, Switzerland. hal-02113486

  29. Colson C, Nehrir M, Gunderson R (2011) Distributed multi-agent microgrids: a decentralized approach to resilient power system self-healing. IEEE, pp 83–88

  30. Cotton-Barratt O (2014) The law of logarithmic returns. Retrieved April 10, 2019, from The Future of Humanity Institute website: http://www.fhi.ox.ac.uk/law-of-logarithmic-returns/

  31. Dartnell L (2014) the knowledge: how to rebuild our world from scratch. Random House

  32. Denkenberger D, Pearce JM (2014) Feeding Everyone No Matter What: Managing Food Security After Global Catastrophe. Academic Press.

  33. Denkenberger DC, Pearce JM (2015) Feeding everyone: Solving the food crisis in event of global catastrophes that kill crops or obscure the sun. Futures 72:57–68

  34. Denkenberger DC, Pearce JM (2016) Cost-Effectiveness of Interventions for Alternate Food to Address Agricultural Catastrophes Globally. Int J Disaster Risk Sci 7(3):205–215. https://doi.org/10.1007/s13753-016-0097-2

    Article  Google Scholar 

  35. Denkenberger D, Pearce J (2018) Micronutrient availability in alternative foods during agricultural catastrophes. Agriculture 8(11):169

    Article  Google Scholar 

  36. Denkenberger D, Pearce J (2018) Design optimization of polymer heat exchanger for automated household-scale solar water pasteurizer. Designs 2(2):11.&nbsp;https://doi.org/10.3390/designs2020011

  37. Denkenberger DC, Pearce JM (2018) A National Pragmatic Safety Limit for Nuclear Weapon Quantities. Safety 4(2):25. https://doi.org/10.3390/safety4020025

  38. Denkenberger D, Sandberg A, Cotton-Barratt O, Dewey D, Li S (2019) Foods without industry and AI X risk cost effectiveness general far future impact publication. Retrieved August 10, 2019, from Guesstimate website: https://www.getguesstimate.com/models/11703

  39. Denkenberger DC, Cole DD, Abdelkhaliq M, Griswold M, Hundley AB, Pearce JM (2017) Feeding everyone if the sun is obscured and industry is disabled. Int J Disaster Risk Reduction 21:284–290

    Article  Google Scholar 

  40. Denkenberger D, Cotton-Barrat O, Dewey D, Li S (2019) Foods without industry and AI X risk cost effectiveness general far future impact Denkenberger. Retrieved August 10, 2019, from Guesstimate website: https://www.getguesstimate.com/models/11599

  41. Denkenberger D, Cotton-Barrat O, Dewey D, Li S (2019) Machine Intelligence Research Institute - Oxford Prioritisation Project. Retrieved August 12, 2019, from Guesstimate website: https://www.getguesstimate.com/models/8789

  42. Denkenberger D, Sandberg A, Tieman R, Pearce JM (2021, July 28). Long Term Cost-Effectiveness of Resilient Foods for Global Catastrophes Compared to Artificial General Intelligence Safety. https://doi.org/10.31219/osf.io/vrmpf

  43. Denkenberger D, Pearce J, Taylor AR, Black R (2019) Food without sun: Price and life-saving potential. Foresight 21(1):118–129

    Article  Google Scholar 

  44. Edison Electric Institute (2020) Why Is Pandemic Planning Important? p 8

    Google Scholar 

  45. Effective Altruism Concepts. (2019). Importance, tractability, neglectedness framework. Retrieved April 10, 2019, from Effective Altruism Concepts website: https://concepts.effectivealtruism.com/concepts/importance-neglectedness-tractability/

    Google Scholar 

  46. Elavarasan M, Rajvikram GMS, Raju K, Vijay M, Arif MT, Jamal T, Senthilkumar S, Sriraja Balaguru VS, Reddy KS, Subramaniam U (2020) COVID-19: impact analysis and recommendations for power sector operation. Appl Energy 279:115739. https://doi.org/10.1016/j.apenergy.2020.115739

    Article  Google Scholar 

  47. European Commission (2021) Overview of natural and man-made disaster risks the European Union May Face. Commission staff working document. European Commission, Brussels

  48. Foster JS, Gjelde E, Graham WR, Hermann RJ, Kluepfel H, Hank M, Lawson RL, … Woodard JB (2004) Report of the Commission to Assess the Threat to the United States from Electromagnetic Pulse (EMP) Attack. Retrieved June 30, 2016, from Committee on Armed Services House of Representatives website: http://commdocs.house.gov/committees/security/has204000.000/has204000_0.HTM

  49. Foster JS Jr, Gjelde E, Graham WR, Hermann RJ, Kluepfel H, Hank M, Lawson RL, … Woodard JB (2008) Report of the commission to assess the threat to the united states from electromagnetic pulse (emp) attack: Critical national infrastructures. Retrieved from DTIC Document website: http://www.empcommission.org/docs/A2473-EMP_Commission-7MB.pdf

  50. Garrick BJ (2008) Quantifying and controlling catastrophic risks. Academic Press

  51. Gent MR, Costantini LP (2003) Reflections on security [power systems]. IEEE Power Energy Mag 1(1):46–52 https://doi.org/10.1109/MPAE.2003.1180360.

  52. GiveWell. (2017). Cost-Effectiveness. Retrieved April 10, 2019, from GiveWell website: https://www.givewell.org/how-we-work/our-criteria/cost-effectiveness

    Google Scholar 

  53. Glauber J, Debucquet DL, Martin W, Vos R (2020) COVID-19: trade restrictions are worst possible response to safeguard food security. In: IFPRI book chapters. International Food Policy Research Institute (IFPRI), pp 66–68

  54. Glenn JC (2009) Futures Research Methodology Version 3.0. The Millennium Project, Washington, D.C.

  55. Good IJ (1966) Speculations concerning the first ultraintelligent machine. In: Advances in computers, vol 6. Elsevier, pp 31–88

  56. Goodin, D. (2016). First known hacker-caused power outage signals troubling escalation. Retrieved from http://arstechnica.com/security/2016/01/first-known-hacker-caused-power-outage-signals-troubling-escalation/

    Google Scholar 

  57. Gorman S (2009) Electricity grid in U.S. penetrated by spies. Wall Street J Retrieved from https://www.wsj.com/articles/SB123914805204099085

  58. Gregory, J., Stouffer, R. J., Molina, M., Chidthaisong, A., Solomon, S., Raga, G, … Stone, D. A. (2007). Climate Change 2007: The Physical Science Basis. Retrieved from http://copa.acguanacaste.ac.cr:8080/handle/11606/461

    Google Scholar 

  59. Griswold M, Denkenberger D, Abdelkhaliq M, Cole D, Pearce J, Taylor AR (2016) Vitamins in Agricultural Catastrophes. Proceedings of the 6th International Disaster and Risk Conference. Presented at the 6th International Disaster and Risk Conference, Davos, Switzerland. hal-02113491

  60. Grubaugh ND, Hanage WP, Rasmussen AL (2020) Making sense of mutation: what D614G means for the COVID-19 pandemic remains unclear. Cell 182(4):794–795. https://doi.org/10.1016/j.cell.2020.06.040

  61. Halstead J (2018) Climate change cause area report. Founders Pledge

  62. Hayakawa H, Ebihara Y, Willis DM, Toriumi S, Iju T, Hattori K, … Ribeiro JR (2019) Space Weather, Temporal and Spatial Evolutions of a Large Sunspot Group and Great Auroral Storms Around the Carrington Event in 1859.

  63. Hébert C (2013) The most critical of economic needs (Risks): a quick look at cybersecurity and the electric grid. Electricity J 26(5):15–19. https://doi.org/10.1016/j.tej.2013.05.009

  64. Helfand I (2013) Nuclear famine: Two billion people at risk. International Physicians for the Prevention of Nuclear War, p 2

  65. Lovins AB, Lovins LH (1982) Brittle power. Brick House Publishing Company.

  66. Kelly-Detwiler, P. (2014). Failure to protect U.S. against electromagnetic pulse threat could make 9/11 look trivial someday. Retrieved August 7, 2019, from https://www.forbes.com/sites/peterdetwiler/2014/07/31/protecting-the-u-s-against-the-electromagnetic-pulse-threat-a-continued-failure-of-leadership-could-make-911-look-trivial-someday/#2ed092db7a14

    Google Scholar 

  67. Keramat M, Kielbasa R (1997) Latin hypercube sampling Monte Carlo estimation of average quality index for integrated circuits. In: Analog Design Issues in Digital VLSI Circuits and Systems. Springer, pp 131–142

  68. Khan A, Naveed M, Dur-e-Ahmad M, Imran M (2015) Estimating the basic reproductive ratio for the ebola outbreak in Liberia and Sierra Leone. Infect Dis Poverty 4(1):13. https://doi.org/10.1186/s40249-015-0043-3

  69. Kinney R, Crucitti P, Albert R, Latora V (2005) Modeling cascading failures in the North American power grid. European Phys J B 46(1):101–107. https://doi.org/10.1140/epjb/e2005-00237-9

  70. Klein C (2012) A Perfect Solar Superstorm: The 1859 Carrington Event. Retrieved August 7, 2019, from HISTORY website: https://www.history.com/news/a-perfect-solar-superstorm-the-1859-carrington-event

  71. Klotz LC, Sylvester EJ (2014) The consequences of a lab escape of a potential pandemic pathogen. Front Public Health 2. https://doi.org/10.3389/fpubh.2014.00116

  72. Krotofil M, Cardenas A, Larsen J, Gollmann D (2014) Vulnerabilities of cyber-physical systems to stale data—Determining the optimal time to launch attacks. Int J Crit Infrastruct Protect 7(4):213–232. https://doi.org/10.1016/j.ijcip.2014.10.003

  73. Kushner D (2013) The real story of stuxnet. IEEE Spectrum 50(3):48–53. https://doi.org/10.1109/MSPEC.2013.6471059

    Article  Google Scholar 

  74. Laborde D, Martin W, Swinnen J, Vos R (2020) COVID-19 risks to global food security. Science 369(6503):500–502. https://doi.org/10.1126/science.abc4765

  75. Lasseter RH (2007) Microgrids and distributed generation. J Energy Eng 133(3):144–149. https://doi.org/10.1061/(ASCE)0733-9402(2007)133:3(144)

    Article  Google Scholar 

  76. Lasseter RH, Piagi P (2004) Microgrid: a conceptual solution. Citeseer 6:4285–4291

    Google Scholar 

  77. Lewis G (2020) “Reducing global catastrophic biological risks.” 80,000 Hours. Retrieved June 8, 2021 https://80000hours.org/problem-profiles/global-catastrophic-biological-risks/.

  78. Li, S. (2017). A model of the Machine Intelligence Research Institute - Oxford Prioritisation Project - EA Forum. Retrieved August 12, 2019, from https://forum.effectivealtruism.org/posts/NbFZ9yewJHoicpkBr/a-model-of-the-machine-intelligence-research-institute

    Google Scholar 

  79. Lingam M, Loeb A (2017) Risks for life on habitable planets from superflares of their host stars. Astrophys J 848(1):41. https://doi.org/10.3847/1538-4357/aa8e96

    Article  Google Scholar 

  80. Liptak BG (2018) Instrument Engineers’ Handbook, Volume Two: Process Control and Optimization. CRC Press

  81. Majdandzic A, Braunstein LA, Curme C, Vodenska I, Sary L-C, Eugene Stanley H, Havlin S (2016) Multiple tipping points and optimal repairing in interacting networks. Nat Commun 7(1). https://doi.org/10.1038/ncomms10850

  82. Manheim D, Denkenberger D (2020)&nbsp;Review of Potential High-Leverage and Inexpensive Mitigations for Reducing Risk in Epidemics and Pandemics. J Glob Health Rep. https://doi.org/10.29392/001c.12530

  83. Matheny JG (2007) Reducing the risk of human extinction. Risk Anal 27(5):1335–1344

    Article  Google Scholar 

  84. McIntyre, P. (2016a). How you can lower the risk of a catastrophic nuclear war. Retrieved August 13, 2019, from 80,000 Hours website: https://80000hours.org/problem-profiles/nuclear-security/

    Google Scholar 

  85. Mekhaldi F, Muscheler R, Adolphi F, Aldahan A, Beer J, McConnell JR, Possnert G, Sigl M, Svensson A, Synal H-A (2015) Multiradionuclide evidence for the solar origin of the cosmic-ray events of AD 774/5 and 993/4. Nat Commun 6(1):8611. https://doi.org/10.1038/ncomms9611

    Article  Google Scholar 

  86. Millett P, Snyder-Beattie A (2017) Existential risk and cost-effective biosecurity. Health Secur 15(4):373–383. https://doi.org/10.1089/hs.2017.0028

  87. Morgan MG, Henrion M (1990) Uncertainty: a guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge University Press, New York. https://doi.org/10.1017/CBO9780511840609

    Book  Google Scholar 

  88. Motesharrei S, Rivas J, Kalnay E (2014) Human and nature dynamics (HANDY): modeling inequality and use of resources in the collapse or sustainability of societies. Ecol Econ 101:90–102. https://doi.org/10.1016/j.ecolecon.2014.02.014

    Article  Google Scholar 

  89. Motter AE, Lai Y-C (2002) Cascade-based attacks on complex networks. Phys Rev E 66(6). https://doi.org/10.1103/PhysRevE.66.065102

  90. Nai Fovino I, Guidi L, Masera M, Stefanini A (2011) Cyber security assessment of a power plant. Electric Power Syst Res 81(2):518–526. https://doi.org/10.1016/j.epsr.2010.10.012

    Article  Google Scholar 

  91. National Research Council (2012) Terrorism and the electric power delivery system. National Academies Press

  92. Norman J, Bar-Yam Y, Taleb NN (2020) Systemic risk of pandemic via novel pathogens—coronavirus: a note, p 2

    Google Scholar 

  93. Oak Ridge National Laboratory (2010) Electromagnetic pulse: effects on the U.S. Power Grid, p 6

  94. Office of Electricity Delivery and Energy Reliability (2014) Large power transformers and the U.S. electrical grid. U.S. Department of Energy

  95. Oke O, Redhead J, Hussain M (1990) Roots, tubers, plantains and bananas in human nutrition. FAO Food Nutr Series 24:182

  96. Onyeji I, Bazilian M, Bronk C (2014) Cyber security and critical energy infrastructure. Electricity J (2):52–60. https://doi.org/10.1016/j.tej.2014.01.011

  97. Open Philanthropy (2021) “Grants database.” Open Philanthropy. Retrieved June 8, 2021 (https://www.openphilanthropy.org/giving/grants).

  98. Open Source Ecology (2019). Open Source Ecology. Retrieved August 10, 2019, from https://www.opensourceecology.org/

    Google Scholar 

  99. Ord, T. (2014). The timing of labour aimed at reducing existential risk. Retrieved April 10, 2019, from The Future of Humanity Institute website: https://www.fhi.ox.ac.uk/the-timing-of-labour-aimed-at-reducing-existential-risk/

    Google Scholar 

  100. Ord T (2020) The Precipice: Existential Risk and the Future of Humanity. Hachette Books

  101. Ord, Toby, Rafaela Hillerbrand, and Sandberg, Anders,&nbsp; 2010,&nbsp; Probing the improbable: methodological challenges for risks with low probabilities and high stakes, Journal of Risk Research, https://doi.org/10.1080/13669870903126267.

  102. Pagliery, J. (2015). Sniper attack on California power grid may have been “an insider,” DHS says. Retrieved August 8, 2019, from CNNMoney website: https://money.cnn.com/2015/10/16/technology/sniper-power-grid/index.html

    Google Scholar 

  103. Prehoda EW, Schelly C, Pearce JM (2017) US strategic solar photovoltaic-powered microgrid deployment for enhanced national security. Renewable Sustainable Energy Rev 78:167–175

    Article  Google Scholar 

  104. Pry PV (2014) Electromagnetic Pulse (EMP): threat to critical infrastructure. Retrieved August 14, 2019, from https://www.govinfo.gov/content/pkg/CHRG-113hhrg89763/html/CHRG-113hhrg89763.htm

  105. Pry P (2017) Nuclear EMP attack scenarios and combined-arms cyber warfare, p 65

    Google Scholar 

  106. Rauch EM, Bar-Yam Y (2006) Long-range interactions and evolutionary stability in a predator-prey system. Phys Rev E 73(2):020903. https://doi.org/10.1103/PhysRevE.73.020903

  107. Robinson RA (2007) Crop histories. Sharebooks Pub

  108. Rolak BJ (1975) General Miles’ mirrors: the heliograph in the Geromino Campaign of 1886. J Arizona History 16(2):145–160

    Google Scholar 

  109. Roodman D (2015) The risk of geomagnetic storms to the grid. 56.

  110. Rosenau W (2001) Aum Shinrikyo’s biological weapons program: why did it fail? Stud Conflict Terrorism 24(4):289–301. https://doi.org/10.1080/10576100120887

  111. Salmeron J, Wood K, Baldick R (2004) Analysis of electric grid security under terrorist threat. IEEE Transact Power Syst 19(2):905–912. https://doi.org/10.1109/TPWRS.2004.825888

    Article  Google Scholar 

  112. Schainker R, Douglas J, Kropp T (2006) Electric utility responses to grid security issues. IEEE Power Energy Magazine 4(2):30–37. https://doi.org/10.1109/MPAE.2006.1597993

    Article  Google Scholar 

  113. Schaul T, Togelius J, Schmidhuber J (2011) Measuring intelligence through games. ArXiv Preprint ArXiv 1109:1314

    Google Scholar 

  114. Shahidehpour M, Khodayar M (2013) Cutting campus energy costs with hierarchical control: The economical and reliable operation of a microgrid. IEEE Electrification Mag 1(1):40–56. https://doi.org/10.1109/MELE.2013.2273994

    Article  Google Scholar 

  115. Silver WH (2004) Ham Radio for Dummies. Wiley Publishing, Inc

  116. Singh S, Kumar R, Panchal R, Tiwari MK (2021) Impact of COVID-19 on logistics systems and disruptions in food supply chain. Int J Prod Res 59(7):1993–2008. https://doi.org/10.1080/00207543.2020.1792000

  117. Space Studies Board (ed) (2008) Severe space weather events—understanding societal and economic impacts: a workshop report. National Academies Press

  118. Sridhar S, Hahn A, Govindarasu M (2012) Cyber–physical system security for the electric power grid. Proc IEEE 100(1):210–224. https://doi.org/10.1109/JPROC.2011.2165269

  119. Sterling CH (2008) Military Communications: From Ancient Times to the 21st Century. ABC-CLIO

  120. Ten C-W, Manimaran G, Liu C-C (2010) Cybersecurity for critical infrastructures: Attack and defense modeling. IEEE Transact Syst Man Cybernetics-Part A: Syst Hum 40(4):853–865

  121. The Maritime Executive. 2020. “India invokes ‘force majeure’ on major port operations.” The Maritime Executive. Retrieved November 24, 2020 (https://www.maritime-executive.com/article/india-invokes-force-majeure-on-major-port-operations).

  122. The World Bank (2021) Manufacturing, value added (Current US$)—World, European Union | Data. The World Bank Retrieved June 8, 2021 (https://data.worldbank.org/indicator/NV.IND.MANF.CD?end=2019&locations=1W-EU&start=2017)

  123. Tonn B, Stiefel D (2013) Evaluating Methods for Estimating Existential Risks. Risk Anal 33(10):1772–1787. https://doi.org/10.1111/risa.12039

  124. Turchin A, Denkenberger D (2018) Classification of global catastrophic risks connected with artificial intelligence. AI & SOCIETY. https://doi.org/10.1007/s00146-018-0845-5

  125. Turchin A, Denkenberger D (2018b) Global catastrophic and existential risks communication scale. Futures 102:27–38. https://doi.org/10.1016/j.futures.2018.01.003

  126. Tzezana R (2016) Scenarios for crime and terrorist attacks using the internet of things. Eur J Futures Res 4(1):18. https://doi.org/10.1007/s40309-016-0107-z

  127. Ulieru M (2007) Design for resilience of networked critical infrastructures. IEEE, pp 540–545

  128. Umbach F (2013) World Review | Energy infrastructure targeted as cyber attacks increase globally. Retrieved August 8, 2019, from https://web.archive.org/web/20130629041842/https://worldreview.info/content/energy-infrastructure-targeted-cyber-attacks-increase-globally

  129. Vidya CT, Prabheesh KP (2020) Implications of COVID-19 pandemic on the global trade networks. Emerg Markets Finance Trade 56(10):2408–2421. https://doi.org/10.1080/1540496X.2020.1785426

  130. Watts D (2003) Security & Vulnerability in electric power systems. North Am Power Symposium 8

  131. Wald M (2020) Why refuel a nuclear reactor now? Nuclear Energy Institute Retrieved November 5, 2020 (https://www.nei.org/news/2020/why-refuel-plant-during-pandemic)

  132. Wiblin R (2017) “Positively shaping the development of artificial intelligence.” 80,000 Hours. Retrieved June 8, 2021 (https://80000hours.org/problem-profiles/positively-shaping-artificial-intelligence/).

  133. World Nuclear Association. 2020a. “Heavy manufacturing of power plants.” Retrieved November 20, 2020 https://www.world-nuclear.org/information-library/nuclear-fuel-cycle/nuclear-power-reactors/heavy-manufacturing-of-power-plants.aspx.

  134. World Nuclear Association. 2020b. “Nuclear Power in the USA.” Retrieved November 24, 2020 https://www.world-nuclear.org/information-library/country-profiles/countries-t-z/usa-nuclear-power.aspx#:~:text=The%20USA%20is%20the%20world's,20%25%20of%20total%20electrical%20output.

    Google Scholar 

  135. Wu FF, Moslehi K, Bose A (2005) Power system control centers: past, present, and future. Proc IEEE 93(11):1890–1908. https://doi.org/10.1109/JPROC.2005.857499

  136. Zerriffi H, Dowlatabadi H, Strachan N (2002) Electricity and conflict: advantages of a distributed system. Electricity J 15(1):55–65. https://doi.org/10.1016/S1040-6190(01)00262-7

    Article  Google Scholar 

Download references

Acknowledgements

The Oxford Prioritisation Project developed the artificial general intelligence safety cost effectiveness submodel. Owen Cotton-Barratt, Daniel Dewey, Sindy Li, Ozzie Gooen, Tim Fist, Aron Mill, Kyle Alvarado, Ratheka Stormbjorne, and Finan Adamson contributed helpful discussions. This is not the official position of the Centre for Effective Altruism, the Future of Humanity Institute, nor the Alliance to Feed the Earth in Disasters (ALLFED).

Funding

Funding was received from the Centre for Effective Altruism. One author received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No 669751).

Author information

Authors and Affiliations

Authors

Contributions

A1 designed the model, determined parameter inputs for model 1, analyzed and interpreted model results, and was a major contributor to theory, writing, and review of the manuscript. A2 aided in design of the model, provided model theory and uncertainty analysis insights, provided parameter inputs for model 2, aided in analysis and interpretation of results, contributed to theory, and aided in writing and reviewing of manuscript. A3 Performed model implementation in Analytica, analysed and interpreted model results, performed uncertainty analysis, performed complex scenario analysis (research, writing and diagram creation), and was a significant contributor to the writing and review of the manuscript. A4 was a major contributor to theory and research design, aided in the interpretation of model results, and was a major contributor to writing and review of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ross John Tieman.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

Civilization collapse from severe pandemic

Complex scenario description

A severe pandemic could be caused without human involvement (i.e., a natural risk) or be caused by humans, whether intentionally (i.e., a malicious risk) or unintentionally (i.e., an accident risk). For instance, a mutation of COVID-19 with increased virulence and mortality could emerge [60] and go undetected before infecting multiple people (i.e., natural risk). Alternatively, a doomsday cult could become obsessed with designing the “perfect” virus [110] and be successful in their endeavor (i.e., malicious risk) thanks to easier availability of gene modification technologies such as CRISPR-CAS9 [24]. Furthermore, a biotechnology lab working with highly infectious diseases could accidently leak a virus (i.e., accident risk) that was created for research purposes [71]. No matter the actual origin, multiple plausible scenarios for the emergence of a highly infectious and deadly pathogen seem to exist. Moreover, humanity’s failure in keeping COVID-19 contained and from becoming a global pandemic is a vivid illustration of the very real possibility of future pathogens also spreading across the globe.

Potential impact logic

Figure 1 illustrates a potential impact logic for the outlined scenario. Information communication technology (ICT), the electrical grid, and health services are three first-order dependencies which rely on the human population being impacted as a result of the virus making critical staff unavailable. In particular, reliable functioning of those Critical Infrastructure CI requires a core of highly skilled personnel to undertake various operational tasks. During a global pandemic, this core of critical personnel could be rendered partially or near completely unavailable through death, illness, family care requirements, government public health recommendations, such as lock downs, fear, and/or quarantining due to suspected illness [82]. Depending on the severity of infectious disease (the combination of transmissibility and virulence), failure could be rapid or more gradual. A highly virulent infectious disease (high transmissibility, high lethality) could rapidly decrease staffing below required operating numbers resulting in a rapid system-wide shut down. A less infectious disease or one with a longer incubation time could result in a more gradual failure as chronic understaffing resulted in reduced maintenance and recovery capacity. Thus, these dependencies are loose, as failures result over weeks as more of the human population (and thus critical staff) become infected. This is as opposed to tight dependencies, such as blackouts, which manifest rapidly and have direct impacts.

Importantly, our analysis suggests that multiple feedback loops exist, such as between the human population, ICT, and the electrical grid. This feedback loop would result from critical staff shortages leading to grid failures, causing ICT to fail, which reduces availability of public health information, which in turn causes greater infection levels that further decrease staff availability for CI. Similarly, health services are loosely dependent on the electrical grid once backup generators run out of fuel, which could precipitate a feedback loop of more infections being caused due to reduced capacity of health services, which in turn causes more staff shortages in CI.

The ability of the infrastructure ecosystem to absorb such stresses introduced by a pandemic depends on the slack (looseness) in key dependencies. For instance, key parameters include how long the electrical grid, ICT infrastructure, and natural gas infrastructure could be chronically understaffed before a critical failure occurs. Once such failures occur, a cascade of failures in dependent systems could be initiated, resulting in critical transitions to system failures. A series of critical transitions across infrastructure systems may occur as the infrastructure ecosystem moves through various states of degradation, before coming to rest at a stable state. Intermediate stable states may exist due to the buffering capacity of a series of loose dependencies. In sum, the diagram highlights how a pandemic could facilitate Catastrophic electricity loss (CEL) by causing an extensive cascade through various interdependent CI. Note that only three first-order effects are shown to highlight a plausible mechanism by which a pandemic could cause CEL. In reality CI are highly interlinked and multiple causal chains exist.

For instance, global supply chain interruptions expected during pandemics would increase already long lead times for critical grid components such as extra high voltage (EHV) transformers and nuclear power station steam turbines, which are manufactured by a limited number of highly specialized companies [94, 133]. Production of EHV transformers requires niche input materials such as electrical steel that are made by a limited number of specialized steel manufacturers, which makes sourcing of alternative inputs during supply chain disruption extremely difficult [94]. Anticipated reductions in global trade during a pandemicFootnote 6 are also expected to decrease availability of more general grid components, further hampering grid maintenance and repair efforts.

Refueling of nuclear power plants illustrates how supply chain disruptions and induced staff shortages could lead to difficult challenges. Refueling is undertaken by a small number of external vendors, requiring highly specialized staff to undertake hundreds of maintenance steps under stringent safety protocols for successful refueling. This process takes ~ 4 weeks and must be performed every 18–24 months depending on reactor design [131]. Nuclear power contributed approximately 841 billion kilowatt hours (TWh) or ~ 19% of US electrical consumption in 2018, across 94 reactors [134]. With such a significant amount of energy concentrated over a relatively small number of production facilities (8.9 TWh per year for the average reactor in 2018) delays beyond the anticipated ~ 4 week refueling would compound to produce significant reductions in energy generation. In order to prevent delays in refueling, healthy personnel would likely be required to work overtime increasing the potential for human error. Similar challenges apply to various other forms of power generation such as gas, coal, hydro-electric, etc.

Moreover, a severe pandemic could cause failures of portions of the electrical grid by inducing failure of critical interlinked systems, e.g., failure of fossil fuel production and distribution. For instance, in order for natural gas power plants to provide the 1558 TWh (37% of electrical energy consumed in the U.S. in 2018) they currently produce, the timely delivery of natural gas to power production infrastructure is required. Achieving this requires the correct functioning of a complex network of gas extraction, refining and distribution infrastructure, which too must be maintained by highly specialized personnel and equipment. For the same reasons as described above, i.e., the requirement for adequate staffing of skilled workers and functioning of supply chains for acquisition of specialized equipment, critical input systems for the electrical grid, such as fossil fuel, are vulnerable to pandemics.

An additional concern which merits increased vigilance for the risk of pandemics is the rise of international flights, drastically increasing rates of international travel between populations. Diseases with high mortality rates that would normally have petered out on their own may not do so with high rates of international travel. In a recent study involving a simple two-dimensional model of a high mortality infectious disease (such as Ebola), a sharp phase transition was found above a threshold level of international travel, where infection spreads to most hosts. The probability of extinction of the hosts increased to near certainty after the phase transition [14, 92]. Such a sharp transition may obscure how dangerously close a high mortality outbreak could be to causing extinction or near-extinction, especially if rates of international travel increase.

The severe health crisis of COVID-19 has demonstrated the willingness of countries to restrict international trade, with the potential to cause more deaths from food insecurity and starvation than the virus alone. Additionally, there have been significant stresses on logistics and manufacturing from the virus [53, 74, 116].

Though no major disruptions to electrical grids have resulted from the COVID-19 pandemic thus far, the potential for disruption has been discussed in the literature. Potential catalysts include disruption of critical interlinked systems such as global supply chains [121]; delays in obtaining inputs for energy production [46]; novel cyber security risks to communication and SCADA systems due to changing work protocols [46]; and staff shortages from illness and travel restrictions within countries and between countries impacting mutual assistance agreements after significant blackouts [44]. It is uncertain how COVID-19 will proceed over the coming months; however, as pandemics exhibit “fat tailed” statistical properties (i.e., there is a non-negligible chance of extreme outcomes) [26]; the potential for severe outcomes is plausible. Novel mutations of COVID-19 with increased transmissibility or mortality provide an illustrative example [92, 106]. Associated risks to electrical grids and other critical infrastructure systems would also increase from losses of skilled staff, and greater supply chain disruptions. The complex nature of interactions between the various critical infrastructure systems imply that non-linear relationships between an increasingly severe pandemic and effects on critical infrastructure should be expected [81].

Plausibility of the scenario

The 2014–2016 Ebola outbreak was an example of an epidemic outbreak that could have turned into a catastrophic global pandemic, with dire effects on critical national infrastructures including agriculture and industry. The primary countries affected by the outbreak, Sierra Leone, Liberia, and Nigeria, had a mean case fatality rate of 50.7%, with a corrected reproductive rate of the virus of 1.64 (i.e., the average number of people a person currently infected with the virus will infect) in Sierra Leone and Liberia [68]. The result from this highly deadly outbreak was a drastic and rapid reduction in agricultural and mining output, with the two largest industries in Sierra Leone, Liberia and Nigeria experiencing major disruption. Within a year major agricultural industries were severely affected. Coffee production fell by half, cocoa production by one third, and palm oil production dropped 75% [2]. Moreover, early on in the epidemic, London Mining, Sierra Leone’s second largest iron ore producer, suspended its activities [5]. Despite these outcomes, Ebola only infected a few tens of thousands of people. A larger outbreak with a similarly deadly but more transmissible virus would likely have led to much more disruption.

Potential interventions to reduce food system impacts

If there is an extended loss of electricity and the functioning of other CI, urgent needs of water and shelter need to be met first. A backup shortwave radio communication system would facilitate the timely advice on where to get water and possibly where to relocate to. Local food supply would likely run out within weeks, so movement of food to people or people to food would be required [1]. For a limited amount of time, this could use aboveground fossil fuels. But over a longer period of time, retrofitting vehicles to be pulled by animals would be useful. Also, adapting ships to be sail or kite powered would be valuable. Replacement of industrial fertilizers could be achieved by planting legumes (peas or beans that fix nitrogen from the air), and burning wood in landfills for other nutrients [28].

Appendix 2

Radio component costs—available on https://osf.io/rgq2z/

Table 5

Appendix 3

Effective Altruism Conference poll questions

Table 6 Poll results from Effective Altruism Global 2018

Appendix 4

Email survey of GCR researchers on loss of civilization

Below is the informational text from the survey:

Earth-derived civilization has potential to spread to the galaxy and possibly beyond. Global catastrophes could reduce the potential of this civilization directly or with further conflict through risk of extinction, risk of losing industrial civilization and not recovering, risk of losing anthropological civilization (basically cities) and not recovering both anthropological and industrial civilization, worse human values that increase the likelihood of further global catastrophes, worse values being placed into artificial general intelligence, etc. Along with each percentage answer, please indicate your confidence level from 1 to 10. Note the numbered questions pertain to catastrophes that could collapse agriculture, while the lettered questions are on 10% global agricultural shortfalls.

Note: Confidence values are included but were not utilized in model.

Table 7 Relevant question from the survey and responses

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Denkenberger, D., Sandberg, A., Tieman, R.J. et al. Long-term cost-effectiveness of interventions for loss of electricity/industry compared to artificial general intelligence safety. Eur J Futures Res 9, 11 (2021). https://doi.org/10.1186/s40309-021-00178-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40309-021-00178-z

Keywords