Skip to main content
The search returned 13 results
Now showing 1 - 10 of 13
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Open Access ,

    Highlights from the First Ten Years of the New Zealand Earthquake Forecast Testing Center

    The Collaboratory for the Study of Earthquake Predictability (CSEP) is a global cyberinfrastructure for prospective evaluations of earthquake forecast models and prediction algorithms. CSEP’s goals are to improve our understanding of earthquake predictability, advance forecasting model development, test key scientific hypotheses and their predictive power, and improve seismic hazard assessments. Since its inception in California in 2007, the global CSEP collaboration has been conducting forecast experiments in a variety of tectonic settings and at a global scale and now operates four testing centers on four continents to automatically and objectively evaluate models against prospective data. These experiments have provided a multitude of results that are informing operational earthquake forecasting systems and seismic hazard models, and they have provided new and, sometimes, surprising insights into the predictability of earthquakes and spurned model improvements. CSEP has also conducted pilot studies to evaluate ground-motion and hazard models. Here, we report on selected achievements from a decadeof CSEP, and we present our priorities for future activities.
      62  281
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Restricted ,

    Predictability study on the aftershock sequence following the 2011 Tohoku-Oki, Japan, earthquake: first results

    Although no deterministic and reliable earthquake precursor is known to date, we are steadily gaining insight into probabilistic forecasting that draws on space–time characteristics of earthquake clustering. Clustering-based models aiming to forecast earthquakes within the next 24 hours are under test in the global project ‘Collaboratory for the Study of Earthquake Predictability’ (CSEP). The 2011 March 11 magnitude 9.0 Tohoku-Oki earthquake in Japan provides a unique opportunity to test the existing 1-day CSEP models against its unprecedentedly active aftershock sequence. The original CSEP experiment performs tests after the catalogue is finalized to avoid bias due to poor data quality. However, this study differs from this tradition and uses the preliminary catalogue revised and updated by the Japan Meteorological Agency (JMA), which is often incomplete but is immediately available. This study is intended as a first step towards operability-oriented earthquake forecasting in Japan. Encouragingly, at least one model passed the test in most combinations of the target day and the testing method, although the models could not take account of the megaquake in advance and the catalogue used for forecast generation was incomplete. However, it can also be seen that all models have only limited forecasting power for the period immediately after the quake. Our conclusion does not change when the preliminary JMAcatalogue is replaced by the finalized one, implying that the models perform stably over the catalogue replacement and are applicable to operational earthquake forecasting. However, we emphasize the need of further research on model improvement to assure the reliability of forecasts for the days immediately after the main quake. Seismicity is expected to remain high in all parts of Japan over the coming years. Our results present a way to answer the urgent need to promote research on time-dependent earthquake predictability to prepare for subsequent large earthquakes in the near future in Japan.
      297  32
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Open Access ,

    Collaboratory for the Study of Earthquake Predictability

    Collaboratory for the Study of Earthquake Predictability
      590  504
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Restricted ,

    Operational earthquake forecasting can enhance earthquake preparedness

    (2014) ; ; ; ;
    Jordan, T. H.; Univ Southern California
    We cannot yet predict large earthquakes in the short term with much reliability and skill, but the strong clustering exhibited in seismic sequences tells us that earthquake probabilities are not constant in time; they generally rise and fall over periods of days to years in correlation with nearby seismic activity. Opera- tional earthquake forecasting (OEF) is the dissemination of authoritative information about these time-dependent proba- bilities to help communities prepare for potentially destructive earthquakes. The goal of OEF is to inform the decisions that people and organizations must continually make to mitigate seismic risk and prepare for potentially destructive earthquakes on time scales from days to decades. To fulfill this role, OEF must provide a complete description of the seismic hazard—ground-motion exceedance probabilities as well as short-term rupture probabilities—in concert with the long-term forecasts of probabilistic seismic-hazard analysis (PSHA).
      295  30
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Restricted ,

    Testing for ontological errors in probabilistic forecasting models of natural systems

    (2014) ; ;
    Marzocchi, W.; Istituto Nazionale di Geofisica e Vulcanologia, Sezione Roma1, Roma, Italia
    ;
    Jordan, T. H.; Univ Southern California
    ;
    Probabilistic forecasting models describe the aleatory variability of natural systems as well as our epistemic uncertainty about how the systems work. Testing a model against observations exposes ontological errors in the representation of a system and its uncertainties. We clarify several conceptual issues regarding the testing of probabilistic forecasting models for ontological errors: the ambiguity of the aleatory/epistemic dichotomy, the quantification of uncertainties as degrees of belief, the interplay between Bayesian and frequentist methods, and the scientific pathway for capturing predictability. We show that testability of the ontological null hypothesis derives from an experimental concept, external to the model, that identifies collections of data, observed and not yet observed, that are judged to be exchange- able when conditioned on a set of explanatory variables. These conditional exchangeability judgments specify observations with well-defined frequencies. Any model predicting these behaviors can thus be tested for ontological error by frequentist methods; e.g., using P values. In the forecasting problem, prior predictive model checking, rather than posterior predictive checking, is desir- able because it provides more severe tests. We illustrate experi- mental concepts using examples from probabilistic seismic hazard analysis. Severe testing of a model under an appropriate set of experimental concepts is the key to model validation, in which we seek to know whether a model replicates the data-generating pro- cess well enough to be sufficiently reliable for some useful pur- pose, such as long-term seismic forecasting. Pessimistic views of system predictability fail to recognize the power of this method- ology in separating predictable behaviors from those that are not.
      173  21
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Restricted ,

    A Unified Probabilistic Framework for Seismic Hazard Analysis

    The proper scientific interpretation of the seismic hazard estimates requires a probabilistic framework that admits epistemic uncertainties on aleatory variables. This is not straightforward because, to subjectivists, all probabilities are epistemic, whereas to frequentists, all probabilities are aleatory. We illustrate the inadequacy of purely subjectivist and purely frequentist interpretations of probability by examining the probabilistic meaning of the mean hazard. We advocate a unified approach based on experimental concepts that define aleatory variability in terms of exchangeable sequences of observations, and we show how experimental concepts allow testing of models based on expert opinion by frequentist methods.
      54  3
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Restricted ,

    Bayesian Forecast Evaluation and Ensemble Earthquake Forecasting

    (2012) ; ; ;
    Marzocchi, W.; Istituto Nazionale di Geofisica e Vulcanologia, Sezione Roma1, Roma, Italia
    ;
    Zechar, J.; ETH Zurich
    The assessment of earthquake forecast models for practical purposes requires more than simply checking model consistency in a statistical framework. One also needs to understand how to construct the best model for specific forecasting applications. We describe a Bayesian approach to evaluating earthquake forecasting models, and we consider related procedures for constructing ensemble forecasts. We show how evaluations based on Bayes factors, which measure the relative skill among forecasts, can be complementary to common goodness-of-fit tests used to measure the absolute consistency of forecasts with data. To construct ensemble forecasts, we consider averages across a forecast set, weighted by either posterior probabilities or inverse log- likelihoods derived during prospective earthquake forecasting experiments. We account for model correlations by conditioning weights using the Garthwaite–Mubwandarikwa capped eigenvalue scheme. We apply these methods to the Regional Earthquake Like- lihood Models (RELM) five-year earthquake forecast experiment in California, and we discuss how this approach can be generalized to other ensemble forecasting applications. Specific applications of seismological importance include experiments being conducted within the Collaboratory for the Study of Earthquake Predictability (CSEP) and ensemble methods for operational earthquake forecasting.
      175  20
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Open Access ,

    Varenna workshop report:
Operational earthquake forecasting and decision making

    A workshop on Operational earthquake forecasting and decision making was convened in Varenna, Italy, on June 8-11, 2014, under the sponsorship of the EU FP 7 REAKT (Strategies and tools for Real-time EArthquake risK reducTion) project, the Seismic Hazard Center at the Istituto Nazionale di Geofisica e Vulcanologia (INGV), and the Southern California Earthquake Center (SCEC). The main goal was to survey the interdisciplinary issues of operational earthquake forecasting (OEF), including the problems that OEF raises for decision making and risk communication. The workshop was attended by 64 researchers from universities, research centers, and governmental institutions in 11 countries. Participants and the workshop agenda are listed in the appendix. The workshop comprised six topical sessions struc- tured around three main themes: the science of opera- tional earthquake forecasting, decision making in a low-probability environment, and communicating haz- ard and risk. Each topic was introduced by a moderator and surveyed by a few invited speakers, who were then empaneled for an open discussion. The presentations were followed by poster sessions. During a wrap-up ses- sion on the last day, the reporters for each topical session summarized the main points that they had gleaned from the talks and open discussions. This report attempts to distill this workshop record into a brief overview of the workshop themes and to describe the range of opin- ions expressed during the discussions.
      64  316
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Open Access ,

    A unified probabilistic framework for volcanic hazard and eruption forecasting

    The main purpose of this article is to emphasize the importance of clarifying the probabilistic framework adopted for volcanic hazard and eruption forecasting. Eruption forecasting and volcanic hazard analysis seek to quantify the deep uncertainties that pervade the modeling of pre-, sin-, and post-eruptive processes. These uncertainties can be differentiated into three fundamental types: (1) the natural variability of volcanic systems, usually represented as stochastic processes with parameterized distributions (aleatory variability); (2) the uncertainty in our knowledge of how volcanic systems operate and evolve, often represented as subjective probabilities based on expert opinion (epistemic uncertainty); and (3) the possibility that our forecasts are wrong owing to behaviors of volcanic processes about which we are completely ignorant and, hence, cannot quantify in terms of probabilities (ontological error). Here we put forward a probabilistic framework for hazard analysis recently proposed by Marzocchi and Jordan (2014), which unifies the treatment of all three types of uncertainty. Within this framework, an eruption forecasting or a volcanic hazard model is said to be complete only if it (a) fully characterizes the epistemic uncertainties in the model's representation of aleatory variability and (b) can be unconditionally tested (in principle) against observations to identify ontological errors. Unconditional testability, which is the key to model validation, hinges on an experimental concept that characterizes hazard events in terms of exchangeable data sequences with well-defined frequencies. We illustrate the application of this unified probabilistic framework by describing experimental concepts for the forecasting of tephra fall from Campi Flegrei. Eventually, this example may serve as a guide for the application of the same probabilistic framework to other natural hazards.
      56  41
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: Restricted ,

    The Forecasting Skill of Physics‐Based Seismicity Models during the 2010–2012 Canterbury, New Zealand, Earthquake Sequence

    The static coulomb stress hypothesis is a widely known physical mechanism for earthquake triggering and thus a prime candidate for physics-based operational earthquake forecasting (OEF). However, the forecast skill of coulomb-based seismicity models remains controversial, especially compared with empirical statistical models. A previous evaluation by the Collaboratory for the Study of Earthquake Predictability (CSEP) concluded that a suite of coulomb-based seismicity models were less informative than empirical models during the aftershock sequence of the 1992 Mw 7.3 Landers, California, earthquake. Recently, a new generation of coulomb-based and coulomb/statistical hybrid models were developed that account better for uncertainties and secondary stress sources. Here, we report on the performance of this new suite of models compared with empirical epidemic-type aftershock sequence (ETAS) models during the 2010–2012 Canterbury, New Zealand, earthquake sequence. Comprising the 2010 M 7.1 Darfield earthquake and three subsequent M ≥ 5:9 shocks (including the February 2011 Christchurch earthquake), this sequence provides a wealth of data (394 M ≥ 3:95 shocks). We assessed models over multiple forecast horizons (1 day, 1 month, and 1 yr, updated after M ≥ 5:9 shocks). The results demonstrate substantial improvements in the coulomb-based models. Purely physics-based models have a performance comparable to the ETAS model, and the two coulomb/statistical hybrids perform better or similar to the corresponding statistical model. On the other hand, an ETAS model with anisotropic (fault-based) aftershock zones is just as informative. These results provide encouraging evidence for the predictive power of coulomb-based models. To assist with model development, we identify discrepancies between forecasts and observations.
      68  5