Standards for the performance assessment of territorial landslide early warning systems

Landslide early warning systems (LEWS) can be categorized into two groups: territorial and local systems. Territorial landslide early warning systems (Te-LEWS) deal with the occurrence of several landslides in wide areas: at municipal/regional/national scale. The aim of such systems is to forecast the increased probability of landslide occurrence in a given warning zone. The performance evaluation of such systems is often overlooked, and a standardized procedure is still missing. This paper describes a new Excel user-friendly tool for the application of the EDuMaP method, originally proposed by (Calvello and Piciullo 2016). A description of indicators used for the performance evaluation of different Te-LEWS is provided, and the most useful ones have been selected and implemented into the tool. The EDuMaP tool has been used for the performance evaluation of the SMART warning model operating in Piemonte region, Italy. The analysis highlights the warning zones with the highest performance and the ones that need threshold refinement. A comparison of the performance of the SMART model with other models operating in different Te-LEWS has also been carried out, highlighting critical issues and positive aspects. Lastly, the SMART performance has been evaluated with both the EDuMaP and a standard 2 x 2 contingency table for comparison purposes. The result highlights that the latter approach can lead to an imprecise and not detailed assessment of the warning model, because it cannot differentiate among the levels of warning and the variable number of landslides that may occur in a time interval.