Measuring the accuracy of agro-environmental indicators

Numerous agro-environmental indicators have been developed by agronomists and ecologists during the last 20 years to assess the environmental impact of farmers' practices, and to monitor effects of agro-environmental policies. The objectives of this paper were (i) to measure the accuracy of a wide range of agro-environmental indicators from experimental data and (ii) to discuss the value of different information typically used by these indicators, i.e. information on farmers' practices, and on plant and soil characteristics. Four series of indicators were considered in this paper: indicators of habitat quality for grassland bird species, indicators of risk of disease in oilseed rape Crops, indicators of risk of pollution by nitrogen fertilizer, and indicators of weed infestation. Several datasets were used to measure their accuracy in Cultivated plots and in grasslands. The sensitivity, specificity, and probability of correctly ranking plots were estimated for each indicator. Our results showed that the indicators had widely varying levels of accuracy. Some show very poor performance and had no discriminatory ability. Other indicators were informative and performed better than random decisions. Among the tested indicators, the best ones were those using information on plant characteristics such as grass height, fraction of diseased flowers, or crop yield. The statistical method applied in this paper could support researchers, farm advisers, and decision makers in comparing various indicators. (c) 2008 Elsevier Ltd. All rights reserved.