4.5 Article

Comparison of discrete Fourier transform (DFT) and principal component analysis/DFT as forecasting tools for absorbance time series received by UV-visible probes installed in urban sewer systems

Journal

WATER SCIENCE AND TECHNOLOGY
Volume 69, Issue 5, Pages 1101-1107

Publisher

IWA PUBLISHING
DOI: 10.2166/wst.2014.011

Keywords

absorbance; forecast; Fourier transform; principal component analysis; UV-Vis sensor

Funding

  1. Bogota Water and Sewage Company (Empresa de Acueducto y Alcantarillado de Bogota - EAAB) [9-07-25100-0763-2010]

Ask authors/readers for more resources

The objective of this work is to introduce a forecasting method for UV-Vis spectrometry time series that combines principal component analysis (PCA) and discrete Fourier transform (DFT), and to compare the results obtained with those obtained by using DFT. Three time series for three different study sites were used: (i) Salitre wastewater treatment plant (WWTP) in Bogota; (ii) Gibraltar pumping station in Bogota; and (iii) San Fernando WWTP in Itagui (in the south part of Medellin). Each of these time series had an equal number of samples (1051). In general terms, the results obtained are hardly generalizable, as they seem to be highly dependent on specific water system dynamics; however, some trends can be outlined: (i) for UV range, DFT and PCA/DFT forecasting accuracy were almost the same; (ii) for visible range, the PCA/DFT forecasting procedure proposed gives systematically lower forecasting errors and variability than those obtained with the DFT procedure; and (iii) for short forecasting times the PCA/DFT procedure proposed is more suitable than the DFT procedure, according to processing times obtained.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Environmental

Forecasting of UV-Vis absorbance time series using artificial neural networks combined with principal component analysis

Leonardo Plazas-Nossa, Thomas Hofer, Guenter Gruber, Andres Torres

WATER SCIENCE AND TECHNOLOGY (2017)

Article Engineering, Multidisciplinary

Identifying explanatory variables of structural state for optimum asset management of urban drainage networks: a pilot study for the city of Bogota

H. Angarita, P. Nino, D. Vargas, N. Hernandez, A. Torres

INGENIERIA E INVESTIGACION (2017)

Review Environmental Sciences

Urban Water Cycle Simulation/Management Models: A Review

Carlos Andres Pena-Guzman, Joaquin Melgarejo, Daniel Prats, Andres Torres, Sandra Martinez

WATER (2017)

Article Computer Science, Interdisciplinary Applications

Practical benchmarking of statistical and machine learning models for predicting the condition of sewer pipes in Berlin, Germany

N. Caradot, M. Riechel, M. Fesneau, N. Hernandez, A. Torres, H. Sonnenberg, E. Eckert, N. Lengemann, J. Waschnewski, P. Rouault

JOURNAL OF HYDROINFORMATICS (2018)

Article Engineering, Civil

Optimizing SVM models as predicting tools for sewer pipes conditions in the two main cities in Colombia for different sewer asset management purposes

Nathalie Hernandez, Nicolas Caradot, Hauke Sonnenberg, Pascale Rouault, Andres Torres

Summary: By optimizing hyper-parameters, SVM models in sewer asset management have higher predictive accuracy, and the differential evolution method can be used to enhance model performance.

STRUCTURE AND INFRASTRUCTURE ENGINEERING (2021)

Article Engineering, Environmental

Bayesian network-based methodology for selecting a cost-effective sewer asset management model

Julian Guzman-Fierro, Sharel Charry, Ivan Gonzalez, Felipe Pena-Heredia, Nathalie Hernandez, Andrea Luna-Acosta, Andres Torres

WATER SCIENCE AND TECHNOLOGY (2020)

Article Environmental Sciences

The influence of the correlation-covariance structure of measurement errors over uncertainties propagation in online monitoring: application to environmental indicators in SUDS

F. Pena-Heredia, S. Sandoval, J. A. Escobar-Vargas, A. Torres

Summary: This paper presents a methodology to assess the influence of the correlation-covariance structure of measurement errors in online monitoring over the propagation of uncertainties. The study analyzed the effect of auto-correlated and heteroskedastic errors on the estimated probability density function of different environmental indicators. Results showed that the temporal delimitation of hydrographs/pollutographs and the intensity of the autocorrelation have the strongest influence in the propagation of measurement errors.

ENVIRONMENTAL MONITORING AND ASSESSMENT (2021)

Article Management

Is it possible developing reliable prediction models considering only the pipe's age for decision-making in sewer asset management?

Nathalie Hernandez, Nicolas Caradot, Hauke Sonnenberg, Pascale Rouault, Andres Torres

Summary: This paper explores and compares different deterioration models based on statistical and machine learning approaches, considering two scenarios involving only age or age with other sewer characteristics. The results show that logistic regression models perform better for network management objectives under Scenario 1, while random forest models are more successful in predicting critical conditions at the sewer level under Scenario 2.

JOURNAL OF MODELLING IN MANAGEMENT (2021)

Article Water Resources

Characterization and analysis of sediments in stormwater drainage for reuse

Carlos Pena-Guzman, Jeimmy Cardenas, Amelia Perez, Andres Torres, Karen Mora-Cabrera

Summary: The study investigated the physical and chemical characteristics of sediment in pluvial sanitation systems, finding that it can be utilized to manufacture cement and pozzolans, with the need to add calcium carbonate to increase lime content.

JOURNAL OF APPLIED WATER ENGINEERING AND RESEARCH (2021)

Review Water Resources

Sewer asset management - state of the art and research needs

Franz Tscheikner-Gratl, Nicolas Caradot, Frederic Cherqui, Joao P. Leitao, Mehdi Ahmadi, Jeroen G. Langeveld, Yves Le Gat, Lisa Scholten, Bardia Roghani, Juan Pablo Rodriguez, Mathieu Lepot, Bram Stegeman, Anna Heinrichsen, Ingo Kropp, Karsten Kerres, Maria do Ceu Almeida, Peter M. Bach, Matthew Moy de Vitry, Alfeu Sa Marques, Nuno Eduardo Simoes, Pascale Rouault, Nathalie Hernandez, Andres Torres, Caty Werey, Benedicte Rulleau, Francois Clemens

URBAN WATER JOURNAL (2019)

Article Urban Studies

Bogota, a City Sensitive to the Water:Elements for Reflection

Andres Torres, Sandra Galarza-Molina, Luis Fernando Molina-Prieto

CUADERNOS DE VIVIENDA Y URBANISMO (2019)

Proceedings Paper Engineering, Environmental

Optimizing SVM Model as Predicting Model for Sewer Pipes in the Two Main Cities in Colombia

Nathalie Hernandez, Nicolas Caradot, Hauke Sonnenberg, Pascale Rouault, Andres Torres

NEW TRENDS IN URBAN DRAINAGE MODELLING, UDM 2018 (2019)

Article Water Resources

Support tools to predict the critical structural condition of uninspected pipes for case studies of Germany and Colombia

Nathalie Hernandez, Nicolas Caradot, Hauke Sonnenberg, Pascale Rouault, Andres Torres

WATER PRACTICE AND TECHNOLOGY (2018)

Article Engineering, Multidisciplinary

Relationship between hydrological, physical and chemical characteristics present in rainwater runoff sediments

Maria A. Pimiento, David S. Rivera, Jaime A. Lara-Borrero, Andres Torres

INGENIERIA Y COMPETITIVIDAD (2018)

Article Engineering, Multidisciplinary

Spectral Estimation of UV-Vis Absorbance Time Series for Water Quality Monitoring

Leonardo Plazas-Nossa, Miguel A. Avila A, Andres Torres

INGENIERIA (2017)

No Data Available