Abstract
The availability of dynamic influent data is of crucial importance for model development, as it provides the model input needed realistic dynamic simulations. Data analysis and reconciliation of such data are however often very time-consuming tasks, making that, even when some online influent data is indeed available, the option is often chosen to generate influent data in one way or the other. A lot of information contained in the available data is lost in that way. This contribution showcases a python package that allows for a streamlined data analysis workflow and provides possibilities for data analysis, validation and gap filling, with as main goal to recover and use as much (influent) data as possible. In the end, this provides a means towards more scientifically sound dynamic simulations and model calibration and validation, while limiting the time spent on data reconciliation.
This is a preview of subscription content, log in via an institution.
References
Cierkens K, Plano S, Benedetti L, Weijers S, de Jonge J, Nopens I (2012) Impact of influent data frequency and model structure on the quality of WWTP model calibration and uncertainty. Water Sci Technol 65(2):233–242
Gernaey KV, Flores-Alsina X, Rosen C, Benedetti L, Jeppsson U (2011) Dynamic influent pollutant disturbance scenario generation using a phenomenological modelling approach. Environ Model Softw 26:1255–1267
Hauduc H, Gillot S, Rieger L, Winkler S (2009) Activated sludge modelling in practice: an international survey. Water Sci Technol 60(8):1943–1951
Hunter JD (2007) Matplotlib: a 2d graphics environment. Comput Sci Eng 9(3):90–95
Langergraber G, Alex J, Weissenbacher N, Woerner D, Ahnert M, Frehmann T, Halft N, Hobus I, Plattes M, Spering V, Winkler S (2008) Generation of diunral variation for influent data for dynamic simulation. Water Sci Technol 57(9):1483–1486
Langeveld J, Schilperoort R, Van Daal P, Benedetti L, Amerlinck Y, de Jonge J, Flameling T, Nopens I, Weijers S (2014) A new empirical sewer water quality model for the prediction of WWTP influent quality. In: Proceedings of the 13th conference on urban drainage
Martin C, Vanrolleghem PA (2014) Analysing, completing, and generating influent data for WWTP modelling: a critical review. Environ Model Softw 60:188–201
McKinney W (2010) Data structures for statistical computing in python. In: van der Walt S, Millman J (eds) Proceedings of the 9th Python in science conference, pp 51–56
Rieger L, Takacs I, Villez K, Siegrist H, Lessard P, Vanrolleghem PA, Comeau Y (2010) Data reconciliation for wastewater treatment plant simulation studies - planning for high-quality data and typical sources of errors. Water Environ Res 82(5):426–438
Acknowledgements
The authors would like to express their gratitude towards Waterboard De Dommel for both the funding of this research and the smooth cooperation.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
De Mulder, C., Flameling, T., Langeveld, J., Amerlinck, Y., Weijers, S., Nopens, I. (2017). Automating the Raw Data to Model Input Process Using Flexible Open Source Tools. In: Mannina, G. (eds) Frontiers in Wastewater Treatment and Modelling. FICWTM 2017. Lecture Notes in Civil Engineering , vol 4. Springer, Cham. https://doi.org/10.1007/978-3-319-58421-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-58421-8_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-58420-1
Online ISBN: 978-3-319-58421-8
eBook Packages: EngineeringEngineering (R0)