Abstract
We discuss filtering procedures for robust extraction of a signal from noisy time series. Moving averages and running medians are standard methods for this, but they have shortcomings when large spikes (outliers) respectively trends occur. Modified trimmed means and linear median hybrid filters combine advantages of both approaches, but they do not completely overcome the difficulties. Improvements can be achieved by using robust regression methods, which work even in real time because of increased computational power and faster algorithms. Extending recent work we present filters for robust online signal extraction and discuss their merits for preserving trends, abrupt shifts and extremes and for the removal of spikes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bernholt T., Fried R. (2003). Computing the update of the repeated median regression line in linear time. Information Processing Letters 88, 111–117.
Cormen T.H., Leiserson C.E., Rivest R.L. (1990). Introduction to algo-rithms. MIT Press, Cambridge, Massachusetts, and McGraw-Hill Book Company, New York.
Croux C., Rousseeuw P.J. (1992). Time-efficient algorithms for two highly robust estimators of scale. COMPSTAT 1992, Physica-Verlag, Heidelberg, 411–428.
Davies P.L., Fried R., Gather U. (2004). Robust signal extraction for online monitoring data. J. Statistical Planning and Inference 122, 65–78.
Fried R. (2004). Robust filtering of time series with trends. Current Advances and Trends in Nonparametric Statistics, special issue of the J. of Nonparametric Statistics, to appear.
Fried R., Bernholt T., Gather U. (2004a). Repeated median and hybrid filters. Technical Report, SFB 475, University of Dortmund, Germany.
Fried R., Bernholt T., Gather U. (2004b). Modified repeated median filters. Preprint, Department of Statistics, University of Dortmund, Germany.
Fried R., Gather U. (2002). Fast and robust filtering of time series with trends. COMPSTAT 2002, Physica-Verlag, Heidelberg, 367–372.
Gather U., Fried R. (2003). Robust estimation of scale for local linear temporal trends. Proceedings of PROBASTAT 2002, Tatra Mountains Mathematical Publications 26, 87–101.
Heinonen P., Neuvo Y. (1987). FIR-median hybrid filters. IEEE Transactions on Acoustics, Speech, and Signal Processing 35, 832–838.
Heinonen P., Neuvo Y. (1988). FIR-median hybrid filters with predictive FIR substructures. IEEE Transactions on Acoustics, Speech, and Signal Processing 36, 892–899.
Lee Y., Kassam S. (1985). Generalized median filtering and related nonlinear filtering techniques. IEEE Transactions on Acoustics, Speech, and Signal Processing 33, 672–683.
Rousseeuw P.J. (1984). Least median of squares regression. J. American Statistical Association 79, 871–880.
Rousseuw P.J., Croux C. (1993). Alternatives to the median absolute deviation. J. American Statistical Association 88, 1273–1283.
Siegel A.F. (1982). Robust regression using repeated medians. Biometrika 68, 242–244.
Tukey J.W. (1977). Exploratory data analysis. Addison-Wesley, Reading, Mass, (preliminary ed. 1971).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gather, U., Fried, R. (2004). Methods and Algorithms for Robust Filtering. In: Antoch, J. (eds) COMPSTAT 2004 — Proceedings in Computational Statistics. Physica, Heidelberg. https://doi.org/10.1007/978-3-7908-2656-2_12
Download citation
DOI: https://doi.org/10.1007/978-3-7908-2656-2_12
Publisher Name: Physica, Heidelberg
Print ISBN: 978-3-7908-1554-2
Online ISBN: 978-3-7908-2656-2
eBook Packages: Springer Book Archive