Robust Regression with Data-Dependent Regularization Parameters and Autoregressive Temporal Correlations
- 118 Downloads
We introduce robust procedures for analyzing water quality data collected over time. One challenging task in analyzing such data is how to achieve robustness in presence of outliers while maintaining high estimation efficiency so that we can draw valid conclusions and provide useful advices in water management. The robust approach requires specification of a loss function such as the Huber, Tukey’s bisquare and the exponential loss function, and an associated tuning parameter determining the extent of robustness needed. High robustness is at the cost of efficiency loss in parameter loss. To this end, we propose a data-driven method which leads to more efficient parameter estimation. This data-dependent approach allows us to choose a regularization (tuning) parameter that depends on the proportion of “outliers” in the data so that estimation efficiency is maximized. We illustrate the proposed methods using a study on ammonium nitrogen concentrations from two sites in the Huaihe River in China, where the interest is in quantifying the trend in the most recent years while accounting for possible temporal correlations and “irregular” observations in earlier years.
KeywordsAmmonia nitrogen Regularization Log-linear model Model selection Robust estimation Temporal correlations
This research was funded by the Australian Research Council projects (DP130100766 and DP160104292).
- 2.Venables, W.N., & Ripley, B.D. (2002). Modern applied statistics with S-PLUS, 4th Edn. Springer.Google Scholar
- 8.He, T., Lu, Y., Cui, Y., Luo, Y., Wang, M., Meng, W., Zhang, K., Zhao, F. (2015). Detecting gradual and abrupt changes in water quality time series in response to regional payment programs for watershed services in an agricultural area. Journal of Hydrology, 525, 457–471. https://doi.org/10.1016/j.jhydrol.2015.04.005.CrossRefGoogle Scholar
- 9.Tian, D., Zheng, W., Wei, X., Sun, X., Liu, L., Chen, X., Zhang, H., Zhou, Y., Chen, H., Zhang, H., Wang, X., Zhang, R., Jiang, S., Zheng, Y., Yang, G., Qu, W. (2013). Dissolved microcystins in surface and ground waters in regions with high cancer incidence in the Huai River Basin of China. Chemosphere, 91(7), 1064–71. https://doi.org/10.1016/j.chemosphere.2013.01.051.CrossRefGoogle Scholar
- 10.Zhang, J.Y., Wang, G.Q., Pagano, T.C., Jin, J.L., Liu, C.S., He, R.M., Liu, Y.L. (2013). Using hydrologic simulation to explore the impacts of climate change on runoff in the Huaihe River Basin of China. Journal of Hydrologic Engineering, 18(11), 1393–1399. https://doi.org/10.1061/(asce)he.1943-5584.0000581.CrossRefGoogle Scholar