Linear Trend Filtering via Adaptive LASSO

  • Matúš MaciakEmail author
Conference paper
Part of the Contributions to Statistics book series (CONTRIB.STAT.)


Linear trend filtering methods are popular due to their overall simplicity—the model is linear in each segment and there are typically only few segments considered. These segments are defined by unique points where the trend changes its direction—so-called changepoints. In this paper, we consider an innovative estimation approach for such models. Our proposal is based on recent developments in the atomic pursuit techniques: we present an estimation algorithm based on the adaptive LASSO penalty and we introduce a fully data-driven method which can be effectively used to fit the continuous linear trend models. Some statistical properties are discussed and the empirical performance is compared with respect to other competitive LASSO-based techniques.


Linear trend filtering Joinpoint regression Regularization Lasso Adaptive lasso Changepoints Oracle properties 



This work was partially supported by the research grant provided by the Czech Science Foundation, grant number P402/12/G097 and the Mobility Grant provided by the Ministry of Education, Youth and Sports in the Czech Republic, grant number 7AMB17FR030.


  1. 1.
    Kim, H.J., Fay, M.P., Yu, B.: Comparability of segmented line regression models. Biometrics 60(4), 1005–1014 (2004)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Bosetti, C., Bertuccio, P., Levi, F., Lucchini, F., Negri, E., La Vecchia, C.: Cancer mortality in the European Union, 1970–2003, with a joinpoint analysis. Ann. Oncol. 16, 631–640 (2008)Google Scholar
  3. 3.
    Kim, H.J., Yu, B., Feuer, E.J.: Selecting the number of change-points in segmented line regression. Stat. Sinica 19, 597–609 (2009)MathSciNetzbMATHGoogle Scholar
  4. 4.
    Kim, H.J., Fay, M.P., Feuer, E.J., Midthune, D.N.: Permutation tests for joinpoint regression with application to cancer rates. Stat. Med. 19, 335–351 (2000)CrossRefGoogle Scholar
  5. 5.
    Qui, D., Katanoda, K., Tomomi, M., Tomotaka, S.: A joinpoint regression analysis of long-term trends in cancer mortality in Japan (1958–2004). Int. J. Cancer 24, 443–448 (2009)Google Scholar
  6. 6.
    Feder, P.: The log likelihood ratio in segmented regression. Ann. Stat. 3, 84–97 (1975)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Hinkley, D.V.: Inference in two-phase regression. J. Am. Stat. Assoc. 66(336), 736–743 (1971)CrossRefGoogle Scholar
  8. 8.
    Carlin, B.P., Gelfand, A.E., Smith, A.F.M.: Hierarchical Bayesian analysis of changepoint problems. Appl. Stat. 41, 389–405 (1992)CrossRefGoogle Scholar
  9. 9.
    Martinez-Beneito, M., García-Donato, G., Salmerón, D.: A Bayesian joinpoint regression model with an unknown number of break-points. Ann. Appl. Stat. 5(3), 2150–2168 (2011)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Kim, S.J., Koh, K., Boyd, S., Gorinevsky, D.: \(l_1\) trend filtering. SIAM Rev. 51, 339–360 (2009)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Tibshirani, R.J.: Adaptive piecewise polynomial estimation via trend filtering. Ann. Stat. 42(1), 285–323 (2014)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Mammen, E., Van De Geer, S.: Locally adaptive regression splines. Ann. Stat. 25(1), 387–413 (1997)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Rudin, L.I., Osher, S., Faterni, E.: Nonlinear total variation based noise removal algorithm. Phys. D: Appl. Phys. 60, 259–268 (1992)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Maciak, M., Mizera, I.: Regularization techniques in joinpoint regression. Stat. Papers 57(4), 939–955 (2016)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Maciak, M.: Testing shape constrains in lasso regularized joinpoint regression. In: Antoch, J., Jurečková, J., Maciak, M., Pešta, M. (eds.) Analytical Methods in Statistics, AMISTAT, Prague, pp. 105–122, November 2015 (2016)CrossRefGoogle Scholar
  16. 16.
    Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM Rev. 43(1), 129–159 (2001)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Tibshirani, R.: Regression shrinkage and selection via the LASSO. J. R. Stat. Soc. Ser. B 58(1), 267–288 (1996)MathSciNetzbMATHGoogle Scholar
  18. 18.
    Meinshausen, N., Bhlmann, P.: Variable selection and high-dimensional graphs with the lasso. Technical report, ETH Zrich (2004)Google Scholar
  19. 19.
    Meinshausen, N., Yu, B.: Lasso-type recovery of sparse representations for high-dimensional data. Ann. Stat. 37(1), 246–270 (2009)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Zou, H.: The adaptive lasso and its oracle properties. J. Am. Stat. Assoc. 476(101), 1418–1429 (2006)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. B 67(2), 301–320 (2005)MathSciNetCrossRefGoogle Scholar
  22. 22.
    Efron, B., Hastie, T., Tibshirani, R.: Least angle regression. Ann. Stat. 32, 407–499 (2004)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Lockhart, R., Taylor, J., Tibshirani, R.J., Tibshirani, R.: A significance test for LASSO. Ann. Stat. 2(42), 413–468 (2014)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Tibshirani, R., Taylor, J., Lockhart, R., Tibshirani, R.: Exact post-selection inference for sequential regression procedures. J. Am. Stat. Assoc. 514(111), 600–620 (2016)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Koenker, R., Ng, P., Portnoy, S.: Quantile smoothing splines. Biometrika 81, 673–680 (1994)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Koenker, R., Mizera, I.: Penalized triograms: total variation regularization for bivariate smoothing. J. R. Stat. Soc. Ser. B 66, 1681–1736 (2004)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Shen, J., Gallagher, C.M., Lu, Q.: Detection of multiple undocumented change-points using adaptive lasso. J. Appl. Stat. 46(6), 1161–1173 (2014)MathSciNetCrossRefGoogle Scholar
  28. 28.
    Chatterjee, A., Lahiri, S.N.: Bootstrapping lasso estimators. J. Am. Stat. Assoc. 106(494), 608–625 (2011)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Department of Probability and Mathematical StatisticsCharles UniversityPragueCzech Republic

Personalised recommendations