Skip to main content

Logical Analysis of Data: Theory, Methodology and Applications

  • Chapter
Three Approaches to Data Analysis

Abstract

Logical analysis of data (LAD) is a data analysis methodology which combines ideas and concepts from optimization, combinatorics and Boolean functions. The idea of LAD was first described by Peter L. Hammer in a lecture given in 1986 at the International Conference on Multi-attribute Decision Making via OR-based Expert Systems [41] and was later expanded and developed in [32]. That first publication was followed by a stream of research studies many of which can be found in the list of references. In early publications the focus of research was on theoretical developments and on computational implementation. In recent years attention was concentrated on practical applications varying from medicine to credit risk ratings. The purpose of the present chapter is to provide an overview of the theoretical foundations of this methodology, to discuss various aspects of its implementation and to survey some of its numerous applications. We start with an introductory example proposed in [32].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abramson, S., Alexe, G., Hammer, P., Kohn, J.: A computational approach to predicting cell growth on polymeric biomaterials. J. Biomed. Mater. Res. Part A 73(1), 116–124 (2005)

    Article  Google Scholar 

  2. Alexe, G., Alexe, S., Axelrod, D.E., Bonates, T.O., Lozina, I.I., Reiss, M., Hammer, P.L.: Breast cancer prognosis by combinatorial analysis of gene expression data. Breast Cancer Research 8, R41 (2006)

    Article  Google Scholar 

  3. Alexe, G., Alexe, S., Axelrod, D.E., Hammer, P.L., Weissmann, D.: Logical analysis of diffuse large B-cell lymphomas. Artif. Intell. Med. 34, 235–267 (2005)

    Article  Google Scholar 

  4. Alexe, G., Alexe, S., Bonates, T.O., Kogan, A.: Logical analysis of data — the vision of Peter L. Hammer. Annals of Mathematics and Artificial Intelligence 49, 265–312 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  5. Alexe, G., Alexe, S., Hammer, P.L.: Pattern-based clustering and attribute analysis. Soft Comput. 10(5), 442–452 (2006)

    Article  Google Scholar 

  6. Alexe, G., Alexe, S., Hammer, P.L., Kogan, A.: Comprehensive vs. comprehensible classifiers in logical analysis of data. Discrete Appl. Math. 156, 870–882 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  7. Alexe, G., Alexe, S., Hammer, P.L., Vizvári, B.: Pattern-based feature selection in genomics and proteomics. Annals OR 148(1), 189–201 (2006)

    Article  MATH  Google Scholar 

  8. Alexe, G., Alexe, S., Liotta, L.A., Petricoin, E., Reiss, M., Hammer, P.L.: Ovarian cancer detection by logical analysis of proteomic data. Proteomics 4(3), 766–783 (2004)

    Article  Google Scholar 

  9. Alexe, G., Hammer, P.L.: Spanned patterns for the logical analysis of data. Discrete Appl. Math. 154, 1039–1049 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  10. Alexe, S., Blackstone, E., Hammer, P.L., Ishwaran, H., Lauer, M.S., Snader, C.E.P.: Coronary risk prediction by logical analysis of data. Annals OR 119(1-4), 15–42 (2003)

    Article  MATH  Google Scholar 

  11. Alexe, S., Hammer, P.L.: Accelerated algorithm for pattern detection in logical analysis of data. Discrete Appl. Math. 154, 1050–1063 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  12. Anthony, M.: Accuracy of techniques for the logical analysis of data. Discrete Appl. Math. 96-97, 247–257 (1999)

    Article  MathSciNet  Google Scholar 

  13. Anthony, M.: Generalization error bounds for the logical analysis of data. Discrete Appl. Math. (to appear)

    Google Scholar 

  14. Anthony, M., Ratsaby, J.: Robust cutpoints in the logical analysis of numerical data. Discrete Appl. Math. 160, 355–364 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  15. Bennane, A., Yacout, S.: LAD-CBM: new data processing tool for diagnosis and prognosis in condition-based maintenance. Journal of Intelligent Manufacturing (to appear)

    Google Scholar 

  16. Blazewicz, J., Hammer, P., Lukasiak, P.: Predicting secondary structures of proteins. IEEE Engineering in Medicine and Biology Magazine 24(3), 88–94 (2005)

    Article  Google Scholar 

  17. Blazewicz, J., Hammer, P.L., Lukasiak, P.: Prediction of protein secondary structure using logical analysis of data algorithm. Computational Methods in Science and Technology 7(1), 7–25 (2001)

    Google Scholar 

  18. Bonates, T.O.: Large Margin Rule-Based Classifiers, pp. 1–12. John Wiley & Sons Inc. (2010)

    Google Scholar 

  19. Bonates, T.O., Hammer, P.L., Kogan, A.: Maximum patterns in datasets. Discrete Appl. Math. 156, 846–861 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  20. Bores, E., Hammer, P., Ibaraki, T., Kogan, A., Mayoraz, E., Muchnik, I.: An implementation of logical analysis of data. IEEE Transactions on Knowledge and Data Engineering 12(2), 292–306 (2000)

    Article  Google Scholar 

  21. Boros, E., Crama, Y., Hammer, P., Ibaraki, T., Kogan, A., Makino, K.: Logical analysis of data: classification with justification. Annals OR 188, 33–61 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  22. Boros, E., Gurvich, V., Hammer, P.L., Ibaraki, T., Kogan, A.: Decomposability of partially defined boolean functions. Discrete Appl. Math. 62(1-3), 51–75 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  23. Boros, E., Hammer, P., Ibaraki, T., Kogan, A.: Logical analysis of numerical data. Mathematical Programming 79, 163–190 (1997)

    MathSciNet  MATH  Google Scholar 

  24. Boros, E., Ibaraki, T., Makino, K.: Logical analysis of binary data with missing bits. Artif. Intell. 107, 219–263 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  25. Boros, E., Ibaraki, T., Makino, K.: Variations on extending partially defined boolean functions with missing bits. Inf. Comput. 180, 53–70 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  26. Boros, E., Kantor, P.B., Neu, D.J.: Logical analysis of data in the TREC-9 filtering track. In: Proceedings of the Ninth Text REtrieval Conference (TREC-9), Maryland, USA, pp. 453–462 (2000)

    Google Scholar 

  27. Brannon, A.R., Reddy, A., Seiler, M., Arreola, A., Moore, D.T., Pruthi, R.S., Wallen, E.M., Nielsen, M.E., Liu, H., Nathanson, K.L., Ljungberg, B., Zhao, H., Brooks, J.D., Ganesan, S., Bhanot, G., Rathmell, W.K.: Molecular stratification of clear cell renal cell carcinoma by consensus clustering reveals distinct subtypes and survival patterns. Genes & Cancer 1(2), 152–163 (2010)

    Article  Google Scholar 

  28. Brauner, M.W., Brauner, N., Hammer, P.L., Lozina, I., Valeyre, D.: Logical analysis of computed tomography data to differentiate entities of idiopathic interstitial pneumonias. In: Pardalos, P.M., Boginski, V.L., Vazacopoulos, A. (eds.) Data Mining in Biomedicine. Springer Optimization and Its Applications, vol. 7, pp. 193–208. Springer, US (2007)

    Chapter  Google Scholar 

  29. Brennan, M.L., Reddy, A., Tang, W.H.W., Wu, Y., Brennan, D.M., Hsu, A., Mann, S.A., Hammer, P.L., Hazen, S.L.: Comprehensive peroxidase-based hematologic profiling for the prediction of 1-year myocardial infarction and death. Circulation 122(1), 70–79 (2010)

    Article  Google Scholar 

  30. Bruni, R.: Reformulation of the support set selection problem in the logical analysis of data. Annals OR 150(1), 79–92 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  31. Cepek, O., Kronus, D., Kucera, P.: Analysing dna microarray data using boolean techniques. Annals OR 188(1), 77–110 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  32. Crama, Y., Hammer, P., Ibaraki, T.: Cause-effect relationships and partially defined boolean functions. Annals OR 16, 299–325 (1988)

    Article  MathSciNet  Google Scholar 

  33. Csizmadia, Z., Hammer, P.L., Vizvari, B.: Artificial attributes in analyzing biomedical databases. In: Pardalos, P.M., Hansen, P. (eds.) Data Mining and Mathematical Programming. CRM Proceedings and Lecture Notes, vol. 45, pp. 41–66. American Mathematical Soc. (2008)

    Google Scholar 

  34. Dupuis, C., Gamache, M., Page, J.F.: Logical analysis of data for estimating passenger show rates at Air Canada. Journal of Air Transport Management 18(1), 78–81 (2012)

    Article  Google Scholar 

  35. Eckstein, J., Hammer, P.L., Liu, Y., Nediak, M., Simeone, B.: The maximum box problem and its application to data analysis. Comput. Optim. Appl. 23, 285–298 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  36. Ekin, O., Hammer, P.L., Kogan, A.: Convexity and logical analysis of data. Theor. Comput. Sci. 244, 95–116 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  37. Gubskaya, A.V., Bonates, T.O., Kholodovych, V., Hammer, P., Welsh, W.J., Langer, R., Kohn, J.: Logical analysis of data in structure-activity investigation of polymeric gene delivery. Macromolecular Theory and Simulations 20(4), 275–285 (2011)

    Article  Google Scholar 

  38. Hammer, A., Hammer, P., Muchnik, I.: Logical analysis of chinese labor productivity patterns. Annals OR 87, 165–176 (1999)

    Article  MATH  Google Scholar 

  39. Hammer, P., Kogan, A., Lejeune, M.: Modeling country risk ratings using partial orders. European Journal of Operational Research 175(2), 836–859 (2006)

    Article  MATH  Google Scholar 

  40. Hammer, P., Kogan, A., Lejeune, M.: Reverse-engineering country risk ratings: a combinatorial non-recursive model. Annals OR 188, 185–213 (2011)

    Article  MathSciNet  Google Scholar 

  41. Hammer, P.L.: Partially defined boolean functions and cause-effect relationships. In: Lecture at the International Conference on Multi-Attrubute Decision Making Via OR-Based Expert Systems. University of Passau, Passau, Germany (1986)

    Google Scholar 

  42. Hammer, P.L., Bonates, T.O.: Logical analysis of data - An overview: From combinatorial optimization to medical applications. Annals OR 148(1), 203–225 (2006)

    Article  MATH  Google Scholar 

  43. Hammer, P.L., Kogan, A., Lejeune, M.: A logical analysis of banks financial strength ratings. Technical Report TR-2010-9, The George Washington University (2010)

    Google Scholar 

  44. Hammer, P.L., Kogan, A., Simeone, B., Szedmák, S.: Pareto-optimal patterns in logical analysis of data. Discrete Appl. Math. 144, 79–102 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  45. Hammer, P.L., Liu, Y., Simeone, B., Szedmák, S.: Saturated systems of homogeneous boxes and the logical analysis of numerical data. Discrete Appl. Math. 144, 103–109 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  46. Han, J., Kim, N., Yum, B.J., Jeong, M.K.: Classification using the patterns generated from the logical analysis of data. In: Proceedings of the 10th Asia Pacific Industrial Engineering and Management Systems Conference, pp. 1562–1569 (2009)

    Google Scholar 

  47. Han, J., Kim, N., Yum, B.J., Jeong, M.K.: Pattern selection approaches for the logical analysis of data considering the outliers and the coverage of a pattern. Expert Systems with Applications 38(11), 13857–13862 (2011)

    Google Scholar 

  48. Hansen, P., Meyer, C.: A new column generation algorithm for logical analysis of data. Annals OR 188, 215–249 (2011)

    Article  MATH  Google Scholar 

  49. Kim, K., Ryoo, H.: A lad-based method for selecting short oligo probes for genotyping applications. OR Spectrum 30, 249–268 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  50. Kim, K., Ryoo, H.S.: Selecting genotyping oligo probes via logical analysis of data. In: Proceedings of the 20th conference of the Canadian Society for Computational Studies of Intelligence on Advances in Artificial Intelligence, CAI 2007, pp. 86–97. Springer, Heidelberg (2007)

    Google Scholar 

  51. Kogan, A., Lejeune, M.A.: Combinatorial methods for constructing credit risk ratings. In: Lee, C.F., Lee, A.C., Lee, J. (eds.) Handbook of Quantitative Finance and Risk Management, pp. 639–664. Springer, US (2010)

    Chapter  Google Scholar 

  52. Kohli, R., Krishnamurti, R., Jedidi, K.: Subset-conjunctive rules for breast cancer diagnosis. Discrete Appl. Math. 154, 1100–1112 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  53. Kronek, L.P., Reddy, A.: Logical analysis of survival data: prognostic survival models by detecting high-degree interactions in right-censored data. Bioinformatics 24, 248–253 (2008)

    Article  Google Scholar 

  54. Lauer, M.S., Alexe, S., Pothier Snader, C.E., Blackstone, E.H., Ishwaran, H., Hammer, P.L.: Use of the logical analysis of data method for assessing long-term mortality risk after exercise electrocardiography. Circulation 106(6), 685–690 (2002)

    Google Scholar 

  55. Lejeune, M.A., Margot, F.: Optimization for simulation: Lad accelerator. Annals OR 188(1), 285–305 (2011)

    Article  MATH  Google Scholar 

  56. Lemaire, P.: Extensions of logical analysis of data for growth hormone deficiency diagnoses. Annals OR 186(1), 199–211 (2011)

    Article  MathSciNet  Google Scholar 

  57. Lemaire, P., Brauner, N., Hammer, P., Trivin, C., Souberbielle, J.C., Brauner, R.: Improved screening for growth hormone deficiency using logical analysis data. Med. Sci. Monit. 15, 5–10 (2009)

    Google Scholar 

  58. Lupca, L., Chiorean, I., Neamtiu, L.: Use of lad in establishing morphologic code. In: Proceedings of the 2010 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR 2010), vol. 03, pp. 1–6. IEEE Computer Society, Washington, DC (2010)

    Chapter  Google Scholar 

  59. Martin, S.G., Kronek, L.P., Valeyre, D., Brauner, N., Brillet, P.Y., Nunes, H., Brauner, M.W., Rety, F.: High-resolution computed tomography to differentiate chronic diffuse interstitial lung diseases with predominant ground-glass pattern using logical analysis of data. European Radiology 20(6), 1297–1310 (2010)

    Article  Google Scholar 

  60. Mayoraz, E.: C++ tools for logical analysis of data. Report 1-95, Rutgers University, New Jersey, USA (1995)

    Google Scholar 

  61. Mayoraz, E.N., Moreira, M.: Combinatorial Approach for Data Binarization. In: Żytkow, J.M., Rauch, J. (eds.) PKDD 1999. LNCS (LNAI), vol. 1704, pp. 442–447. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  62. Mortada, M.A., Carroll, T., Yacout, S., Lakis, A.: Rogue components: their effect and control using logical analysis of data. Journal of Intelligent Manufacturing (to appear)

    Google Scholar 

  63. Muselli, M., Ferrari, E.: Coupling logical analysis of data and shadow clustering for partially defined positive boolean function reconstruction. IEEE Trans. on Knowl. and Data Eng. 23, 37–50 (2011)

    Article  Google Scholar 

  64. Ono, H., Makino, K., Ibaraki, T.: Logical analysis of data with decomposable structures. Theor. Comput. Sci. 289, 977–995 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  65. Ono, H., Yagiura, M., Ibaraki, T.: An Index for the Data Size to Extract Decomposable Structures in LAD. In: Eades, P., Takaoka, T. (eds.) ISAAC 2001. LNCS, vol. 2223, pp. 279–290. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  66. Ono, H., Yagiura, M., Ibaraki, T.: A decomposability index in logical analysis of data. Discrete Appl. Math. 142(1-3), 165–180 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  67. Puszyński, K.: Parallel Implementation of Logical Analysis of Data (LAD) for Discriminatory Analysis of Protein Mass Spectrometry Data. In: Wyrzykowski, R., Dongarra, J., Meyer, N., Waśniewski, J. (eds.) PPAM 2005. LNCS, vol. 3911, pp. 1114–1121. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  68. Reddy, A., Wang, H., Yu, H., Bonates, T., Gulabani, V., Azok, J., Hoehn, G., Hammer, P., Baird, A., Li, K.: Logical analysis of data (lad) model for the early diagnosis of acute ischemic stroke. BMC Medical Informatics and Decision Making 8(1), 30 (2008)

    Article  Google Scholar 

  69. Ryoo, H.S., Jang, I.Y.: Milp approach to pattern generation in logical analysis of data. Discrete Appl. Math. 157, 749–761 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  70. Yacout, S.: Fault detection and diagnosis for condition based maintenance using the logical analysis of data. In: 2010 40th International Conference on Computers and Industrial Engineering (CIE), pp. 1–6 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Igor Chikalov .

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Chikalov, I. et al. (2013). Logical Analysis of Data: Theory, Methodology and Applications. In: Three Approaches to Data Analysis. Intelligent Systems Reference Library, vol 41. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28667-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28667-4_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28666-7

  • Online ISBN: 978-3-642-28667-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics