Skip to main content

Genetic Algorithm for Optimization of Multiple Objectives in Knowledge Discovery from Large Databases

  • Chapter
Multi-Objective Evolutionary Algorithms for Knowledge Discovery from Databases

Part of the book series: Studies in Computational Intelligence ((SCI,volume 98))

Knowledge discovery in databases (KDD) is increasingly being accepted as a viable tool for collecting, analyzing, and making decision from massive data sets. Though many sophisticated techniques are developed by various interdisciplinary fields, only few of them are well equipped to handle multi-criteria issues of KDD. It seems to provide a new frontier of research directions. The KDD issues like feature selection, instance selection, rule mining and clustering involves simultaneous optimization of several (possibly conflicting) objectives. Further, considering a single criterion, as with the existing soft computing techniques like evolutionary algorithms (EA), neural network (NN), and particle swarm optimization (PSO) are not up to the mark. Therefore, the KDD issues have attracted considerable attention of the well established multi-objective genetic algorithms to optimize the identifiable objectives in KDD.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Deb K (2001) Multi-objective optimisation using evolutionary algorithms. Wiley, New York

    Google Scholar 

  2. Goldberg D E (1989) Genetic algorithms in search, optimisation and machine learning. Addison-Wesley

    Google Scholar 

  3. Rechenberg I (1973) Evolutionsstrategie: optimierung technischer systeme, nach prinzipien der biologischen evolution. Frammann-Holzboog Verlag, Stuttgart

    Google Scholar 

  4. Durham W (1994) Co-evolution:genes, culture, and human diversity. Stanford University Press

    Google Scholar 

  5. Koza J R (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MA

    MATH  Google Scholar 

  6. Back T (1996) Evolutionary algorithms in theory and practice. Oxford University Press, New York

    Google Scholar 

  7. Freitas A A (2002) Data mining and knowledge discovery with evolutionary algorithms. Springer-Verlag, New York

    MATH  Google Scholar 

  8. Cover J M, Thomas J A (1991) Elements of information theory. John Wiley

    Google Scholar 

  9. Liu H, Motoda H (1998) Feature selection for knowledge discovery and data mining. Kluwer Academic Publishers

    Google Scholar 

  10. Quinlan J R (1993) C4.5: programs for machine learning. Morgan Kaufmann, San Mateo, CA

    Google Scholar 

  11. Fukunaga K (1972) Introduction to statistical pattern recognition. Academic Press, New York

    Google Scholar 

  12. Jain A K, Dubes R C (1988) Algorithm for clustering data. Pretince Hall, Englewood Cliffs, New Jersey

    Google Scholar 

  13. Adamo J M (2001) Data mining for association rules and sequential patterns. Springer-Verlag, New York

    MATH  Google Scholar 

  14. Fogel D B (2000) Evolutionary computation: Toward a new philosophy of machine intelligence. IEEE Press, Piscataway, New Jersey

    Google Scholar 

  15. Fogel D B (1998) Evolutionary computation: The fossil record. IEEE Press, Piscataway, New Jersey

    MATH  Google Scholar 

  16. Fayyad U M, Piatetsky-Shapiro G, Smyth P (1996) From data mining to knowledge discovery: an Overview. In: Fayyad U M, Piatetsky-Shapiro G, Smyth P, Uthurusamy R (eds) Advances in Knowledge Discovery and Data Mining. MIT Press, MA 1–34

    Google Scholar 

  17. Brachman R J, Anand T (1996) The process of knowledge discovery in databases: a human centred approach. In: Fayyad U M, Piatetsky-Shapiro G, Smyth P, Uthurusamy R (eds) Advances in Knowledge Discovery and Data Mining. MIT Press, MA 37–57

    Google Scholar 

  18. Frawley W J, Piatetsky-Shapiro G, and Matheus C J (1991) Knowledge discovery in databases: an overview. In: Piatetsky-Shapiro G, Frawley B (eds) Knowledge Discovery in Databases. MIT Press, MA 1–27

    Google Scholar 

  19. Reeves C R, Bush D R (2001) Using genetic algorithms for training data selection in RBF networks. In: Liu H, Motoda H (eds) Instance Selection and Construction for Data Mining, Norwell, MA: Kluwer 339–356

    Google Scholar 

  20. Cano J R, Herrera F, Lozano M (2003) Using evolutionary algorithms as instance selection for data reduction in KDD: an experimental study. IEEE Transactions on Evolutionary Computation 7(6):561–575

    Article  Google Scholar 

  21. Ghosh A, Nath B (2004) Multi-objective rule mining using genetic algorithms. Information Sciences 163:123–133

    Article  MathSciNet  Google Scholar 

  22. Babcock C (1994) Parallel processing mines retail data. Computer World, 6

    Google Scholar 

  23. Fashman K H, Cuticchia A J, Kingsbury D T (1994) The GDB (TM) human genome database. Anna. Nucl. Acid. R. 22(17):3462–3469

    Article  Google Scholar 

  24. Weir N, Fayyad, U M, Djorgovski S G (1995) Automated star/galaxy classification for digitized POSS-II. Astron. Journal 109(6): 2401–2412

    Article  Google Scholar 

  25. Weir N, Djorgovski S G, Fayyad U M (1995) Initial galaxy counts from digitized POSS-II. Astron. Journal 110(1):1–20

    Article  Google Scholar 

  26. Back T, Schwefel H-P (1993) An overview of evolutionary algorithms for parameter optimisation. Evolutionary Computation 1(1):1–23

    Article  Google Scholar 

  27. Ghosh A, Dehuri S (2004) Evolutionary algorithms for multi-criterion optimization: a survey. International Journal on Computing and Information Science 2(1):38–57

    Google Scholar 

  28. Laumanns M, Rudolph G, Schwefel H-P (1998) A spatial predator-prey approach to multi-objective optimization. Parallel Problem Solving from Nature 5:241–249

    Article  Google Scholar 

  29. Deb K, Pratap A, Agrawal S, Meyarivan T (2002) A Fast and elitist multi-objective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6:182–197

    Article  Google Scholar 

  30. Ziztler E, Thiele L (1999) Multi-objective evolutionary algorithms: a comparative case study and strength pareto approach. IEEE Transactions on Evolutionary Computation 3:257–271

    Article  Google Scholar 

  31. Reinartz T (2002) A unifying view on instance selection. Data Mining and Knowledge Discovery 6:191–210

    Article  MATH  MathSciNet  Google Scholar 

  32. Kohavi R, John G H (1997) Wrappers for feature subset selection. Artificial Intelligence 97:273–324

    Article  MATH  Google Scholar 

  33. Siedlecki W, Sklansky J (1989) A note on genetic algorithms for large scale feature selection. Pattern Recognition Letters 10:335–47

    Article  MATH  Google Scholar 

  34. Jain A, Zongker D (1997) Feature selection: evaluation, application and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 19:153–158

    Article  Google Scholar 

  35. Lim T-S, Loh W-Y, Shih Y-S (2000) A Comparison of prediction accuracy complexity and training time of thirty-three old and new classification algorithms. Machine Learning Journal 40:203–228

    Article  MATH  Google Scholar 

  36. Krovi R (1991) Genetic algorithm for clustering: a preliminary investigation. IEEE Press 504–544

    Google Scholar 

  37. Krishna K, Murty M N (1999) Genetic K-means algorithms. IEEE Transactions on Systems, Man and Cybernetics- Part-B 29:433–439

    Article  Google Scholar 

  38. Sarafis I, Zalzala AMS, Trinder P W (2001) A genetic rule based data clustering toolkit

    Google Scholar 

  39. Dehuri S, Mall R (2006) Predictive and comprehensible rule discovery using a multi-objective genetic algorithm. Knowledge Based Systems 19(6):413–421

    Article  Google Scholar 

  40. Dehuri S, Patnaik S, Ghosh A, Mall R (2007) Application of elitist multi-objective genetic algorithm for classification rule generation. Applied Soft Computing (in press)

    Google Scholar 

  41. Ishibuchi H, Nakashima T (2000) Multiobjective pattern and feature selection by a genetic algorithm. Proceedings of Genetic and Evolutionary Computation Conference 1069–1076

    Google Scholar 

  42. Fayyad U M, Uthurusamy, R (1995) (eds) Proceedings 1st Internationl Conference Knowledge Discovery and Data Mining (KDD-95). AAAI Press, Montreal, Canada

    Google Scholar 

  43. Simoudis E, Han J, Fayyad, U M (1996) Proceedings 2nd International Conference Knowledge Discovery & Data Mining, Portland, Oregon

    Google Scholar 

  44. Holland J H (1990) ECHO: Explorations of evolution in a miniature world. In Famer J D, Doyne J (eds) Proceedings of the Second Conference on Artificial Life, Addison Wesley

    Google Scholar 

  45. Noda E, Freitas A A, Lopes H S (1999) Discovering interesting prediction rules with a genetic algorithm. Proceeding Conference on Evolutionary Computation (CEC-99), Washington D.C., USA 1322–1329

    Google Scholar 

  46. Emmanouilidis C, Hunter A, MacIntyre J (2000) A multiobjective evolutionary setting for feature selection and a commonality based crossover operator. Proceedings CEC-2000 La Jolla CA, USA 309–316

    Google Scholar 

  47. Dehuri S, Mall R (2004) Mining predictive and comprehensible classification rules using multi-objective genetic algorithm. Proceeding of ADCOM, India

    Google Scholar 

  48. Agrawal R, Srikant R (1994) Fast algorithms for mining association rules. Proceedings of the 20th International Conference on Very Large Databases

    Google Scholar 

  49. Agrawal R, Imielinski T, Swami A (1993) Mining association rules between sets of items in large databases. Proceedings of ACM SIGMOD Conference on Management of Data 207–216

    Google Scholar 

  50. Jie L, Xinbo G, Li-Chang J (2003) A GA based clustering algorithm for large datasets with mixed numeric and categorical values. Proceedings of the 5th International Conference on Computational Intelligence and Multi. Application

    Google Scholar 

  51. Schewefel H -P (1975) Evolutionsstrategie and numerische optimierung. Ph. D. Thesis, Technical University, Berlin

    Google Scholar 

  52. Handl J, Knowles J (2004) Multi-objective clustering with automatic determination of the number of clusters. Tech. Report TR-COMPSYSBIO-2004-02 UMIST, Manchester

    Google Scholar 

  53. Ayad A M (2000) A new algorithm for incremental mining of constrained association rules. Master Thesis, Department of Computer Sciences and Automatic Control, Alexandria University

    Google Scholar 

  54. Schaffer J D (1984) Multiple objective optimization with vector evaluated genetic algorithms. PhD Thesis, Vanderbilt University

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Dehuri, S., Ghosh, S., Ghosh, A. (2008). Genetic Algorithm for Optimization of Multiple Objectives in Knowledge Discovery from Large Databases. In: Ghosh, A., Dehuri, S., Ghosh, S. (eds) Multi-Objective Evolutionary Algorithms for Knowledge Discovery from Databases. Studies in Computational Intelligence, vol 98. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77467-9_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-77467-9_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-77466-2

  • Online ISBN: 978-3-540-77467-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics