Skip to main content

Kolmogorov Complexity as a Language

  • Conference paper
Computer Science – Theory and Applications (CSR 2011)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 6651))

Included in the following conference series:

  • 796 Accesses

Abstract

The notion of Kolmogorov complexity (=the minimal length of a program that generates some object) is often useful as a kind of language that allows us to reformulate some notions and therefore provide new intuition. In this survey we provide (with minimal comments) many different examples where notions and statements that involve Kolmogorov complexity are compared with their counterparts not involving complexity.

Supported in part by NAFIT ANR-08-EMER-008-01 grant. Author is grateful to all the participants of Kolmogorov seminar at Moscow State University and to his LIF/ESCAPE colleagues. Many of the results covered in this survey were obtained (or at least inspired) by Andrej Muchnik (1958–2007).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alon, N., Newman, I., Shen, A., Tardos, G., Vereshchagin, N.K.: Partitioning multi-dimensional sets in a small number of “uniform” parts. European Journal of Combinatorics 28(1), 134–144 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  2. Antunes, L., Laplante, S., Pinto, A., Salvador, L.: Cryptographic Security of Individual Instances. In: Desmedt, Y. (ed.) ICITS 2007. LNCS, vol. 4883, pp. 195–210. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  3. Calude, C.S., Hertling, P.H., Khoussainov, B., Wang, Y.: Recursively Enumerable Reals and Chaitin \(\mathrm\Omega\) Numbers. Theoretical Computer Science 255, 125–149 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  4. Chan, T.H., Yeung, R.W.: On a relation between information inequalities and group theory. IEEE Transaction on Information theory 48(7), 1992–1995 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  5. Chernov, A., Muchnik, A.A., Romashchenko, A.E., Shen, A., Vereshchagin, N.K.: Upper semi-lattice of binary strings with the relation “x is simple conditional to y”. Theoretical Computer Science 271(1-2), 69–95 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  6. Durand, B., Levin, L.A., Shen, A.: Complex Tilings. Journal of Symbolic Logic 73(2), 593–613 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  7. Gács, P., Korner, J.: Common Information is Far Less Than Mutual Information. Problems of Control and Information Theory 2(2), 119–162 (1973)

    MathSciNet  MATH  Google Scholar 

  8. Hammer, D., Romashchenko, A.E., Shen, A., Vereshchagin, N.: Inequalities for Shannon Entropy and Kolmogorov Complexity. Journal for Computer and System Sciences 60, 442–464 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  9. Hammer, D., Shen, A.: A Strange Application of Kolmogorov Complexity. Theory of Computing Systems 31(1), 1–4 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  10. Hansen, K.A., Lachish, O., Miltersen, P.B.: Hilbert’s Thirteenth Problem and Circuit Complexity. In: Dong, Y., Du, D.-Z., Ibarra, O. (eds.) ISAAC 2009. LNCS, vol. 5878, pp. 153–162. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  11. Kolmogorov, A.N.: Three approaches to the definition of the concept “quantity of information”. Problemy Peredachi Informatsii 1(1), 3–11 (1965) (Russian)

    MathSciNet  MATH  Google Scholar 

  12. Kritchman, S., Raz, R.: The Surprise Examination Paradox and the Second Incompleteness Theorem. Notices of the AMS 75(11), 1454–1458 (2010)

    MathSciNet  MATH  Google Scholar 

  13. Kučera, A., Slaman, T.A.: Randomness and recursive enumerability. SIAM Journal on Computing 31(1), 199–211 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  14. Li, M., Vitanyi, P.: An Introduction to Kolmogorov Complexity and Its Applications, 3rd edn. Springer, Heidelberg (2008)

    Book  MATH  Google Scholar 

  15. Muchnik, A.: Conditional complexity and codes. Theoretical Computer Science 271(1-2), 97–109 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  16. Rogers Jr., H.: Theory of Recursive Functions and Effective Computability. McGraw-Hill Book Company, New York (1967)

    MATH  Google Scholar 

  17. Romashchenko, A.E.: A Criterion of Extractability of Mutual Information for a Triple of Strings. Problems of Information Transmission 39(1), 148–157

    Google Scholar 

  18. Romashchenko, A.E., Shen, A., Vereshchagin, N.K.: Combinatorial Interpretation of Kolmogorov Complexity. Theoretical Computer Science 271(1-2), 111–123 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  19. Rumyantsev, A.Y., Ushakov, M.A.: Forbidden substrings, kolmogorov complexity and almost periodic sequences. In: Durand, B., Thomas, W. (eds.) STACS 2006. LNCS, vol. 3884, pp. 396–407. Springer, Heidelberg (2006), arxiv.org/abs/1009.4455

    Chapter  Google Scholar 

  20. Shen, A.: Algorithmic Information theory and Kolmogorov complexity. Uppsala university Technical Report TR2000-034, www.it.uu.se/research/publications/reports/2000-034/2000-034-nc.ps.gz

  21. Shen, A.: Decomposition complexity. Journées Automates Cellulaires (Turku), 203–213 (2010), hal-00541921 at archives-ouvertes.fr

    Google Scholar 

  22. Ti, Y.-W., Chang, C.-L., Lyuu, Y.-D., Shen, A.: Sets of k-independent strings. International Journal of Foundations of Computer Science 21(3), 321–327 (2010)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shen, A. (2011). Kolmogorov Complexity as a Language. In: Kulikov, A., Vereshchagin, N. (eds) Computer Science – Theory and Applications. CSR 2011. Lecture Notes in Computer Science, vol 6651. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20712-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20712-9_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20711-2

  • Online ISBN: 978-3-642-20712-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics