Physics, Information, and Computation

  • Ming Li
  • Paul Vitányi
Part of the Graduate Texts in Computer Science book series (TCS)

Abstract

Various issues in information theory and theoretical physics can be fruitfully analyzed by Kolmogorov complexity. This is the case for physical aspects of information processing and for application of complexity to physics issues. Physicists have used complexity arguments in a variety of settings like information distance, thermodynamics, chaos, biology, and philosophy. We touch briefly upon several themes, but focus on three main issues.

Keywords

Turing Machine Kolmogorov Complexity Reversible Computation Carnot Cycle Fredkin Gate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

History and References

  1. T.M. Cover, P. Gács and R.M. Gray, Ann. Probab., 17:3(1989), 840–865.MathSciNetMATHCrossRefGoogle Scholar
  2. W.H. Zurek in [Phys. Rev. A, 40:8(1989), 4731–4751; pp. 73-89 in: Complexity, Entropy and the Physics of Information, W.H. Zurek (Ed.), Addison-Wesley, 1991; Nature, 341 (September 1989), 119-124]MathSciNetCrossRefGoogle Scholar
  3. C.M. Caves in [pp. 91-115 in: Complexity, Entropy and the Physics of Information, W.H. Zurek (Ed.), Addison-Wesley, 1991; pp. 47-89 in: Physical Origins of Time Asymmetry, J.J. Halliwell, J. Perez-Mercader and W.H. Zurek, Eds., Cambridge Univ. Press, 1994].Google Scholar
  4. R. Schack [‘Algorithmic information and simplicity in statistical physics’, Phys. Rev. E, Submitted].Google Scholar
  5. J. H. Felker [Proc. IRE 40(1952), 728–729; Ibid. 42(1954), 1191].CrossRefGoogle Scholar
  6. J.R. Pierce. See also [J. R. Pierce and C. C. Cutler, pp. 55-109 in: F. I. Ordway, III, Ed., Advances in Space Science, Vol. 1, Academic Press, Inc., New York, 1959].Google Scholar
  7. [Theory of Self-Reproducing Automata, A.W. Burks, Ed., Univ. Illinois Press, Urbana, 1966].Google Scholar
  8. R. Landauer in [IBM J. Res. Develop., 5(1961), 183–191].MathSciNetMATHCrossRefGoogle Scholar
  9. Y. Lecerf, Comptes Rendus, 257(1963), 2597–2600.MathSciNetGoogle Scholar
  10. C.H. Bennett, IBM J. Res. Develop., 17(1973), 525–532.MathSciNetMATHCrossRefGoogle Scholar
  11. [C.H. Bennett, Scientific American, (Nov. 1987), 108-117.Google Scholar
  12. C.H. Bennett and R. Landauer, Scientific American, (July 1985), 48-56.Google Scholar
  13. C.H. Bennett, Int. J. Theoret. Phys., 21:12(1982), 905–940.CrossRefGoogle Scholar
  14. Phys. Rev. Lett., 53:12(1984), 1202-1206].Google Scholar
  15. [T. Toffoli, Proc. 7th Int. Colloq. Automata, Languages and Prog., Lect. Notes Comp. Sci., vol. 85, Springer-Verlag, 1980, pp. 632-644.Google Scholar
  16. Math. Systems Theory, 14(1981), 13-23.Google Scholar
  17. E. Fredkin and T. Toffoli, Int. J. Theoret. Phys., 21(1982), 219–253].MathSciNetMATHCrossRefGoogle Scholar
  18. Int. J. Theoret. Phys., 21(1982).Google Scholar
  19. [Proc. IEEE Workshop on Physics and Computation, Dallas, 1992 and 1994 (also: Preliminary Proceedings 1992)].Google Scholar
  20. C.H. Bennett [Int. J. Theoret. Phys., 21:12(1982), 905–940]CrossRefGoogle Scholar
  21. P.A. Benioff [Int. J. Theoret. Physics, 21(1982), 177–202.MathSciNetMATHCrossRefGoogle Scholar
  22. Ann. New York Acad. Sci., 480(1986), 475-486].Google Scholar
  23. R.P. Feynman [Optics News, 11(1985), 11].Google Scholar
  24. [C.H. Bennett, SIAM J. Comput., 18(1989), 766–776.MathSciNetMATHCrossRefGoogle Scholar
  25. R.Y. Levine and A.T. Sherman, SIAM J. Comput, 19(1990), 673–677.MathSciNetMATHCrossRefGoogle Scholar
  26. M. Li and P.M.B. Vitányi, Proc. Royal Soc. London, Ser. A, 452(1996), 769–789].MATHCrossRefGoogle Scholar
  27. [M. Li and P.M.B. Vitányi, Proc. Royal Soc. London, Ser. A, 452(1996), 769–789].MATHCrossRefGoogle Scholar
  28. [C.H. Bennett, P. Gács, M. Li, P.M.B. Vitányi, and W.H. Zurek, Proc. 25th ACM Symp. Theory Comput., 1993, pp. 21-30].Google Scholar
  29. [R. Landauer, IBM J. Res. Develop., 5(1961), 183–191]MathSciNetMATHCrossRefGoogle Scholar
  30. [R.W. Keyes and R. Landauer, IBM J. Res. Develop., 14(1970), 152–157]CrossRefGoogle Scholar
  31. [C.H. Bennett, IBM J. Res. Develop., 17(1973), 525–532; BioSystems, 11(1979), 85-90.MathSciNetMATHCrossRefGoogle Scholar
  32. C.H. Bennett and R. Landauer, Scientific American, (July 1985), 48-56]Google Scholar
  33. [E. Fredkin and T. Toffoli, Int. J. Theoret. Phys., 21(1982), 219–253].MathSciNetMATHCrossRefGoogle Scholar
  34. [K. Likharev, Int. J. Theoret. Phys., 21(1982), 311–326].CrossRefGoogle Scholar
  35. [C.H. Bennett, Int. J. Theoret. Phys., 21(1982), 905–940].CrossRefGoogle Scholar
  36. [C.H. Bennett, IBM J. Res. Develop., 32(1988), 16–23.MathSciNetCrossRefGoogle Scholar
  37. R.W. Keyes and R. Landauer. IBM J. Res. Develop., 14(1970), 152–157.CrossRefGoogle Scholar
  38. R. Landauer, Int. J. Theoret. Phys., 21(1982), 283; Nature, 335(October 1988), 779-784.MATHCrossRefGoogle Scholar
  39. R.W. Keyes, Science, 230(October 1985), 138-144; Rev. Mod. Phys., 61(1989), 279-287.Google Scholar
  40. IBM J. Res. Develop., 32(1988), 24-28.Google Scholar
  41. Phys. Today, 45(August 1992), 42-48].Google Scholar
  42. [R.C. Merkle, Nanotechnology, 4(1993), 21–40].CrossRefGoogle Scholar
  43. [Proc. IEEE Workshop on Physics and Computation, Dallas, 1992, 227-228, 237-247, 267-270; K.E. Drexler, Nanosystems: Molecular Machinery, Manufacturing, and Computation, Wiley, 1992].Google Scholar
  44. [M. Li and P.M.B. Vitányi, Proc. IEEE Workshop on Physics and Computation, Dallas, 1992, 42-46.Google Scholar
  45. C.H. Bennett, P. Gács, M. Li, P.M.B. Vitányi, and W.H. Zurek, Proc. 25th ACM Symp. Theory Comput, 1993, pp. 21-30].Google Scholar
  46. [M. Gell-Mann and S. Lloyd, Complexity, 2:1(1996), 44–52].MathSciNetCrossRefGoogle Scholar
  47. [E. Fermi, Thermodynamics, Dover, 1956].Google Scholar
  48. [J. Schumacher, CWI Quarterly, 6:2(1993), 97–120].MathSciNetMATHGoogle Scholar
  49. C.H. Bennett, [Int. J. Theoret. Phys., 21:12(1982), 905–940; Scientific American, 255:11(1987), 108-117]CrossRefGoogle Scholar
  50. W.H. Zurek in [Phys. Rev. A, 40:8(1989), 4731–4751; Complexity, entropy and the physics of information, W.H. Zurek (Ed.), Addison-Wesley, 1991, pp. 73-89; Nature, 341(September 1989), 119-124]MathSciNetCrossRefGoogle Scholar
  51. C.H. Bennett [Int. J. Theoret. Phys., 21:12 (1982), 905-940; Scientific American, 255:11(1987), 108–117].Google Scholar
  52. W.H. Zurek using “Physical entropy” arguments in [Nature, 341(September 1989), 119–124; Phys. Rev. A, 40:8(1989), 4731-4751; Complexity, entropy and the physics of information, W.H. Zurek (Ed.), Addison-Wesley, 1991, pp. 73-89].CrossRefGoogle Scholar
  53. [Z. Phys., 53(1929), 840-856].Google Scholar
  54. [H.S. Leff and A.F. Rex, Eds., Maxwell’s Demon: Entropy, Information, Computing, Princeton University Press, 1990].Google Scholar
  55. [R.G. Brewer and E.L. Hahn, Scientific American, December 1984, 42-49].Google Scholar
  56. [M. Li and P.M.B. Vitányi, Proc. 19th Int. Colloq. Automata, Languages and Prog., Lect. Notes Comp. Sci., vol. 623, Springer-Verlag, Heidelberg, 1992, 1–16].Google Scholar
  57. P. Gács, Proc. 2nd IEEE Workshop on Physics and Computation, 1994, 209-216.Google Scholar
  58. [M. Gell-Mann, The Quark and the Jaguar, W.H. Freeman, New York, 1994.MATHGoogle Scholar
  59. M. Gell-Mann, Complexity, 1:1(1995), 16–19.MathSciNetMATHGoogle Scholar
  60. M. Gell-Mann and S. Lloyd, Complexity, 2:1(1996), 44–52]MathSciNetCrossRefGoogle Scholar
  61. [M. Gell-Mann and J.B. Hartle, Proc. 4th Drexel Symp. Quantum Non-Intergrability—The Quantum-Classical Approach, D.H. Feng, Ed., To appear].Google Scholar
  62. [S. Lloyd and J.J. Slotine, Int J. Adapt. Contr. Sign. Proc, To appear].Google Scholar
  63. W.H. Zurek’s [Ibid.].Google Scholar
  64. [J. Ford, Phys. Today, (April 1983), 40-47; ‘Chaos: Solving the unsolvable, predicting the unpredictable,’ in Chaotic Dynamics and Fractals, M.F. Barnsley and S.G. Demko (Ed.), Academic Press, 1986].Google Scholar
  65. [R. Schack, G.M. D’Ariano, and C.M. Caves, Phys. Rev. E, 50(1994), 972]CrossRefGoogle Scholar
  66. R. Schack and C. Caves [Phys. Rev. E, 53:4(1996), 3257–3270; Phys. Rev. E, 53:4(1996), 3387-3401].MathSciNetCrossRefGoogle Scholar
  67. [D. Ruelle, Chance and Chaos, Penguin, 1993].Google Scholar
  68. Zh.I. Reznikova and B. Ya. Ryabko [Problems Inform. Transmission, 22(1986), 245–249]. Francis Bacon is quoted from Sylva Sylvarum, 337, 1627.MATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1997

Authors and Affiliations

  • Ming Li
    • 1
  • Paul Vitányi
    • 2
  1. 1.Department of Computer ScienceUniversity of WaterlooWaterlooCanada
  2. 2.Centrum voor Wiskunde en InformaticaSJ AmsterdamThe Netherlands

Personalised recommendations