Advertisement

Physics, Information, and Computation

  • Ming Li
  • Paul Vitányi
Part of the Graduate Texts in Computer Science book series (TCS)

Abstract

Various issues in information theory and theoretical physics can be fruitfully analyzed by Kolmogorov complexity. This is the case for physical aspects of information processing and for application of complexity to physics issues. Physicists have used complexity arguments in a variety of settings like information distance, thermodynamics, chaos, biology, and philosophy. We touch briefly upon several themes, but focus on three main issues.

Keywords

Turing Machine Kolmogorov Complexity Reversible Computation Carnot Cycle Fredkin Gate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

History and References

  1. T.M. Cover, P. Gács and R.M. Gray, Ann. Probab., 17:3(1989), 840–865.MathSciNetzbMATHCrossRefGoogle Scholar
  2. W.H. Zurek in [Phys. Rev. A, 40:8(1989), 4731–4751; pp. 73-89 in: Complexity, Entropy and the Physics of Information, W.H. Zurek (Ed.), Addison-Wesley, 1991; Nature, 341 (September 1989), 119-124]MathSciNetCrossRefGoogle Scholar
  3. C.M. Caves in [pp. 91-115 in: Complexity, Entropy and the Physics of Information, W.H. Zurek (Ed.), Addison-Wesley, 1991; pp. 47-89 in: Physical Origins of Time Asymmetry, J.J. Halliwell, J. Perez-Mercader and W.H. Zurek, Eds., Cambridge Univ. Press, 1994].Google Scholar
  4. R. Schack [‘Algorithmic information and simplicity in statistical physics’, Phys. Rev. E, Submitted].Google Scholar
  5. J. H. Felker [Proc. IRE 40(1952), 728–729; Ibid. 42(1954), 1191].CrossRefGoogle Scholar
  6. J.R. Pierce. See also [J. R. Pierce and C. C. Cutler, pp. 55-109 in: F. I. Ordway, III, Ed., Advances in Space Science, Vol. 1, Academic Press, Inc., New York, 1959].Google Scholar
  7. [Theory of Self-Reproducing Automata, A.W. Burks, Ed., Univ. Illinois Press, Urbana, 1966].Google Scholar
  8. R. Landauer in [IBM J. Res. Develop., 5(1961), 183–191].MathSciNetzbMATHCrossRefGoogle Scholar
  9. Y. Lecerf, Comptes Rendus, 257(1963), 2597–2600.MathSciNetGoogle Scholar
  10. C.H. Bennett, IBM J. Res. Develop., 17(1973), 525–532.MathSciNetzbMATHCrossRefGoogle Scholar
  11. [C.H. Bennett, Scientific American, (Nov. 1987), 108-117.Google Scholar
  12. C.H. Bennett and R. Landauer, Scientific American, (July 1985), 48-56.Google Scholar
  13. C.H. Bennett, Int. J. Theoret. Phys., 21:12(1982), 905–940.CrossRefGoogle Scholar
  14. Phys. Rev. Lett., 53:12(1984), 1202-1206].Google Scholar
  15. [T. Toffoli, Proc. 7th Int. Colloq. Automata, Languages and Prog., Lect. Notes Comp. Sci., vol. 85, Springer-Verlag, 1980, pp. 632-644.Google Scholar
  16. Math. Systems Theory, 14(1981), 13-23.Google Scholar
  17. E. Fredkin and T. Toffoli, Int. J. Theoret. Phys., 21(1982), 219–253].MathSciNetzbMATHCrossRefGoogle Scholar
  18. Int. J. Theoret. Phys., 21(1982).Google Scholar
  19. [Proc. IEEE Workshop on Physics and Computation, Dallas, 1992 and 1994 (also: Preliminary Proceedings 1992)].Google Scholar
  20. C.H. Bennett [Int. J. Theoret. Phys., 21:12(1982), 905–940]CrossRefGoogle Scholar
  21. P.A. Benioff [Int. J. Theoret. Physics, 21(1982), 177–202.MathSciNetzbMATHCrossRefGoogle Scholar
  22. Ann. New York Acad. Sci., 480(1986), 475-486].Google Scholar
  23. R.P. Feynman [Optics News, 11(1985), 11].Google Scholar
  24. [C.H. Bennett, SIAM J. Comput., 18(1989), 766–776.MathSciNetzbMATHCrossRefGoogle Scholar
  25. R.Y. Levine and A.T. Sherman, SIAM J. Comput, 19(1990), 673–677.MathSciNetzbMATHCrossRefGoogle Scholar
  26. M. Li and P.M.B. Vitányi, Proc. Royal Soc. London, Ser. A, 452(1996), 769–789].zbMATHCrossRefGoogle Scholar
  27. [M. Li and P.M.B. Vitányi, Proc. Royal Soc. London, Ser. A, 452(1996), 769–789].zbMATHCrossRefGoogle Scholar
  28. [C.H. Bennett, P. Gács, M. Li, P.M.B. Vitányi, and W.H. Zurek, Proc. 25th ACM Symp. Theory Comput., 1993, pp. 21-30].Google Scholar
  29. [R. Landauer, IBM J. Res. Develop., 5(1961), 183–191]MathSciNetzbMATHCrossRefGoogle Scholar
  30. [R.W. Keyes and R. Landauer, IBM J. Res. Develop., 14(1970), 152–157]CrossRefGoogle Scholar
  31. [C.H. Bennett, IBM J. Res. Develop., 17(1973), 525–532; BioSystems, 11(1979), 85-90.MathSciNetzbMATHCrossRefGoogle Scholar
  32. C.H. Bennett and R. Landauer, Scientific American, (July 1985), 48-56]Google Scholar
  33. [E. Fredkin and T. Toffoli, Int. J. Theoret. Phys., 21(1982), 219–253].MathSciNetzbMATHCrossRefGoogle Scholar
  34. [K. Likharev, Int. J. Theoret. Phys., 21(1982), 311–326].CrossRefGoogle Scholar
  35. [C.H. Bennett, Int. J. Theoret. Phys., 21(1982), 905–940].CrossRefGoogle Scholar
  36. [C.H. Bennett, IBM J. Res. Develop., 32(1988), 16–23.MathSciNetCrossRefGoogle Scholar
  37. R.W. Keyes and R. Landauer. IBM J. Res. Develop., 14(1970), 152–157.CrossRefGoogle Scholar
  38. R. Landauer, Int. J. Theoret. Phys., 21(1982), 283; Nature, 335(October 1988), 779-784.zbMATHCrossRefGoogle Scholar
  39. R.W. Keyes, Science, 230(October 1985), 138-144; Rev. Mod. Phys., 61(1989), 279-287.Google Scholar
  40. IBM J. Res. Develop., 32(1988), 24-28.Google Scholar
  41. Phys. Today, 45(August 1992), 42-48].Google Scholar
  42. [R.C. Merkle, Nanotechnology, 4(1993), 21–40].CrossRefGoogle Scholar
  43. [Proc. IEEE Workshop on Physics and Computation, Dallas, 1992, 227-228, 237-247, 267-270; K.E. Drexler, Nanosystems: Molecular Machinery, Manufacturing, and Computation, Wiley, 1992].Google Scholar
  44. [M. Li and P.M.B. Vitányi, Proc. IEEE Workshop on Physics and Computation, Dallas, 1992, 42-46.Google Scholar
  45. C.H. Bennett, P. Gács, M. Li, P.M.B. Vitányi, and W.H. Zurek, Proc. 25th ACM Symp. Theory Comput, 1993, pp. 21-30].Google Scholar
  46. [M. Gell-Mann and S. Lloyd, Complexity, 2:1(1996), 44–52].MathSciNetCrossRefGoogle Scholar
  47. [E. Fermi, Thermodynamics, Dover, 1956].Google Scholar
  48. [J. Schumacher, CWI Quarterly, 6:2(1993), 97–120].MathSciNetzbMATHGoogle Scholar
  49. C.H. Bennett, [Int. J. Theoret. Phys., 21:12(1982), 905–940; Scientific American, 255:11(1987), 108-117]CrossRefGoogle Scholar
  50. W.H. Zurek in [Phys. Rev. A, 40:8(1989), 4731–4751; Complexity, entropy and the physics of information, W.H. Zurek (Ed.), Addison-Wesley, 1991, pp. 73-89; Nature, 341(September 1989), 119-124]MathSciNetCrossRefGoogle Scholar
  51. C.H. Bennett [Int. J. Theoret. Phys., 21:12 (1982), 905-940; Scientific American, 255:11(1987), 108–117].Google Scholar
  52. W.H. Zurek using “Physical entropy” arguments in [Nature, 341(September 1989), 119–124; Phys. Rev. A, 40:8(1989), 4731-4751; Complexity, entropy and the physics of information, W.H. Zurek (Ed.), Addison-Wesley, 1991, pp. 73-89].CrossRefGoogle Scholar
  53. [Z. Phys., 53(1929), 840-856].Google Scholar
  54. [H.S. Leff and A.F. Rex, Eds., Maxwell’s Demon: Entropy, Information, Computing, Princeton University Press, 1990].Google Scholar
  55. [R.G. Brewer and E.L. Hahn, Scientific American, December 1984, 42-49].Google Scholar
  56. [M. Li and P.M.B. Vitányi, Proc. 19th Int. Colloq. Automata, Languages and Prog., Lect. Notes Comp. Sci., vol. 623, Springer-Verlag, Heidelberg, 1992, 1–16].Google Scholar
  57. P. Gács, Proc. 2nd IEEE Workshop on Physics and Computation, 1994, 209-216.Google Scholar
  58. [M. Gell-Mann, The Quark and the Jaguar, W.H. Freeman, New York, 1994.zbMATHGoogle Scholar
  59. M. Gell-Mann, Complexity, 1:1(1995), 16–19.MathSciNetzbMATHGoogle Scholar
  60. M. Gell-Mann and S. Lloyd, Complexity, 2:1(1996), 44–52]MathSciNetCrossRefGoogle Scholar
  61. [M. Gell-Mann and J.B. Hartle, Proc. 4th Drexel Symp. Quantum Non-Intergrability—The Quantum-Classical Approach, D.H. Feng, Ed., To appear].Google Scholar
  62. [S. Lloyd and J.J. Slotine, Int J. Adapt. Contr. Sign. Proc, To appear].Google Scholar
  63. W.H. Zurek’s [Ibid.].Google Scholar
  64. [J. Ford, Phys. Today, (April 1983), 40-47; ‘Chaos: Solving the unsolvable, predicting the unpredictable,’ in Chaotic Dynamics and Fractals, M.F. Barnsley and S.G. Demko (Ed.), Academic Press, 1986].Google Scholar
  65. [R. Schack, G.M. D’Ariano, and C.M. Caves, Phys. Rev. E, 50(1994), 972]CrossRefGoogle Scholar
  66. R. Schack and C. Caves [Phys. Rev. E, 53:4(1996), 3257–3270; Phys. Rev. E, 53:4(1996), 3387-3401].MathSciNetCrossRefGoogle Scholar
  67. [D. Ruelle, Chance and Chaos, Penguin, 1993].Google Scholar
  68. Zh.I. Reznikova and B. Ya. Ryabko [Problems Inform. Transmission, 22(1986), 245–249]. Francis Bacon is quoted from Sylva Sylvarum, 337, 1627.zbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1997

Authors and Affiliations

  • Ming Li
    • 1
  • Paul Vitányi
    • 2
  1. 1.Department of Computer ScienceUniversity of WaterlooWaterlooCanada
  2. 2.Centrum voor Wiskunde en InformaticaSJ AmsterdamThe Netherlands

Personalised recommendations