Computation quotes

From Motley Bytes Wiki
Jump to: navigation, search

David_Deutsch

Gigantic Computation

“Think of all our knowledge-generating processes, our whole culture and civilization, and all the thought processes in the minds of every individual, and indeed the entire evolving biosphere as well, as being a gigantic computation. The whole thing is executing a self-motivated, self-generating computer program. More specifically it is, as I have mentioned, a virtual-reality program in the process of rendering, with ever-increasing accuracy, the whole of existence.”

Theory of Computation

“The theory of computation has traditionally been studied almost entirely in the abstract, as a topic in pure mathematics. This is to miss the point of it. Computers are physical objects, and computations are physical processes. What computers can or cannot compute is determined by the laws of physics alone, and not by pure mathematics.”

Quantum Computation

“Quantum computation is … nothing less than a distinctly new way of harnessing nature … It will be the first technology that allows useful tasks to be performed in collaboration between parallel universes, and then sharing the results.”

Stuart_Hameroff

Brain Neurons

“Well I used to think as other people do that the brain is a computer and I think instead, as I have said before, it's more of a multi-scale hierarchical system. More like a musical system in some sense. I'd refer to it as a quantum orchestra. Because I think the computational metaphor doesn't work because, well it works to a point but it treats neurons  as simple on/off switches and that's an insult to neurons... If you go inside neurons there's all this interesting, I hate to use the word complex because I think complexity is often the last refuge of the bewildered. Just say it's complex and that explains everything which I think is wrong. But you have all this structure, these microtubules doing all this interesting quantum stuff and quantum computation reducing by OR [Orchestrated Objective Reduction/Orch OR] is not the kind of computation I was disillusioned with. So, I'd say that one thing is that the brain is a multi-scale hierarchal system more like music than a classical computer.”
  • Source: Stuart Hameroff speaking in the YouTube video entitled “Sir Roger Penrose & Stuart Hameroff: Collapsing a theory of quantum consciousness? Part 2 (248)” on the channel entitled “Dr Brian Keating” streamed live 2022-08-05, retrieved 2024-04-17 from <https://www.youtube.com/live/OoDi856wLPM?si=XJrLm0AVUIl_dECG>.

Donald_Hoffman

AI Computation

“If we look at an LLM [Large Language Model] or a future AI [Artificial Intelligence], it's going to be some kind of computational system. And computational systems have their limits. We have Gödel who said that at a minimum. I'm betting that you and I are avatars of an infinite intelligence that's the true source of all creativity and that Einstein or any scientist taps into when they come up with their truly original ideas. The first step would be to say, if it's just a computational bias, then it doesn't transcend. It doesn't get to this true originality. But then there's a deeper level... These are just avatars in a particular headset. So why can't we create a new avatar in our headset that looks like a computer that is actually an avatar of the deep intelligence? If we are only going to stick with the computational thing... But somehow the [human] avatar is a portal into the infinite consciousness... And we know one way of creating new portals into this infinite consciousness, and that is having kids. So that is one technology that allows us to do that. Once we understand spacetime as a headset, and we understand the headset and at least some layers of its relationship to the infinite reality, that's the source of true insight and true originality and creativity, could we figure out new ways to open up genuine new portals, and might that look like AI… The jury is out.”
  • Source: Donald Hoffman, in the YouTube video entitled “Donald Hoffman's New Approach To Consciousness” channel “Dr Brian Keating”. Online at <https://youtu.be/mU_WBela71Y?si=fNfLLsOsUDRDC1XD> posted 2024-08, retrieved 2024-08. In video at 1:14:40.

Hans_Hüttel

Program Synthesis

“The problem of generating correct program code from a specification is well known in computer science and in fact it is a central one. It is the problem of program synthesis... A lot is already known about the synthesis problem in its various guises and in particular we know it is hard, where ‘hard’ means computationally hard.”
  • Source: Written by Hans Hüttel in the journal article entitled “On Program Synthesis and Large Language Models”, in Communications of the ACM, volume 68, number 1, 2025-01. DOI:10.1145/3680410.

David_Kipping

Nature Computation

“It is important to distinguish between testing whether the universe is built upon the principles of computation but is not a simulation versus testing where the universe is indeed a simulation on someone's computer. Those are different to each other. It is quite possible that the laws of computation are somehow embedded within nature and yet everything we see around us is not a simulation.”
  • Source: David Kipping from the YouTube “Why You're Probably Not a Simulation”, posted 2020-09-04 in the channel ‘Cool Worlds’. Video offset 11:15. Online at https://youtu.be/HA5YuwvJkpQ (2025).

Simulation Depth Limit

“Given... the ensemble of all [simulated] realities that will ever exist, one might wonder how deep the rabbit hole goes... There should exist some limit to how deep the generations can indeed go... This is motivated by the fact the base civilization is truly responsible for simulating all of the daughters beneath it, and it presumably has some finite computational limit at its disposal.”
  • Source: David Kipping from the paper “A Bayesian Approach to the Simulation Argument”, published 2020 in the journal ‘Universe’, volume 6, issue 8. DOI:10.3390/universe6080109. Online at https://www.mdpi.com/2218-1997/6/8/109 (2025).

Seth_Lloyd

Information and Computation

“So, just as it is real to say that the universe is made out of electrons and electromagnetic fields and photons and elementary particles, the universe is also really made out of information and the way the universe changes over time is really a computation.”'
  • Source: Spoken by Seth Lloyd during a video interview. Contained in a video entitled Seth Lloyd - What is Information?. Posted on Youtube channel Closer to Truth. Posted 2019-12-05. Video location circa 9:30. Online at https://youtu.be/u8VdPW8tCWY.

Alan_Perlis

Balance Efficiency and Generality

“Our progress, then, is measured by the balance we achieve between efficiency and generality. As the nature of our involvement with computation changes — and it does — the appropriate description of language changes; our emphasis shifts. I feel that our successor model will show such a change. Computer science is a restless infant and its progress depends as much on shifts in point of view as on the orderly development of our current concepts.”


Steven_Pinker

Computational Mind

“The mind is a system of organs of computation, designed by natural selection to solve the kinds of problems our ancestors faced in their foraging way of life, in particular, understanding and outmaneuvering objects, animals, plants, and other people.”
  • Source: Steven Pinker (1997). How the Mind Works. New York, NY: W. W. Norton. ISBN 978-0-393-06973-0; eISBN 978-0-393-06973-0. Chapter 1 Section Reverse-Engineering the Psyche.

Thinking is Computation

“Thinking is computation, I claim, but that does not mean that the computer is a good metaphor for the mind.”
  • Source: Steven Pinker (1997). How the Mind Works. New York, NY: W. W. Norton. ISBN 978-0-393-06973-0; eISBN 978-0-393-06973-0. Chapter 1 Section Reverse-Engineering the Psyche.

Information and Computation Medium

“Information and computation reside in patterns of data and in relations of logic that are independent of the physical medium that carries them.”
  • Source: Steven Pinker (1997). How the Mind Works. New York, NY: W. W. Norton. ISBN 978-0-393-06973-0; eISBN 978-0-393-06973-0. Chapter 1 Section Reverse-Engineering the Psyche.

Computational Theory of Mind

“The computational theory of mind is not the same thing as the despised ‘computer metaphor.’ As many critics have pointed out, computers are serial, doing one thing at a time; brains are parallel, doing millions of things at once. Computers are fast; brains are slow. Computer parts are reliable; brain parts are noisy. Computers have a limited number of connections; brains have trillions. Computers are assembled according to a blueprint; brains must assemble themselves.”
  • Source: Steven Pinker (1997). How the Mind Works. New York, NY: W. W. Norton. ISBN 978-0-393-06973-0; eISBN 978-0-393-06973-0. Chapter 1 Section Reverse-Engineering the Psyche.

Computational Mind Probabilistic

“The computational theory thus embraces an alternative kind of computer with many elements that are active to a degree corresponding to the probability that some statement is true or false, and in which the activity levels change smoothly to register new and roughly accurate probabilities. (As we shall see, that may be the way the brain works.) The key idea is that the answer to the question 'What makes a system smart?' is not the kind of stuff it is made of or the kind of energy flowing through it, but what the parts of the machine stand for and how the patterns of changes inside it are designed to mirror truth-preserving relationships (including probabilistic and fuzzy truths).”
  • Source: Steven Pinker (1997). How the Mind Works. New York, NY: W. W. Norton. ISBN 978-0-393-06973-0; eISBN 978-0-393-06973-0. Chapter 2 Section: The search for Intelligent Life in the Universe.

Herbert_Simon

Operational Research Restrictions

“The powerful algorithms associated with OR impose a strong mathematical structure on the decision problem. Their power is bought at the cost of shaping and squeezing the real-world problem to fit their computational requirements.”

Psychology of Choice

“Research findings on the psychology of choice, indicate some properties a thermometer of satisfaction should have. First, unlike the utility function, it is not limited to positive values, but has a zero point (of minimal contentment). Above zero, various degrees of satisfaction are experienced, and below zero, various degrees of dissatisfaction. Second, if periodic readings are taken of people in relatively stable life circumstances, we only occasionally find temperatures very far from zero in either direction, and the divergent measurements tend to regress over time back toward the zero mark. Most people consistently register either slightly below zero (mild discontent) or a little above (moderate satisfaction). To deal with these phenomena, psychology employs the concept of aspiration level... Aspiration levels provide a computational mechanism for satisficing.”

Game Theory

“Game theory's most valuable contribution has been to show that rationality is effectively undefinable when competitive actors have unlimited computational capabilities for outguessing each other, but that the problem does not arise as acutely in a world, like the real world, of bounded rationality.”

Bounded Rationality

“In a world of bounded rationality there are several ways to magnify the computing capabilities of individual human beings and enhance the possibilities of their collective survival and prosperity. With the combined use of markets and administrative hierarchies, the human species has enormously increased its capabilities for specialization and division of work.”

Not Just Optimization

“The subject of computational techniques need not be limited to optimization.”

Max_Tegmark

Mathematical Computer Game

“The closer I look at things that seemed non-mathematical, like my arm and my hand, the more mathematical it turns out to be. Could it be that our world also then is really just as mathematical as the computer game reality?”
  • Source: Youtube The Great Math Mystery - Documentary posted by Aerospace Engineering 2017-03-03.

Mathematical Reality

“Many of my physics colleagues will say that mathematics describes our physical reality, at least in some approximate sense. I go further and argue that it actually is our physical reality because I'm arguing that our physical world doesn't just have some mathematical properties, but it has only mathematical properties.”
  • Source: Youtube The Great Math Mystery - Documentary posted by Aerospace Engineering 2017-03-03.

Shannon_Vallor

AI Longtermism

“What longtermists and effective altruists have in common... is the utilitarian view that morality is a happiness optimization problem, a matter of running the numbers. Conveniently for AI enthusiasts... For a virtue ethicist like me, there are profound dangers and moral errors in any view of morality that separates it from humane feeling, relational bonds, and social context, reducing it to a mere computation of net happiness units.”
  • Source: From the book “The AI Mirror” by Shannon Vallor. Published 2024 by Oxford University Press. ISBN 978-0197759066. Chapter 3, page 77.

Stephen_Wolfram

Time

“Time is the inexorable progress of computation. If we think about things in the world as being governed by rules, then what happens in the course of time is those rules get applied... The thing that changes through time is that we've applied these rules more and more and more times.”
  • Source: Spoken by Stephen Wolfram in a video interview with Brian Keating recorded in the YouTube video ‘Stephen Wolfram | My Discovery Changes Everything’ published on channel ‘Dr. Brian Keating’ on 2024-01-19. Video offset 15:16. Online at https://youtu.be/c-RO3vM10Ok?si=i-XspeEtzqA3jPl9 retrieved 2024.

Computation

“Computation is just the following of rules...”
  • Source: Spoken by Stephen Wolfram in a video interview with Brian Keating recorded in the YouTube video ‘Stephen Wolfram | My Discovery Changes Everything’ published on channel ‘Dr. Brian Keating’ on 2024-01-19. Video offset 20:38. Online at https://youtu.be/c-RO3vM10Ok?si=i-XspeEtzqA3jPl9 retrieved 2024.

Keywords: Computation_quotes Follow_quotes Rule_quotes

Second Law of Thermodynamics

“The second law is essentially a computational statement of the fact that systems that start simple to describe will typically become complicated to describe. It's kind of like encryption. You're saying you start with that simple initial seed and then you run this thing and you get something which for all practical purposes looks random. That's what's happening in these systems. It doesn't have to do with molecules running around. It doesn't have to do with the specifics of temperature and so on. It really is a very basic computational phenomenon that actually is a consequence of computational irreducibility.”
  • Source: Spoken by Stephen Wolfram in a video interview with Brian Keating recorded in the YouTube video ‘Stephen Wolfram | My Discovery Changes Everything’ published on channel ‘Dr. Brian Keating’ on 2024-01-19. Video offset 22:17. Online at https://youtu.be/c-RO3vM10Ok?si=i-XspeEtzqA3jPl9 retrieved 2024.

Computational Irreducibility

“I’ve increasingly come to view the whole fundamental story of science as being about the interplay between computational irreducibility and computational reducibility. The computational nature of things inevitably leads to computational irreducibility. But there are slices of computational reducibility that inevitably exist on top of this irreducibility that are what make it possible for us — as computationally bounded entities — to identify meaningful scientific laws and to do science.”

Quantum Computing

“The basic idea of quantum computing... is to do different computations in parallel along different possible threads of history. But the key issue is then how to corral those threads of history together to figure out a definite answer for the computation... The preliminary indication is that at least at a formal level, quantum computers aren’t going to come out ahead.”

Simple Purpose

“Whenever there’s computational irreducibility we can think of it as exerting a powerful force towards unpredictability and randomness... So for a system to achieve an overall “computationally simple purpose” this computational irreducibility must in some sense be tamed, or at least contained. And in fact it’s an inevitable feature of computational irreducibility that within it there must be “pockets of computational reducibility” where simpler behavior occurs. And at some level the way computationally simple purposes must be achieved is by tapping into those pockets of reducibility. When there’s computational irreducibility it means that there’s no simple narrative one can expect to give of how a system behaves, and no overall “mechanism” one can expect to identify for it. But one can think of pockets of computational reducibility as corresponding to at least small-scale “identifiable mechanisms”... When there’s a “simple overall purpose” being achieved these mechanisms tend to become more manifest.”

Future Jumping

“There’s a certain robustness to time when viewed in these computational terms. There’s no way to ‘jump ahead’ in time; the only way to find out what will happen in the future is to go through the irreducible computational steps to get there.”

Shoshana_Zuboff

Automated Evaluation

“The system automatically computed efficiency ratings for each worker by comparing the amount of time it took to complete a job had been priced. Such calculations with the amount of time for which it could have been generated only by a computer system, since 'we could never have enough clerks to compute these kinds of ratios.' The ratings were considered management information and were not accessible to the craftworkers. Many foremen cautioned against taking the ratings at face value. The most experienced craftsperson frequently was loaded with the most difficult assignments. That individual might show the worst efficiency rating simply because his or her assignments were the most complex and required more than the assigned time.”
  • Source: Zuboff, S. (1988). In The Age Of The Smart Machine: The Future Of Work And Power. New York, NY: Basic Books, p. 331. ISBN:0465032125.