ZH version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
69% Positive
Analyzed from 2974 words in the discussion.
Trending Topics
#conscious#consciousness#don#universe#more#thing#might#qualia#llms#mind

Discussion (72 Comments)Read Original on HackerNews
What's still missing is the constant internal "state" and I think this boils down to lacking a body. It may be that a disembodied consciousness needs to be tethered to the physical plane. to be self referential enough and develop a feedback loop to "start the engine" of self awareness.
I don't think processing power gets us there, I think it's very much an architecture problem.
The article kind of fills in some of these questions as well, but fails to give any further clues as to how to implement this unfortunately.
Maybe we should set the threshold for consciousness a little bit higher
I will read it in more detail when I can afford more time.
My only immediate comment is that it talks about qualia being "experienced" without defining what the nature of that experience is. And it kind of assumes that qualia have an ultimate physical manifestation - rather than being merely a rhetorical device.
Also, this site would really benefit from an rss/atom feed.
An llm is in principle implementable with a large lookup table where the prompt is the hash. And it can be implemented in an emulator running an emulator running an emulator of the operating system the llm app runs in. How far are you willing to stretch this substrate idea?
You don't want to call machines conscious? Fine. Call it quasiconscious, semiconscious, technoconscious, whatever makes you feel alpha human, and move on to our current reality where we confront the existence of thinking machines rather than footnote it into obscurity.
I don't think that the way we frame the question about consciousness makes it easy to resolve.
But I do want to point out that humans are very diverse. There're many functional adults lacking any internal motivation besides getting food, sleep, and some kind of entertainment. There're millions of people who just act on external stimuli.
So the gap between the "least conscious" human and the "most conscious" machine might be more narrow than we expect.
But I wouldn't rule out that ChatGPT 10 or Claude Fable 15 might get conscious.
Yes, I know about machine learning, but I also know about how natural biological systems learn. It is, just from what we know, very different, yes, but the crucial point is that it, also, has zero identifiable things that you could point at and say: oh, look, that over there is consciousness. So the fact that there is no such thing in an ANN proves nothing.
I had an eye surgery last year. The first day after was magical, I felt like I was on acid because the entire world felt different.
I went for a checkup one week later and told the doctor the vision has gone down since. They checked and it was objectively the same as on the first day. They told me: "People get used to good vision very fast".
I think it's just human nature.
For example, free will and determinism may be orthogonal concepts (compatibilism).
Eg the rules of chess are written as if the players have free choice. Similarly, algorithms are often analysed as if the antagonist that provides the data has free choice (so we assume the worst case to be sure).
That's a very different non-determinism from assuming a probability distributions.
And different frames might be accurate depending on context. You might know what chess bot you are playing against and that chess bot might be a deterministic computer program, or might be a computer program that uses radioactive decay to randomise.
And as you suggested, free will is yet another kettle of fish.
How else could they be written?
My sense is that the whole machine consciousness debate really kicked off since LLMs started being able to spew out a bunch of words in a row that sound like they make sense. Since only humans could do that before now, and humans are conscious, therefore...
I don't think language has anything to do with consciousness.
What do you think of the bicameral mind theory?
1. Scale. There's clearly a scale of consciousness (a jellyfish isn't very conscious but an ape is). Current LLMs are so small (on the scale of brains) that they must be not very conscious at all.
2. Structure. There might be some fundamental structure of computation that is required for consciousness that LLMs don't have yet. For example the ability to form memories (they don't really have that), or some structure of weights that gives consciousness.
My guess is it's definitely 1. and probably also 2.
But I don't think that means thinking LLMs are conscious is completely ridiculous, just a bit premature. I would not be surprised if they are conscious in 50 years.
The real question is how would we ever know that they are. The only reason we know animals are conscious is by direct experience, and we'll never have that for AI.
Anyway this blog post looks like typically worthless philosophy.
There are some religious people who clutch at nonsense like quantum microtubules, but nobody has found anything real that would preclude pure computation from being conscious. (And yes that does have all sorts of mind-bending consequences.)
Anyway, I do think the heart of the practical question is what distinctions between machine / human / other biological intelligences are critical versus incidental. In this article the meat of the argument comes only right at the end
> Digital computers employ signal quantisation along with a variety of other error prevention methods in order to neutralise holistic physical effects like crosstalk between circuits. The purpose of digital logic is to make computational output invariant to the underlying physics – up to some thermal noise floor. This discretises their behavioural space – perturb the electric field slightly and this shouldn’t flip any bits. This is great – this is what permits reliable, deterministic computing in a wide variety of physical environments. However, if what we are interested in is phenomenal introspection, these error prevention systems prevent the exact kind of holistic behaviour we value.
There could be something here, but I am not convinced. Why is "varies in behavior with respect to arbitrary perturbations" a critical feature of consciousness? And is this even true for brains? If a perturbation is small compared to a neural impulse, will it affect anything?
Replace universe simulation with a LLM an it’s hard to consider a bunch of rocks shuffling on a beach as conscious.
Or alternatively, our own minds are simply (squishy, organic) rocks on a beach, which is quite humbling if you think about it long enough.
LLMs are nice here: we don't need a theory of everything to simulate them. You can indeed use pebbles on the beach.
Scott Aaronson said that in theory a finite look-up table can win eg a ten minute Turing test (any finite length is fine). Of course, to borrow his argument further, the naive table would be galactic in size. So the real magic is in being able to compress the responses of that table into something human sized / LLM-server sized.
Is it even possible that a complete simulation of the rules of this universe (let alone the content of it) could exist in this universe?
I am no expert but I did manage to read most of GEB [0] so I feel fully qualified to say that it feels like something Gödel would have opinions about?
[0] the honest nerd's "did sleep in a Holiday Inn last night"
Yes, it is possible! See how a Quine is constructed.
https://en.wikipedia.org/wiki/Quine_(computing)
As an analogy: you can have a zip archive that expands to itself. Or even more so: to itself (the simulation of itself in itself) plus something arbitrary (standing in for the rest of the universe).
After seeing the story of the fruit fly brain simulation I figured stuff like the nematode would be trivial.
The lack of active plasticity in LLMs causes a lot of frustration imo. Having agents make the same mistakes over and over and not be able to correct course without prompt engineering is the biggest symptom.
Obviously a static mind is more helpful from a performance perspective, especially if you consider model deployments into gateware.
Maybe this will be an inherent limitation to LLMs that won’t be solvable without a new approach.
People also interpret the 'unitarity' of quantum mechanics to mean that information is preserved.
However I am open to your belief (and not on religious or theistic grounds which I assume many people might think you're talking about) because people have (non-religious) experiences that lend to such possibilities.
However, the real issue, as always completely unaddressed, isn't attempting to make a gague-invariant theory of qualia, or even defining what "qualia" is (I am totally unconvinced it is an EM field, there must be an epigenetic component). The first step is defining what "consciousness" is! Is it awareness of qualia or awareness of reality? These are not the same thing. It seems significant that any animal I would call a little conscious, even ants, are capable of being startled or curious when their sensations mismatch or incompletely describe reality (and animals that lack any sense of curiosity are at most borderline conscious). Curiosity and surprise[1] seems hard to convey in an EM field. Qualia strikes me as a somewhat technical problem of neuroscience, and the "hard problem of consciousness" is unscientific BS. The simplest basics aren't understood, which leads to totally unhinged statements like "in some ways a thermostat is conscious" because in some ways it seems to fit the hard problem. But statements like that are ideologically motivated by a sort of tech futurism: rationally, we should be deeply skeptical of an account of consciousness which insists that clocks perceive the flow of time.
[1] There's an information-theoretic version of surprise which intuitively describes "surprising" data. A sudden bright light has high surprise and is certainly surprising. A sudden realization that the vine you're leaning on is a large snake might involve very low information-theoretic surprise... and is far more alarming. So how do you systematically quantify this second form of surprise?
They have the real photonic futuristic hardware you are looking for!
I think that Illusionism and related philosophies will tend to be seen as "correct" once AI systems become more and more commonplace, and people will be forced to dismiss the whole concept of "consciousness" along with mind/body dualism in general as a massive category error that philosophers have been making since antiquity.
When you get down to it, philosophy of consciousness mostly exists because philosophers have assumed that because "mind", "soul", "consciousness" etc are nouns in our language, and that since nouns are "persons places and things" and mind is a noun, mind must be a thing, which is of course not how language works and not sound logic.
It is even more interesting: we cannot be certain that other people have the subjective experience like we imagine it to be like. It seems to me that the rest of author's arguments implicitly assume that we can be certain about other people's subjective experiences, but if you take this assumption away the arguments can't explain why digital consciousness hypothesis is any different from the hypothesis that the Universe contains at least one person besides me.
I mean I see no point in proving that LLM is not conscious if your methods do not enable us to prove that there are at least two people who is conscious.
> Personally, I consider myself a physicalist, but I’m also a panpsychist – because physics doesn’t really seem to deal in hard absolutes, and I find it straightforward to consider that everything is conscious to some greater or lesser degree
You might easily be you because if you weren't it'd be an evolutionary dead end. Everything with the ability to make choices ahs to believe at some level that it has more of a right to exist than the systems they consume energy more.
A part of the universe is objectively conscious.
Each consciousness is a universe on its own. Matter is just how those universes interact with each other. This is how quantum mechanics work in my idea, each observer affects the matter and quantum effects take most probable outcomes because of that.