How do our conscious experiences relate to the “real world”?
How does our conscious experience relate to the external world? Could we be in a “Matrix” type of simulation? Is there any experiment we could do which would enable us to find out? A huge conceptual difficulty is that any attempt to find out what consciousness is can only be done “from the inside”. We need to use consciousness in order to find out what consciousness is and there are reasons to think that this places severe limitations on what can be known. This problem is well described in a quote attributed to Chalmers [Chalmers 2009]: ‘Consider a computer simulation in which the bodies of the creatures are controlled by their minds and the minds remain strictly external to the simulation. The creatures can do all the science they want in the world, but they will never be able to figure out where their minds are, for they do not exist in their observable universe.’ If we were in a “matrix” type simulation there is no experiment we could do which would demonstrate this. We can never know.
Illusions of perception
It is well known that what we perceive and experience as phenomenal consciousness is the output of much computational processing and that, despite appearances, we do not have direct access to the real world. Scientific experiments show that the gap between what we perceive and the external world is wider than we think. What we perceive is the output of a large amount of sophisticated signal processing based on our sensory inputs and a mental model of the world which has been built up throughout our lives. In many cases, the information we receive through our senses is very incomplete but our mental models can fill in the gaps, usually accurately enough to allow smooth interaction with the world. If we consider illusions, we can see cases where our mental model gets it wrong and what we perceive is not how things really are. The amount and sophistication of computation and pre-processing involved can be seen in illusions such as the McGurk effect where what we hear is demonstratively dependent not only on the sounds reaching our ears but also visual information reaching our eyes. Also lip reading where use is made of visual cues to clarify what we subjectively hear. This is an example of “data fusion” which gives rise to the “binding problem”.
Illusions of agency
Often we can believe that we have consciously chosen to do something when we have not, or vice versa. For example, the computation referred to above takes time and the events we perceive are ones which have happened about 300ms previously [Libet 1985]. Fast responses, such as withdrawing one’s hand from a hot surface or returning a tennis serve, happen before we are consciously aware of them. Although it is widely believed that the withdrawal of the hand is a response to the pain of touching the hot surface eg. [Kim 1996], it is actually automatic and non-conscious. The pain of the hot surface is only felt after the hand has been withdrawn. This raises questions about what the feeling of pain is for. Even descriptions involving the use of pain to learn what situations to avoid in the future do not explain why the pain has to be felt rather than it simply adjusting the internal controls.