Logic in action. A centipede was happy, quite, Until a toad in fun Said, "Pray, which leg moves after which?" Which raised her doubts to such a pitch, She fell exhausted in the ditch, Not knowing how to run. -Sir Edwin Ray Lankester, 1898. Two perspectives on perception.
A centipede was happy, quite,Until a toad in funSaid, "Pray, which leg moves after which?"Which raised her doubts to such a pitch,She fell exhausted in the ditch,Not knowing how to run.
-Sir Edwin Ray Lankester, 1898
Hermann von Helmholtz (1821-1894)
James Gibson (1904-1979)
Perception is “unconscious inference”
Perception is Direct:“the information is in the light”
Our sensations are simply effects which are produced in our organs by objective causes. . . [O]ur sensations are signs, not images, of such characteristics. . . .
[However], even if in their qualities our sensations are only signs whose specific nature depends completely upon our make-up or organisation, they are not to be discarded as empty appearances. They are still signs of something - something existing or something taking place - and given them we can determine the laws of these objects or these events. . . .
[T]he connections of ideas which take place in these processes [are] unconscious inferences. These inferences are unconscious insofar as their major premise is not necessarily expressed in the form of a proposition; it is formed from a series of experiences whose individual members have entered consciousness only in the form of sense impressions which have long since disappeared from memory. Some fresh sense impression forms the minor premise, to which the rule impressed upon us by previous observations is applied.
Hermann von Helmholtz, ‘The Facts of Perception” (1878)
It is not necessary to believe that anything whatever is transmitted along the optic nerve in the activity of perception... We can think of vision as a perceptual system, the brain being simply part of the system. The eye is also part of the system, since retinal inputs lead to occular adjustments and then to altered retinal inputs, and so on. The process is circular, not a one-way transmission... The eye-head-brain-body system registers the invariants in the structure of ambient light .
James Gibson, “The Ecological Approach to Visual Perception” (1979)
[S]timulus information can specify its source in the world without necessarily being like it.
James Gibson, “A Further Note on the Perception of the Motion of Objects as Related to the Perception of Events” (1966)
The information is in the light.
Helmholtz: perception is like scientific discovery
Gibson: perception is like bacterial chemotaxis
The direct perception debate has a religious character,
reminiscent of arguments about points of doctrine like free will and predestination.
Aside: the role of inference in perception
is connected to a philosophical argument about morality...
Right and wrong are like sense impressions, so that morality is “more properly felt than judg’d of”.
Our decisions concerning moral rectitude and depravity are evidently perceptions; and as all perceptions are either impressions or ideas, the exclusion of the one is a convincing argument for the other. Morality, therefore, is more properly felt than judg'd of; tho' this feeling or sentiment is commonly so soft and gentle, that we are apt to confound it with an idea, according to our common custom of taking all things for the same, which have any near resemblance to each other.
If you assert, that vice and virtue consist in relations susceptible of certainty and demonstration, . . . , you run into absurdities, from which you will never be able to extricate yourself.
David Hume. A Treatise of Human Nature, book III, “Of Morals” (1740)
Every one knows that judicious matter and charms of style have rendered Hume's history the manual of every student. I remember well the enthusiasm with which I devoured it when young, and the length of time, the research and reflection which were necessary to eradicate the poison it had instilled into my mind. . . .
It is this book which has undermined the free principles of the English government, . . . , and has spread universal toryism over the land.
-Thomas Jefferson letter to William Duane Monticello, August 12, 1810
Is perception (of form, color, motion, pitch, speech...) ‘feeling’? or ‘judging’?
Gibson never denied that there was complicated processing going on -- he simply wasn't interested in it. Gibson carried a hearing aid in his shirt pocket, with a prominent volume control. If you started talking about mechanisms, he would simply turn off his hearing aid, and that would be the end of that. For him, finding out what in the environment made perception possible was more than enough challenge for a lifetime . . .
Bruce Bridgeman, “Simple Conscious Percepts Require Complex Unconscious Processing”. Psyche (1998)
What is the computation being performed? What algorithm is the “Mexican hat” receptive field part of?
“Center-surround” or “Mexican hat” receptive fields of neurons in retinal ganglion cells
Is this part of a Helmholtzian process of perceptual inference?
or part of a Gibsonian process of direct perception?
Are the edges “in the light”?
Does edge detection create hypotheses that can be true or false?
what kind of inference is it?
reasoning from the general to the specific
All men are mortal. Socrates is a man.
Therefore, Socrates is mortal.
reasoning from the specific to the general
[telephone survey of 1,007 Californians]
40% of California voters favor Arnold (±3%)
reasoning from observations to the best explanation
[ ... detective work ... ]
The butler did it.
Invented: application of Boolean algebra to logic circuits (1946) information theory (1949) – relation of messages and signals
“... known for keeping to himself by day and riding his unicycle down the halls at night...”
background (prior) knowledge about the plausibility of different theoriescan be combined with knowledge aboutthe relation of theories to evidence
[The] major premise . . . is formed from a series of experiences whose individual members have entered consciousness only in the form of sense impressions which have long since disappeared from memory. Some fresh sense impression forms the minor premise, to which the rule impressed upon us by previous observations is applied.
Is Bayes’ rule a form of inference? which kind?
Another component of Bayes’ analysis of “a problem in the doctrine of chances”:
--costs and benefits of the alternatives
= “utility function”
Combined with prior, likelihood to “place your bets” on alternative choices of action...
(a) Two drifting gratings superimposed in the image plane produce a translating ‘plaid’ pattern. (b) Dotted lines indicate constraint lines; arrows indicate perceived direction of grating viewed in isolation. The Interaction of Constraints solution (circle) is the unique velocity consistent with the constraint lines of both gratings. The Vector Average solution (square) is the average of the two normal velocities.
(a) Narrow rhombus at high contrast appears to move horizontally (consistent with IOC). (b) Narrow rhombus at low contrast appears to move diagonally (consistent with VA).
(d,e) Fat rhombus at low or high contrast appears to move horizontally (consistent with IOC).
Model’s likelihood functions for three local patches of a horizontally translating diamond stimulus. (Intensity corresponds to probability). Top: high-contrast diamond. Bottom: low-contrast diamondAt edges, the local likelihood is a ‘fuzzy’ constraint line; at corners, the local likelihood peaks around the veridical velocity. The sharpness of the likelihood decreases with decreasing contrast (because the signal-to-noise ratio gets worse)
(note: P(I|V)estimate incorporates noise model)
(a) High-contrast thin rhombus estimated to move horizontally(b) Low-contrast thin rhombus estimated to move obliquely
For “fat” rhombus, the model estimates horizontal motion regardless of contrast.
(d) Circles show perceived direction for a human subject as (low contrast) rhombus angle was shifted gradually from thin to fat. Solid line shows the predictions of the Bayesian estimator. Dotted lines indicate the predictions when the free parameter was decreased by a factor of 10 (top dotted line) or increased by a factor of 10 (bottom line).