Issue #2: Shift Invariance. Backprop cannot handle shift invariance (it cannot generalize from 0011, 0110 to 1100) But the cup is on the table whether you see it right in the center or from the corner of your eyes (i.e. in different areas of the retina map)
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
There are two different types of learning
Schafer collateral pathway
1 sec. stimuli
At 100 hz
The activity-dependent tuning of the developing nervous system, as well as post-natal learning and development, do well by following Hebb’s rule.
Explicit Memory in mammals appears to involve LTP in the Hippocampus.
Many computational systems for modeling incorporate versions of Hebb’s rule.
Twin requirements of LTP induction:
F = B/N
the point is, with a fan-out of1000,
if we allow 2 intermediate layers,
we can almost always find a pathThe Idea of Recruitment Learning
P = (1-F) **B**K
P = Probability of NO link between X and Y
N = Number of units in a “layer”
B = Number of randomly outgoing units per unit
F = B/N , the branching factor
K = Number of Intermediate layers, 2 in the example
106 107 108
# Paths = (1-Pk-1)*(N/F) = (1-Pk-1)*B
For Networks with N nodes and branching factor,
there is a high probability of finding good links.
Cognition and Language
Neural Net and learning
How does it work?
How does it improve fitness?
How does it develop and adapt?
How did it evolve?
On Vo Co
Adapted from Gary Dell, “Producing words from pictures or from other words”
adds additional somatosensory information to
the movement to be imitated
provides an early
description of the action
Parietal mirror neurons (PF)
(inferior parietal lobule)
Frontal mirror neurons (F5) (BA 44)
copies of the motor plans necessary to imitate actions for monitoring purposes
codes the goal of the
action to be imitated
Buccino et al. Eur J Neurosci 2001
English has 11 basic color terms