Self organization and error correction
This presentation is the property of its rightful owner.
Sponsored Links
1 / 29

Self-organization and error correction PowerPoint PPT Presentation


  • 72 Views
  • Uploaded on
  • Presentation posted in: General

Cognitive Neuroscience and Embodied Intelligence. Self-organization and error correction. Based on a courses taught by Prof. Randall O'Reilly , University of Colorado, Prof. Włodzisław Duch , Uniwersytet Mikołaja Kopernika and http://wikipedia.org/.

Download Presentation

Self-organization and error correction

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Self organization and error correction

Cognitive Neuroscience and Embodied Intelligence

Self-organization and error correction

Based on a courses taught by

Prof. Randall O'Reilly, University of Colorado,

Prof. Włodzisław Duch, Uniwersytet Mikołaja Kopernika

and http://wikipedia.org/

http://grey.colorado.edu/CompCogNeuro/index.php/CECN_CU_Boulder_OReilly

http://grey.colorado.edu/CompCogNeuro/index.php/Main_Page

Janusz A. Starzyk


Learning types

How should an ideal learning system look?

How does a human being learn?

Learning: types

Detectors (neurons) can change local parameters but we want to achieve a change in the functioning of the entire information processing network.

We will consider two types of learning, requiring other mechanisms:

  • Learning an internal model of the environment (spontaneous).

  • Learning a task set by the network (supervised).

  • Combination of both.


Learning operations

One output neuron can't learn much.

Operation = sensomotor transformation, perception-action.

Learning operations

Stimulation and selection of the correct operation, interpretation, expectations, plan…

What type of learning does this allow us to explain? What types of learning require additional mechanisms?


Simulation

Select self_org.proj.gz, in Chapter 4.8.1

25 inputs

20 hidden neurons, kWTA;

The network will learn interesting features.

Simulation


Self organization and error correction

ChoseSelf_org.projfrom Ch4.

5x5 input has either a single horizontal or vertical line (10 samples)or a combination of 2 lines (45 samples).

Learning is possible only for individual lines.

Miracle: Hebbian lerning + kWTA is sufficient for the network to make correct internal representations.

Simulation


Self organization and error correction

4x5 = 20 hidden neurons, kWTA.

After training (30 epochs presenting all line pairs), selective units responding to single lines appear, (2 units for 2 lines) giving a combinatorial representation!

Initially responses to inputs are random but winners quickly appear. Some units (5) remain inactive and they can be used to learn new inputs.

Self-organization, but no topological representation, since neighbors respond to different features.

Simulation

10 unique representations for single line inputs – all correct.


Sensomotor maps

Sensomotor maps

Self-organization is modeled in many ways; simple models are helpful in explaining qualitative features of topographic maps.

Fig. from:

P.S. Churchland, T.J. Sejnowski,

The computational brain.

MIT Press, 1992


Motor and somatosensory maps

Motor and somatosensory maps

This is a very simplified image, in reality most neurons are multimodal, neurons in the motor cortex react to sensory, aural, and visual impulses (mirror neurons)

- many specialized circuits of perception-action-naming.


Finger representation plasticity

Hand

Before

After stimulation

stimulation

Face

Finger representation: plasticity

Sensory fields in the cortex expand after stimulation

– local dominances resulting from activation

Plasticity of cortical areas to sensory-motor representations


Simplest models

Simplest models

SOM or SOFM (Self-Organized Feature Mapping) – self-organizing feature map, one of the most popular models.

How can topographical maps be created in the brain?

Local neural connections create strong groups

interacting with each other, weaker across greater

distances and inhibiting nearby groups.

History:

von der Malsburg and Willshaw (1976), competitive learning, Hebbian learning with "Mexican hat" potential, mainly visual system

Amari (1980) – layered models of neural tissue.

Kohonen (1981) – simplification without inhibition; only two essential variables: competition and cooperation.


Som idea

SOM: idea

Data: vectors XT = (X1, ... Xd) from d-dimensional space.

A net of nodes with local processors (neurons) in each node.

Local processor # j has dadaptive parameters W(j).

Goal: adjust the W(j) parameters to model the clusters in p-niX.


Training som

Training SOM

Fritzke's algorithm Growing Neural Gas (GNG)

Demonstrations of competitive GNG learning in Java: http://www.neuroinformatik.ruhr-uni-bochum.de/ini/VDM/research/gsn/DemoGNG/GNG.html


Som algorithm competition

SOM algorithm: competition

Nodes should calculate the similarity of input data to their parameters.

Input vectorXis compared to node parametersW.

Similar = minimal distance or maximal scalar product. Competition: find node j=c with W most similar to X.

Node number c is most similar to the input vectorX

It is a winner, and it will learn to be more similar to X, hence this is a “competitive learning” procedure.

Brain: those neurons that react to some signals activate and learn.


Som algorithm cooperation

SOM algorithm: cooperation

Cooperation: nodes on a grid close to the winnercshould behave similarly. Define the “neighborhoodfunction” O(c):

t– iteration number (or time);

rc– position of the winning node c (in physical space, usually 2D).

||r-rc||– distance from the winning node, scaled by sc(t).

h0(t)– slowly decreasing multiplicative factor

The neighborhood function determines how strongly the parameters of the winning node and nodes in its neighborhood will be changed, making them more similar to data X


Som algorithm dynamics

SOM algorithm: dynamics

Adaptation rule: take the winner nodec, and those in its neighborhood O(rc), change their parameters making them more similar to the data X

Randomly select new sample vector X, and repeat.

Decrease h0(t)slowly until there will be no changes.

Result:

  • W(i) ≈ the center of local clusters in the X feature space

  • Nodes in the neighborhood point to adjacent areas in X space


Maps and distortions

Maps and distortions

Initial distortions may slowly disappear or may get frozen ... giving the user a completely distorted view of reality.


Demonstrations with the help of gng

Demonstrations with the help of GNG

Growing Self-Organizing Networks demo http://www.neuroinformatik.ruhr-uni-bochum.de/ini/VDM/research/gsn/DemoGNG/GNG.html

Parameters of the SOM program:

t – iterations

e(t) = ei (ef / ei )t/tmax specifies a step in learning

s(t) = si (sf / si )t/tmaxspecifies the size of the neighborhood

Maps 1x30 show the formation of Peano's curves.

We can try to reconstruct Penfield's maps.


Mapping kwta cpca

Hebbian learning finds relationship between input and output.

Mapping kWTA CPCA

Example:

pat_assoc.proj.gz

in Chapter 5,described in 5.2

Simulations for 3 tasks, from easy to impossible.


Derivative based hebbian learning

Derivative based Hebbian learning

Hebb's rule: Dwkj = e (xk -wkj) yj

will be replaced by derivative based learning based on time domain correlation of firing between neurons.

This can be implemented in many ways;

  • For the signal normalization purpose let us assume that the maximum rate of change between two consecutive time frames is 1.

  • Let us represent derivative of the signal x(t) change by dx(t).

    Assume that the neuron responds to signal changes instead of signal activation


Derivative based hebbian learning1

Define product of derivatives

pdkj(t)=dxk(t)*dyj(t).

Derivative based weight adjustment will be calculated as follows:

Feedforward weights are adjusted as

Dwkj = e0 (pdki (t) - wkj) |pdki (t)|

and feedback weight are adjusted as

Dwjk = e0 (pdki (t) - wjk) |pdki (t)|

This adjustment gives symmetrical feedforward and feedback weights.

Derivative based Hebbian learning

xk(t)

yj(t)

pdkj(t)

t


Derivative based hebbian learning2

Asymmetrical weight can be obtained by using product of shifted derivative values

pdkj(+)=dxk(t)*dyj(t+1) and pdkj(-)=dxk(t)*dyj(t-1).

Derivative based weight adjustment will be calculated as follows:

Feedforward weights are adjusted as

Dwkj = e1 (pdki (+) - wkj) |pdki (+)|

and feedback weight are adjusted as

Dwjk = e1 (pdki (-) - wjk) |pdki (-)|

yj

wjk

wkj

xk

x1

x2

Derivative based Hebbian learning


Derivative based hebbian learning3

Feedforward weights are adjusted as

Dwkj = e1 (pdki (+) - wkj) |pdki (+)|

yj

wkj

xk

x1

x2

xk(t)

yj(t)

yj(t+1)

pdkj(+)

t

Derivative based Hebbian learning


Derivative based hebbian learning4

and feedback weight are adjusted as

Dwjk = e1 (pdki (-) - wjk) |pdki (-)|

yj

wjk

xk

x1

x2

xk(t)

yj(t)

yj(t-1)

pdkj(-)

t

Derivative based Hebbian learning


Task learning

Unfortunately Hebbian learning won't suffice to learn arbitrary relationship between input and output.

This can be done by learning based on error correction.

Task learning

Where do goals come from? From the "teacher," or confronting the predictions of the internal model.


The delta rule

Idea:

weights wik should be revised so that they change strongly for large errors and not undergo a change if there is no error, so

Dwik ~ ||tk – ok|| si

Change is also proportional to the size of the activation by input si

Phase + is the presentation of the goal, phase – is the result of the network.

This is the delta rule.

The Delta rule


Credit assignment

Credit/blame assignment

Dwik =e ||tk – ok|| si

The error is local, for image k.

Credit Assignment

If a large error formed and output ok is significantly smaller than expected then input neurons with a large activation will make the error even larger. If output ok is significantly larger than expected then input neurons with a large activation will decrease it significantly.

Eg. input si is the number of calories in different foods, output is a moderate weight; if it's too big then we must decrease high-calorie weights (food), if it's too small then we must increase them.

Representations created by an error-minimalization process are the result of the best assignment of credit to many units, and not the greatest correlation (like in Hebbian models).


Limiting weights

We don't want the weights to change without limits and not accept negative values.

This is consistent with biological demands which separate inhibitory and excitatory neurons and have upper weight limits.

The weight change mechanism below, based on the delta rule, ensures the fulfillment of both restrictions.

Dwik = Dik (1- wik) if Dik >0

Dwik = Dikwik if Dik <0

whereDik is the weight change resulting from error propagation

1

Dik

Dwik

weight

0

Limiting weights

This equation limits the weight values to the 0-1 range.

The upper limit is biologically justified by the maximum amount of NT which can be emitted and the maximum density of the synapses


Task learning1

We want: Hebbian learning and learning using error correction, hidden units and biologically justified models.

The combination of error correction and correlations can be aligned with what we know about LTP/LTD

Dwij = e [  xi yj +-  xi yj -]

Hebbian networks model states of the world but not perception-action.

Error correction can learn mapping. Unfortunately the delta rule is only good for output units, and not hidden units, because it has to be given a goal.

Backpropagation of errors can teach hidden units.

But there is no good biological justification for this method…

Task learning


Simulations

Select:

pat_assoc.proj.gz, in Chapt. 5

Description: Chapt. 5. 5

The delta rule can learn difficult mappings, at least theoretically...

Simulations


  • Login