1 / 43

Functional Link Network

Functional Link Network. Support Vector Machines. Support Vector Machines. support vectors. separator . margin. Support Vector Machines. Support Vector Machines. Support Vector Machines. Support Vector Machines. Support Vector Machines. Support Vector Machines. Support Vector Machines.

asher
Download Presentation

Functional Link Network

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Functional Link Network

  2. Support Vector Machines

  3. Support Vector Machines

  4. support vectors separator margin

  5. Support Vector Machines

  6. Support Vector Machines

  7. Support Vector Machines

  8. Support Vector Machines

  9. Support Vector Machines

  10. Support Vector Machines

  11. Support Vector Machines

  12. Support Vector Machines

  13. Two Spiral Problem

  14. SVM architecture

  15. Application: text classification • Reuters “newswire” messages • Bag-of-words representation • Dimension reduction • Training SVM

  16. Results Break-even point = precision value at which precision and recall are nearly equal

  17. Results

  18. Application 2: face recognition

  19. False detections

  20. System architecture

  21. Results

  22. Results

  23. Skin detection and real-time recognition

  24. Neural Networks

  25. Ccortex is a massive spiking neuron network emulation and will mimic the human cortex, the outer layer of gray matter at the cerebral hemispheres, largely responsible for higher brain functions. The emulation covers up to 20 billion layered neurons and 2 trillion 8-bit connections.

  26. Spiking Neural Networks • From neurones to neurons • Artificial Spiking Neural Networks (ASNN) • Dynamic Feature Binding • Computing with spike-times

  27. Neural Networks • Artificial Neural Networks • (neuro)biology -> Artificial Intelligence (AI) • Model of how we think the brain processes information • New data on how the brain works! • Artificial Spiking Neural Networks

  28. Real Neurons • Real cortical neurons communicate with spikes or action potentials

  29. Real Neurons • The artificial sigmoidal neuron models the rate at which spikes are generated • artificial neuron computes function of weighted input:

  30. Artificial Neural Networks • Artificial Neural Networks can: • approximate any function • (Multi-Layer Perceptrons) • act as associative memory • (Hopfield networks, Sparse Distributed Memory) • learn temporal sequences • (Recurrent Neural Networks)

  31. ANN’s • BUT.... for understanding the brain the neuron model is wrong • individual spikes are important, not just rate

  32. Binding Problem • When humans view a scene containing a red circle and a green square, some neurons • signal the presence of red, • signal the presence of green, • signal the circle shape, • Signal the square shape. • The binding problem: • how does the brain represent the pairing of color and shape? • Specifically, are the circles red or green?

  33. Binding • Synchronizing spikes?

  34. New Data! • neurons belonging to same percept tend to synchronize (Gray & Singer, Nature 1987) • timing of (single) spikes can be remarkably reproducible • Spikes are rare: average brain activity < 1Hz • “rates” are not energy efficient

  35. Computing with Spikes • Computing with precisely timed spikes is more powerful than with “rates”. (VC dimension of spiking neuron models) [W. Maass and M. Schmitt., 1999] • Artificial Spiking Neural Networks??[W. Maass Neural Networks, 10, 1997]

  36. Artificial Spiking Neuron • The “state” (= membrane potential) is a weighted sum of impinging spikes • spike generated when potential crosses threshold, reset potential

  37. Artificial Spiking Neuron • Spike-Response Model: where ε(t) is the kernel describing how a single spike changes the potential:

  38. Artificial Spiking Neural Network • Network of spiking neurons:

  39. Error-backpropagation in ASNN • Encode “X-OR” in (relative) spike-times

  40. XOR in ASNN • Change weights according to gradient descent using error-backpropagation (Bohte et al, Neurocomputing 2002) • Also effective for unsupervised learning(Bohte etal, IEEE Trans Neural Net. 2002)

  41. Oil Application

More Related