Cognitive Computing via
Download
1 / 48

Cognitive Computing via Synaptronics and Supercomputing - PowerPoint PPT Presentation


  • 148 Views
  • Uploaded on

Cognitive Computing via Synaptronics and Supercomputing.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Cognitive Computing via Synaptronics and Supercomputing' - norah


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Cognitive computing via synaptronics and supercomputing

Cognitive Computing via Synaptronics and Supercomputing


Cognitive computing via synaptronics and supercomputing

"The information that comes from deep in the evolutionary past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


Cognitive computing via synaptronics and supercomputing

Inflection Point 1: past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."Neuroscience has matured

1414 pages


Cognitive computing via synaptronics and supercomputing

Inflection Point 2: past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."Supercomputing meets Brain


Cognitive computing via synaptronics and supercomputing

Mammalian-scale simulation in near real-time? past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

Computation

Memory

Communication


Cognitive computing via synaptronics and supercomputing

Cat past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

763 x 106

6.1 x 1012

Monkey

2 x 109

20 x 1012

Mouse

16 x 106

128 x 109

Rat

56 x 106

448 x 109

Human

22 x 109

220 x 1012

Almaden

BG/L

December, 2006

Watson

BG/L

April, 2007

WatsonShaheen

BG/P

March, 2009

LLNL Dawn

BG/P

May, 2009

BlueGene Meets Brain

N:

S:

New results for SC09

Latest simulations achieve unprecedented scale of

109 neurons and 1013 synapses


Cognitive computing via synaptronics and supercomputing

Inflection Point 3: past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."Nanotechnology meets Brain


Cognitive computing via synaptronics and supercomputing

Novel non-von Neumann Architectures are necessary past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

Data from Todd Hylton

Brain can be realized in modern electronics


Cognitive computing via synaptronics and supercomputing

Turning Back the Clock past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

Digital, synchronous conventional, 5GHz(compare Power 6, 2008)

Digital, semi-synchronous, 5 MHz(compare IBM PC/8088, 1978)

Digital-Analog, asynchronous, clockless(compare the Brain)

Digital, asynchronous, 100 kHz(compare ENIAC, 1946)

Commandment:Do what is necessary, when it is necessary, and only that which is necessary.


Cognitive computing via synaptronics and supercomputing

Dharmendra S Modha past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."IBM Research – Almaden

Raghavendra SinghIBM Research – India

Network Architecture of the White Matter Pathways in the Macaque BrainPNAS (July 2010)


The connection model
The connection model past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

  • Cortex has evolved such that it is organized into areas with distinct structural and functional properties

    • Primary sensory areas

    • Association areas

    • Motor areas

  • The white matter (myelinated nerve cell) underneath the outer covering of gray matter (nerve cell bodies), interconnects different regions of the central nervous system and carries nerve impulses between neuron

  • Model each area as a node and each connection as an edge in a graph

    • Analysis and Visualization of the brain

      • Wire length minimization

      • Organizational model that suggest the flow of information from input of sensory signals to the eventual output by motor neurons

    • Use model to simulate dynamics in the simulator


  • Cognitive computing via synaptronics and supercomputing

    CoCoMac: Connectivity data on the Macaque brain past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

    Rolf Kotter, Klass Stephen, 2000

    413 literature reports

    7007 brain sites

    8003 mapping details

    2508 tracer injections

    39748 connection details


    Cognitive computing via synaptronics and supercomputing

    AP84-TE past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

    PG91b-IT

    BP82-46

    SP89a-46

    FV91-V4

    FV91-TF

    RV99-TF

    FV91-V1

    RV99-CA1

    BR98-CA1

    FV91-TH

    BR98-TH

    כ

    כ

    =

    =

    =

    =

    PFCd

    9

    PCi

    IPL

    PF#1

    7b

    24c

    כ

    כ

    =

    =

    =

    =

    =

    CCa

    24c

    24

    24d

    CMAr

    Divergent Nomenclature and Abundant Conflicts


    Cognitive computing via synaptronics and supercomputing

    Bundling Algorithm by Holten, 2006 past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Kaiser, Hilgetag, 2006 past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Notable Collations past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Notable Collations past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Cingulum Bundle past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Uncinate Fasciculus past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    C, C, C, C, C, and C past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

    Complete Cortex, Thalamus, Basal Ganglia

    Comprehensive Includes every study in CoCoMac

    Consistent Every connection can be tracked back

    Concise 6,877 areas to 383

    Coherent Unified hierarchical parcellation

    Colossal 3 times larger than previous network

    wetware to software


    Cognitive computing via synaptronics and supercomputing

    Aggregate Statistics past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Brain is small-world past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

    SCC: 351 areas, 6,491 connections


    Cognitive computing via synaptronics and supercomputing

    “Organized Complexity” – Weaver, 1948 past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Degree Distribution Consistent with Exponential past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Prefrontal Cortex is Topologically Central past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Brain is small-world, Core is “tiny”-world! past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

    Core contains only 32% of vertices yet 88% of all edges originate or terminate in the core


    Cognitive computing via synaptronics and supercomputing

    Core contains correlated-anti-correlated networks past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."and may be a key to consciousness

    Fox, Snyder, Vincent, Corbetta, Van Essen, and Raichle, 2005


    Cognitive computing via synaptronics and supercomputing

    Inter-chip Connectivity past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."


    Cognitive computing via synaptronics and supercomputing

    Rent’s Rule past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

    • Rent's rule pertains to the organization of computing logic, specifically the relationship between the number of external signal connections (C) to a logic block with the number of logic gates (N) in the logic block

    • E.F. Rent observed a power-law relationship in the 1960’s - the law has been shown to hold true for small circuits upto mainframe computers

    0 ≤ p≤1 is the Rent parameter and k is the Rent coefficient.

    • Intrinsically it’s a surface area (wire) to volume (number of nodes) relationship

      • Represents a cost-efficient solution to the challenge of embedding a high dimensional functional interconnect topology in a relatively low dimensional physical space with economical wiring costs

    • Circuits with greater logical capacity have higher values of Rent parameter

      • Microprocessor (0.45), Gates Arrays (0.5), High speed Computers (0.63)

    • For 2D layouts p> 0.5 implies that wires must grow longer as circuit size increases; global connections dominate over local connections for large p

      • The relative contribution of wiring to layout area will grow with the size of circuit to allow space for a greater number of wires to pass between adjacent nodes, increasing the node-to-node spacing

    • Allometric scaling

      • Gray (physical) to white (logical) matter scaling - Zhang & Sejnowski


    Cognitive computing via synaptronics and supercomputing

    Rent’s Rule past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

    • High value of p

      • Topological dimensionality of network greater than 3, i.e., greater than the dimensionality of the Euclidean space in which the network is embedded

      • Communication is a significant factor of power and space

      • Tradeoff between wiring costs and greater logical capacity.

        • Rewiring the network so as to reduce its topological dimension results in loss of functional modularity


    Cognitive computing via synaptronics and supercomputing

    “white matter is nature’s finest masterpiece” past we call genetics. The information passed along from hundreds of years ago we call culture. The information passed along from decades ago we call family, and the information offered months ago we call education. But it is all information that flows through us. The brain is adapted to the river of knowledge and exists only as a creature in that river. Our thoughts are profoundly molded by this long historic flow, and none of us exists, self-made, in isolation from it."

    Nicolaus Steno, 1669


    Cognitive computing via synaptronics and supercomputing

    Owing both to limitations in hardware and architecture, these (convential) machines are of limited utility in complex, real-world environments, which demand an intelligence that has not yet been captured in an algorithmic-computational paradigm. As compared to biological systems for example, today’s programmable machines are less efficient by a factor of one million to one billion in complex, real-world environments. The SyNAPSE program seeks to break the programmable machine paradigm and define a new path forward for creating useful, intelligent machines.

    The vision for the anticipated DARPA SyNAPSE program is the enabling of electronic neuromorphic machine technology that is scalable to biological levels. Programmable machines are limited not only by their computational capacity, but also by an architecture requiring (human-derived) algorithms to both describe and process information from their environment. In contrast, biological neural systems (e.g., brains) autonomously process information in complex environments by automatically learning relevant and probabilistically stable features and associations. Since real world systems are always many body problems with infinite combinatorial complexity, neuromorphic electronic machines would be preferable in a host of applications—but useful and practical implementations do not yet exist.