HUMAN INFORMATION PROCESSING

1. HUMAN INFORMATIONPROCESSING OTHER SYSTEMS AND ORGANIZATION

2. ONE ANGLE OR TWO CHOPSTICKS ? • LET START WITH MORE PICTURES ILLUSTRATING VISUAL PROCESSING CONCLUSION: THE SYSTEM PRODUCES INTERPRETATION WHICH IS MOST LIKELY THAT IS CREATES STABLE REPRESENTATION

3. WE SEE HERE ILLUSORY CONTOURS OF OBJECTS VISUAL SYSTEM IS REALLY GOOD IN EXTRACTING THEM

4. JUNCTIONS ARE CRITICAL FOR OBJECT PERECPTION COMPARE LEFT AND RIGHT SIDES

5. LIGHT DIRECTION • VISUAL SYSTEM ASSUMES THAT LIGHT IS COMING FROM TOP SAME PICTURE UPSIDE DOWN

6. IN ALL FIGURES GREY ELEMENTS HAVE THEY SAME INTENSITY BUT PERCEIVED INTENSITY DEPENDS ON THE SURROUNDING AREA. VISUAL SYSTEM IS THUS NOT AN OBJECTIVE LIGHT INTENSITY MEASURING DEVICE

7. WHERE IS THE LIGHT SOURCE? • WE CAN ESTABLISH ITS POSITION FROM SHADOWS OF OBJECTS

8. OBJECTS CAN BE EASILY RECOGNIZED FROM MOTION OF DOTS IF THEY ARE MOUNTED ON THE OBJECT

9. HERE WE HAVE EXAMPLE THAT THE SYSTEM IS ALSO VERY ADAPTIVE BRAIN ADAPTATION TO REVERSED LEFT-RIGHT PICTURES Four volunteers lived for an entire month in the strange reverse world we see while shaving or applying lipstick. Wearing special 'prism spectacles' designed to reverse their vision meant that to go left they had to turn right, and if they looked one way to catch a tennis ball, it would hit them on the back. It took three weeks of adaptation for correct answers.

10. VISUAL SYSTEM IS ONE IMPORANT PART OF HUMAN INFORMATION PROCESSING BUT THERE ARE OTHERS: • ACOUSTICAL SYSTEM • HAPTIC +MOTORIC (TOUCH) WITH VESTIBULAR (ORIENTATION IN SPACE) • SMELL • TASTE

11. ACOUSTICAL SYSTEM HEARING + SOUND/SPEECH PRODUCTION: THIS IS MATCHED RECEIVER-TRANSMITTER SYSTEM VESTIBULAR SYSTEM

12. COCHLEA – SOUND TRANSDUCER MODEL OF COHLEAR TRANSDUCER SOUND PRESSURE IS CHANGED INTO FLUID PRESSURE UT OUTPUT IS MAXIMUM FOR CERTAIN FREQUENCY AT SOME POSITION ALONG THE TRANSDUCER

13. HAIRS – CHANGE THE MECHANICAL SIGNAL INTO ELECTRICAL

14. ACOUSTICAL SIGNALS – CAN BE ANALYZED IN TIME AND FREQUENCY OR BOTH. AND BOTH SYSTEMS SEEM TO BE PRESENT IN THE BRAIN WE ARE ABLE TO DETECT PRECISELY FREQUENCY OF TONES E.G. SINUSOIDS AND POSITION OF SOUNDS IN TIME E.G. CLICKS IN THE ACOUSTICAL CORTEX THERE ARE TIME DETECTORS (PLACE) AND FREQUENCY DETECTORS. BOTH TYPE OF SYSTEMS OPERATE AT SOME FREQUENCY RANGES (TOP) FILTERS ARE BROADLY TUNED (BOTTOM)

15. WE CAN SEE SEVERAL STAGES FOM COCHLEA TO CORTEX SUPERIOR OLIVARY NUCLEUS IS THE PLACE WHERE SPATIAL SOUND PROCESSING STARTS MAPPING INTO FREQUENCY AND SPACE LOCATIONS IS PRESENT, LIKE IN VISION IT WAS FOR LOCAL SIGNAL FEATURES • THE STRUCTURE OF HEARING SYSTEM

16. WE HAVE DIFFERENT SENSITIVITIES FOR DIFFEERENT FREQUENCIES, HIGHEST IS IN THE MIDDLE RANGE MUSIC FROM INSTRUMENTS CAN BE VERY EFFICIENTLY RECOGNIZED. THIS MUST BE BASED ON DETAILED FREQUENCY AND TIME ANALYSIS

17. LOCALIZATION OF SOUND SOURCES IN SPACE IS BASED ON MEASURING DIFFERENCES IN TIME OF SOUND ARRIVAL BETWEEN THE EARS. THIS MUST BE VERY PRECISE MEASUREMENT, ON THE ORDER OF TENS OF MICROSECONDS SOUND LOCALIZATION IS QUITE PRECISE BUT HEAD MOVEMENTS AND VISUAL CUES HELP A LOT, ERRORS IN LOCATION CAN BE SEEN IN PICTURES

18. MUSIC PROCESSING....

19. CERTAIN TONES HAVE HARMONY, THEY SOUND NICE TO US, OTHR TONES NOT. WE ARE PROBABLY BORN WITH A SYSTEM WHICH PROCESSES TONES AND THUS WE ARE PREDISPOSED FOR CERTAIN SOUNDS WHICH ARE ”NATURAL” FOR US

20. SPEECH PROCESSING SYSTEM A COMPLEX ELASTIC MECHANICAL SYSTEM CONTROLLED ELECTRICALLY FOR REGULATION OF AIRFLOW

21. BASIC UNITS OF SPEECH –PHONEMS USING THESE UNITS SPEECH CAN BE GENERATED HEARING AND SPEECH ARE PRECISLY MATCHED TO EACH OTHER SPEECH CAN BE RECOGNIZED EVEN AT HIGH LEVEL OF NOISE AND INTERFERENCE . EXAMPLE IS SO CALLED COCTAIL PARTY EFFECT: MANY PEOPLE ARE TALKING AT THE SAME TIME BUT WE ARE ABLE TO CONCENTRATE ON ONE SPEAKER.

22. VESTIBULAR SYSTEM NOTE THAT THE WORLD WE SEE IS STABLE, WHILE PICTURES ON RETINAS OF EYES ARE NOT. MOVEMENTS ARE COMPENSATED BY SIGNALS FROM VESTIBULAR SYSTEM (ORIENTATION IN SPACE) EXAMPLE: WHEN PERSON IS ROTATING ON A PLATFORM IN DARK ROOM, HORIZONTAL LINE WILL BE DEFLECTED

23. TOUCH SYSTEM IT HAS RECEPTORS IN THE BODY. IN THE BRAIN THERE IS MAPPING OF THE BODY IN THE CORTEX

24. MAPPING OF BODY PARTS IN THE SOMATOSENSORY CORTEX

26. SKIN RECEPTORS OF TOUCH (CAPSULES AT THE NERVE ENDINGS)

27. TOUCH SENSITIVITY THRESHOLD OVER THE BODY: FEMALES MALES FEMALES ARE MORE SENSITIVE TO TOUCH

28. PAIN SYSTEM WHAT IS PAIN? IT IS SIGNALLING FROM THE BODY TO THE BRAIN ABOUT IMPROPER OPERATION THE BRAIN CHANGES ITS ACTION TO DEAL WITH THE PROBLEM THERE IS ALSO A SYSTEM FOR IHIBITING THE PAIN SIGNALS

29. IT IS ACTIVATION OF TOUCH AND PAIN SYSTEM IN ORDER TO STIMULATE OTHER BRAIN STRUCTURES PERHAPS IMMUNE SYSTEM IS STIMULATED??? • ACUPUNCTURE

30. INTEGRATION OF SENSESIN BIOLOGICAL SYSTEMS WE COULD CALL IT ”BIOLOGICAL MULTIMEDIA” but this is ONLY A JOKE!

31. PEOPLE HAVE FANTASTIC CAPABILITIES IN RECEIVING AND PRODUCING INFORMATION BY DIFFERENT SENSES AND SYSTEMS FOR EXAMPLE THEY CAN SPEAK, LISTEN AND DANCE AT THE SAME TIME HOW SUCH THINGS ARE CONTROLLED AND ORGANIZED IN THE BRAIN? LET’S SEE FIRST SOME OF THE BRAIN CAPABILITIES (SOME OF THEM QUITE FUNNY TOO)

32. CROSSMODAL MATCHING HERE THE PERSON MUST RECOGNIZE OBJECT VISUALLY, RECOGNIZE OBJECT BY TOUCH, COMPARE THEM AND MATCH HOW THIS IS DONE? PROBABLY INFORMATION FROM DIFFERENT SENSES IS STORED IN SOME GENERAL WAY, INEPENDENT FROM PARTICULAR SENSE

33. SOME PEOPLE HAVE PECULIAR EXPERIENCE: THEY FEEL E.G. SPECIFIC SHAPE WHEN FEEL SPECIFIC TASTE THIS IS CALLED SYNESTHESIA, ONE CAN SPECULATE THAT SENSORY SIGNALS GET MIXED UP SOMWHERE

34. VENTRILOQUISM - BY COORDINATING MOVEMENTS OF A PUPPET WITH SPEECH, VENTIRLOQUIST INDUCES STRONG ILLUSION THAT THE PUPPET IS SPEAKING

35. HOW THE COORDINATION IS DONE? DEEP IN THE BRAIN THERE IS A STRUCTURE CALLED SUPERIOR COLLICULUS

36. IN THIS STRUCTURE THERE ARE NEURONS REACTING TO DIFFERENT SENSORY INFORMATION: THEY ARE MULTIMODAL

37. STIMULATION OF DIFFERENT SENSORY AREAS OF CORTEX WILL PRODUCE RESPONSE FROM Superior Colliculus NEURONS:

38. THERE ARE MANY KINDS OF MULTIMODAL NEURONS: SOME RESPOND TO 2 DIFFERENT SENSES AND SOME TO 3 NEURON RECEIVING SIGNALS FROM THREE SENSES

39. THESE NEURONS HAVE CONNECTIONS FROM LAYERS OF SINGLE SENSORY NEURONS

40. HERE WE SEE LAYER OF VISUAL NEURONS FOR DIFFERENT ANIMALS THEY FORM A MAP OF VISUAL SPACE

41. HERE WE SEE LAYER OF AUDITORY NEURONS THEY FORM A MAP OF AUDITORY SPACE

42. THE DIFFERENT MAPS ARE OVERLAID ON EACH OTHER SO THEY MATCH!

43. THESE NEURONS RESPOND TO OVERLAPPING AREAS FROM DIFFERENT SENSORY MAPS. THEY HAVE BROAD RESPONSE

44. RESPONSE PATTERNS FOR DIFFERENT BODY AREAS

45. CONTROL OF BODY MOVEMENTS EAR POSITIONS

46. REACTION OF VISUAL-ACOUSTICAL NEURON. REPONSE IS GREATLY ENHANCED FOR SIMULTANEOUS VISUAL-ACOUSTICAL STIMULATION PLEASE NOTE THAT SIGNALS ARE SYNCHRONIZED I N TIME!

47. RESPONSE OF VISUAL-TOUCH NEURON. RESPONSE IS ENHANCED PLEASE NOTE THAT SIGNALS ARE SYNCHRONIZED I N TIME!

48. TOUCH-VISUAL NEURON. RESPONSE ENHANCED PLEASE NOTE THAT SIGNALS ARE SYNCHRONIZED I N TIME!

49. TRIMODAL NEURON- SENSITIVE TO 3 SENSES. RESPONSE TO TWO SENSES AT A TIME

50. DEPRESSION OF RESPONSE WHEN SIGNALS ARE NOT OPTIMALLY SYNCHRONIZED