ERP Old/New Effects During Auditory and Visual Word Recognition Memory Tasks:

1. Psychophysiological Laboratory 42nd Annual Meeting of the Society for Psychophysiological Research (SPR), October 2-6, 2002,Washington, DC, USA ERP Old/New Effects During Auditory and Visual Word Recognition Memory Tasks: Findings for Healthy Adults and Depressed Patients Jürgen Kayser, Craig Tenke, Regan Fong, Jonathan Stewart, Frederic Quitkin, Gerard Bruder Department of Biopsychology New York State Psychiatric Institute Columbia University College of Physicians and Surgeons

2. Temporal resolution of ERPs allows to study memory-retrieval processes in ‘real time’ Typical finding during explicit memory tasks (i.e., judging items as being old or new) P600 N2 ERP correlate of conscious recollection Friedman 2000, Biol. Psychol., 54:175-206. ms Background Old/New Effect • begins at 300 – 400 ms • lasts 300 – 500 ms • mostly posterior • words, pictures, faces, etc. Difference Waveform • overlaps at least two distinct ERP components • scalp distribution ERP old/new effect differs from N400/N2 and P600/P3b topographies

3. Few ERP studies of recognition memory in the auditory modality (although similar ERP old/new effects were observed for spoken words or environmental sounds) Behavioral and neurological evidence suggests that visual and auditory short-term memory processes are distinct and involve separate neural pathways • ERPs should reflect time course and anatomy of these separate processing streams of • perceptual • linguistic processes • mnemonic Objective • ERP old/new effect across modalities • within-subjects design • continuous word-recognition memory task N1 N2 N1 N2 Price 2000, J. Anat., 197:335-359. ERP correlates of word-recognition memory rarely been studied in psychiatric disorders Schizophrenic dysfunction affects primarily auditory modality P3 Kayser et al. 1999, Int. J. Psychophysiology, 34:249-265. Background (cont.) • verbal memory / left MTL impairments in schizophrenia? • memory / medial temporal (hippocampal) dysfunction in depression?

4. Visual Auditory … … … habit rock rock fraction Exposure [ms] 400 411 (229 – 718) new item paper filler item (never-repeated) V-A-A-V or A-V-V-A lags: 8 items 24 items shock 4 blocks check check old item 456 trials total time 228 items/modality 92 filler 68 new/old pairs forced choice button press newold Continuous Word Recognition Memory Task SOA 2,000 ms

5. Condition p = .0009 Study 1: Behavioral Data Gender (male / female) 8 / 8 Age (years) 31.7 ± 6.2 (24 – 40 yrs) Handedness (EHI) 80.4 ± 21.4 Healthy Adults (N = 16) Modality p < .0001 Condition p = .01 Modality x Condition p = .0003

6. ElectroCap (30-channel) Left Mastoid Right Mastoid 10-20 System EEG Montage (Nose Reference) Nose

7. Study 1: ERP Waveforms Healthy Adults (N = 16) Visual ERPs were normalized within this modality by vector scaling across time, electrodes, condition and lag following the procedure suggested by McCarthy and Wood (1985). Kayser et al., in press, Cogn. Brain Res.

8. Study 1: ERP Waveforms Healthy Adults (N = 16) Auditory ERPs were normalized within this modality by vector scaling across time, electrodes, condition and lag following the procedure suggested by McCarthy and Wood (1985). Kayser et al., in press, Cogn. Brain Res.

9. Study 1: ERP Difference Waveforms Healthy Adults (N = 16) ERPs were normalized within each modality by vector scaling across time, electrodes, condition and lag following the procedure suggested by McCarthy and Wood (1985). Kayser et al., in press, Cogn. Brain Res.

10. Study 1: Normalized Surface Potential Topographies Time interval: 0 – 1,600 ms Healthy Adults (N = 16) Emotional Content Negative Neutral Negative - Neutral Controls (n=16) Patients (n=30) Kayser et al., in press, Cogn. Brain Res.

11. Explained Variance F1350 19.3% F750 19.3% F520 17.6% F1000 13.9% F370 7.5% F220 6.3% F130 2.6% 86.5% Topographies of PCA Factor Scores F130 F220 F370 F1350 F520 F750 F1000 Visual -1.4 0.0 +1.4 Auditory Study 1: PCA for ERP Component Measurement • covariance matrix • unrestricted factor extraction • unscaled Varimax rotation Kayser et al., in press, Cogn. Brain Res.

12. New New New Old Old Old Old - New Old - New Old - New -0.7 -1.1 -0.8 -1.1 -0.8 -0.7 -1.1 -1.1 -0.8 -1.7 -1.7 -0.8 Visual Visual Visual 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 +0.8 +0.8 +1.7 +0.7 +1.1 +1.7 +1.1 +1.1 +0.8 +1.1 +0.8 +0.7 F370 Auditory Auditory Auditory F520 F750 Study 1: Topographies of PCA Factor Scores

13. Beck Depression Inventory (BDI) Gender (male/female) Age (years) Education (years) Handedness (EHI) 1.5 ± 3.2 82.1 ± 18.8 12 / 14 28.7 ± 6.0 (21 – 42 yrs) 17.0 ± 2.7 15.4 ± 2.1 26.1 ± 11.1 15 / 9 83.0 ± 17.7 35.2 ± 9.6 (20 – 58 yrs) p = .01 p < .0001 p = .06 Study 2: Demographic Data Healthy Adults (n = 26) Depressed Patients (n = 24) • no history of any psychopathology or neurology disorder • unmedicated, unipolar depressed outpatients (DSM-IV) • - major depressive disorder (MDD) n = 16 • - dysthymic disorder (DYST) n = 3 • - both MDD + DYST n = 5

14. Healthy Adults (n = 26) Condition p < .0001 Modality x Condition p = .006 Study 2: Behavioral Data Depressed Patients (n = 24) Modality p < .0001 Modality x Condition p < .0001

15. Healthy Adults (n = 26) Depressed Patients (n = 24) Pz P9 Study 2: ERP Waveforms at Selected Sites ERPs were normalized within each modality by vector scaling across time, electrodes, condition and lag following the procedure suggested by McCarthy and Wood (1985).

16. Explained Variance F500 20.2% F790 19.2% F1450 17.8% F1075 16.6% F250 7.6% F125 2.1% F360 1.9% 85.4% Topographies of PCA Factor Scores F125 F250 F360 F1450 F500 F790 F1075 Visual -1.3 0.0 +1.3 Auditory Study 2: PCA for ERP Component Measurement • covariance matrix • unrestricted factor extraction • unscaled Varimax rotation

17. Healthy Adults (n = 26) Depressed Patients (n = 24) New Old Old - New New Old Old - New -1.7 -1.2 -1.0 -1.7 -1.0 -0.8 -0.8 -1.2 -1.0 -0.8 -0.8 -1.0 -1.0 -1.0 -1.0 -1.7 -0.8 -1.7 -1.0 -1.2 -1.2 -0.8 -0.8 -0.8 Visual 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 F360 +1.7 +0.8 +0.8 +1.7 +1.0 +1.0 +1.0 +1.2 +0.8 +1.0 +1.7 +1.0 +1.7 +1.2 +1.2 +0.8 +1.2 +0.8 +0.8 +1.0 +1.0 +0.8 +1.0 +0.8 Auditory New Old Old - New New Old Old - New Visual F500 Auditory New Old Old - New New Old Old - New Visual F790 Auditory Study 2: Topographies of PCA Factor Scores

18. Healthy Adults (n = 26) Nose Study 2: Re-referenced ERP Waveforms Linked Mastoids (TP9/10) Nose Linked Mastoids (TP9/10) ERPs were normalized within each modality by vector scaling across time, electrodes, condition and lag following the procedure suggested by McCarthy and Wood (1985).

19. In healthy adults, visual/auditory word recognition memory tasks repeatedly showed: • distinct ERP components • discrete topographies reflecting anatomy of visual/auditory pathways • The expected old/new effect was observed in both modalities: • comparable time course (maximal between 500-600 ms) • a more anterior scalp topography for visual items common cognitive process (i.e., memory retrieval) associated with separable neural generators in each modality • However, the old/new effect overlapped ERP components (N2, P3) having distinct • scalp topographies • peak latencies for each modality, suggesting a functionally separable process • The posterior old/new effect was markedly reduced in depressed patients for both modalities, but particularly for auditory presentations, despite • identical ERP component structure • comparable behavioral performance to healthy adults Modality-specific ERP components and condition-effects are severely affected by a recording reference placed over regions where these components are prominent • systematic changes of references • reference-free CSD measures to dissociate neural generators and their genuine contributions to ERP old/new effects Conclusions

20. http://psychophysiology.cpmc.columbia.edu New York State Psychiatric Institute Depression Evaluation Service Department of Biopsychology Jürgen Kayser Craig Tenke Regan Fong Gerard Bruder JonathanStewart Frederic Quitkin