Workshop on Directed Functional Connectivity Analysis Using Wiener-Granger Causality

1. Workshop on Directed Functional Connectivity Analysis Using Wiener-Granger Causality Dr. Steven Bressler Cognitive Neurodynamics Laboratory Center for Complex Systems & Brain Sciences Department of Psychology Florida Atlantic University http://www.ccs.fau.edu/~bressler/

2. The Problem To understand the neural basis of cognition

3. To understand the neural basis of cognition requires understanding the influences exerted by neuronal groups in the cortex on one another. • Stimulation • Ablation • Statistical time series analysis

4. Directed Functional Connectivity • Directed Functional Connectivity (DFC) refers to a class of metrics used to infer causal influence(effective connectivity) between neuronal groups. • DFC estimates directionally oriented functional relations between neuronal groups.

5. The Concept of Causality David Hume Bertrand Russell • “an object, followed by another, and where all objects similar to the first are followed by objects similar to the second” • “…to exhibit certain confusions, especially in regard to teleology and determinism, which appear to me to be connected with erroneous notions as to causality"

6. Interpreting Causality Deterministic Causality Probabilistic Causality • A change in the activity of one group (A) necessarily produces a change in that of another group (B). • A change in the activity of A contributes an influence that changes the likelihood of a change occurring in the activity of B. P(B|A) > P(B|~A) P(B|A) = 1

7. Causality in the Cortex[Mannino & Bressler, in prep] • The complex large-scale anatomical connectivity of the cerebral cortex is characterized by bi-directionality and heavy convergence. • The influence from one cortical neuronal group (A) does not necessarily produce a measurable effect in another group (B), and cortical causality is non-deterministic. • Group A may change the likelihood of a change in B, so causal influences in the cortex are probabilistic.

8. DFC & Causality • Metrics for DFC should reflect probabilistic causality rather than deterministic causality between neuronal groups. • Time series DFC metrics should quantify the degree of predictability of the time series of one group from that of another. • Granger causality is a probabilistic concept of causality that is based on predictability. • For two simultaneous time series, one series is called ‘Granger causal’ to the other if we can better predict the second series by incorporating knowledge of the first one.

9. Statistical Causality Clive Granger Norbert Wiener

10. Wiener Causality Wiener considered 2 functions, f1(α) and f2(α). He proposed a “nonnegative quantity not exceeding 1 which measures the additional effectiveness of the past values of f2(α) in helping to determine the present value of f1(α), and may be considered as a measure C of the causality effect of f2(α) on f1(α).” Norbert Wiener The Theory of Prediction, 1956

11. Granger Causality “In the early 1960's I was considering a pair of related stochastic processes which were clearly inter-related and I wanted to know if this relationship could be broken down into a pair of one way relationships. It was suggested to me to look at a definition of causality proposed by a very famous mathematician, Norbert Weiner, so I adapted this definition (Wiener 1956) into a practical form and discussed it.” Clive Granger’s personal account in: Seth A. (2007) Granger causality, Scholarpedia 2(7):1667.

12. Granger Causality • “Applied economists found the definition understandable and useable and applications of it started to appear.” • “However, several writers stated that ‘of course, this is not real causality, it is only Granger causality.’ Thus, from the beginning, applications used this term to distinguish it from other possible definitions.” Clive Granger’s personal account in: Seth A. (2007) Granger causality, Scholarpedia 2(7):1667.

13. UNIVARIATE AUTOREGRESSIVE MODEL xt= [a1xt-1 + a2xt-2 + a3xt-3 + … + amxt-m] + εt where xt is a zero-mean stationary stochastic process, ai are model coefficients, m is the model order, and εt is the residual error.

14. DEFINITION OF GRANGER CAUSALITY[BRESSLER & SETH, NEUROIMAGE, 2011] • Granger (1969):Let x1, x2, …, xt and y1, y2, …, yt represent two time series. • Compare two autoregressive models: xt = a1xt-1 + … + amxt-m + 1t and xt = b1xt-1 + … + bmxt-m + c1yt-1 + … + cmyt-m + 2t • Let 1= var(1t) and 2= var(2t). • If 2 < 1, thenthe y time series has a Granger casual influence on the x time series. restricted unrestricted

15. TIME DOMAIN GRANGER CAUSALITY MEASURE The time domain Granger causality from y to x is:

16. TOTAL INTERDEPENDENCE[DING ET AL, HANDBOOK OF TIME SERIES ANALYSIS, 2006] • The total interdependence between time series xt and yt can be decomposed into three components: where the 3rd component, called the instantaneous causality, may be due to factors exogenous to the (x, y) system, such as a common driving input.

17. 4 POSSIBLE RELATIONS BETWEEN 2 TIME SERIES • Unidirectional GC only from x to y • Unidirectional GC only from y to x • Bidirectional GC between x and y • Independence of x and y

18. BIVARIATE VOXELWISE GC FROM FMRI [BRESSLER ET AL, J NEUROSCI, 2008] • Granger Causality was computed as an F-statistic for every voxel pair of a pair of Regions of Interest (ROIs). RSS T = # observations = ~700 m = model order = 1 Distributions of F-statistics in top-down and bottom-up directions for ROIs RaIPS & RV3A.

19. The fraction of voxel pairs having significant GC from one ROI to another was greater in top-down than bottom-up direction. 60 ROI pairs from 8 ROIs in each cerebral hemisphere of 6 subjects were analyzed. By subject By ROI pair Voxel-Randomized Control Trial-Randomized Control

20. MULTIVARIATE VOXELWISE GC WITH LASSO[TANG ET AL, PLOS COMP BIOL, 2012] • The MVAR Model: The Least Absolute Shrinkage and Selection Operator (LASSO) makes model estimation feasible when too few observations are available to otherwise estimate the model coefficients. The b-coefficients represent GC:

21. LASSO GC VS. CORRELATION • LASSO GC shows directional asymmetry between ROIs by use of summary statistic W. • Connectivity between FEF and VP is more sparse for LASSO GC (A) than for Correlation (B), indicating greater spatial specificity.

22. CONDITIONAL GC OF DAN & VOC IN VISUAL SPATIAL ATTENTION Positive W Negative W Modified method after Garg et al 2011, FARM using fMRI

23. SPECTRAL GRANGER CAUSALITY[DING ET AL, HANDBOOK OFTIME SERIES ANALYSIS, 2006] • MVAR Model: Xt = A1Xt-1 +  + AmXt-m + Εt • The Spectral Matrix is defined as: • S( f ) = <X (f ) X (f )*> = H(f )  H*(f ) • where * denotes matrix transposition & complex conjugation;  is the covariance matrix of Et ; and • is the transfer function of the • system.

24. SPECTRAL GRANGER CAUSALITY[DING ET AL, HANDBOOK OFTIME SERIES ANALYSIS, 2006] • Geweke (1982) found a spectral representation of the time domain Granger causality: • Geweke showed that: where Sxx(f) is the spectral power of x, Hxx(f) is an element of the transfer matrix H(f)=A-1(f), and * denotes matrix transposition & complex conjugation. X(f)=H(f)E(f); X(f)=A-1(f), where the first component of A is:

25. SPECTRAL GRANGER CAUSALITY OF MACAQUE LFPS • Coefficient matricesare obtained by solving the multivariate Yule-Walker equations (of size mp2), using the Levinson, Wiggens, Robinson algorithm, as implemented by Morf et al. (1978). • Repeated trials are treated as realizations of a stationary stochastic process. • The model order is determined by parametric testing.

26. SPECTRAL GRANGER CAUSALITY OF MACAQUE LFPS • Spectral GC is bi-directional in the frequency domain. • It shows predictability in 2 directions as a function of frequency. Coherence between PAR1 and PAR2 GC from PAR1 to PAR2 (black) GC from PAR2 to PAR1 (orange) Model order = 15

27. SENSORIMOTOR GC IN MOTOR CONTROL[BROVELLI ET AL, PNAS, 2004] • GC pattern consistent with: • Anatomical connectivity • MacKay functional loop • Clinical deafferentation evidence

28. EXTRASTRIATE-V1 GC IN VISUAL EXPECTATION[BRESSLER ET AL, STAT MED, 2007] • GC pattern consistent with: • Descending anatomical connectivity • Visual anticipation

29. BIVARIATE VERTEXWISE SPECTRAL GC FROM MEG[MAHALINGAM ET AL, CNS, 2008]

30. WORKING MEMORY GC IN FRONTOPARIETAL SYSTEM[SALAZAR ET AL, SCIENCE, 2012] GC spectra from PPC to PFC (red) and from PFC to PPC (blue) during late delay period Directional GC difference (solid). Significance level from surrogate difference distribution (dashed) PPCPFC GC > PFCPPC GC

31. CONCLUSIONS • Granger Causality is a useful tool to investigate influences between neural groups. • It can be applied to multivariate time series of different neural signal types. • When applied to fMRI BOLD data, it can be useful to non-invasively study inter-regional interactions in humans under normal physiological conditions. • When applied to LFP data, it can be useful to study inter-regional interactions with high spatial, temporal, and frequency precision.