Bifurcation

1. “Ergodic” (Invariant) Measures Applied to n-Dimensional, Lag Embeddings of Expanding and Mixing, Biological Dynamical Systems Arnold J. Mandell M.D. Multi Modal Imaging Laboratory, MMILDepartment of Psychiatry, UCSD and Fetzer-Franklin Fund Ornstein theorem: Most/All suitably normalized measures made on chaotic dynamical systems are equivalent to their informational entropy, h (which has no single or definitive algorithmic computation). Frobenius-Perron theorem: Square matrices with non-negative entries have at at least one positive eigenvalue, λ ≥ 0 and log λ ≈ h. Pesin-Young-Mandell (conservation of) : For uniformly & non-uniformly hyperbolic systems, the topological entropy, hT , varies asthe product of the capacity dimension, Dc & the leading Lyapounov exponent, Λ1 . hT = Dc Λ1.

2. Fractal Bifurcation Nonlinear Dynamics Entropy Leading Lyapounov Chaos Google Book Title Word Count From 1750 to 2005. Note decline of relevant words beginning in the vicinity of 2000. Adoption of new science characteristically comes late to biology

3. Dynamical systems as qualitative nonlinear orbital behavior (in for example, phase portraits) “The qualitative theory of differential equations” see classic book by VI Arnold,(1983) global behavior Statistical mechanics’ central point is the dependence on microscopic variables. Distributions/moments versus . “Invariant Measure” “Ergodic theory of dynamical systems” Topological. metric and nonuniform entropy, the dimensions, the expansion exponents, graph theoretic exponents….see Ergodic Theory by Cornfield, Fommin &Sinai (1982)

4. Phase Portraits Quasi-periodic and chaotic van der pol. Stretch, fold, shuffle. Points get out of order; “mixing”Lyapounov > 0 Generic membrane equations Chaotic? Irrational winding on the torus Lyapounov ≤ 0 Multiply periodic? Mandell and Selz, 1990

5. In place of n-tori of stable periodic orbits, we may have:Homoclinic Orbits Which Join Unstable Fixed Points to Themselves Recurrence via unstable periodic orbits of increasing lengths and self-similar structure. “sizes” are hierarchical and scale with a power law. “A small disc centered near a homoclinic point includes infinitely many periodic points of different periods” Poincare; Smale; Yorke; etc. X Intersection of stable and unstable manifolds of unstable fixed point WU Ws A two dimensional section showing the unstable and stable manifolds of an orbital flow meeting at a “homoclinic” point.

6. UNSTABLE PERIODIC ORBITS, UPOs, (HOMOCLINIC TOUNSTABLE FIXED POINTS) OF HIPPOCAMPAL NEURON INTERSPIKE INTERVALS (period one) So et al, 1998 (Steve Schiff’s group) Stable and unstable manifolds support chaotic dynamical systems Aattractors. Hippocampal neuron spikes Interspike intervals Return embedding of ISI; colored points UPOs Phase portraits Of ISI; stable and unstable manifolds of unstable fixed points defining unstable periodic orbits Find periodic orbit (period one)

7. An example of phase space reconstruction and measures made on phase portrait of a physiological time series. Phase Portrait of Temperature Time SeriesBefore a Catch X (t – 1) X(t) Effect of “catch and return” on fresh water pike fish temperature dynamics

8. Phase Portrait of Temperature Time SeriesAfter a Catch X (t-1) X(t)

9. Spontaneous, bursting, intermittent patterns of brain stem neuronal discharge drive subcortical and neocortical membrane fluctuations: both at several time scales with power spectral power law scaling. Thanks to Carlson, Foote, Guillemin,

10. “…equating entropy increase as the spontaneous dispersal of energy, namely how much energy is spread out in a process, or how widely dispersed it becomes...” Leff, 1996,2007 AG YM Phase portraits of IMF3,4,5 of C16-ssds(i) in AG, control, YM, intermediate state, and SP, typical medicated schizophrenic proband. SP

11. Modal Descriptions • Frequency (power) Spectrum in Log-Log plot slope → α • Broomhead-King autocovariance eigenfunctions, Ψ • Morlet mother wavelet, wavelet transformation of Ψ, W(Ψ) • Emperical Mode Decomposition →Intrinsic Mode Functions, EMD →IMF

12. The continuous power spectrum with complex singularities of a chaotic attractor (from “hydrodynamic” equation)Farmer, Crutchfield, Froehling, Packard and Shaw, 1978-89“The original UCSC chaos kids” The “funnel” Positive Lyapounov exponent Continuous power spectrum Complex singularities Unstable periodic orbits Recursive homoclinic behavior near unstable fixed points Chaotic dynamical systems manifest a variety of power spectral exponents. Universality classes??

13. “Universal” scaling laws show up in a wide range of contexts: log(amplitude2) (i.e., power) Log(frequency)--> A common manifestation of hierarchical, multiscale, self-similar, fractal statistical dynamics is “1/f αnoise.” The system manifests correlations at many scales. This “signature” is common to many systems with strong (cooperative) interactions and many degrees of freedom (e.g. the brain’s electromagnetic systems). It may also accompany distribution functions with infinite second moments as in a Levy Process

14. Log-log Power Spectra of Three Minutes (108,000 points) of MEG Central C16 ssds(i) in Ten Normal Controls The Spectral Power law, α,approximates the Kolmogorov scaling of 5/3 (1)Use standard Fourier transform of time series; (2) log transform the frequency and power axes. (3) Compute the slope of the middle third of log-log plot; (4) –slope = α f--α , Mean α = -1.67± 0.43; Median = -1.59; Var = 0.18; fs = 600/150 ComputHz

15. To Study the Inverse of the Time-Dependent Wavelengths, Broomhead-king Decomposition Uses the Leading Eigenvectors of a Lagged Autocovariance Matrix, Composed with the Original Series to Generate Two or Three Leading B/K Eigenfunctions

16. To Observe the Dynamics in Time of Scaling System(s) We Apply the Wavelet Transformation in which a “Mother” Wavelet is Convolved with the Data as it is Translated Down the Series, “b”, at Various Dilations, “a”. Morlet mother wavelet, w, = w = sine wave x Gaussian

17. Intermittent, hierarchical scaling vortices, we call strudels, the German word for “whirlpools” or “eddies,” in the 3-5 to 20+ second time scales. Here, two strudels:

18. Intermittent Vortices in the 3-5 to 20+ second BK eigenfunction time scales. Four intermittent, hierarchical, scaling strudels, i(S), i = 4, are seen, defined by their near continuity beginning below the middle scales and, over shorter or longer times, reaching or exceeding the upper scaling bound of the wavelet graph. Both the incidence and durations are within the range reported for TUTIs (task unrelated thoughts and images): 5 to 20+ seconds. Note how much detail and texture of the time series would be lost reporting only their means, variance and higher moments

19. Local field potentials from neocortical pyramidal cell network in taskless, resting monkey statistically resemble MEG ssds (Shew and Plenz, 2009) EEG, multi- electrode Local field potentials from Pyramidal cell layers II and III (self-referential network) MEG, symmetric sensor difference series, ssds

20. Morlet wavelet decomposition of 14 second,C16 sensor difference sequence During brief “petite absence” seizure demonstrate spike, dome and Vertically coherent strudels. Fast spiking drives an expanding flow. ~ 14 seconds ~0.8 Hz ~2.0 Hz ~3-4Hz >100 Hz

22. Intermittent 3 to 8 Second Strudel “Absences” Persist Over the 2.3 min of Eyes-Closed Resting Record in Proband, YM Λ = 0.451; DC =1.61; hT =0.348 memv = 0.2526 (0.572) α = 2.79; X4=0.441;

23. To empirically “unpeel” the hierarchical scales revealed in the log-log power spectra use Huang’s Empirical Mode Decomposition yielding an array of Intrinsic Mode Functions. • Identify successive pairs of zero crossings, identify local extrema • Connect max, min with cubic splines (upper and lower “envelopes”) • Compute first mean, m1, of the envelopes • [ssds]-m1 = h1; h2 = h1 – m2…. ….+ …residue(“sifting”) • Inter-maxima distance is the local time scale • Allows real time snap shots of nonstationary, “instantaneous” fluctuations growing in scale (wavelength) from left to right. • hi I = 0..n

24. AG hn YM SP Hilbert-Huang Intrinsic Mode Functions, IMF1,2,3,4,5 MEG, C16(ssds),16.66 sec Note Loss of modular amplitudes in proband SP’s intermediate time scales

25. Invariant Measure Theory Using “Blind Boys and the Elephant” Metrics

26. Battery of measures being applied to resting, eyes closed, asymmetric MEG sensor difference sequences: ssds: symmetric sensor difference sequences Note that axiosymmetric B fields would cancel Phase space geometry Probability distribution Symbolic dynamics; Information Modal analysis

27. Algorithmic Themes in Quantifying Global Fine Structure in Expanding & Mixing Dynamical Systems Partition (“generating”?) , transition matrix, with or without symbol substitution, and symbolic dynamics The quantities sought are fractional exponents (logarithms) These quantities may indicate hierarchical scaling relations, “self similarity” capacity, correlation, Hausdorffdimensions.Dc Logarithmic relation between the measure (abscissa) and the measurement (ordinate), capacity, correlation, Hausdorff dimensions Dc. From the growth rate of the trace of the exponentiated transition incidence matrix, Rate of appearance of new recursive orbits, topological entropy, hT From the transition matrix, distribution of weights in normalized, exponentiated Markoff matrix,metricentropyhM Using the phase space reconstruction, determination of the separation rate of recursively renewed “nearby initial conditions.”. Leading (positive) Lyapounov exponent, λ or Λ

28. Measures: Λ, Dc, hT “box” capacity dimension Complexity of manifold Slope Log measurement Sensitivity to initial conditions, Lyapounov Exponent (rate of Expansion) Log measure (scales) Partition→transition incidence matrix→growth rate of trace while exponentiating matrix Growth rate of new recursive orbits…..topological entropy

29. Multi-parameter quantitative-qualitative descriptions of dynamical systems. Leading Lyapounov exponent; divergence, expansion, mixing Power spectral scaling exponent:log-log slope, global, scaling Topological entropy; rate of new “loop” formation Metric entropy: distribution of weights on loops Capacity dimension: complexity of manifold of support Non-uniformity ||top-met| difference Measureable entropy manifold volume top x Lya xdimension Unwinding number lags to asymptotic capacity dimension Skew distributional asymmetry Kurtosis peakedness and heavy tail Levy exponent rate of converrgence of tail of distribution Hurst exponent persistence vsantipersistent

30. Measurable entropy manifold volume, MEMV =[hT l DC ] Thereom: hT = lDCPesin, Young, Manning, topological entropy = product of the leading lyapounov exponent and the capacity dimension; Premise: conservation of brain entropy Λ = log (rad B/rad Bi ) hT = log(#Bi) d = lim (me)/log(e) Intuition about the relations between entropy, Lyapounov and dimension Λ increases dC increases hT increases Fixing entropy, hT, log (3) dimension, d, goes down as the Lyapounov increases Fixing Λ, hT and dC go up.

31. REDUCED VOLUME OF FRONTAL LOBE (F14 SSDS) MEASUREABLE ENTROPY MANIFOLD VOLUME, MEMV, IN PROBANDSImplicit function representation of the Pesin-Young Ansatz: ld=hT(means of 10 SSDS, each of which were computed on 32,000 points) l Lyapounov exponent Topological Entropy hT d capacity dimension Ten medicated schizophrenic patients Ten control subjects memv = 3.13 log units memv = 2.37 log units

32. Third new findings: aggregate measure relations and memv decreased in “abnormal” brain plasmas.

33. Phase Portraits and Recurrence Plots of the Three Leading Autocovariance Matrix Eigenfunctions

34. New: MEG-ssds Measure Suite Data: symmetric sensor difference series, ssds, Four minutes 600/150 Hz Recurrence plot B/K phase Space

36. Topological entropy, hT , capacity dimension, DC , and leading Lypounov exponent, Λ, and their Cartesian product, measurable entropy manifold volume, memv = Π[Λ DC hT ] on ssds(i) discriminate controls from probands. x ≡ L, y ≡ DC, Z ≡ hT

37. Aggregate of relative changes in measures From Intermittency to Transitivity in Neuropsychobiological FlowsAJ M, Am. J. Physiol. 245: R484-R494, 1983 • Intermittency Transitivity • ∂(Λ) > 0 • ∂(α) < 0 • ∂(hT) > 0 • ∂(hM) > 0 • ∂|hT – hM| < 0 • ∂(DC) > 0 • ∂(σ3) < 0 • ∂(σ4) < 0 • ∂( memv ) > 0

38. A few (personal) references Mandell, AJ (1987) Dynamical complexity and pathological order in the cardiac monitring problem. Physica D 27:235-242. Mandell, AJ & Selz, KA(1993) Brain stem neuronal noise and neocortical resonance. J. Stat. Phys. 70:355-373. Mandell, AJ & Selz, KA(1997) Entropy conservation as hT = Λ*Dc. (1997) Chaos 7:67-81. Mandell, AJ & Shlesinger, MF(1990) Lost choices, parallelism and topological entropy decrements in neurobiological aging. AAAS Washington. Selz, KA & Mandell, AJ. (1991) Bernoulli partition equivalence of intermittent neuronal discharge patterns. Int. J. Bifurcation Chaos 1:717-722. Mandell, AJ (2013) Intermittent turbulent eddies in brain magnetic fields. Chaos, Solitons & Fractals 55:95-101. Robinson, S, Mandell, AJ & Coppola, R (2013) Spatiotemporal imaging of complexity.Frontiers in Comp. Neurosci. 6:1-14 (#101).

39. New: MEG-ssds Measure Suite Data: symmetric sensor difference series, ssds, Four minutes 600/150 Hz Recurrence plot B/K phase Space

40. Intermittent 3 to 8 Second Strudel “Absences” Persist Over the 2.3 min of Eyes-Closed Resting Record in Proband, YM Λ = 0.451; DC =1.61; hT =0.348 memv = 0.2526 (0.572) α = 2.79; X4=0.441;

41. Daydreaming, Thought Blocking and Strudels in the Task-free, Resting Consciousness of the Brain Plasma’s Magnetic Fields* Arnold J. Mandella,b,d, Karen A. Selzb, John Avena,c, Tom Holroyda and Richard Coppolaa a. NIMH Core MEG Facility, Building 10, NIMH, Bethesda, MD b. Cielo Institute, 486 Sunset Dr., Asheville, NC 28804-3727 c. Fetzer-Franklin Fellow in Consciousness Studies at NIMH; d. Corresponding Author www.cieloinstitute.org * Supported by the Fetzer-Franklin Trust, DARPA ( Microelectronics), and the Space and Naval Warfare Systems Center. “A plasma is lawfully and intrinsically multidisciplinary”

42. Consciousness :One of the Properties of the Body Temperature Brain Plasma (1) “Particle” lengths overlap; each particle effects many. Motion is intrinsically cooperative; (2) Important interactions in the bulk, not like dipole magnets (Stokes Theorem) at the surface. (3) Elemental oscillations mucn faster than collisions:→ EM instantaneous forces dominate gas and chemical kinetics. (4) Responds strongly to electromagnetic fields which can generate transient structures in the plasma. (5)Need not have specific shape or size (6) Overlapping fields: chemical, electromagnetic, psychological (6) Composed of ionized and neutral particles “balanced” (8) Small space charge (7) High density of charge carriers (ions, electrons, neutrals, hydrophobic charges). (8) Spontaneous currents and return currents., moving charges. (9) Persistent magnetic fields The plasma of consciousness includes observable and subjective elements slower and cooler

43. We study the mean field approximation of the global magnetic field component of the conscious brain plasma. Traveling charges in apical dendrites of the neocortical pyramidal cell networks (MU) are associated with extracellular return currents with varying impedance, capacitance, inductances which constitute electromagnetic “ephaptic” fields (LFP). These, in turn, “feed back” to modulate the thresholds and dynamics of the networks (Frolich, 2009). apical dedrites Cahal 103 Electrical currents flowing within the apical dendrites of pyramidal cells generate the surrounding magnetic field Temporally covariant large volume recorded from single central pair of sensors. Ctx layers II and III

44. Some psychoanalytic characteristics of the conscious brain plasma: • All properties of the conscious brain plasma are deterministic; not random. • The plasma of consciousness is ceaselessly driven by energizing “drives”. • Psychic energy (entropy) is conserved. • The plasma of consciousness has levels of topographic scaling: unconscious, preconscious and conscious, Ucs, Pcs, Cs. • The plasma of consciousness has finite set of thematic dynamical quasi-specialized components: id, ego, superego (flavored energetics). These components are not necessarily aware of each other. • Inhibitory “defenses” modulate access between levels of plasma consciousness by primarily repression, more primitively denial, dissociation, conversion, and undoing, and if persistent and stereotyped, character formation, for example obsessive compulsive (doing and undoing), and hysterical personality (dissociation and display). • Normal failures of defenses create leaks between levels of the plasma of consciousness into the preconscious and conscious: dreaming, parapraxes, “”I was thinking about one thing and I said my mother” “free associations”, and day dreaming.

45. Psychological transients, eddies in the flow of consciousness in the brain’s plasma Task Unrelated Thoughts and Images, TUTIs. “…thoughts, images (and sounds) that intrude into a person’s Cs unintentionally (involuntarily)…and are unrelated to their activity, Giambra, 1995 • Using probe windows of five to twenty-five seconds (“beep”) TUTI buttons are pushed after daydreams one or more times in 60-70% of the windows during repetitious tasks and/or taskless resting conditions • TUTIs are increased with psychologically perturbing preconditions . • Interrupting TUTIs makes the next one occur more quickly (“pressure”) • TUTI deficiency has been reported with aging, Alzheimer's, mTBI, interictal epilepsies and schizophrenia. • Brain damage to some areas of the default network leads to “mental emptiness” , TUTI deficiency and reduction in spontaneous speech and thoughts. • Anterior cingulotomy (for OCD)---prominent in Columbia-Greystone Project (1948-1956) leads to very vivid daydreams that are often confused with reality. • Increased demand via speed of signal processing or task difficulty decreases the frequency and extent of TUTIs Klinger, Antrobus, Singer, Giambra, Binder, Smallwood and others (1960-2000).

46. The products of ceaseless Ucs activity intrude into Pcs and Cs as Task Unrelated Thoughts and Images, TUTIs, when internal entropies increase (alertness, arousal, fearfulness) or when ongoing attention demanding tasks are minimized Implicit model of Antrobus, Singer, Giambra, Binder and others, 1960 to 1999 Psychic entropies not conserved. Changes in total brain entropies “psychic energies” Conservation of psychic entropies Reciprocal partitions of available entropies (“psychic energies” ) Involuntary thoughts and images, daydreaming: ↑ frequency/duration of TUTIs when quiet governed by the Pleasure/Displeasure Principle. Purposeful thoughts, plans and actions governed by The Reality Principle, Freud, 1911

47. Marcus Raichle’s 2001 default activation anatomy of a component of the conscious plasma of the brainfMRI regions light up when task-free and resting, Pleasure/Displeasure Principle;but are dark when purposefully thinking or doing, the Reality Principle. Averages of nine subjects: medial prefrontal, medial parietal, anterior and posterior cingulate, habenula, etc.; generally the medial brain.

48. To study the magnetic fields components of the plasma of consciousness Cooper electron pairs tunnel across JJs at critical current; this process is perturbed by a change in magnetic flux density. 0.00005 Tesla =

49. The CTF gradiometer records the magnetic fields of the concious brain plasma 103 The ssds primary data range in amplitude from 50-4000 fT

50. SYMMETRIC SENSOR DIFFERENCE SEQUENCES, ssds L-R: C16, F14, T44, P57 Mean Field Approximation of the Brain Plasma’s Magnetic Field/t C16 16.6 seconds of ssds 275-channel, superconducting quantum interference device (SQUID),radial gradiometer system from VSM MedTech Ltd., Why ssds • Minimizes physical artifacts such as coughing/ blinking; • Reduce-covariances-includingd,t,a,b,g modes; examining “similarity regime”(Novikov, 1991) • Global, scalar fields makes location less relevant. • Imposes a local gauge, [(0-ssds max) fT/Hz]. • Relative motion regularizes locally (in time) the • globally nonstationary MEG signals • Difference metric (like velocity increment) is a common variable in turbulence dynamics and statistics. • Evokes intuitions and techniques of magnetic hydrodynamic, MHD, plasmas and fields • ssds minimizes central values and emphasizes outliers. 350 seconds of fMRI fluctuations Reichle, 2009