Convergent cross mapping

Statistical test for causality

Convergent cross mapping (CCM) is a statistical test for a cause-and-effect relationship between two variables that, like the Granger causality test, seeks to resolve the problem that correlation does not imply causation.[1] While Granger causality is best suited for purely stochastic systems where the influences of the causal variables are separable (independent of each other), CCM is based on the theory of dynamical systems and can be applied to systems where causal variables have synergistic effects. As such, CCM is specifically aimed to identify linkage between variables that can appear uncorrelated with each other.

Theory

In the event one has access to system variables as time series observations, Takens' embedding theorem can be applied. Takens' theorem generically proves that the state space of a dynamical system can be reconstructed from a single observed time series of the system, X {\displaystyle X} . This reconstructed or shadow manifold M X {\displaystyle M_{X}} is diffeomorphic to the true manifold, M {\displaystyle M} , preserving instrinsic state space properties of M {\displaystyle M} in M X {\displaystyle M_{X}} .

Convergent Cross Mapping (CCM) leverages a corollary to the Generalized Takens Theorem[2] that it should be possible to cross predict or cross map between variables observed from the same system. Suppose that in some dynamical system involving variables X {\displaystyle X} and Y {\displaystyle Y} , X {\displaystyle X} causes Y {\displaystyle Y} . Since X {\displaystyle X} and Y {\displaystyle Y} belong to the same dynamical system, their reconstructions via embeddings M X {\displaystyle M_{X}} and M Y {\displaystyle M_{Y}} , also map to the same system.

The causal variable X {\displaystyle X} leaves a signature on the affected variable Y {\displaystyle Y} , and consequently, the reconstructed states based on Y {\displaystyle Y} can be used to cross predict values of X {\displaystyle X} . CCM leverages this property to infer causality by predicting X {\displaystyle X} using the M Y {\displaystyle M_{Y}} library of points (or vice-versa for the other direction of causality), while assessing improvements in cross map predictability as larger and larger random samplings of M Y {\displaystyle M_{Y}} are used. If the prediction skill of X {\displaystyle X} increases and saturates as the entire M Y {\displaystyle M_{Y}} is used, this provides evidence that X {\displaystyle X} is causally influencing Y {\displaystyle Y} .

Cross mapping is generally asymmetric. If X {\displaystyle X} forces Y {\displaystyle Y} unidirectionally, variable Y {\displaystyle Y} will contain information about X {\displaystyle X} , but not vice versa. Consequently, the state of X {\displaystyle X} can be predicted from M Y {\displaystyle M_{Y}} , but Y {\displaystyle Y} will not be predictable from M X {\displaystyle M_{X}} .

Algorithm

The basic steps of convergent cross mapping for a variable X {\displaystyle X} of length N {\displaystyle N} against variable Y {\displaystyle Y} are:

  1. If needed, create the state space manifold M Y {\displaystyle M_{Y}} from Y {\displaystyle Y}
  2. Define a sequence of library subset sizes L {\displaystyle L} ranging from a small fraction of N {\displaystyle N} to close to N {\displaystyle N} .
  3. Define a number of ensembles N E {\displaystyle N_{E}} to evaluate at each library size.
  4. At each library subset size L i {\displaystyle L_{i}} :
    1. For N E {\displaystyle N_{E}} ensembles:
      1. Randomly select L i {\displaystyle L_{i}} state space vectors from M Y {\displaystyle M_{Y}}
      2. Estimate X ^ {\displaystyle {\hat {X}}} from the random subset of M Y {\displaystyle M_{Y}} using the Simplex state space prediction
      3. Compute the correlation ρ {\displaystyle \rho } between X ^ {\displaystyle {\hat {X}}} and X {\displaystyle X}
    2. Compute the mean correlation ρ ¯ {\displaystyle {\bar {\rho }}} over the N E {\displaystyle N_{E}} ensembles at L i {\displaystyle L_{i}}
  5. The spectrum of ρ ¯ {\displaystyle {\bar {\rho }}} versus L {\displaystyle L} must exhibit convergence.
  6. Assess significance. One technique is to compare ρ ¯ {\displaystyle {\bar {\rho }}} to ρ S ¯ {\displaystyle {\bar {\rho _{S}}}} computed from S {\displaystyle S} random realizations (surrogates) of X {\displaystyle X} .

Applications

CCM is used to detect if two variables belong to the same dynamical system, for example, can past ocean surface temperatures be estimated from the population data over time of sardines or if there is a causal relationship between cosmic rays and global temperatures. As for the latter it was hypothesised that cosmic rays may impact cloud formation, therefore cloudiness, therefore global temperatures. [3]

Extensions

Extensions to CCM include:

  • Extended Convergent Cross Mapping[4]
  • Convergent Cross Sorting[5]

See also

  • Empirical dynamic modeling
  • System dynamics
  • Complex dynamics

References

  1. ^ Sugihara, George; May, Robert; Ye, Hao; Hsieh, Chih-hao; Deyle, Ethan; Fogarty, Michael; Munch, Stephan (2012). "Detecting Causality in Complex Ecosystems". Science. 338 (6106): 496–500. Bibcode:2012Sci...338..496S. doi:10.1126/science.1227079. PMID 22997134. S2CID 19749064.
  2. ^ Deyle, Ethan R.; Sugihara, George (2011). "Generalized Theorems for Nonlinear State Space Reconstruction". PLOS ONE. 6 (3): e18295. Bibcode:2011PLoSO...618295D. doi:10.1371/journal.pone.0018295. PMC 3069082. PMID 21483839.
  3. ^ Tsonis, Anastasios A.; Deyle, Ethan R.; Ye, Hao; Sugihara, George (2018), Tsonis, Anastasios A. (ed.), "Convergent Cross Mapping: Theory and an Example", Advances in Nonlinear Geosciences, Cham: Springer International Publishing, pp. 587–600, doi:10.1007/978-3-319-58895-7_27, ISBN 978-3-319-58895-7, retrieved 2023-10-19
  4. ^ Ye, Hao; Deyle, Ethan R.; Gilarranz, Luis J.; Sugihara, George (2015). "Distinguishing time-delayed causal interactions using convergent cross mapping". Scientific Reports. 5: 14750. Bibcode:2015NatSR...514750Y. doi:10.1038/srep14750. PMC 4592974. PMID 26435402.
  5. ^ Breston, Leo; Leonardis, Eric J.; Quinn, Laleh K.; Tolston, Michael; Wiles, Janet; Chiba, Andrea A. (2021). "Convergent cross sorting for estimating dynamic coupling". Scientific Reports. 11 (1): 20374. Bibcode:2021NatSR..1120374B. doi:10.1038/s41598-021-98864-2. PMC 8514556. PMID 34645847. S2CID 238859361.

Further reading

  • Chang, CW., Ushio, M. & Hsieh, Ch. (2017). "Empirical dynamic modeling for beginners". Ecol Res. 32 (6): 785–796. doi:10.1007/s11284-017-1469-9. hdl:2433/235326.{{cite journal}}: CS1 maint: multiple names: authors list (link)
  • Stephan B Munch, Antoine Brias, George Sugihara, Tanya L Rogers (2020). "Frequently asked questions about nonlinear dynamics and empirical dynamic modelling". ICES Journal of Marine Science. 77 (4): 1463–1479. doi:10.1093/icesjms/fsz209.{{cite journal}}: CS1 maint: multiple names: authors list (link)

External links

Animations:

  • State Space Reconstruction: Time Series and Dynamic Systems on YouTube
  • State Space Reconstruction: Takens' Theorem and Shadow Manifolds on YouTube
  • State Space Reconstruction: Convergent Cross Mapping on YouTube