Loading in 5 sec....

NUMERICAL ANALYSIS OF BIOLOGICAL AND ENVIRONMENTAL DATAPowerPoint Presentation

NUMERICAL ANALYSIS OF BIOLOGICAL AND ENVIRONMENTAL DATA

- 71 Views
- Uploaded on

Download Presentation
## PowerPoint Slideshow about ' NUMERICAL ANALYSIS OF BIOLOGICAL AND ENVIRONMENTAL DATA' - karyn-vaughan

**An Image/Link below is provided (as is) to download presentation**

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

### DIRECT GRADIENT ANALYSIS

Interpretation of ordination axes with external data

Canonical or constrained ordination techniques (= direct gradient analysis)

Canonical correspondence analysis (CCA)

Introduction

Basic terms and ordination plots

Other topics in CCA

Robustness

Scaling and interpretation of CCA plots

Example

Redundancy analysis (RDA) (= constrained PCA)

Scaling and interpretation of RDA plots

Statistical testing of constrained ordination axes

Partial constrained ordinations

Partial ordinations

Partitioning variance

Environmental (predictor) variables and their selection

Canonical correlation analysis

Distance-based redundancy analysis

Canonical analysis of principal co-ordinates

Principal response curves

Polynomial RDA and CCA

CCA/RDA as predictive tools

Non-linear canonical analysis of principal co-ordinates

Canonical Gaussian ordination

Constrained additive ordination

CANODRAW

BASIS OF CLASSICAL ORDINATION INTERPRETATION AND ENVIRONMENT

We tend to assume that biological assemblages are controlled by environment, so:

- Two sites close to each other in an indirect ordination are assumed to have similar composition, and
- if two sites have similar composition, they are assumed to have similar environment.
- In addition:
- 3. Two sites far away from each other in ordination are assumed to have dissimilar composition, and thus
- 4. if two sites have different composition, they are assumed to have different environment.

J. Oksanen (2002)

Values of environmental variables and Ellenberg’s indicator values of species written alongside the ordered data table of the Dune Meadow Data, in which species and sites are arranged in order of their scores on the second DCA axis. A1: thickness of A1 horizon (cm), 9 meaning 9cm or more; moisture: moistness in five classes from 1 = dry to 5 = wet; use: 1 = hayfield, 2 = a mixture of pasture and hayfield, 3 = pasture; manure: amount applied in five classes from 0 = no manure to 5 = heavy use of manure. The meadows are classified by type of management: SF, standard farming; BF, biological farming; HF, hobby farming; NM, nature management; F, R, N refer to Ellenberg’s indicator values for moisture, acidity and nutrients, respectively .

Vegetational data

Environmental

data

axis 2

DCA

axis 1

The amount of manure written on the DCA ordination. The trend in the amount across the diagram is shown by an arrow, obtained by a multiple regression of manure on the site scores of the DCA axes. Also shown are the mean scores for the four types of management, which indicate, for example, that the nature reserves (NM) tend to lie at the top of the diagram.

Ez=b0 + b1x1 + b2x2

Angle ()with axis 1 = arctan(b2 / b1)

Site scores of the second DCA axis plotted against the amount of manure.

Correlation coefficients (100 amount of manure. r) of the environmental variables for the four first DCA axes for the Dune Meadow Data

Variable Axes

1 2 3 4

1 A1 58 24 7 9

2 moisture 76 57 7 -7

3 use 35 -21 -3 -5

4 manure 6 -68 -7 -64

5 SF 22 -29 5 -60

6 BF -28 -24 39 22

7 HF -22 -26 -55 -14

8 NM 21 73 17 56

Eigenvalue 0.54 0.29 0.08 0.05

Multiple regression of the first CA axis on four environmental variables of the dune meadow data, which shows that moisture contributes significantly to the explanation of the first axis, whereas the other variables do not.

Term Parameter Estimate s.e. t

constant c0 –2.32 0.50 –4.62

A1 c1 0.14 0.08 1.71

moisture c2 0.38 0.09 4.08

use c3 0.31 0.22 1.37

manure c4 –0.00 0.12 –0.01

ANOVA table

d.f. s.s. m.s. F

Regression 4 17.0 4.25 10,6

Residual 15 6.2 0.41

Total 19 23.2 1.22

R2 = 0.75 R2adj = 0.66

Ey1 = b0 + b1x1 + b2x2 + ...bnxn

CA axis 1

environmental variables

x = environmental variables

TWO-STEP APPROACH OF INDIRECT GRADIENT ANALYSIS environmental variables

Standard approach to about 1985: started by D.W. Goodall in 1954

Limitations: (1) environmental variables studied may turn out to be poorly related to the first few ordination axes.

(2) may only be related to 'residual' minor directions of variation in species data.

(3) remaining variation can be substantial, especially in large data sets with many zero values.

(4) a strong relation of the environmental variables with, say, axis 5 or 6 can easily be overlooked and unnoticed.

Limitations overcome by canonical or constrained ordination techniques = multivariate direct gradient analysis.

CANONICAL ORDINATION TECHNIQUES environmental variables

Ordination and regression in one technique – Cajo ter Braak 1986

Search for a weighted sum of environmental variables that fits the species best, i.e. that gives the maximum regression sum of squares

Ordination diagram

1) patterns of variation in the species data

2) main relationships between species and each environmental variable

Redundancy analysis constrained or canonical PCA

Canonical correspondence

analysis (CCA) constrained CA

(Detrended CCA) constrained DCA

Axes constrained to be linear combinations of environmental variables.

In effect PCA or CA with one extra step:

Do a multiple regression of site scores on the environmental variables and take as new site scores the fitted values of this regression.

Multivariate regression of Y on X.

Abundances environmental variables

or

+/-

variables

Response variables

Species

Indirect GA

Values

Direct GA

Predictor or explanatory variables

Env. vars

Classes

PRIMARY DATA IN GRADIENT ANALYSIS

PLUS

Artificial example of environmental variablesunimodal response curves of five species (A-E) with respect to standard-ised environmental variables showing different degrees of separation of the species curves

moisture

linear combination of moisture and phosphate

CCA linear combination

a: Moisture

b: Linear combination of moisture and phosphate, chosen a priori

c: Best linear combination of environmental variables, chosen by CCA.

Sites are shown as dots, at y = 1 if Species D is present and at y = 0 if Species D is absent

Combinations of environmental variables environmental variables

e.g. 3 x moisture + 2 x phosphate

e.g. all possible linear combinations

zj = environmental variable at site j

c = weights

xj = resulting ‘compound’ environmental variable

CCA selects linear combination of environmental variables that maximises dispersion of species scores, i.e. chooses the best weights (ci) of the environmental variables.

ALTERNATING REGRESSION ALGORITHMS environmental variables

- DCA

- CCA

- CA

Algorithms for (A) Correspondence Analysis, (B) Detrended Correspondence Analysis, and (C) Canonical Correspondence Analysis, diagrammed as flowcharts. LC scores are the linear combination site scores, and WA scores are the weighted averaging scores.

REF environmental variables

REF

CANONICAL CORRESPONDENCE ANALYSIS

Algorithm

1) Start with arbitrary, but unequal, site scores xi.

2) Calculate species scores by weighted averaging of site scores.

3) Calculate new site scores by weighted averaging of species scores.

[So far, two-way weighted average algorithm of correspondence analysis].

REF

REF

REF environmental variables

REF

4) Obtain regression coefficients of site scores on the environmental variables by weighted multiple regression.

where b and x* are column vectors

Z is environmental data n x (q +1)

R is n x n matrix with site totals in diagonal

5) Calculate new site scores

or

6) Centre and standardise site scores so that:

and

7) Stop on convergence, i.e. when site scores are sufficiently close to site scores of previous iteration. If not, go to 2.

REF

REF

CANONICAL OR CONSTRAINED CORRESPONDENCE ANALYSIS (CCA) environmental variables

- Ordinary correspondence analysis gives:
- Site scores which may be regarded as reflecting the underlying gradients.
- Species scores which may be regarded as the location of species optima in the space spanned by site scores.
- Canonical or constrained correspondence analysis gives in addition:
- 3. Environmental scores which define the gradient space.
- These optimise the interpretability of the results.

J. Oksanen (2002)

BASIC TERMS environmental variables

Eigenvalue = Maximised dispersion of species scores along axis. In CCA usually smaller than in CA. If not, constraints are not useful.

Canonical coefficients = ‘Best’ weights or parameters of final regression.

Multiple correlation of regression = Species–environment correlation. Correlation between site scores that are linear combinations of the environmental variables and site scores that are WA of species scores. Multiple correlation from the regression. Can be high even with poor models. Use with care!

Species scores = WA optima of site scores, approximations to Gaussian optima along individual environmental gradients.

Site scores = Linear combinations of environmental variables (‘fitted values’ of regression) (1).

Can also be calculated as weighted averages of species scores that are themselves WA of site scores (2).

(1) LC scores are predicted or fitted values of multiple regression with constraining predictor variables 'constraints'.

(2) WA scores are weighted averages of species scores.

Generally always use (1) unless all predictor variables are 1/0 variables.

SUMMARY OF DUNE MEADOW DATA environmental variables

Dune Meadow Data. Unordered table that contains 20 relevées (columns) and 30 species (rows). The right-hand column gives the abbreviation of the species names listed in the left-hand column; these abbreviations will be used throughout the book in other tables and figures. The species scores are according to the scale of van der Maarel (1979b).

Sample environmental variables

number

A1

horizon

Moisture

class

Management

type

Manure

class

Use

1 2.8 1 SF 2 4

2 3.5 1 BF 2 2

3 4.3 2 SF 2 4

4 4.2 2 SF 2 4

5 6.3 1 HF 1 2

6 4.3 1 HF 2 2

7 2.8 1 HF 3 3

8 4.5 5 HF 3 3

9 3.7 4 HF 1 1

10 3.3 2 BF 1 1

11 3.5 1 BF 3 1

12 5.8 4 SF 2 2*

13 6.0 5 SF 2 3

14 9.3 5 NM 3 0

15 11.5 5 NM 2 0

16 5.7 5 SF 3 3

17 4.0 2 NM 1 0

18 4.6* 1 NM 1 0

19 3.7 5 NM 1 0

20 3.5 5 NM 1 0

Environmental data of 20 relevées from the dune meadows

Use categories: 1 = hay

2 = intermediate

3 = grazing

* = mean value of variable

Axis Two environmental variables

2 = 0.29

Axis One

1 = 0.54

DCA

Correlations of environmental variables with DCA axes 1 and 2

CCA environmental variables

CCA of the Dune Meadow Data. a: Ordination diagram with environmental variables represented by arrows. the c scale applies to environmental variables, the u scale to species and sites. the types of management are also shown by closed squares at the centroids of the meadows of the corresponding types of management.

1 2 R axis 1 R axis 2

DCA 0.54 0.40 0.87 0.83

CCA 0.46 0.29 0.96 0.89

Variable environmental variables

Coefficients

Correlations

Axis 1 Axis 2

Axis 1 Axis 2

A1 9 -37 57 -17

Moisture 71 -29 93 -14

Use 25 5 21 -41

Manure -7 -27 -30 -79

SF - - 16 -70

BF -9 16 -37 15

HF 18 19 -36 -12

NM 20 92 56 76

CANONICAL CORRESPONDENCE ANALYSISCanonical correspondence analysis: canonical coefficients (100 x c) and intra-set correlations (100 x r) of environmental variables with the first two axes of CCA for the Dune Meadow Data. The environmental variables were standardised first to make the canonical coefficients of different environmental variables comparable. The class SF of the nominal variable 'type of management' was used as a reference class in the analysis.

CCA of the Dune Meadow Data. environmental variablesa: Ordination diagram with environmental variables represented by arrows. the c scale applies to environmental variables, the u scale to species and sites. the types of management are also shown by closed squares at the centroids of the meadows of the corresponding types of management.

a

b

b: Inferred ranking of the species along the variable amount of manure, based on the biplot interpretation of Part a of this figure.

BIPLOT PREDICTION OF ENVIRONMENTAL VARIABLES environmental variables

- Project a site point onto environmental arrow: predict its environmental value
- Exact with two constraints only
- Projections are exact only in the full multi-dimensional space. Often curved when projected onto a plane

Modified from J. Oksanen (2002)

REF environmental variables

REF

CLASS VARIABLES- Class 1/0 variables usually represented as 'dummy' variables: make m - 1 indicator variables out of m levels (moisture classes 1, 2, 4, 5). Ignore class 3
- Scoring: 1 if site belongs to the class, 0 otherwise
- One dummy less than levels, because one is redundant. If it does not belong to any of the m - 1 classes, it must belong to the remaining one.
- Ordered factors such as the four moisture classes can be expressed as polynomial constraints. A four-level ordered factor can be expressed in three 'dummy' variables - linear, quadratic, and cubic effects. Plot as biplot arrows. Helps to find when one can replace a multilevel factor by a single continuous variable (e.g. Moisture Linear)

J. Oksanen (2002)

REF

CCA: JOINT PLOTS AND TRIPLOTS environmental variables

- You may have in a same figure
- WA scores of species
- WA or LC scores of sites
- Biplot arrows or class centroids of environmental variables

- In full space, the length of an environmental vector is 1: When projected onto ordination space
- Length tells the strength of the variable
- Direction shows the gradient
- For every arrow, there is an equal arrow to the opposite direction, decreasing direction of the gradient
- Project sample points onto a biplot arrow to get the expected value

- Class variables coded as dummy variables
- Plotted as class centroids
- Class centroids are weighted averages
- LC score shows the class centroid, WA scores show the dispersion of the centroid

- With class variables only: Multiple Correspondence Analysis or Analysis of Concentration

CANOCO environmental variables

Summary Axes

Axes 1 2 3 4 Total inertia

Eigenvalues .461 .298 .160 .134 2.115

Species-environment .958 .902 .855 .889

correlations

Cumulative percentage variance

of species data 21.8 35.9 43.5 49.8

of species-environment 37.8 62.3 75.4 86.3

relation

Sum of all unconstrained eigenvalues = inertia 2.115

Sum of all canonical eigenvalues = species-environment 1.220

relation

'Fitted' species data

Rules of thumb:

>0.30 strong gradient

>0.40 good niche separation of species

CONVERGENCE CRITERIA IN EIGENVALUE EXTRACTION environmental variables

Oksanen & Minchin (1997) J. Vegetation Science 8, 447–454

Tolerance Number of

iterations

DECORANA 0.0001 10

CANOCO

version 2 0.00005 15

version 3.1

CANOCO

version 3.12a 0.000005 999

(‘STRICT’ CRITERIA)

CANOCO

version 4 0.000005 999

OTHER CCA TOPICS environmental variables

1) Environmental variables

continuous – biplot arrows

classes – centroid (weighted average) of sites belonging to that class

2) CA approximates ML solution of Gaussian model

CCA approximates ML solution of Gaussian model if CA axis is close to the linear com-bination of environmental variables. [Johnson & Altman (1999) Environmetrics 10, 39-52]

In CCA species compositional data are explained through a Gaussian unimodal response model in which the explanatory variable is a linear combination of environmental variables.

3) CCA – very robust, major assumption is that response model is UNIMODAL.

(Tolerances, maxima, and location of optima can be violated - see Johnson & Altman 1999)

4) Constraints become less and less strict the more environmental variables there are. If q, number of environmental variables ≥ number of samples -1, no real constraints and CCA = CA.

5) Arch effect may crop up. Detrending (by polynomials) DCCA. Useful for estimating gradient lengths (use segments).

6) Arch effect can often be removed by dropping superfluous environmental variables, especially those highly correlated with the arched axis.

REPRESENTATION OF CLASS VARIABLES (1/0) IN CCA environmental variables

- Make class centroids as distinct as possible
- Make clouds about centroids as compact as possible

- Success
- LC scores are the class centroids: the expected locations, WA scores are the dispersion of the centroid
- If high , WA scores are close to LC scores
- With several class variables, or together with continuous variables, the simple structure can become blurred

J. Oksanen (2002)

Canonical correspondence analysis environmental variables

Unimodal curves for the expected abundance response (y) of four species against an environmental gradient or variable (x). The optima, estimated by weighted averages, (u) [k=1,2,3], of three species are indicated. The curve for the species on the left is truncated and therefore appears monotonic instead of unimodal; its optimum is outside the sampled interval but, its weighted average is inside. The curves drawn are symmetric, but this is no strict requirement for CCA.

7) t-values of canonical coefficients or forward selection option in CANOCO to find minimal set of significant variables that explain data about as well as full set.

8) Can be sensitive to deviant sites, but only if there are outliers in terms of both species composition and environment. CCA usually much more robust than CA.

9) Can regard CCA as a display of the main patterns in weighted averages of each species with respect to the environmental variables.

Intermediate between CA and separate WA regressions for each species.

Separate WA regressions point in q-dimensional space of environmental variables. NICHE.

CCA attempts to provide a low-dimensional representation of this niche.

10) ‘Dummy’ variables (e.g. group membership or classes) as environmental variables. Shows maximum separation between pre-defined groups.

11) ‘Passive’ species or samples or environmental variables. Some environmental variables active, others passive

e.g. group membership – active

environmental variables – passive

12) CANOCO ordination diagnostics

fit of species and samples

pointwise goodness of fit can be expressed either as residual distance from the ordination axis or plane, or as proportion of projection from the total chi-squared distance

species tolerances, sample heterogeneity

Passive ‘fossil’ samples added into CCA of modern data option in CANOCO to find

Canonical correspondence analysis (CCA) time-tracks of selected cores from the Round Loch of Glenhead; (a) K5, (b) K2, (c) K16, (d) k86, (e) K6, (f) environmental variables. Cores are presented in order of decreasing sediment accumulation rate.

13) Indicator species selected cores from the Round Loch of Glenhead; (a) K5, (b) K2, (c) K16, (d) k86, (e) K6, (f) environmental variables. Cores are presented in order of decreasing sediment accumulation rate.

14) Behaves well with simulated data.

M W Palmer (1993) Ecology 74, 2215–2230

Copes with skewed species distributions

‘noise’ in species abundance data

unequal sampling designs

highly intercorrelated environmental variables

situations when not all environmental factors are known

Site scores along the first two axes in CCA and DCA ordinations, with varying levels of quantitative noise in species abundance. Quantitative noise was not simulated. The top set represents CCA LC scores and environmental arrows, the middle represents CCA WA scores, and the bottom represents DCA scores. Sites with equal positions along the environmental gradient 2 are connected with lines to facilitate comparisons.

Palmer, M.W. (1993) Ecology 74, 2215–2230

..continued ordinations, with varying levels of quantitative noise in species abundance. Quantitative noise was not simulated. The top set represents CCA LC scores and environmental arrows, the middle represents CCA WA scores, and the bottom represents DCA scores. Sites with equal positions along the environmental gradient 2 are connected with lines to facilitate comparisons.

Site scores along the first two axes in CCA and DCA ordinations, with varying levels of quantitative noise in species abundance. Quantitative noise was not simulated. The top set represents CCA LC scores and environmental arrows, the middle represents CCA WA scores, and the bottom represents DCA scores. Sites with equal positions along the environmental gradient 2 are connected with lines to facilitate comparisons.

Palmer, M.W. (1993) Ecology 74, 2215–2230

ROBUSTNESS OF CANONICAL CORRESPONDENCE ANALYSIS ordinations, with varying levels of quantitative noise in species abundance. Quantitative noise was not simulated. The top set represents CCA LC scores and environmental arrows, the middle represents CCA WA scores, and the bottom represents DCA scores. Sites with equal positions along the environmental gradient 2 are connected with lines to facilitate comparisons.

Like all numerical techniques, CCA makes certain assumptions, most particularly that the abundance of a species is a unimodal function of position along environmental gradient. Does not have to be symmetric unimodal function.

Simulated data Palmer 1993 – CCA performs well even with highly skewed species distributions.

‘Noise’ in ecological data – errors in data collection, chance variation, site-specific factors, etc. Noise is also regarded as ‘unexplained’ or ‘residual’ variance. Regardless of cause, noise does not affect seriously CCA.

‘Noise’ in environmental data is another matter. In regression, assumed that predictor variables are measured without error. CCA is a form of regression, so noise in environmental variables can affect CCA.

Highly correlated environmental variables, e.g. soil pH and Ca. Species distributions along Ca gradient may be identical to distributions along pH gradient, even if one is ecologically unimportant. Species and object arrangement in CCA plot not upset by strong inter-correlations. CCA (like all other regression techniques) cannot tell us which is the ‘real’ important variable.

Both may be statistically significant – small amount of variation in Ca at a fixed level of pH may cause differences in species composition.

Arch – very rarely occurs in CCA. Detrended CCA generally should not be used except in special cases.

INFLUENCE OF NOISY ENVIRONMENTAL DATA ON CANONICAL CORRESPONDENCE ANALYSIS

McCune (1997) Ecology 78, 2617–2623

Simulated artificial data 10 x 10 grid. 40 species following Gaussian response model.

(1)

(2)

(3)

(4)

(5)

- 2 environmental variables X and Y co-ordinates TENXTEN
- 2 environmental variables with added noise NOISMOD
- (random number mean = 0, variance 17%)
- added to each cell
- 10 random environmental variables NOIS1O
- 2 environmental variables with added noise from NOISMOD
- +
- random environmental variables from NOIS 10
- NOISBOTH
- 99 random environmental variables NOISFULL

NOISFULL – ‘Species-environment’ correlation increases as number of random variables increases for axis 1 and 2.

Is in fact the correlation between the linear combination and WA site scores.

Poor criterion for evaluating success.

Not interpreted as measure of strength of relationship.

Monte Carlo permutation tests - NO STATISTICAL SIGNIFICANCE!

TEN x TEN CORRESPONDENCE ANALYSIS

NOISMOD

NOISIO

Dependence of the 'species-environment correlation,' the correlation between the LC and WA site scores, on a second matrix composed of from 1 to 99 random environmental variables. This correlation coefficient is inversely related to the degree of statistical constraint exerted by the environmental variables.

NOISFULL

Monte Carlo tests CORRESPONDENCE ANALYSIS12r1r2

TENXTEN * 0.77 0.79 0.98 0.9

NOISMOD * 0.65 0.65 0.90 0.8

NOISE 10 ns 0.20 0.12 0.49 0.4

NOISBOTH * 0.65 0.65 0.91 0.8

NOISFULL ns 0.12 0.08 1.0 1.0

(99 env vars)

Linear combination site best fit of species abundances to scores the environmental data

WA site scores best represent the assemblage structure

‘Species-environmental correlation’ better called ‘LC-WA’ correlation. Better measure of the strength of the relationship is the proportion of the variance in the species data that is explained by the environmental data. Evaluation should always be by a Monte Carlo permutation test.

LC scoresWA scores

Sensitive to noise +–

True direct gradient analysis +–

(multivariate regression)

Aim to describe biological +–

variation in relation to

environment

Assemblage structure –+

Which to use depends on one's aims and the nature of the data.

LC OR WA SCORES? CORRESPONDENCE ANALYSIS

MIKE PALMER

"Use LC scores, because they give the best fit with the environment and WA scores are a step from CCA towards CA."

BRUCE MCCUNE

"LC scores are excellent, if you have no error in constraining variables. Even with small error, LC scores can become poor, but WA scores can be good even in noisy data."

LC scores are the default in CANODRAW.

Be aware of both - plot both to be sure.

J. Oksanen (2002)

DATA ORDERINGS CORRESPONDENCE ANALYSIS

CCA DIAGRAM CORRESPONDENCE ANALYSIS

TEN SETS OF DISTANCES TO REPRESENT, EMPHASIS ON 5, 8, AND 1 (FITTED ABUNDANCES OF SPECIES AND SITES)

Data-tables in an ecological study on species environmental relations. Primary data are the sub-table 1 of abundance values of species and the sub-tables 4 and 7 of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The primary data are input for canonical correspondence analysis (CCA). The other sub-tables contain derived (secondary) data, as the arrows indicate, named after the (dis)similarity coefficient they contain. The coefficients shown in the figure are optimal when species-environmental relations are unimodal. The CA ordination diagram represents these sub-tables, with emphasis on sub-tables 5 (weighted averages of species with respect to quantitative environmental variables), 8 (totals of species in classes of qualitative environmental variables) and 1 (with fitted, as opposed to observed, abundance values of species). The sub-tables 6, 9, and 10 contain correlations among quantitative environmental variables, means of the quantitative environmental variables in each of the classes of the qualitative variables and chi-square distances among the classes, respectively. (Chis-sq = Chi-square; Aver = Averages; Rel = Relative)

DEFAULT CCA PLOT relations. Primary data are the sub-table 1 of abundance values of species and the sub-tables 4 and 7 of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The primary data are input for canonical correspondence analysis (CCA). The other sub-tables contain derived (secondary) data, as the arrows indicate, named after the (dis)similarity coefficient they contain. The coefficients shown in the figure are optimal when species-environmental relations are unimodal. The CA ordination diagram represents these sub-tables, with emphasis on sub-tables 5 (weighted averages of species with respect to quantitative environmental variables), 8 (totals of species in classes of qualitative environmental variables) and 1 (with fitted, as opposed to observed, abundance values of species).

- Like CA biplot, but now a triplot: vectors for linear constraints.
- Classes as weighted averages or centroids.
- Most use LC scores: these are the fitted values.
- Popular to scale species relative to eigenvalues, but keep sites unscaled. Species-conditional plot.
- Sites do not display their real configuration, but their projections onto environmental vectors are the estimated values.

J. Oksanen (2002)

fitted by least squares relations. Primary data are the sub-table 1 of abundance values of species and the sub-tables 4 and 7 of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The primary data are input for canonical correspondence analysis (CCA). The other sub-tables contain derived (secondary) data, as the arrows indicate, named after the (dis)similarity coefficient they contain. The coefficients shown in the figure are optimal when species-environmental relations are unimodal. The CA ordination diagram represents these sub-tables, with emphasis on sub-tables 5 (weighted averages of species with respect to quantitative environmental variables), 8 (totals of species in classes of qualitative environmental variables) and 1 (with fitted, as opposed to observed, abundance values of species).

REF

REF

SCALING IN CCAHill scaling Default scaling

–1 2

Emphasis on SITES SPECIES

1 Species x sites Rel abundances Fitted abundances (rel)

2 Species x species – Chi-squared distances

3 Sites x sites Turnover distances –

Quant env vars

4 Sites x env vars3 – Values of env vars

5 Species x env vars Weighted averages Weighted averages

6 Env vars x env vars Effects2 Correlations2

Qualit env vars

7 Sites x env classes4 Membership1 Membership1

8 Species x env classes Rel total abund Rel total abund

9 Env vars x env classes – Mean values of env vars

10 Env classes x env Turnover distances –

classes

1 by centroid principle

2 change in site scores if env variable changes are one standard deviation

3 inter-set correlations

4 group centroids

REF

REF

REF relations. Primary data are the sub-table 1 of abundance values of species and the sub-tables 4 and 7 of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The primary data are input for canonical correspondence analysis (CCA). The other sub-tables contain derived (secondary) data, as the arrows indicate, named after the (dis)similarity coefficient they contain. The coefficients shown in the figure are optimal when species-environmental relations are unimodal. The CA ordination diagram represents these sub-tables, with emphasis on sub-tables 5 (weighted averages of species with respect to quantitative environmental variables), 8 (totals of species in classes of qualitative environmental variables) and 1 (with fitted, as opposed to observed, abundance values of species).

REF

Sub-tables (row numbers) that can be displayed by two differently scaled ordination diagrams in canonical correspondence analysis (CCA). Display is by the biplot rule unless noted otherwise. Hill's scaling (column 2) was the default in CANOCO 2.1, whereas the species-conditional biplot scaling (column 3) is the default in CANOCO 3.1 and 4. The weighted sum of squares of sites scores of an axis is equal to /(1-) with its eigenvalue and equal to 1 in scaling -1 and scaling 2, respectively. The weighted sum of squares of species scores of an axis is equal to 1/(1-) and equal to in scaling -1 and scaling 2, respectively. If the scale unit is the same of both species and sites scores, then sites are weighted averages of species scores in scaling -1 and species are weighted averages of site scores in scaling 2. Table in italics are fitted by weighted least-squares (rel. = relative; env. = environmental; cl. = classes; - = interpretation unknown).

Note that symmetric scaling (=3) has many optimal properties

(Gabriel, 2002; ter Braak, personal communication)

REF

REF

REF relations. Primary data are the sub-table 1 of abundance values of species and the sub-tables 4 and 7 of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The primary data are input for canonical correspondence analysis (CCA). The other sub-tables contain derived (secondary) data, as the arrows indicate, named after the (dis)similarity coefficient they contain. The coefficients shown in the figure are optimal when species-environmental relations are unimodal. The CA ordination diagram represents these sub-tables, with emphasis on sub-tables 5 (weighted averages of species with respect to quantitative environmental variables), 8 (totals of species in classes of qualitative environmental variables) and 1 (with fitted, as opposed to observed, abundance values of species).

REF

a Site scores are linear combinations of the environmental variables. The adjective "fitted" must be deleted if site scores are proportional to the weighted average of species scores.

b The centroid principle can be applied also if sites and species scores are plotted in the same units, i in scaling -1, species that occur in a site lie around it, whereas in scaling 2, the species' distribution is centred at the species point.

c The biplot rule cannot be applied

d In the definition of this coefficient, abundance must be replaced by fitted abundance values, because CCA is correspondence analysis of fitted abundance values

e No explicit formula known

f Chi-square distances, provided the eigenvalues of the axes are of the same magnitude

g Environmental scores are (intra-set) correlations in scaling 2; more precisely, the coordinate of an arrow head on an axis (i.e. the score) is the weighted product-moment coefficient of the environmental variable with the axis, the weights being the abundance totals of the sites (yi+). The scores in scaling -1 are {(1-)}½ times those in scaling 2.

h Effect is defined as the change in site scores if the environmental variable changes one standard deviation in value (while neglecting the other variables).

i Environmental points are centroids of site points

k Via centroid principle, not via biplot

REF

REF

INTERPRETATION OF CCA PLOTS relations. Primary data are the sub-table 1 of abundance values of species and the sub-tables 4 and 7 of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The primary data are input for canonical correspondence analysis (CCA). The other sub-tables contain derived (secondary) data, as the arrows indicate, named after the (dis)similarity coefficient they contain. The coefficients shown in the figure are optimal when species-environmental relations are unimodal. The CA ordination diagram represents these sub-tables, with emphasis on sub-tables 5 (weighted averages of species with respect to quantitative environmental variables), 8 (totals of species in classes of qualitative environmental variables) and 1 (with fitted, as opposed to observed, abundance values of species).

Centroid principle

Distance principle

Biplot principle (of relative abundances)

Small eigenvalues, short (< 4SD) gradients – Biplot principle

Large eigenvalues (> 0.40), long (> 4SD) gradients – Centroid and distance principles and some biplot principles

Note that the centroid and distance principle may approximate biplot principle if gradients are short and eigenvalues small.

Differences are least important if 12

} relations. Primary data are the sub-table 1 of abundance values of species and the sub-tables 4 and 7 of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The primary data are input for canonical correspondence analysis (CCA). The other sub-tables contain derived (secondary) data, as the arrows indicate, named after the (dis)similarity coefficient they contain. The coefficients shown in the figure are optimal when species-environmental relations are unimodal. The CA ordination diagram represents these sub-tables, with emphasis on sub-tables 5 (weighted averages of species with respect to quantitative environmental variables), 8 (totals of species in classes of qualitative environmental variables) and 1 (with fitted, as opposed to observed, abundance values of species).

Ordinal

4 classes

7 binary class

variables

3 classes

Remove effect of

seasonal variation

CCA EXAMPLEExample data: quantitative and qualitative environmental variables (a) and qualitative covariables (b) recorded at 40 sites along two tributaries from the Hierden stream (sd: standard deviation, min: minimum, max: maximum). Aquatic macro-fauna data

Ranking environmental variables in importance relations. Primary data are the sub-table 1 of abundance values of species and the sub-tables 4 and 7 of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The primary data are input for canonical correspondence analysis (CCA). The other sub-tables contain derived (secondary) data, as the arrows indicate, named after the (dis)similarity coefficient they contain. The coefficients shown in the figure are optimal when species-environmental relations are unimodal. The CA ordination diagram represents these sub-tables, with emphasis on sub-tables 5 (weighted averages of species with respect to quantitative environmental variables), 8 (totals of species in classes of qualitative environmental variables) and 1 (with fitted, as opposed to observed, abundance values of species). by their marginal (left) and conditional (right) effects of the macrofauna in the example data-set, as obtained by forward selection. (1 = fit = eigenvalue with variable j only; a= additional fit = increase in eigenvalue; cum (a) = cumulative total of eigenvalues a; P = significance level of the effect, as obtained with a Monte Carlo permutation test under the null model with 199 random permutations; - additional variables tested; veg. = vegetation). Seasonal variation is partialled out by taking the month class variables as covariables.

Species-conditional triplot based on a canonical correspondence analysis of the example macro-invertebrate data displaying 13% of the inertia (=weighted variance) in the abundances and 69% of the variance in the weighted averages and class totals of species with respect to the environmental variables. The eigenvalue of axis 1 (horizontally) and axis 2 (vertically) are 0.35 and 0.17 respectively; the eigenvalue of the axis 3 (not displayed) is 0.13. Sites are labelled with stream code (U, L) and are ranked by distance from the source (rank number within the stream). Species (triangles) are weighted averages of site scores (circles). Quantitative environmental variables are indicated by arrows. The class variable shrub is indicated by the square points labelled Shrub and No shrub. The scale marks along the axes apply to the quantitative environmental variables; the species scores, site scores and class scores were

multiplied by 0.4 to fit in the coordinate system. Only selected species are displayed which have N2>4 and a small N2-adjusted root mean square tolerance for the first two axes. The species names are abbreviated to the part in italics as follows Ceratopogonidae, Dendrocoelum lacteum, Dryops luridus, Erpobdella testacea, Glossiphonia complanata, Haliplus lineatocollis, Helodidae, Micropsectra atrofasciata, Micropsectra fusca, Micropterna sequax, Prodiamesa olivacea, Stictochironomus sp.

CANONICAL CORRESPONDENCE ANALYSIS (CCA) - A SUMMARY correspondence analysis of the example macro-invertebrate data displaying 13% of the inertia (=weighted variance) in the abundances and 69% of the variance in the weighted averages and class totals of species with respect to the environmental variables. The eigenvalue of axis 1 (horizontally) and axis 2 (vertically) are 0.35 and 0.17 respectively; the eigenvalue of the axis 3 (not displayed) is 0.13. Sites are labelled with stream code (U, L) and are ranked by distance from the source (rank number within the stream). Species (triangles) are weighted averages of site scores (circles). Quantitative environmental variables are indicated by arrows. The class variable shrub is indicated by the square points labelled Shrub and No shrub. The scale marks along the axes apply to the quantitative environmental variables; the species scores, site scores and class scores were

- Unconstrained CA gives
- Species ordination which is derived from site ordination
- Site ordination which is derived from species ordination
- Fitted vectors for environmental variables (indirect gradient analysis)

- Constrained CA (Canonical CA) gives a direct gradient analysis
- Species ordination which is derived from site ordination
- Site scores which are linear combinations of environmental variables (LC scores)
- Site ordination which is derived from species ordination (WA scores) so that species-environment correlation is maximised with the LC scores
- Vectors of environmental variables that define the linear combination scores for sites

Gradient length correspondence analysis of the example macro-invertebrate data displaying 13% of the inertia (=weighted variance) in the abundances and 69% of the variance in the weighted averages and class totals of species with respect to the environmental variables. The eigenvalue of axis 1 (horizontally) and axis 2 (vertically) are 0.35 and 0.17 respectively; the eigenvalue of the axis 3 (not displayed) is 0.13. Sites are labelled with stream code (U, L) and are ranked by distance from the source (rank number within the stream). Species (triangles) are weighted averages of site scores (circles). Quantitative environmental variables are indicated by arrows. The class variable shrub is indicated by the square points labelled Shrub and No shrub. The scale marks along the axes apply to the quantitative environmental variables; the species scores, site scores and class scores were

estimation

CA

Indirectly

CCA

Directly

Outline of ordination techniques present-ed here. DCA (detrended correspondence analysis) was applied for the determina-tion of the length of the gradient (LG). LG is important for choosing between ordination based on a linear or on an unimodal response model. Correspond-ence analysis (CA) is not considered any further because in “microcosm experi-ment discussed here LG < or = 1.5 SD units. LG < 3 SD units are considered to be typical in experimental ecotoxicology. In cases where LG < 3, ordination based on linear response models is considered to be most appropriate. PCA (principal component analysis) visualizes variation in species data in relation to best fitting theoretical variables. Environmental variables explaining this visualised variation are deduced afterwards, hence, indirectly. RDA ( redundancy analysis) visualises variation in species data directly in relation to quantified environ-

mental variables.Before analysis, covariables may be introduced in RDA to compensate for systematic differences in experimental units. After RDA, a permutation test can be used to examine the significance of effects.

REDUNDANCY ANALYSIS – CONSTRAINED PCA correspondence analysis of the example macro-invertebrate data displaying 13% of the inertia (=weighted variance) in the abundances and 69% of the variance in the weighted averages and class totals of species with respect to the environmental variables. The eigenvalue of axis 1 (horizontally) and axis 2 (vertically) are 0.35 and 0.17 respectively; the eigenvalue of the axis 3 (not displayed) is 0.13. Sites are labelled with stream code (U, L) and are ranked by distance from the source (rank number within the stream). Species (triangles) are weighted averages of site scores (circles). Quantitative environmental variables are indicated by arrows. The class variable shrub is indicated by the square points labelled Shrub and No shrub. The scale marks along the axes apply to the quantitative environmental variables; the species scores, site scores and class scores were

Short (< 2SD) compositional gradients

Linear or monotonic responses

Reduced-rank regression

PCA of y with respect to x

Two-block mode C PLS

PCA of instrumental variables Rao (1964)

PCA - best hypothetical latent variable is the one that gives the smallest total residual sum of squares

RDA - selects linear combination of environmental variables that gives smallest total residual sum of squares

ter Braak (1994) Ecoscience 1, 127–140 Canonical community ordination Part I: Basic theory and linear methods

RDA ordination diagram of the Dune Meadow Data with environmental variables represen-ted as arrows. The scale of the diagram is: 1 unit in the plot corresponds to 1 unit for the sites, to 0.067 units for the species and to 0.4 units for the environmental variables.

Variable Coefficients Correlations environmental variables represen-ted as arrows. The scale of the diagram is: 1 unit in the plot corresponds to 1 unit for the sites, to 0.067 units for the species and to 0.4 units for the environmental variables.

Axis1 Axis2 Axis1 Axis2

A1 -1 -5 54 -6

Moisture 15 9 92 12

Use 5 -6 15 29

Manure -8 16 -26 86

SF - - 25 76

BF -10 0 -48 -11

HF -10 -2 -40 13

NM -4 -13 51 -79

Redundancy analysis: canonical coefficients (100 x c) and intra-set correlations (100 x r) of environmental variables with the first two axes of RDA for the Dune Meadow Data. The environmental variables were standardized first to make the canonical coefficients of different environmental variables comparable. The class SF of the nominal variable “type of management” was used as reference class in the analysis.

PCA and RDA comparisons environmental variables represen-ted as arrows. The scale of the diagram is: 1 unit in the plot corresponds to 1 unit for the sites, to 0.067 units for the species and to 0.4 units for the environmental variables.

Important to do the check that the environmental variables relate to the major gradients in composition detected by the PCA.

Axis 1 Axis 2

PCA % 29 21

RDA % 26 17

PCA Correlation 0.90 0.82

RDA Correlation 0.95 0.89

BIPLOT INTERPRETATION environmental variables represen-ted as arrows. The scale of the diagram is: 1 unit in the plot corresponds to 1 unit for the sites, to 0.067 units for the species and to 0.4 units for the environmental variables.

Cosine of angle correlation

Long arrows of species and environmental variables most important

species

unconstrained

Goodness of fit 1 + 2

sum of eigenvalues

constrained

fitted species

Euclidean distance biplot

Covariance (correlation) biplot

RDA covariance or correlation matrix of species

RDA – constrained form of multiple regression

Uses 2 (q + m) + m parameters (q env variables, m species)

Multiple regression m (q + 1)

e.g. 40 species 10 envir variables

RDA 140 parameters

MR 440 parameters

RDA is thus reduced rank regression (RR)

Primary and secondary data tables in a typical community ecological study of species-environment relations. Indirect methods of ordination use the tables under (a). Direct methods also use the tables under (b). The primary data are the table of abundance values and the tables of values and class labels of quantitative and qualitative environmental variables (env. var), respectively. The secondary tables are named after the (dis)similarity coefficients they contain. The appropriate coefficients must be chosen by the ecologist. The coefficients shown in the figure are optimal when species-environment relations are linear.

Tables that can be displayed by two differently scaled biplots in principal components analysis (a) and redundancy analysis (b).

The sum of squares of site scores of an axis is equal to its eigenvalue in scaling 1, and equal to 1 in scaling 2. The sum of squares of species scores of an axis is equal to 1 in scaling 1 and equal to its eigenvalue in scaling 2. Tables in bold are fitted by (weighted) least-squares.

Biplot scaling 1: focus on sites 2: focus on species

distance biplot correlation biplot

(a) principal components analysis

species x sites abundances abundances

sites Euclidean distances -

species - correlationsa

(b) redundancy analysis

species x sitesbfitted abundances fitted abundances

sitesb Euclidean distancesc -

species - correlationsa,c

Quantitative env. vars.:

species x env. vars. dcorrelations correlations

sites x env. vars. d - values of env. vars

env. vars. d effectse correlations

Qualitative env. vars:

species x env. classesfmeans means

sites x env. classesfgg

env. classesf Euclidean distances -

env. vars. x env. classes - means

REF biplots in principal components analysis (a) and redundancy analysis (b).

REF

a Automatic if abundance is standardised by species. If abundance is only centred by species, a post-hoc rescaling of the site scores is needed so as to account for the differences in variance amongst species.

b Site scores are a linear combination of the environment variables instead of being a weighted sum of species abundances.

c In the definition of this coefficient, abundance must be replaced by the fitted abundance.

d Environmental scores are intraset correlations in scaling 2 and s½ times those in scaling 1 with s the eigenvalue of axis . In CANOCO, the scores are termed biplot scores for environmental variables.

e Effect of the environmental variable on the ordination scores, while neglecting the other environmental variables; length of arrow is the effect size, i.e. the variance explained by the variable.

f Environmental classes are centroids of site points belonging to the class.

g membership via centroid principle, not via the biplot rules.

REF

REF

Correlation biplot based on a redundancy analysis of the Dune Meadow Data displaying 43% of the variance in the abundances and 71% of the variances in the fitted abun-dances. Quantitative environ-ment variables are indicated by arrows. The qualitative variable Management type is indicated by the square points labelled SF, BF, HF, and NM. The displayed species are selected on the basis that more than 30% of their variance is accounted for by the diagram. Eigenvalues of the first three axes are 0.26, 0.17,and 0.07; the sum of all canonical eigenvalues is 0.61.

The scale marks along the axes apply to the species and quantitative environmental variables; the site scores and class scores were multiplied by 0.46 to fit in the coordinate system. The abbreviations are given in Jongman et al. (1987).The rule for interpreting a biplot (projection on an imaginary axis) is illustrated for the species Pla lan and sites 11 and 12.

PROPOSED NEW SCALING FOR CCA AND RDA Dune Meadow Data displaying 43% of the variance in the abundances and 71% of the variances in the fitted abun-dances. Quantitative environ-ment variables are indicated by arrows. The qualitative variable Management type is indicated by the square points labelled SF, BF, HF, and NM. The displayed species are selected on the basis that more than 30% of their variance is accounted for by the diagram. Eigenvalues of the first three axes are 0.26, 0.17,and 0.07; the sum of all canonical eigenvalues is 0.61.

Gabriel, K.R. (2002) Biometrika 89, 423-436

Symmetric scaling (3) of biplots preserves the optimal fit to the species data table and preserves the (proportional) fit of at least 95% of the inter-species correlations/distances and inter-sample distances. It is a very good compromise.

Only recommended (ter Braak, pers. comm.) to deviate from symmetric scaling if the focus of study is strongly on either species (scaling 2) or on samples (scaling 1).

Data table unaffected by scaling:

Species x sites Species data (PCA)

Fitted species data (RDA)

Relative species data (CA)

Fitted relative species data (CCA)

Species x environmental variables Correlations of species (RDA)

Optima (WA) of species (CCA)

Species x environmental classes Mean abundances of species (RDA)

Relative abundances of species across classes (CCA)

Data tables with 95% preservation of proportional fit: Dune Meadow Data displaying 43% of the variance in the abundances and 71% of the variances in the fitted abun-dances. Quantitative environ-ment variables are indicated by arrows. The qualitative variable Management type is indicated by the square points labelled SF, BF, HF, and NM. The displayed species are selected on the basis that more than 30% of their variance is accounted for by the diagram. Eigenvalues of the first three axes are 0.26, 0.17,and 0.07; the sum of all canonical eigenvalues is 0.61.

Species x species Correlations (PCA, RDA)

Chi-square distances (CA, CCA)

Sites x sites Euclidean distances (PCA, RDA)

Chi-square distances (CA, CCA)

Env. classes x env. classes Euclidean distances (RDA)

Chi-square distances (CCA)

Env. variables x env. variables Correlations (RDA, CCA)

Sites x env. variables Values (RDA, CCA)

Sites x env. classes Means (RDA, CCA)

Env. variables x env. classes Mean values of env. variables (RDA, CCA)

ALTERNATIVES TO ENVIRONMENTAL VECTORS IN CCA AND RDA Dune Meadow Data displaying 43% of the variance in the abundances and 71% of the variances in the fitted abun-dances. Quantitative environ-ment variables are indicated by arrows. The qualitative variable Management type is indicated by the square points labelled SF, BF, HF, and NM. The displayed species are selected on the basis that more than 30% of their variance is accounted for by the diagram. Eigenvalues of the first three axes are 0.26, 0.17,and 0.07; the sum of all canonical eigenvalues is 0.61.

- Fitted vectors natural in constrained ordination, since these have linear constraints.
- Distant sites are different, but may be different in various ways: environmental variables may have a non-linear relation to ordination.

Contours

Bubble plots

GAM

J. Oksanen (2002)

STATISTICAL TESTING OF CONSTRAINED ORDINATION RESULTS Dune Meadow Data displaying 43% of the variance in the abundances and 71% of the variances in the fitted abun-dances. Quantitative environ-ment variables are indicated by arrows. The qualitative variable Management type is indicated by the square points labelled SF, BF, HF, and NM. The displayed species are selected on the basis that more than 30% of their variance is accounted for by the diagram. Eigenvalues of the first three axes are 0.26, 0.17,and 0.07; the sum of all canonical eigenvalues is 0.61.

Statistical significance of species-environmental relationships. Monte Carlo permutation tests.

Randomly permute the environmental data, relate to species data ‘random data set’. Calculate eigenvalue and sum of all canonical eigenvalues (trace). Repeat many times (99).

If species react to the environmental variables, observed test statistic (1 or trace) for observed data should be larger than most (e.g. 95%) of test statistics calculated from random data. If observed value is in top 5% highest values, conclude species are significantly related to the environmental variables.

STATISTICAL SIGNIFICANCE OF CONSTRAINING VARIABLES Dune Meadow Data displaying 43% of the variance in the abundances and 71% of the variances in the fitted abun-dances. Quantitative environ-ment variables are indicated by arrows. The qualitative variable Management type is indicated by the square points labelled SF, BF, HF, and NM. The displayed species are selected on the basis that more than 30% of their variance is accounted for by the diagram. Eigenvalues of the first three axes are 0.26, 0.17,and 0.07; the sum of all canonical eigenvalues is 0.61.

- CCA or RDA maximise correlation with constraining variables and eigenvalues.
- Permutation tests can be used to assess statistical significance:
- - Permute rows of environmental data.
- - Repeat CCA or RDA with permuted data many times.
- - If observed higher than (most) permutations, it is regarded as statistically significant.

J. Oksanen (2002)

PARTIAL CONSTRAINED ORDINATIONS Dune Meadow Data displaying 43% of the variance in the abundances and 71% of the variances in the fitted abun-dances. Quantitative environ-ment variables are indicated by arrows. The qualitative variable Management type is indicated by the square points labelled SF, BF, HF, and NM. The displayed species are selected on the basis that more than 30% of their variance is accounted for by the diagram. Eigenvalues of the first three axes are 0.26, 0.17,and 0.07; the sum of all canonical eigenvalues is 0.61.(Partial CCA, RDA, etc)

e.g. pollution effects

seasonal effects COVARIABLES

Eliminate (partial out) effect of covariables. Relate residual variation to pollution variables.

Replace environmental variables by their residuals obtained by regressing each pollution variable on the covariables.

Analysis is conditioned on specified variables or covariables. These conditioning variables may typically be 'random' or background variables, and their effect is removed from the CCA or RDA based on the 'fixed' or interesting variables.

Ordination diagram of a partial canonical correspond-ence analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O2 = oxygen, P = ortho-phosphate, Si= silicium-compunds, WIDTH = dyke width, and soil types (CLAY, PEAT). All variables except BOD, WIDTH, CLAY and PEAT were transformed to logarithms because of their skew distribution. The diatoms shown are: Ach hun = Achnanthes hungarica, Ach min = A. minutissima, Aph cas= Amphora castellata Giffen, Aph lyb = A. lybica, Aph ven = A. veneta, Coc pla = Cocconeis placentulata, Eun lun = Eunotia lunaris, Eun pec = E. pectinalis, Gei oli = Gomphoneis olivaceum, Gom par = Gomphonema parvulum, Mel jur = Melosira jürgensii, Nav acc = Navicula accomoda, Nav cus = N. cuspidata, Nav dis = N. diserta, Nav exi = N. exilis, Nav gre = N. gregaria, Nav per = N. permitis, Nav sem = N. seminulum, Nav sub= N. subminuscula,Nit amp = Nitzschia amphibia, Nit bre = N. bremensis v. brunsvigensis, Nit dis = N. dissipata, Nit pal = N. palea, Rho cur = Rhoicosphenia curvata.

(Adapted from H. Smit, in prep)

PARTIAL CCA

Natural variation due to sampling season and due to gradient from fresh to brackish water partialled out by partial CCA.

Variation due to pollution could now be assumed.

PARTIAL ORDINATION ANALYSIS analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O(Partial PCA, CA, DCA)

There can be many causes of variation in ecological or other data. Not all are of major interest. In partial ordination, can ‘factor out’ influence from causes not of primary interest. Directly analogous to partial correlation or partial regression. Can have partial ordination (indirect gradient analysis) and partial constrained ordination (direct gradient analysis). Variables to be factored out are ‘COVARIABLES’ or ‘CONCOMITANT VARIABLES’. Examples are:

1) Differences between observers.

2) Time of observation.

3) Between-plot variation when interest is temporal trends within repeatedly sampled plots.

4) Uninteresting gradients, e.g. elevation when interest is on grazing effects.

5) Temporal or spatial dependence, e.g. stratigraphical depth, transect position, x and y co-ordinates. Help remove autocorrelation and make objects more independent.

6) Collecting habitat – outflow, shore, lake centre.

7) Everything – partial out effects of all factors to see residual variation in data. Given ecological knowledge of sites and/or species, can try to interpret residual variation. May indicate environmental variables not measured, may be largely random, etc.

PARTIAL ORDINATIONS analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

e.g. partial out the effects of some covariables prior to indirect gradient analysis

within-plot change PRIMARY INTEREST

between-plot differences NOT OF INTEREST

Partial plot identity, ordination of residual variation, i.e. within-plot change.

e.g. Swaine & Greig-Smith (1980) J Ecol 68, 33–41

Bakker et al. (1990) J Plankton Research 12, 947–972

Background variables or 'covariables' analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

Partial CCA

Partial RDA

Vegetation

Environmental variables or 'constraints'

CCA

RDA

Vegetation

(residual)

CA

DCA

PCA

Vegetation

(residual)

COVARIABLES IN CCA AND RDA"Nuisance" variables or other background factors can be removed before studying interesting factors. Partial CCA or partial RDA.

Permutation tests are for environmental variables only.

Residual variation can be analysed at any level. Can partition the variance.

Final residual shows what you cannot explain with available environmental variables.

Interpretation of final residual based on other correlates and/or ecological knowledge.

PARTITIONING VARIATION analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

ANOVA total SS = regression SS + residual SS

Two-way ANOVA between group (factor 1)

+ between treatments (factor 2)

+ interactions

+ error component

Borcard et al. (1992) Ecology 73, 1045–1055

Variance or variation decomposition into 4 components

Important to consider groups of environmental variables relevant at same level of ecological relevance (e.g. micro-scale, species-level, assemblage-level, etc.).

Variation = variance in RDA

Variation = inertia in CCA = chi-square statistic of data divided by the data’s total = sum of all eigenvalues of CA

a b c d analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

unique

unexplained

unique

covariance

Total inertia = total variance 1.164

Sum canonical eigenvalues = 0.663 57%

Explained variance 57%

Unexplained variance = T – E 43%

What of explained variance component?

Soil variables (pH, Ca, LOI)

Land-use variables (e.g. grazing, mowing)

Not independent

Do CCA/RDA using

1) Soil variables only canonical eigenvalues 0.521

2) Land-use variables only canonical eigenvalues 0.503

3) Partial analysis Soil Land-use covariables 0.160

4) Partial analysis Land-use Soil covariables 0.142

a) Soil variation independent of land-use (3) 0.160 13.7%

b) Land-use structured (covarying) soil variation (1–3) 0.361 31%

c) Land-use independent of soil (4) 0.142 12.2%

Total explained variance 56.9%

d) Unexplained 43.1%

CANOCO

Predictors Covariables Sum of canonical analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

G+C+D - 0.811

D G+C 0.027

G+C - 0.784

G+C D 0.132

D - 0.679

Joint effect

DG+C=0.784-0.132=0.679-0.027=0.652

C D+G 0.106

G+D - 0.706

G+D C 0.074

C - 0.737

Joint effect

CD+G=0.737-0.106=0.706-0.074=0.631

0.811

0.811

0.812

0.811

VARIATION PARTITIONING OR DECOMPOSITION WITH 3 OR MORE SETS OF PREDICTOR (EXPLANATORY) VARIABLESQinghong & Bråkenheim, (1995) Water, Air and Soil Pollution 85, 1587–1592

Three sets of predictors – Climate (C), Geography (G) and Deposition of Pollutants (D)

Series of RDA and partial RDA

Predictors Covariables Sum of canonical analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

G D+G 0.034

D+C - 0.777

D+C G 0.228

G - 0.538

Joint effect

GD+C=0.777-0.228=0.538-0.034=0.549

0.811

0.811

D

PD

CD

DG

CDG

PC

PG

CG

C

G

Canonical eigenvalues

All predictors 0.811

Pure deposition 0.027 PD

Pure climate 0.106 PC

Pure geography 0.034 PG

Joint G + C 0.132

Joint G + D 0.074

Joint D + C 0.228

Unexplained variance 1 – 0.811 = 0.189

Covariance

terms

CD

DG

CG

CDG

CD + DG + CDG = 0.652 analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

CD + CG + CDG = 0.631

DG + CG + CDG = 0.549

PD + PC + CD = 0.027 + 0.106 + CD = 0.777 – 0.549 = 0.228

PD PC (D+C) (DG +

CG +

CDG)

PD + PG + DG =0.027+0.034+ DG =0.706 – 0.631= 0.074

PD PG (G+D)(CD +

CG +

CDG)

PC + PG + CG =0.106+0.034+ CG =0.784 – 0.652= 0.132

PCPG (G+C)(CD +

DG+

CDG)

CD = 0.095 DG = 0.013 CG = –0.008

CDG = 0.652 – 0.013 – 0.095 = 0.544

= 0.631 – (–0.008) – 0.095 = 0.544

= 0.054 – (–0.008) – 0.013 = 0.544

Total explained variance 0.811 consists of: analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

Common climate + deposition 0.095 Unique climate PC 0.106

Common deposition + geography 0.013 Unique geography PG 0.034

Common climate + geography 0.008 Unique deposition PD 0.027

Common climate + geography + deposition 0.544 Unexplained variance 0.189

See also Qinghong Liu (1997) – Environmetrics 8, 75–85

Anderson & Gribble (1998) – Australian J. Ecology 23, 158-167

Total variation:

1) random variation

2) unique variation from a specific predictor variable or set of predictor variables

3) common variation contributed by all predictor variables considered together and in all possible combinations

Usually only interpretable with 2 or 3 'subsets' of predictors.

In CCA and RDA, the constraints are linear. If levels of the environmental variables are not uncorrelated (orthogonal), may find negative 'components of variation'.

REF analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

REF

'NEGATIVE' VARIANCESIn variance partitioning, the groups of predictor variables used should be non-linearly independent for unbiased partitioning or decomposition.

If the groups of variables have polynomial dependencies, some of the variance components may be negative. Negative variances are, in theory, impossible.

High-order dependencies commonly arise with high numbers of variables and high number of groups of variables.

Beware of inter-relationships between predictor variables and between groups of predictors. Problem common to all regression-based techniques, including (partial) CCA or RDA.

Careful model selection (minimal adequate model) is essential for many purposes, including variance partitioning.

REF

REF

Variation explained by Z analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

Variation explained by X

[a]

[b]

[c]

Unexplained (residual) variation = [d]

UNBIASED ESTIMATES OF VARIANCE COMPONENTSPeres-Neto et al. 2006 Ecology 87: 2614-2615

Legendre 2007 Journal of Plant Ecology (in press)

Variation in response variable y or Y

=

Rectangle = 100% of the variation in y or Y (response variable(s))

Fraction b is the intersection (not interaction) or covariance of the amounts of variation explained by linear model of X and Z

Partial linear regression analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

y ~X|Z– partial linear regression of response variable y on predictor variables X (m variables) whilst controlling for the linear effect of Z containing q covariables

Partial R analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O2y~X|Z= SS (fitted values of y~X|Z)

(SS (fitted values) + SS (residuals))

R2y~X|Z= [a] ([a] + [d])

Partial linear regression y = x + covariables z

F statistic used to test significance of partial R2 takes into account number of covariables q; in ordinary multiple regression q = 0

F = (R2partialm)

F = ([a] m)

([d] (n – 1 – m – q))

((1 – R2partial) (n – 1 – m – q))

m= number of predictor variables, n=number of objects

Also compute y~Z|X as well as y~X|Z

Unadjusted and adjusted coefficients of determination analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, OR2

R2 = Regression SS = 1 – Residual SS

(A)

Total SS

Total SS

R2adj = 1 – Residual mean square = 1 – (1 – R2) Total df

(B)

Residual df

Total mean square

R2adjtakes into account numbers of degrees of freedom associated with numerator and denominator in equation A

In ordinary multiple regression total df = (n – 1) and residuals df = (n – m - 1) where n = number of observations and m = number of explanatory variables

Partial canonical analysis analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, O

In RDA, canonical R2is ratio of the sum of each response variable’s regression (or fitted values) SS to the sum of all response variables’ total SS.

Significance of F tested by permutation with (m x p) and p (n – m – 1) degrees of freedom where p = number of response variables

Can calculate R2adjusted(equation B) to produce unbiased estimates of the real contributions of variables in X to the explanation of the response matrix Y.

where analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, Om = number of predictor variables in matrix X

Variation partitioning of analysis of diatom species (A) in dykes with as explanatory variables 24 variables-of-interest (arrows) and 2 covariables (chloride concentration and season). The diagram is symmetrically scaled [23] and shows selected species and standardized variables and, instead of individual dykes, centroids (•) of dyke clusters. The variables-of-interest shown are: BOD = biological oxygen demand, Ca = calcium, Fe = ferrous compounds, N = Kjeldahl-nitrogen, OY with respect to X and W, two sets of explanatory variables

* Calculated as 1-(1-R2)(Total df/Residual df)

= 1 – Residual mean square/Total mean square

varpart in R vegan

Significance of fractions a and c tested by ‘permutation of the residuals’ option in CANOCO

Fraction [a]

Fraction [c]

where m = number of explanatory variables in predictor set Xq = number of explanatory variables in predictor set W

Significance of fractions [b] (covariance) and [d] (residuals) cannot be assessed statistically

Oribatid mite data: 35 species, 70 samples, 5 habitat variables, and spatial descriptors

varpart in R vegan

Representation of components variables, and spatial descriptors

Fraction [a] dot maps of ‘bubble’ lots

Fraction [b] interpolation maps

Fraction [c] interpolation maps (e.g. kriging)

Fraction [d] maps either dot or interpolated

Can be expanded to 3 or 4 tables of explanatory variables. Gets very complex!

Applicable to CCA but algebra even more complicated.

ENVIRONMENTAL CONSTRAINTS AND CURVATURE IN ORDINATIONS variables, and spatial descriptors

- Curvature often cured because axes are forced to be linear combination of environmental variables (constraints).
- High number of constraints = no constraint.
- Absolute limit: number of constraints = min (M, N) - 1, but release from the constraints can begin much earlier.
- Reduce environmental variables so that only the important remain: heuristic value better than statistical criteria.
- Reduces multicollinearity as well.

J. Oksanen (2002)

Classification of gradient analysis techniques by type of problem, response model and method of estimation

ENVIRONMENTAL VARIABLES IN CONSTRAINED ORDINATIONS problem, response model and method of estimation

1) Choice can greatly influence the results. Fewer the environmental variables, the more constrained the ordination is.

2) Possible to have one only – can evaluate its explanatory power.

3) Can always remove superfluous variables if they are confusing or difficult to interpret. Can often remove large number without any marked effect. Remember post-hoc removal of variables is not valid in a hypothesis-testing analysis.

4) Linearcombinations – environmental variables cannot be linear combinations of other variables. If a variable is a linear combination of other variables, singular matrix results, leads to analogous process of dividing by zero.

Examples:

- total cations, Ca, Mg, Na, K, etc. Delete total cations

- % clay, % silt, % sand

- dummy variables (granite or limestone or basalt)

5) Transformation of environmental data – how do we scale environmental variables in such a way that vegetation ‘perceives’ the environment? Need educated guesses.

Log transformation usually sensible – 1 unit difference in N or P is probably more important at low concentrations than at high concentrations.

As statistical significance in CANOCO is assessed by randomisation tests, no need to transform data to fulfil statistical assumptions.

Transformations useful to dampen influence of outliers.

Environmental data automatically standardised in RDA and CCA.

6) problem, response model and method of estimation Dummy variables – factors such as bedrock type, land-use history, management, etc, usually described by categorical or class variables. 1 if belongs to class, 0 if it does not. For every categorical variable with K categories, only need K – 1 dummy variables e.g.

Granite Limestone Basalt Gabbro

Plot 1 1 0 0 0

2 0 1 0 0

3 1 0 0 0

4 0 1 0 0

5 0 0 1 0

6 0 0 0 1

7) Circular data – some variables are circular (e.g. aspect) and large values are very close to small values. Aspect – transform to trigonometric functions.

northness = cosine (aspect)

eastness = sine (aspect)

Northness will be near 1 if aspect is generally northward and –1 if southward. Close to 0 if west or east.

Alternatively for aspect

southness = 180 - |aspect - 180| (S = 180, N =0)

westness = |180 - |aspect - 270|| (W = 180, E = 0)

Day of year – usually not a problem unless dealing with sampling over whole year. Can create ‘winterness’ and ‘springness’ variables as for aspect.

8) problem, response model and method of estimation Vegetation-derived variables – maximum height, total biomass, total cover, light penetration, % open ground can all be ‘environmental’ variables. Such variables SHOULD NOT BE USED in hypothesis testing, as danger of circular reasoning.

9) Interaction terms – e.g. elevation * precipitation. Easy to implement, difficult to interpret. If elevation and precipitation interact to influence species composition, easy to make term but the ecological meaning of where in environmental space the stands or species are is unclear. Huge number of possibilities N variables ½ N (N – 1) possible interactions. 5 variables 10 interactions.

AVOID quadratic terms [e.g. pH * pH (pH2) (cf. multiple regression and polynomial terms)]. Can create an ARCH effect or warpage of ordination space.

Try to avoid interaction terms except in clearly defined hypothesis-testing studies where the null hypothesis is that ‘variables c and d do not interact together to influence the species composition’.

For interaction to be significant, eigenvalue 1 of the analysis with product term should be considerably greater than 1when there is no product term and the t-value associated with the product term should be greater than 2 in absolute value.

Avoid product variables to avoid ‘data dredging’.

SELECTING ENVIRONMENTAL VARIABLES IN CON-STRAINED ORDINATION ANALYSIS (e.g. CCA, RDA)

1) The fewer the environmental variables, stronger the constraints are.

2) With q (number of samples – 1) environmental variables, the analysis is unconstrained.

3) Small numbers of environmental variables may remove any arch effect.

4) Want to try to find MINIMAL ADEQUATE SET of environmental variables that explain the species data about as well as the FULL SET.

5) Automatic selection (e.g. forward selection) can be dangerous:

a) Several sets can be almost equally good. Automatic selection finds one but may not be the best.

b) Selection order may change the result and important variables may not be selected.

c) Small changes in the data can change the selected variables. Difficult to draw reliable conclusions about relative importance of variables. Omission of a variable does not mean it is not ecologically important.

6) If you are lucky, there may only be one minimal adequate model but do not assume that there is only one such model.

7) How do we go about finding a minimal adequate model or set of environmental variables?

1) Start with all explanatory variables in the analysis, FULL MODEL. Consider sum of canonical eigenvalues (amount of explained variance), eigenvalues and species-environmental correlations.

2) Try to simplify full model by deleting variables but not reducing the model performance. May be impossible to remove variables without some loss of information.

Deletion criteria:

a) Deletion on external criteria – variables not relevant.

b) Deletion on correlation structure – variables may be highly correlated (e.g. pH, Ca, Mg, CEC). Any one could be used as a proxy for the others. Best to choose the one that is likely to be the most direct cause of vegetation response.

Can do a PCA of environmental variables to explore correlation structure of variables.

c) Interpretability – variables with short arrows.

d) Non-significant – delete any that are non-significant (p > 0.05) in analysis with one environmental variable only in CCA or RDA.

e) Ecologicalimportance

f) Stepwiseanalysis – forward selection, add one variable at a time until no other variables ‘significantly’ explain residual variation in species data.

3) Final selection must be based on ecological and statistical criteria. The purpose of numerical data analysis is 'INSIGHT', not complex statistics!

WHAT IS DONE? FULL MODEL. Consider sum of canonical eigenvalues (amount of explained variance), eigenvalues and species-environmental correlations.

1) CCA (or RDA) is performed on each variable separately and marginal effects are listed in order.

2) Select the variable with largest marginal effect (= eigenvalue) and test its statistical significance by unrestricted Monte Carlo permutation tests and 999 permutations. Accept if p < 0.05.

3) This variable is now used as a covariable and the variables are now listed in order of their conditional effects (i.e. variance explained when allowing for effects of variable one selected). Evaluate its statistical significance and apply Bonferroni-type correction for simultaneous multiple tests,

namely 1 = /t where t =number of tests.

For = 0.05 t = 1, 1 = 0.05

t = 2, 1 = 0.025

t = 3. 1 = 0.0166

t = 4, 1 = 0.0125

With 999 permutations (i.e. p of 0.001 can be evaluated), becomes very slow. Required if you are to properly evaluate the Monte Carlo permutation probabilities.

These tests do not control for overall Type I error. In practical terms this means that too many variables will be judged ‘significant’.

Alternatively, can stop when the increase in fit when including a variable is less than 1.0% (EXTRA FIT).

MINIMAL ADEQUATE MODEL IN CCA FULL MODEL. Consider sum of canonical eigenvalues (amount of explained variance), eigenvalues and species-environmental correlations.

13 environmental variables

3 environmental variables

J. Oksanen (2002)

OTHER PROBLEMS FULL MODEL. Consider sum of canonical eigenvalues (amount of explained variance), eigenvalues and species-environmental correlations.

1) Selection of categorical variables coded as dummy variables. Suppose there are 5 bedrock types but only ‘granite’ is selected by forward selection. Should you select the other variables as well? If you consider the different bedrock types to be independent, the answer is NO. If you consider there to be one categorical variable (bedrock) with five states, the answer is YES.

2) Last two remaining variables within a category will always have identical fit because they contain identical information (if it is not z then it must be y). Does not matter which you choose. Select the commoner category.

3) No guarantee that forward selection (or any other stepwise procedure) will result in ‘best’ set of variables. Only way is perform constrained ordinations for every conceivable combination of variables. Currently impossible with current technology.

4) Accept that minimal adequate model is one possible solution only.

5) For exploratory, descriptive studies, do not be reluctant to use a priori ecological knowledge.

VARIANCE INFLATION FACTORS (VIF) FULL MODEL. Consider sum of canonical eigenvalues (amount of explained variance), eigenvalues and species-environmental correlations.

Variance of estimated regression (= canonical) coefficients (cj) are proportional to their VIF.

number of predictors

number of samples

VIF is related to the (partial) multiple correlation coefficient Rj between variable j and the other environmental variables.

Not unique, e.g. pH and Ca (and other variables).

VIF VIF

pH 123.8 6.4

Ca 2.6 –

Mg 8.1 29.3

If VIF > 20, that variable is almost perfectly correlated with other variables and has no unique contribution to the regression equation. Regression (= canonical) coefficient unstable, not worth considering.

Useful for finding minimal set of variables.

'AIC' FOR MODEL SELECTION IN CCA AND RDA FULL MODEL. Consider sum of canonical eigenvalues (amount of explained variance), eigenvalues and species-environmental correlations.

Jari Oksanen (2004) VEGAN 1.7-6 R deviance.cca deviance.rda

Find statistics in CCA and RDA that resemble deviance and assess an AIC-like statistic as in regression model building.

Deviance of CCA = chi-square of the residual data matrix after fitting the constraints.

Deviance of RDA = average residual variance per species.

Can be used to help select between possible models in CCA or RDA.

AIC - index of fit that takes account of the parsimony of the model by penalising for the number of parameters.

smaller the values, better the fit.

here equals the residual deviance + 2x number of regression (canonical) coefficients fitted.

STAGES IN 'AIC' MODEL SELECTION IN CCA AND RDA FULL MODEL. Consider sum of canonical eigenvalues (amount of explained variance), eigenvalues and species-environmental correlations.

- Define a null model into which variables are sequentially added in order of their statistical importance. Null model is unconstrained PCA or CA.
- Now do stepping by either a forward selection of a backward elimination of the predictor variables. Need to define an upper and lower scope for the stepping to occur within.
- Forward selection – lower scope = null model (no predictors)
- - upper scope = full model (all predictors included)
- Backward elimination – lower scope = full model
- - upper scope = null model

- At each step, the effect of adding or deleting a variable is evaluated in terms of the AIC criterion. Low AIC values are to be preferred.
- If a lower AIC can be achieved by adding or deleting a variable at a stage, then this predictor variable is added/deleted.
- Useful to use both backward elimination and forward selection at each step. Start with full model, eliminate first variable, then the next, try to add either variable back into the model, and so on.
- After the final model is derived (lowest AIC), can test this model to see if the effects of the constraining predictor variables are statistically significant. Use Monte Carlo permutation test under the reduced model.

'AIC' MODEL SELECTION evaluated in terms of the AIC criterion. Low AIC values are to be preferred.

Godínez-Domínguez & Freire 2003 Marine Ecology Progress Series 253, 17-24

Rather than a statistical test of one null hypothesis, AIC provides a methodology for selecting an a priori set of alternative hypotheses.

- Definition of set of a priori models
- Statistical fit of models to data (e.g. CCA)
- Selection of 'best' model – Akaike Information Criterion (AIC)
- AIC =
- where k = number of free parameters in the model
- = model maximum likelihood

From estimated residual sum of squares (RSS) in CCA evaluated in terms of the AIC criterion. Low AIC values are to be preferred.

where h =number of predictor variables in model,

where log = loge

n = sample size, and

= RSS/n

To avoid bias in AIC due to links between sample size and number of parameters, corrected AIC is

As in GLM, interested in differences in AIC between models

i = AICci – min AICc

Data – 5 cruises (DEM-1 – DEM-5) number of parameters, corrected AIC is

- 8 models

Godinez-Dominguez & Freire, 2003

CCA permutation tests 40 models number of parameters, corrected AIC is

27 p < 0.05 (global test) 20 p < 0.05 (first CCA axis)

AICc approach to find most parsimonious model

Can determine not only the 'best' model but rank the different underlying hypotheses according to AIC criteria of parsimony. Spatial models 2 and 5, namely depth stratification but no difference between sheltered and exposed stations, are most appropriate for these data.

REF different underlying hypotheses according to AIC criteria of parsimony. Spatial models 2 and 5, namely depth stratification but no difference between sheltered and exposed stations, are most appropriate for these data.

REF

CANONICAL CORRELATION ANALYSIS – CANCORStandard linear technique for relating two sets of variables.

Similar to RDA – assumes linear response model.

Selects canonical coefficients for species and environmental variables to MAXIMISE species – environmental correlation canonical correlation

RDA species scores are simply weighted sums of site scores

CANCORspecies scores are b parameters estimated by multiple regression of site scores on species variables

number of species << number of sites

In fact number of species + number of environmental variables must be smaller than number of sites

i.e. m must be < n – q

CANCOR biplot

Differs from RDA also in error component.

van der Meer (1991) J. Expl. Mar. Biol. Ecol. 148, 105–120

REF

REF different underlying hypotheses according to AIC criteria of parsimony. Spatial models 2 and 5, namely depth stratification but no difference between sheltered and exposed stations, are most appropriate for these data.

REF

RDA uncorrelated independent errors with equal variances (least-squares technique).

CANCOR correlated normal errors (maximum likelihood technique). Is in realty, a GLM.

residual correlations between errors are additional parameters in CANCOR. Many species. Cannot estimate them reliably from data from few sites.

Generalised variance minimised in CANCOR = product of eigenvalues of matrix ‘volume’ of hyperellipsoid.

Total variance minimised in RDA = sum of diagonal elements = sum of eigenvalues.

Linear transformation Non-linear transformation Linear transformation

of species data of species data of environmental data

CA, PCA affects results no effect

CCA, RDA affects results no effect

CANCOR no effect no effect

REF

REF

Not significant different underlying hypotheses according to AIC criteria of parsimony. Spatial models 2 and 5, namely depth stratification but no difference between sheltered and exposed stations, are most appropriate for these data.

Can corr 0.88 0.75 0.41 Small sample size

COMPARISON WITH CANONICAL CORRELATION ANALYSISMcKecknie et al. (1975) Genetics 81, 571–594

Genetic variability in 21 colonies of butterfly Euphydryas editha in relation to 11 environmental variables in California and Oregon.

Gene frequencies of phosphoglucose-isomerase (Pgi) determined by electrophoresis.

What are relations between Pgi frequencies and environment?

Canonical correlation analysis

Leaving aside significance, first CC contrast between percentage of 0.4 mobility genes and other genes and precipitation and low max temperatures.

i.e. 0.4 mobility gene lacking in colonies from areas of high precipitation and low max temperatures.

Frequency of 1.0 mobility genes high in colonies at high altitudes and high precipitation and low temperatures.

Environmental variables and phosphoglucose-isomerase Pg different underlying hypotheses according to AIC criteria of parsimony. Spatial models 2 and 5, namely depth stratification but no difference between sheltered and exposed stations, are most appropriate for these data.i gene frequencies for colonies of the butterfly Euphdryas editha in California and Oregon.

Data source: McKechnie et al. (1975). Environmental variables have been rounded to integers for simplicity. The original data were for 21 colonies. For the present example, five colonies with small samples for the estimation of gene frequencies have been excluded so as to make all of the estimates about equally reliable.

Colonies of Euphydryas editha in California and Oregon

Canonical correspondence analysis different underlying hypotheses according to AIC criteria of parsimony. Spatial models 2 and 5, namely depth stratification but no difference between sheltered and exposed stations, are most appropriate for these data.

1 = 0.16 2 = 0.07 Pgi

Pgi 0.4 0.6 0.8 opposite to latitude, i.e. southerly

1 2 3

Pgi 1.0 high max temp, high min temp

4

Pgi 1.16 high pptn

5

Pgm 1.4 ?

6

Ordination diagram based on canonical correspondence analysis of allele frequencies in the butterfly Euphdryas editha in the 21 colonies () with respect to 11 environmental variables (data from McKechnie et al. 1975). The alleles () from the three loci Pgm,Pgi and Hk, are numbered in order of increasing mobility class. Infrequent alleles are displayed by a dot. The environmental variables (arrows) are: altitude; latitude; annual precipitation (Annuprec), annual maximum and minimum temperature (Max-temp, Min-temp); highest and lowest temperature in posi-diapause (H-Posdia,L-Posdia), the adult phase (H-Adul, L-Adul) and the pre-diapause (H-predia, L-predia). The abbreviations of colony names follow Manly (1985). ( = 0 0.16, = 0.07, scaling = ½).

CONSTRAINED LINEAR ORDINATION (PCA FRAMEWORK) analysis of allele frequencies in the butterfly

- Canonical Correlation Analysis (CANCOR)
- Continuous environmental variables and vegetation
- Can be computed only if number of sites > number of species + number of env. vars +1

- Redundancy analysis (RDA)
- As CANCOR but assumes that error variance constant for all plant species
- Technically possible to estimate in vegetation data, unlike CANCOR

- Canonical Variates Analysis (CVA) or Discriminant Analysis – see lecture 9
- Predict class membership using continuous variables
- For instance, pre-determined vegetation type using vegetation data
- LC score shows the centroids, Weighted sum scores show the dispersion and overlap

DISTANCE-BASED REDUNDANCY ANALYSIS analysis of allele frequencies in the butterfly

DISTPCOAPierre Legendre & Marti Anderson (1999) Ecol. Monogr. 69, 1-24.

RDA but with any distance coefficient

RDA - Euclidean distance Absolute abundances Quantity dominated

CCA - chi-square metric Relative abundances Shape/composition dominated

Does it matter?

Total biomass or cover and species composition

Varying e.g. ridge snow bed gradient

Other dissimilarities

Bray & Curtis non-Euclidean semi-metric

Jaccard +/- non-Euclidean semi-metric

Gower mixed data non-Euclidean semi-metric

Basic idea

Reduce sample x sample DC matrix (any DC) to principal co-ordinates (principal co-ordinates analysis, classical scaling, metric scaling – Torgerson, Gower) but with correction for negative eigenvalues to preserve distances.

PCoA – embeds the Euclidean part of DC matrix, rest are negative eigenvalues for which no real axes exist. These correspond to variation in distance matrix, which cannot be represented in Euclidean space. If only use positive eigenvalues, RDA gives a biased estimate of the fraction of variance in original data.

Correction for negative eigenvalues analysis of allele frequencies in the butterfly

where c1 is equal to absolute value of largest negative eigenvalue of matrix used in PCoA 1

D

1

Use all principal co-ordinate sample scores (n - 1 or m, whichever is less) as RESPONSE (species) data in RDA. Use dummy variables for experimental design as predictors in X in RDA.

Now under framework of RDA and battery of permutation tests, can analyse structured experiments but WHOLE ASSEMBLAGE (cf. MANOVA but where m >N).

Now can test null hypothesis (as in MANOVA) that assemblages from different treatments are no more different than would be expected due to random chance at a given level of probability. BUT unlike non-parametric tests (ANOSIM, Mantel tests), can test for interactions between factors in multivariate data but using any DC (not only Euclidean as in ANOVA / MANOVA). Using permutation tests means we do not have to worry about multivariate normality or homogeneity of covariance matrices within groups, or abundance of zero values as in ecological data.

DISTPCoA www.umontreal.ca

Raw data analysis of allele frequencies in the butterfly

(replicates x species)

Distance matrix

(Bray-Curtis, etc)

Principal coordinate analysis

(PCoA)

Correction for

negative eigenvalues

Matrix Y

(replicates x

principal coordinates)

Matrix X

(dummy variables

for the factor)

Test of one factor

in a single-factor model

Redundancy analysis (RDA)

F# statistic

Test of F# by permutation

Matrix X

(dummy variables

for the interaction)

Matrix XC

(dummy variables

for the main effects)

Matrix Y

(replicates x

principal coordinates)

Test of interaction term

in multifactorial model

Test of F# by permutation

under the full model

Partial redundancy analysis

(partial RDA) F# statistic

Univariate ANOVA Multivariate RDA statistic analysis of allele frequencies in the butterfly

Total sum of squares sum of all eigenvalues of Y

Treatment sum of squares = SSTr trace = sum of all canonical eigenvalues of Y on X

Treatment degrees of freedom = dfTr q

Residual sum of squares = SSRes rss = sum of all eigenvalues – trace

Residual degrees of freedom = dfRes nT – q – 1

Treatment mean square = SStr/dfTr = MSTr trace/q

Residual mean square SSRes/dfRes = MSRes rss/(nT – q - 1)

REF

REF

Correspondence between the various components of the univariate F-statistics and the multivariate RDA statistics in the one-factor case.

Tr = treatment, q = number of linearly independent dummy variables, nT = number of replicates

REF

REF

random error analysis of allele frequencies in the butterfly

responses

predictors

covariables

Placing non-metric distances into Euclidean space first, then use ANOVA/MANOVA within RDA with permutation tests-.

Builds on ANOVA as form of multiple regression with orthogonal dummy variables as predictors.

MATCH between ANOVA statistics and RDA statistics.

PERMUTATION TESTS in RDA (also CCA) in CANOCO.

What is shuffled?

Y = Z B + X C + E

B & C - unknown but fixed regression coefficients

(Note Z = covariables and X = predictors here)

- To test analysis of allele frequencies in the butterflyH0 C = 0 (i.e. the effect of X on Y)
- 1. Permute rows of Y
- 2. Permute rows of X (env. data) CANOCO 2
- 3. Permute residuals Erof regression Y on Z (covariables)
- REDUCED MODEL OR NULL MODEL CANOCO 3 & 4
- 4. Permute residuals Ef of regression Y on Z and X (covariables and predictors)
- FULL MODEL CANOCO 3 & 4
- 1 & 2 DESIGN-BASED PERMUTATIONS
- 1 Wrong type I error, low power
- 2 OK but no basis for testing interaction effects

- 3 & 4 MODEL-BASED PERMUTATIONS
- 3. Permute residuals of Y on Z (covariables) Default in CANOCO 3 & 4
- Reduced model – maintains type I error in small data sets. Without covariables, gives exact Monte Carlo significance level. Retains structure in X and Z.
- 4. Permute residuals of Y on X and Z. Full model. Gives lower type II error, but only slightly so.

- (If no covariables Y = XC + E, does not matter if samples in Y or X are permuted. CANOCO permutes X)

In analysis of allele frequencies in the butterflyDISTPCOA, do RDA with Y as principal co-ordinates scores, X defines dummy variables to code for interaction terms, and Z defines dummy variables for main effects (covariables) if interested in interactions. Can determine components of variation attributable to individual factors and interaction terms as in a linear model for multivariate data BUT using any DC that integrates both quantities and composition.

Can test the significance of individual terms and interaction terms for any complex multi-factorial experimental design. Cannot be applied to unbalanced data. If unbalanced because of missing or lost values, use missing data replacements (if other replicates).

Shares characteristics with: analysis of allele frequencies in the butterfly

MAN-RDAANO- MAN-

OVASIM TEL

* *

**

**

** *

*

**

Distance-based RDA offers special advantages to ecological researchers not shared by any other single multivariate method. These are:

1 The researcher has the flexibility to choose an appropriate dissimilarity measure, including those with semi-metric qualities, such as the Bray-Curtis measure

2 PCoA puts the information on dissimilarities among the replicates into a Euclidean framework which can then be assessed using linear models

3 A correction for negative eigenvalues in the PCoA, if needed, can be done such that probabilities obtained by a permutation test using the RDA F# -statistic are unaffected (correction method 1)

4 By using the multiple regression approach to analysis of variance, with dummy variables coding for the experimental design, RDA can be used to determine the components of variation attributable to individual factors and interaction terms in a linear model for multivariate data

5 Multivariate test statistics for any term on a linear model can be calculated, with regard to analogous univariate expected mean squares

6 Statistical tests of multivariate hypothesis using RDA statistics are based on permutations, meaning that there is no assumption of multinormality of response variables in the analysis. Also, there are no restrictions to the number of variables that can be included in RDA

7 Permutations of residuals using the method of ter Braak (1992) allows the permutation test to be structured precisely to the hypothesis and the full linear model of the design under consideration

8 The significance of multivariate interaction terms can be tested

DISTANCE-BASED MULTIVARIATE ANALYSIS FOR A LINEAR MODEL analysis of allele frequencies in the butterfly

McArdle, B.H. & Anderson, M.J. (2001) Ecology 82; 290-297

DISTLM, DISTLMforward - www.stat.auckland.ac.nz/~mja

DISTLM - multivariate multiple regression of any symmetric distance matrix with or without forward selection of individual predictors or sets of predictors and associated permutation tests.

Y response variables (n x m)

X predictor variables (n x q) (1/0 or continuous variables)

Performs a non-parametric test of the multivariate null hypothesis of no relationship between Y and X on the basis of any distance measure of choice, using permutations of the observations. X may contain the codes of an ANOVA model (design matrix) or it may contain one or more predictor variables (e.g., environmental variable) of interest.

Like Legendre and Anderson's (1999) distance-based redundancy analysis but with no correction for negative eigenvalues. Shown theoretically that partitioning the variability in X according to a design matrix or model can be achieved directly from the distance matrix itself, even if the distance measure is semi-metric (e.g., Bray-Curtis distance).

CANONICAL ANALYSIS OF PRINCIPAL CO-ORDINATES analysis of allele frequencies in the butterfly

Anderson, M.J. & Willis, T.J. (2003) Ecology 84, 511-525

CAP – www.stat.auckland.ac.nz/~mja

CAP - canonical analysis of principal co-ordinates based on any symmetric distance matrix including permutation tests.

Y response variables (n x m)

X predictor variables (n x q) (1/0 or continuous variables)

Performs canonical analysis of effects of X on Y on the basis of any distance measure of choice and uses permutations of the observations to assess statistical significance.

If X contains 1/0 coding of an ANOVA model (design matrix), result is a generalised discriminant analysis. If X contains one or more quantitative predictor variables, result is a generalised canonical correlation analysis.

Output analysis of allele frequencies in the butterfly

- Eigenvalues and eigenvectors from the PCOORD. Can use latter to plot an indirect ordination of data.
- Canonical correlations and squared canonical correlations.
- Canonical axis scores.
- Correlations of original variables (Y) with canonical axes.
- Diagnostics to help determine appropriate value for Qt, number of eigenvectors. Select the lowest misclassification error (in the case of groups) or the minimum residual sum of squares (in the case of quantitative variables in X). Also Qt must not exceed m or n and is chosen so that the proportion of variance explained by the first Qt axes is more that 60% and less than 100% of the total variation in the original dissimilarity matrix.
- In the case of groups, table of results for 'leave-one-out' classification of individual observations to groups.
- Results of permutation test to test statistical significance of Qt axis model (trace and first eigenvalue).
- Scores to construct constrained ordination diagram to compare with unconstrained ordination diagram.

Very good at highlighting and testing for group differences (e.g. sampling times) as CAP finds axes that maximise separation between groups.

With quantitative predictors, CAP finds axes that maximise correlation with predictor variables.

'AIC' for model selection deviance-capscale Jari Oksanen VEGAN 1.7-6 R

Extensions by Jari Oksanen (capscale in Vegan R) analysis of allele frequencies in the butterfly

- Axes are weighted by their corresponding eigenvalues so that the ordination distances are best approximations of the original dissimilarities.
- Uses all axes with positive eigenvalues. Guarantees that the results are the best approximation of the original dissimilarities.
- Adds species scores as weighted sums of the (residual) species data.
- Negative eigenvalues are harmless and can be ignored. Often most sensible to use dissimilarity coefficients that do not have negative eigenvalues. Square-root transformation of the species data prior to calculating dissimilarities can drastically reduce the number of negative eigenvalues.

Note that CAP with Euclidean distance is identical to RDA in sample, species, and biplot scores (except for possible reversal of sign).

Possible uses of canonical analysis of principal co-ordinates

- As in CCA or RDA with biological and environmental data.
- Fit models to data with rare or unusual samples or species that may upset CCA.
- Analyse many environmental variables in relation to external (e.g. geographical, geological, topographical) constraints with Monte Carlo permutation tests. In other words, do a multivariate linear regression but not have to worry about the data meeting the assumptions of least-squares estimation and models.

Examples:

Willis & Anderson 2003 Marine Ecology Progress Series 257: 209-221 (cryptic reef fish assemblages)

Edgar et al. 2003 Journal of Biogeography31: 1107-1124 (shallow reef fish and invertebrate assemblages)

SUMMARY OF CONSTRAINED ORDINATION METHODS co-ordinates

Methods of constrained ordination relating response variables, Y (species abundance variables) with predictor variables, X (such as quantitative environmental variables or qualitative variables that identify factors or groups as in ANOVA).

^

^

- Finds axis of maximum correlation between co-ordinatesY and some linear combination of variables in X (i.e., multivariate regression of Y on X, followed by PCA on fitted values, Y).
- Same as RDA, but Y are transformed to Y* and weights (square roots of row sums) are used in multiple regression.
- Finds linear combination of variables in Y and X that are maximally correlated with one another.
- Finds axis that maximises differences among group locations. Same as CCorA when X contains group identifiers. Equivalent analysis is regression of X on Y, provided X contains orthogonal contrast vectors.
- Finds linear combination of axes in Qt and in X that are maximally correlated, or (if X contains group identifiers) finds axis in PCO space that maximises differences among group locations.

RDA

CCA

CCorA

CVA

CAP

^

CRITERION FOR DRAWING ORDINATION AXESPRINCIPAL RESPONSE CURVES (PRC) co-ordinates

van der Brink, P. & ter Braak, C.J.F. (1999) Environmental Toxicology & Chemistry 18, 138-148

van der Brink, P. & ter Braak, C.J.F. (1998) Aquatic Ecology 32, 163-178

PRC is a means of analysing repeated measurement designs and of testing and displaying optimal treatment effects that change across time.

Based on RDA (= reduced rank regression) that is adjusted for changes across time in the control treatment. Allows focus on time-dependent treatment effects. Plot resulting principal component against time in PRC diagram.

Developed in ecotoxicology; also used in repeated measures in experimental ecology and in descriptive ecology where spatial replication is substituted for temporal replication.

Highlights differences in measurement end-points betweeen treatments and the reference control.

Y co-ordinatesd(i)tk = Yotk + bk cdt + d(i)tk where

Yd(i)tk = abundance counts of taxonkat timetin replicateiof treatmentd

Yotk= mean abundance of taxonkin controls (o) at timet

cdt = principal response of treatment d at time t (PRC)

bk = weight of species k with respect to cdt

d(i)tk = error term with mean of zero and variance 2k

Modelling the abundance of particular species as a sum of three terms, mean abundance in control, a treatment effect, and an error term.

Data input - species data (often log transformed) for different treatments at different times

- predictor variables of dummy variables (1/0) to indicate all combinations of treatment and sampling time ('indicator variables')

- covariables of dummy variables to indicate sampling time

Do partial RDA with responses, predictors, and covariables and delete the predictor variables that represent the control. This ensures that the treatment effects are expressed as deviations from the control.

PRC MODELPRC MODEL (continued) co-ordinates

Simple example - three treatments: C = control, L = low dosage (not rep-licated), H = high dosage sampled at four times (W0, W1, W2, W3), six species.

PRC MODEL (continued) co-ordinates

* * * * deleted in the RDA

PRC PLOTS co-ordinates

One curve for each treatment expressed as deviation from the control. Species weights (bk) allow species interpretation. Higher the weight, more the actual species response is likely to follow the PRC pattern, because the response pattern = bk cdt. Taxa with high negative weight are inferred to show opposite pattern. Taxa with near zero weight show no response.

Significance of PRC can be tested by Monte Carlo permutation of the whole time series within each treatment.

Can use the second RDA axis to generate a second PRC diagram to rank 2 model.

PRC PLOTS (continued) co-ordinates

Principal response curves resulting from the analysis of the example data set, indicating the effects of the herbicide linuron on the phyto-plankton community. Of all variance, 47% could be attributed to sampling date, and is on the horizontal axis. Of all variance, 30% could be attributed to treatment. Of the variance explained by treatment, 23% is displayed on the vertical axis. The lines represent the course of the treatment levels in time. The species weight (bk) can be interpreted as the affinity of the taxon with the principal response curves.

See maximum deviation from control after 4 weeks, maximum effect larger for 150 g/l treatment than for 50 g/l treatment.

Chlamydomonas has high negative weight and this had highest abundances in high doses after treatment began.

PRINCIPAL RESPONSE CURVES AND ANALYSIS OF MONITORING DATA co-ordinates

PRC usually used with experimental data. Can be used with (bio)monitoring data.

Samples at several dates at several sites of a river, some upstream of a sewage treatment plant (STP) (300 m, 100 m), in the STP outlet, and some downstream (100 m, 1 km). 795 samples, 5 sites, 1994-2002.

PRC using sampling month as covariable, product of sampling month and site as explanatory variables. Used STP outlet as the reference site.

Van der Brink, P. et al. (2003) Austr. J. Ecotoxicology 9: 141-156

Principal Response Curves indicating the effects of the outlet of a sewage treatment plant on some monthly averages of physico-chemical characteristics of a river. Of all variance, 24% could be attributed to between-month variation; this is displayed on the horizontal axis. 57% of all variance could be allocated to between-site differences, the remaining 19% to within-month variation. Of the between-site variation, 58% is displayed on the vertical axis. The lines represent the course of the sites in time with respect to the outlet. The weight of the physico-chemical variable (bk) can be interpreted as the affinity of the variables with the Principal Response Curves (cdt).

See biggest differences for the two upstream sites, with lower NOx, total N, conductivity, salinity, total P, and temperature and higher values of turbidity and faecal coliforms. STP outlet leads to increases in N, P, temperature, etc. Downstream values decrease but are not as low as upstream sites. STP successfully reduces faecal coliforms as their values are higher in the upstream sites due to pollution.

PRINCIPAL RESPONSE CURVES – A SUMMARY lower NO

Filters out mean abundance patterns across time in the control. Focuses on deviation between treatment and control. PRC displays major patterns in those deviations and provides good summary of response curves of individual taxa.

PRC helps to highlight 'signal' from 'noise' in ecological data in replicated experimental studies.

Simplified RDA - simplified by representing the time trajectory for the controls as a horizontal line and taking the control as the reference to which other treatments are compared.

PRC gives simple representation of how treatment effects develop over time at the assemblage level.

ECOLOGICAL APPLICATIONS OF PRINCIPAL RESPONSE CURVES lower NO

Vandvik, V. 2004. J. Ecology 92: 86-96 – revegetation of gaps in replicated successional series 0, 10, and 40 years after abandonment.

Vandvik, V et al. 2005. J. Applied Ecology 42: 139-149 – post-fire succession in heathlands.

Heegaard, E. & Vandvik, V. 2004. Oecologia 139: 459-466 – space-for-time substitution to analyse compositional differences in local ridge-snowbed gradients in 100 m altitudinal bands from 1140 to 1550 m.

Makarenkov lower NO& Legendre (2002) Ecology 83, 1146-1161

Instead of using multiple linear regression to model the relationship between each response variable y in Y and the explanatory variables X, use polynomial regression

Y = b1x1 + b2x12 + b3x2 + b4x22 ... ... bpxp2

Aim is to develop a multivariate reduced-rank regression model that produces a noticeable increase in the amount of variation in Y accounted for by the model compared to standard linear RDA and CCA.

REF

REF

POLYNOMIAL RDA AND POLYNOMIAL CCAPOLYRDACCA

www.fas.umontreal.ca/biol/legendre

REF

REF lower NO

REF

RDA - can be viewed as a series of multiple linear regressions followed by an eigenvalue decomposition of the table of fitted values

CCA - approximate unimodal responses of species to environmental gradients through a chi-square transformation of the species data. Assumes linear relationships between Y and X.

Resulting fitted values are no longer a linear combination of the explanatory variables but a polynomial combination of variables,

e.g. b1x1 + b2x12 + b3x2 + b4x22 + b5x1x2 etc.

Tries to use polynomial relationships to model non-linear relationships only when these cannot be modelled well by simple linear models.

Need to reduce the number of predictor variables so as to avoid too many terms and 'overfitting'. Overfitting occurs if number of regression terms > n-1 where n = number of observations.

Polynomial algorithm proceeds by successively reducing the matrix of explanatory variables while increasing the R2 for the response variable by introducing polynomial terms.

REF

REF

REF lower NO

REF

Display of results

1. Plot individual terms by biplot arrows. Can easily get too many arrows. May only plot those with a correlation greater than some pre-specified value.

2. Represent each explanatory variable by a single arrow corresponding to the multiple correlation of x and x2 with the ordination axes.

Tests of significance

1. Test statistical significance of linear model by permutation tests as in CANOCO.

2. Test statistical significance of polynomial model by related permutation test.

3. Test if the difference in variance accounted for between the polynomial and the linear models is significant and hence if the simpler linear model is the minimal adequate model.

REF

REF

Polynomial RDA lower NO

REF

REF

Linear RDA

P = 0.001 (999 permutations)

Notes: Matrix Y: hunting spider species 1-12. Matrix X: water content, reflection of soil surface. Either set of biplot scores can be used to represent the environmental variables in biplots. Users of the program may also request the matrix of regression coefficients B of the multiple linear regressions of Y on X (if classical linear RDA or CCA is computed) or the polynomial coefficients for each response variable y of Y (if polynomial RDA or CCA is used). The program may also carry out permutation tests of the significance of the linear and polynomial models, as well as the significance of the difference in variance accounted for between the two models.

Significance of difference in explained variance p = 0.002 (999 permutations). Use the polynomial RDA model.

REF

REF

REF lower NO

REF

Linear RDA

Polynomial RDA

35.4%

53.7%

Full arrows = biplot scores of environmental variables in polynomial: Dashed arrows = biplot scores based on multiple correlations of (water, water2) and (reflection, relection2) with the axes.

REF

REF

CCA/RDA AS PREDICTIVE TOOLS lower NO

- Prediction is important challenge in environmental science.
- Given environmental shift, how will species respond?
- Given environmental data only (e.g. satellite image data), what biotic assemblages could be expected?

Conventional CCA/RDA – description and modelling

Ym and XmModelm where subscript m = modern

'Palaeo' CCA/RDA – modelling and reconstruction

Ym and XmModelm

Yo and Modelm Xo where subscript o = fossil or 'palaeo' data(Lecture 8 on Environmental Reconstruction)

Predictive CCA/RDA – modelling and prediction

Ym and XmModelm

Xfand Modelm Yfwhere subscript f = future (predicted) data

Gottfried lower NOet al. 1998. Arctic and Alpine Research 30: 207-211

Schrankogel (3497 m) Tyrol, eastern central Alps.

1000 1x1 m plots between 2830 and 3100 m, ecotonal transition between alpine zone (vegetation cover >50%) and nival zone (vegetation cover <10%).

Vegetation data - species +/- and relative abundance of 19 species

Environmental data – Digital Elevation Model (DEM) with pixel size of plots in GIS ARC/INFO

- gives 17 topographic descriptors at 10 resolutions plus altitude.

Gottfried lower NOet al. 1998

CCA with forward selection to give 37 predictor variables lower NO

Calculated CCA sample scores for 650,000 cells of DEM area as weighted linear combination of environmental variables times the canonical coefficients.

For each predicted environment of each cell, estimated which of the 1000 plots it is closest to CCA space.

Gottfried et al. 1999

Extrapolate vegetation data from those plots to the 650,000 cells to predict species distributions, vegetation types, species richness, etc.

To evaluate predictions, did 10-fold cross-validation, namely model with 90% of the plots, predict with left-out 10%, and repeat 10 times. Compare predictions with actual observed data. Also calculated Cohen's kappa statistic between observed and predicted distributions (0 = uncorrelated, 1 = perfect match).

Total inertia 1.79 Constrained inertia 0.68 38% explained by topography

Species fell into five groups of kappa and other performance values

Predicted distributions explained by topography

Gottfried et al. 1998

Predicted vegetation types explained by topography

Gottfried et al. 1998

Best predictors are topographic measures of roughness and curvature rather than simple elevation, slope, or exposure.

Modelled richness patterns decline with altitude but with a maximum richness at the alpine-nival ecotone.

What might happen under future climate warming of 1ºC or 2ºC?

Gottfried et al. 1999 Diversity and Distributions 5: 241-251.

Calculated altitudinal lapse rate using 33 temperature loggers.

Assume that the altitudinal limits are determined by temperature. Knowing the temperature lapse rate, predict species distributions for +1ºC and +2ºC temperature increases.

Done by increasing the values of the altitude variable in the environmental data for the sample plots corresponding to the lapse rate. Repeated the CCA/GIS interpolation/mapping.

Assumes that species growing at lower altitudes and hence warmer situations will occur in a future warmer climate in the same topographical conditions

Predicted distribution patterns at +0º, +1º and +2º

Gottfried et al. 1999

Predicted distribution patterns at +0 the environmental data for the sample plots corresponding to the lapse rate. Repeated the CCA/GIS interpolation/mapping.º, +1º and +2º

Gottfried et al. 1999

Predictions - 19 species modelled, about 2 will become extinct

will be a reduction in genetic diversity as some 'topographical forms' will be lost

Dirnböck et al. 2003 Applied Vegetation Science 6: 85-96.

Same approach but with topographic descriptors and infra-red spectral data, and 3 nearest neighbours to predict rather than 1.

Predictive mapping of 17 vegetation types between 1600 m and 2277 m on Hochschwab, eastern Alps.

Dirnböck extinctet al. 2003

69.4% accuracy, Cohen kappa of 0.64 extinct

Topography - good predictors of different alpine grasslands

Infra-red spectra - good predictors of different pioneer vegetation types

Unexplained variation - land-use history, soil variation especially nutrients like N, P, and K

CANONICAL CORRESPONDENCE ANALYSIS extinct

Builds on:

1) Weighted averaging of indicator species and extends WA to the simultaneous analysis of many species and many environmental variables.

2) Reciprocal averaging (= correspondence analysis) by adding the statistical methodology of regression. General framework of estimation and statistical testing of the effects of explanatory variables on biological communities.

- Major Uses: extinct
- Identify environmental gradients in ecological data-sets.
- In palaeoecology, used as a preliminary to determine what variables influence present-day community compositions well enough to warrant palaeoenvironmental reconstruction.
- Add 'fossil' samples into modern 'environmental' space.
- Study seasonal and spatial and temporal variation in communities and how this variation can be explained by environmental variation. Variance can be decomposed into seasonal, temporal, spatial, environmental and random components.
- Niche analysis – niche-space partitioning where species probability or abundance is unimodal function of environment.
- Impact studies.
- Predictive studies.
- Experimental data analysis.

Powerful alternative to multivariate analysis of variance MANOVA.

e.g. analysis of BACI (before-after-control-impact) studies with and without replication of the impacted site

e.g. repeated measurement designs

e.g. experimental plot (= block) designs

e.g. split-plot designs

Seeter Braak C.J.F. & Verdonschot P.F.M (1995) Aquatic Sciences 57, 255–289

Canonical correspondence analysis and related multivariate methods in aquatic ecology

NON-LINEAR CANONICAL ANALYSIS OF PRINCIPAL CO-ORDINATES MANOVA.

Millar, Anderson & Zunan 2005 Ecology 86: 2245-2251

All the methods discussed so far (RDA, CCA, Canonical correlation analysis, distance-based RDA, CAP, non-linear RDA or CCA) are intrinsically linear with respect to the environmental variables and are fitting a linear model to the distances of dissimilarities implicit in the particular method (e.g. Euclidean distances in RDA, chi-squared distance in CCA, any distance measure in distance-based RDA or CAP).

In some ecological situations, the relationship between community structure and environmental variables may be intrinsically NON-LINEAR.

e.g. community composition at different distances from a pollution source. At what point along the gradient does the impact become negligible? Environmental variable (distance from pollution source) has non-linear, exponential effect.

e.g. community change through time. After disturbance, succession occurs, with invasion and replacement of species with time. At what point in time does community composition stabilise?

Non-linear canonical analysis of principal co-ordinates (NCAP) of Y in relation to X

- Principal co-ordinates analysis of Y to obtain Q orthogonal principal co-ordinates using any distance measure.
- Non-linear canonical correlation analysis of Q in relation to X – to maximise correlation of Q with respect to a non-linear transformation of X
- Use non-linear link function (e.g. exponential) just as we do when we extend a traditional univariate linear model to a GLM through the use of a link function. Non-linear optimisation procedures as in GLM.
- Determine the smallest number of principal co-ordinates using BIC in the NCAP context
- where p = number of parameters, c = constant, R2 = coefficient of determination

- Test null hypothesis of no association between (NCAP) of Y and X or Q and X by randomisation tests of rows of X.
- Test if the non-linear gradient fitted is preferred to a linear gradient. Can view the non-linear model as the 'full' model and the linear model as the 'reduced' model. Use a pseudo-F statistic to test the null hypothesis of a linear gradient and derive its significance by permutation of rows of X.
- Determine the approximate 95% confidence intervals of the regression coefficients by bootstrapping.

R

Unlike non-linear canonical correlation analysis or non-linear polynomial RDA or CCA, no limit to the number of variables in Y as the analysis is based on a distance measure of choice.

No explicit assumptions about distributions in the biological data (e.g. counts, presence/absence) as randomisation tests and bootstrapping are used to test formally the statistical significance of the observed non-linear gradient.

Virtually any non-linear form of gradient can be used along with any reasonable distance measure.

Of considerable potential in the analysis of multivariate non-linear ecological systems.

CANONICAL GAUSSIAN ORDINATION non-linear polynomial RDA or CCA, no limit to the number of variables in Something New but a bit Heavy!

- CCA can be estimated in two ways
- weighted averaging estimation – heuristic, rapid, computationally simple, approximation to
- maximum likelihood (ML) estimation – 'ideal' but theoretically rigorous and computationally difficult

CANOCO implements the weighted averaging approach. ML canonical Gaussian ordination (CGO) not computationally possible until very recently.

Yee (2004) Ecological Monographs 74: 685-701 non-linear polynomial RDA or CCA, no limit to the number of variables in

Quadratic reduced-rank vector generalised linear models (QRR-VGLMs) as a way of implementing CGO.

Basis is RR-VGLMs where by reduced-rank regression multivariate regression (many responses and many predictors) is implemented in the framework of GLM with specified link functions, error distributions, etc.

QRR-VGLMs are simply RR-VGLMs but with the addition of a quadratic form to each linear predictor, so that bell-shaped responses can be modelled as functions of environmental variables or gradients.

VGLM package in R

Hunting spider data – 12 species, 28 sites non-linear polynomial RDA or CCA, no limit to the number of variables in

QRR-VGLM – assume equal or unequal species tolerances non-linear polynomial RDA or CCA, no limit to the number of variables in

QRR-VGLM results very similar to CCA results non-linear polynomial RDA or CCA, no limit to the number of variables in

- Advantages of canonical Gaussian ordination (CGO) non-linear polynomial RDA or CCA, no limit to the number of variables in
- CGO has clear statistical assumptions
- CGO provides estimates of maxima, optima, and tolerances of species

- 3. CGO avoids complications, heuristics, and statistical simplifications and inefficiencies implicit in weighted averaging and detrending.
- 4. CGO is built on firm statistical theory.
- CGO is more flexible than CCA.
- CCA makes four assumptions (equal tolerances, equal maxima, homogeneously distributed data, site scores homogeneously distributed over the gradients – assumptions 1-3 imply a species-packing model). These assumptions cannot simultaneously hold with real ecological data.
- CGO does not make any of these assumptions though the equal-tolerance assumption makes the ordination plot more easily interpretable.

6. Residual diagnostic plots are available. (In theory possible in CCA.)

- Disadvantages of CGO are: possible in CCA.)
- Statistical assumption of symmetric unimodal Gaussian responses may be unrealistic in practice – skewed or multimodal responses.
- Sensitive to outliers, sparse data, multicollinearity, high leverage points, as in other GLMs.
- The global log-likelihood function that is maximised may have several maxima, and convergence to a local solution can never be ruled out.
- Good initial starting values can be difficult to obtain, especially as the number of species and environmental variables increases.
- Difficult to establish statistically the rank R of the data.
- Numerically very intensive. CPU power continues to increase exponentially, so the size of data that can be handled will also increase.

- QRR-VGLM advantages: possible in CCA.)
- Basic framework is very broad, so error distributions such as binomial, negative binomial, and zero-inflated Poisson can be handled, along with compositional data. As Yee (2006) say "CGO operates on various types of species data such as presence/absence data and Poisson counts; CCA treats all types of data the same, which, to purists, is a bit like using a baseball bat to play golf, squash, and tennis."
- Can accommodate linear combinations of non-linear functions of explanatory variables. Can include factors and functions such as orthogonal polynomials and B-splines. Polynomial CCA is ad hoc and too limited.
- Any rank R can be fitted in theory.
- Approximate statistical significance of regression parameters can be tested.
- Statistical hypothesis testing in terms of deviance is possible.
- Overdispersion and underdispersion in the data can be detected. Not possible in CCA (Overdispersion - variance in data exceeds nominal variance under an assumed model: underdispersion is opposite).

- QRR-VGLM disadvantages possible in CCA.)
- 1. Requires large amounts of memory as large model matrices are constructed to perform the fitting.
- Specialist software needed – VGAM package in R.
- Convergence problems may occur, especially with 'dirty' real data.
- Much skill and statistical understanding are needed to use QRR-VGLMs.
- 'Exact' standard errors for all estimated parameters currently not possible.
- Currently computationally possible for rank 2 with 500 sites x 5 species x 5 predictors or 60 sites x 10 species x 10 predictors. Computational needs increase very rapidly with number of species and with the rank.

Important message, not mentioned by Yee (2004, 2006) is that the CCA solution is very similar to the CGO QRR-VGLM (and the CAO RR-VGAM) model results.

Reassuring for all CCA users!

Remarkable just how robust CCA is and how good weighted average estimation is.

Next step: the CCA solution is very similar to the CGO QRR-VGLM (and the CAO RR-VGAM) model results.

to move from GLM framework of specified response models to GAM framework with smooth data-driven functions

i.e. RR-VGAMs.

Yee (2006) Ecology 97: 203-213

CONSTRAINED ADDITIVE ORDINATION (CAO) the CCA solution is very similar to the CGO QRR-VGLM (and the CAO RR-VGAM) model results.

CAO, unlike CA, DCA, CCA, CGO, etc, does NOT assume any underlying species response model (e.g. unimodal, symmetric, etc).

Computes optimal gradients and flexible GAM-like response curves. Can see response curves as they really are in relation to the major gradients.

With one gradient, CAO is a generalisation of constrained quadratic (or Gaussian) ordination (CQO or CGO).

Replaces symmetric bell-shaped responses in CQO (=CGO) with completely flexible smooth curves estimated using smoothers.

CAO models are GAMs fitted to a very small number of latent variables.

Data-driven rather than model-driven, so CAO allows the data "to speak for themselves". No assumptions.

Can now think of ordination methods based on modern regression procedures as unconstrained or constrained (=canonical) and linear, quadratic, or smooth depending on assumed underlying responses.

VGAM package in R

Assumptions of CCA, CQO (=CGO), and CAO the CCA solution is very similar to the CGO QRR-VGLM (and the CAO RR-VGAM) model results.

Ordination (O) procedures based on modern regression procedures (Yee 2006)

VGLM = vector generalised linear model; VGAM = vector generalised additive model; RR = reduced rank

Yee (2006) proposes that ordination, prediction (estimating procedures (Yee 2006)y from x), and calibrating (estimating x from y) can all be performed from the same model.

Can, in theory, have

Ordination Prediction Calibration

CLO CLP CLC

CQO (= CGO) CQP CQC

CAO CAP CAC

Reduced-rank vector-based generalised additive models (RR-VGLM)

Approximates each surface in R-dimensional latent-variable space by an additive model.

Interpretable and avoids the 'curse of dimensionality' when R becomes large. Splines or LOESS smoothers are unusable if R is large and are uninterpretable if R > 2.

Technical problems arise in how much flexibility to allow in the GAM smoother, the effective non-linear degrees of freedom.

Smooth curve with zero non-linear degrees of freedom is linear, so CAO = CLO.

Values between 1.5 and 2.5 non-linear degrees of freedom usually necessary.

Hunting spider data: 12 species 28 sites 6 environmental variables

Each species has three non-linear degrees of freedom in rank-1 CAO model

Clear unimodal response curves

Similar to De'ath's (1999) principal curves for the same data

Yee (2006)

Yee (2006) environmental variables

CAO model. Very similar to CQO (and CCA) results

CQO (= CGO) preferred to CAO as the final model as it is simpler and parameters such as species tolerances are well defined (as in GLM compared to GAM).

CAO best used as an exploratory tool and to help CQO work better.

RR-VGLMs more powerful than ordinary GAMs because they search for optimal latent variables before applying the additive model.

GAMs are a special case of RR-VGAMs because GAMs smooth one environmental variable at a time whereas each RR-VGAM smooth is on a composite of the environmental variables after searching for the optimal combination or weighting.

At present, software only handles rank-1 RR-VGAMs.

Cannot handle interactions in X.

Are "fragile with dirty data" (Yee 2006).

SOFTWARE FOR CONSTRAINED ORDINATIONS search for optimal latent variables before applying the additive model.

CANOCO + CANODRAW

[CANCOR, CAP]

canonical

correlation analysis

constrained principal

co-ordinates analysis

DISTPCOA

distance-based redundancy analysis via principal co-ordinates analysis

POLYRDACCA

polynomial RDA and CCA

R(VEGAN) (CCA, RDA)

R (Non-linear CAP)

R(VGLM) (CGO)

R(VGAM) CAO)

CANODRAW 4 search for optimal latent variables before applying the additive model.

Pie symbols plot

CANODRAW 4 search for optimal latent variables before applying the additive model.

CANODRAW 4 search for optimal latent variables before applying the additive model.

Response curves fitted using GAM

Sample diagram with principal response curves

T-value biplot

Isolines in RDA ordination diagram

Biplot with environmental variables & sites

Attribute plot

Thomas Yee search for optimal latent variables before applying the additive model.

Mark Hill

Cajo ter Braak

Marti Anderson

Petr Šmilauer

Download Presentation

Connecting to Server..