Multivariate Early Warning Signals

Published in Chaos (AIP Publishing), 2019. Read the paper.

Authors: J. Prettyman, T. Kuna, V. Livina

Summary

Real-world dynamical systems rarely involve just one variable. Climate involves temperature, pressure, humidity, and countless other factors. This paper extends early warning signal (EWS) techniques from one-dimensional time series to multivariate and spatially distributed data.

The key contributions are: (1) an analytical justification for using Empirical Orthogonal Functions (EOF) for dimension reduction in EWS contexts, (2) extension of EWS techniques to 2D spatial fields, and (3) development of astochastic model of a moving cyclone to validate these methods.

The Challenge of Multidimensional Data

Standard EWS indicators (variance, autocorrelation, scaling exponents) are designed for univariate time series. When we have multiple variables or spatially distributed measurements, we need strategies to either:

  • Reduce dimensionality to apply 1D techniques to a derived signal
  • Extend the indicators to work directly with multivariate data
  • Analyse spatial patterns across multiple measurement locations

Empirical Orthogonal Functions (EOF)

The EOF method (also known as Principal Component Analysis) projects multidimensional data onto a new basis that maximises variance. The first EOF captures the direction of maximum variability in the system.

A natural question arises: Does the component with maximum variance also capture the early warning signal? After all, what matters for EWS detection is not variance itself, but the change in variance (or autocorrelation) as the system approaches a tipping point.

Theoretical Justification

I proved analytically that for a general linear dynamical system approaching bifurcation, the first EOF loading vector tends to align with the eigenvector corresponding to the critical mode — exactly where the EWS will be observed.

Consider a discrete dynamical system:

xn+1=Bxn+Sηn\mathbf{x}_{n+1} = B \cdot \mathbf{x}_n + S \cdot \boldsymbol{\eta}_n

where B is a contracting matrix with eigenvalue λ₁ approaching 1 (the bifurcation point). The covariance matrix of the system state is:

E[C]=j=0BjSST(BT)j\mathbb{E}[C] = \sum_{j=0}^{\infty} B^j \cdot S S^T \cdot (B^T)^j

As λ₁ → 1, the term (1 - λ₁²)⁻¹ dominates, and the principal eigenvector of E[C] aligns with the first eigenvector of B — precisely the direction where the bifurcation will occur.

EOF_sliding.m - Dimension Reduction
function eof_ts = EOF_sliding(data, windowSize)
%% Project multivariate data onto principal component

    [n, dim] = size(data);
    eof_ts = zeros(n, 1);

    for i = (windowSize + 1):n
        window = data((i - windowSize):i, :);

        % Compute covariance matrix
        C = cov(window);

        % Find eigenvector with largest eigenvalue
        [V, D] = eig(C);
        [~, idx] = max(diag(D));

        % Project current point onto EOF
        eof_ts(i) = data(i, :) * V(:, idx);
    end
end

The Williamson Method: Direct Jacobian Estimation

An alternative approach directly estimates the Jacobian eigenvalues from multivariate time series data. This method, introduced by Williamson et al., extends the 1D autocorrelation concept to multiple dimensions.

The matrix A is computed as a higher-dimensional analogue of the lag-1 autocorrelation:

A=t(xt+1xtT)xˉ2t(xtxtT)xˉ2A = \frac{\sum_t (\mathbf{x}_{t+1} \cdot \mathbf{x}_t^T) - \bar{\mathbf{x}}^2}{\sum_t (\mathbf{x}_t \cdot \mathbf{x}_t^T) - \bar{\mathbf{x}}^2}

The eigenvalues of A relate to the Jacobian eigenvalues via:

Re(λk)=1Δtlnak,Im(λk)=1Δtφk\text{Re}(\lambda_k) = \frac{1}{\Delta t} \ln|a_k|, \quad \text{Im}(\lambda_k) = \frac{1}{\Delta t} \varphi_k

As the system approaches a bifurcation, the real part of the leading Jacobian eigenvalue crosses from negative to positive, providing a direct indicator of the approaching instability.

A Hopf bifurcation in the Van der Pol oscillator. The stable equilibrium becomes unstable and gives birth to a limit cycle as the control parameter crosses zero.
A Hopf bifurcation in the Van der Pol oscillator. The stable equilibrium becomes unstable and gives birth to a limit cycle as the control parameter crosses zero.

Application to Tropical Cyclone Data

Both methods were tested on sea-level pressure (SLP) and wind speed (WS) datafrom weather stations near tropical cyclone landfalls. The multivariate approach combines information from both variables.

Sea-level pressure time series from multiple weather stations in a region during a hurricane event.
Sea-level pressure time series from multiple weather stations in a region during a hurricane event.

Results

Applying the ACF1 indicator to the first EOF score of combined SLP and WS data produced an EWS intermediate between the individual variables — better than SLP alone (which showed no signal) but not as strong as WS alone. The PS indicator on EOF data performed similarly to PS on SLP alone.

Data SourceACF1 TrendPS Trend
Sea-level pressure-0.20.79
Wind speed0.910.70
EOF (combined)0.450.72

Mann-Kendall coefficients measuring indicator trend in the 30-hour window before the cyclone event.

Spatial Analysis: Heat Maps Over Geographic Regions

For spatially distributed data, I developed a method to visualise EWS indicators across a geographic region. By calculating the PS indicator at each weather station and measuring its trend (using the Mann-Kendall coefficient), we can create contour maps showing where warning signals are strongest.

Hurricanes Analysed for Spatial Patterns:

Andrew (Florida & Louisiana), Katrina, Wilma, Gustav, Matthew, Harvey, Irma, Nate

The resulting contour maps consistently showed higher indicator values (stronger EWS) in the direction from which the hurricane approached — essentially revealing the hurricane's path as a "wave" of increasing indicator values.

Stochastic Hurricane Model

To validate these methods, I developed a novel stochastic model of an approaching cyclone. The model combines the Holland pressure profile with time-varying noise that mimics the critical slowing down observed in real data.

The Holland model describes the pressure profile of a hurricane as:

p(r)=pc+(pnpc)exp(ArB)p(r) = p_c + (p_n - p_c) \cdot \exp\left(-\frac{A}{r^B}\right)

I modified this to model pressure at a fixed point as the cyclone approaches:

p(d(t))=pc+(pn(t)pc)exp(Ad(t)B)+ηtp(d(t)) = p_c + (p_n(t) - p_c) \cdot \exp\left(-\frac{A}{d(t)^B}\right) + \eta_t

The noise term η_t has an increasing power spectrum exponent as the cyclone approaches, parameterised to match the indicator behaviour observed in real data.

Moving Cyclone Model
function p = cyclone_model(t, d, pc, pn, A, B, alpha)
%% CYCLONE_MODEL - Pressure at distance d from cyclone center
%
% Inputs:
%   t     - time vector
%   d     - distance to cyclone center as function of time
%   pc    - central pressure (e.g., 950 mbar)
%   pn    - ambient pressure function (includes tidal oscillation)
%   A, B  - Holland model parameters
%   alpha - PS exponent (increases as cyclone approaches)

% Ambient pressure with 12-hour tidal oscillation
K = rand() * 12;  % random phase offset
pn_t = 1016 + 5*randn() + 1.6*sin(2*pi*t/12 + K);

% Generate coloured noise with increasing alpha
noise = generate_coloured_noise(length(t), alpha);

% Holland pressure profile
p = pc + (pn_t - pc) .* exp(-A ./ d.^B) + noise;
end

Running the model on a 10×10 spatial grid and computing the PS indicator at each point reproduced the spatial patterns observed in real hurricane data, validating our understanding of the statistics.

Conclusions

Key Contributions

  • Analytical justification for EOF dimension reduction in EWS contexts
  • Demonstrated that EOF projections capture the critical mode of bifurcating systems
  • Extended EWS methods to 2D spatial fields via contour mapping
  • Developed a novel stochastic hurricane model for method validation
  • Applied multivariate techniques to real tropical cyclone data
  • Showed spatial patterns reveal hurricane approach direction

This work provides a foundation for applying EWS techniques to the rich, multidimensional datasets available from modern climate monitoring systems. The methods can be applied to any tipping-point phenomenon where high-resolution spatial data is available.

Citation: Prettyman, J., Kuna, T., & Livina, V. (2019). Generalised early warning signals in multivariate and gridded data with an application to tropical cyclones.Chaos, 29(7), 073105.