6
Limits of Observability in Large-Scale Linear Networked Clocks ? Elma O’Sullivan-Greene * Iven Mareels * * Department of Electrical and Electronic Engineering, The University of Melbourne, Victoria, Australia (e-mail:[email protected]) Abstract: Large-scale networks of undamped coupled oscillators represent both modern engineered systems and systems from the biological world. The neural network of the brain is a particular example of motivating interest. The degree to which tracking, predicting and controlling dynamics in such networks will be successful is conditional on observability. Observability is considered using large-scale networked clocks, a linearisation of networked oscillators, through the structure of the observability matrix using Vandermonde matrices. Observability is found to be particularly poor for these undamped networked clocks. This raises interesting challenges to elucidate sufficient information from these networks for therapeutic benefit in medical bionics. Keywords: Network Observability, Biomedical Systems, Neural Dynamics, Brain Models, Large-scale Systems 1. INTRODUCTION Coupled oscillators networks are fascinating both in the phenomenon they exhibit and in the diversity of real- world examples they model. Phenomenon include self- synchronisation, that is the ability of coupled oscillators to merge into collective behaviour without the need for a conductor or driving node in the network. Coupled oscillator networks can model many engineered distributed systems that exhibit self-organising behaviour through synchronisation from modern telecommunications (Pre- hofer and Bettstetter (2005)) to future power systems (Butler (2007); Rohden et al. (2012)). The natural world is also replete with examples, from synchronously flashing fireflies to the neural networks of brain tissue (Strogatz and Stewart (1993)). Observability of these oscillatory networks has motivations in the need to extract information from such systems, both human-engineered and biological, to predict, track and control their dynamics. Networked clocks, as investigated in this paper, are the linearised counterpart to networks of coupled non-linear oscillators. An initial insight into oscillator network observability is considered using linear approaches. Existing work in network observability, from early work in Wu and Monticelli (1985) and Monticelli and Wu (1985) to more recent advancements in Liu et al. (2013), seeks to exploit redundancies in connection pathways so that all states are reachable, through network pathways, from a subset of states that directly influence the the system output. By contrast, in this paper we explore a network with fully connected graph. There is an absence of any connection redundancies by construction, since each state is connected through network pathways to every ? This research was supported by The University of Melbourne’s Early Career Academic Fellowship Scheme. other state. This provides a network that is theoretically observable by measuring from a single state (any single state), however, severe practical challenges to observability are found for these networks. This paper presents a coupled oscillator model in Section 2. A structural analysis of the observability matrix for the network using Vandermonde matrices is considered analytically, under the extreme condition of maximally separated clock frequencies, in Section 3. An analysis of the broader range of possible observability outcomes, for clock frequencies drawn from (i) a uniform distribution and (ii) a Gaussian distribution, is provided through simulation in Section 4, followed by conclusions in Section 5. 2. NETWORK CLOCK MODEL Inspired by the neural networks of the brain, we use a generic and scalable network clock model based on coupled second order pendula. Wright et al. (1985) devised a simi- lar coupled oscillator model in 1985 to model state changes in brain activity as measured by EEG (Electroencephalog- raphy), that is, electrical recordings from the brain. Fur- ther background on EEG recordings can be found in Ch. 2 of Varsavsky et al. (2010) and in Niedermeyer and Lopes Da Silva (2005). As a generic synthetic model which neglects the complexities of biologically realistic neuron- dynamics, this is not a model which can tell us anything about the nature of brain function. This approach is rather suited instead to the specific task of investigating what underlying information one may expect to recover from an observation comprised of a linear map of the state. Vari- ations of this model were also used towards preliminary analysis on the brain observation problem (O’Sullivan- Greene et al. (2009a,b); OSullivan-Greene et al. (2011)). Each individual oscillator is modelled as a linearised un- damped pendulum clock, Proceedings of the 19th World Congress The International Federation of Automatic Control Cape Town, South Africa. August 24-29, 2014 978-3-902823-62-5/2014 © IFAC 1164

Observability issues in networked clocks with applications to epilepsy

Embed Size (px)

Citation preview

Limits of Observability in Large-ScaleLinear Networked Clocks ?

Elma O’Sullivan-Greene ∗ Iven Mareels ∗

∗Department of Electrical and Electronic Engineering, The Universityof Melbourne, Victoria, Australia (e-mail:[email protected])

Abstract: Large-scale networks of undamped coupled oscillators represent both modernengineered systems and systems from the biological world. The neural network of the brainis a particular example of motivating interest. The degree to which tracking, predictingand controlling dynamics in such networks will be successful is conditional on observability.Observability is considered using large-scale networked clocks, a linearisation of networkedoscillators, through the structure of the observability matrix using Vandermonde matrices.Observability is found to be particularly poor for these undamped networked clocks. This raisesinteresting challenges to elucidate sufficient information from these networks for therapeuticbenefit in medical bionics.

Keywords: Network Observability, Biomedical Systems, Neural Dynamics, Brain Models,Large-scale Systems

1. INTRODUCTION

Coupled oscillators networks are fascinating both in thephenomenon they exhibit and in the diversity of real-world examples they model. Phenomenon include self-synchronisation, that is the ability of coupled oscillatorsto merge into collective behaviour without the need fora conductor or driving node in the network. Coupledoscillator networks can model many engineered distributedsystems that exhibit self-organising behaviour throughsynchronisation from modern telecommunications (Pre-hofer and Bettstetter (2005)) to future power systems(Butler (2007); Rohden et al. (2012)). The natural worldis also replete with examples, from synchronously flashingfireflies to the neural networks of brain tissue (Strogatzand Stewart (1993)).

Observability of these oscillatory networks has motivationsin the need to extract information from such systems, bothhuman-engineered and biological, to predict, track andcontrol their dynamics. Networked clocks, as investigatedin this paper, are the linearised counterpart to networksof coupled non-linear oscillators. An initial insight intooscillator network observability is considered using linearapproaches.

Existing work in network observability, from early workin Wu and Monticelli (1985) and Monticelli and Wu(1985) to more recent advancements in Liu et al. (2013),seeks to exploit redundancies in connection pathways sothat all states are reachable, through network pathways,from a subset of states that directly influence the thesystem output. By contrast, in this paper we explore anetwork with fully connected graph. There is an absenceof any connection redundancies by construction, since eachstate is connected through network pathways to every

? This research was supported by The University of Melbourne’sEarly Career Academic Fellowship Scheme.

other state. This provides a network that is theoreticallyobservable by measuring from a single state (any singlestate), however, severe practical challenges to observabilityare found for these networks.

This paper presents a coupled oscillator model in Section2. A structural analysis of the observability matrix forthe network using Vandermonde matrices is consideredanalytically, under the extreme condition of maximallyseparated clock frequencies, in Section 3. An analysis of thebroader range of possible observability outcomes, for clockfrequencies drawn from (i) a uniform distribution and (ii)a Gaussian distribution, is provided through simulation inSection 4, followed by conclusions in Section 5.

2. NETWORK CLOCK MODEL

Inspired by the neural networks of the brain, we use ageneric and scalable network clock model based on coupledsecond order pendula. Wright et al. (1985) devised a simi-lar coupled oscillator model in 1985 to model state changesin brain activity as measured by EEG (Electroencephalog-raphy), that is, electrical recordings from the brain. Fur-ther background on EEG recordings can be found in Ch.2 of Varsavsky et al. (2010) and in Niedermeyer andLopes Da Silva (2005). As a generic synthetic model whichneglects the complexities of biologically realistic neuron-dynamics, this is not a model which can tell us anythingabout the nature of brain function. This approach is rathersuited instead to the specific task of investigating whatunderlying information one may expect to recover from anobservation comprised of a linear map of the state. Vari-ations of this model were also used towards preliminaryanalysis on the brain observation problem (O’Sullivan-Greene et al. (2009a,b); OSullivan-Greene et al. (2011)).

Each individual oscillator is modelled as a linearised un-damped pendulum clock,

Proceedings of the 19th World CongressThe International Federation of Automatic ControlCape Town, South Africa. August 24-29, 2014

978-3-902823-62-5/2014 © IFAC 1164

N x N Geometric Coupling Matrix (N=10)

1 2 3 4 5 6 7 8 9 10

1

2

3

4

5

6

7

8

9

10

10-4 α

α

10-8 α

10-12 α

10-16 α

Fig. 1. An image showing the structure of the couplingmatrix for a 2-D network of N = 10 clocks witha fully connected graph. The white boxes indicatethat each clock is coupled to its nearest neighbourswith the maximum coupling magnitude of α. Couplingstrength to other clocks is geometrically decaying bydistance of clock i to clock j as indicated by theaccompanying greyscale bar. The black boxes indicatethat each clock is not coupled to itself.

xi + ω2i xi = Fi, i = 1 . . . N, (1)

where xi is the angular position, ωi is the natural frequencyof oscillation and Fi is the forcing term of the ith pendulumdefined in (2).

Fi =∑j

αij(xj − xi), (2)

Fi consists of a feedback term that couples the positionstate from other pendula,

∑j αij(xj−xi). αij denotes the

coupling strength between clocks i and j.

A simple fully-connected graph is assumed, with stronglocal connection and weaker long range connection, asillustrated in Fig. 1. Additionally, it is assumed that allmodel parameters are known.

It is chosen to restrict the model to pure or marginally sta-ble oscillators rather than include a damping term. Whilecertainly the brain will naturally deviate into both slightlyunderdamped and slightly damped modes of oscillation, itis envisioned that the natural balance of excitability inthe brain will constrain this damped and underdampedactivity to dynamics that lie near to the critically dampedboundary.

A coupled clock network of N linear clocks (illustrated forN = 4 in Fig. 2) can be written in state space format asx = Ax with an ideal EEG measurement of y = Cxusing (A,C) defined in (3,7) where x is the state.

A =

A1 + ε11 ε12 . . . ε1Nε21 A2 + ε22 . . . ε2N...

.

.

.. . .

.

.

.

εN1 εN2 . . . AN + εNN

, (3)

where

Ai =

(0 −ωi

+ωi 0

), (4)

εij =

(0 0−αij 0

)for i 6= j, (5)

ω1

α12

α13

α14

α23

α24

ω2

~ ~

~ ~α34 ω4

ω3

y

δ1δ

2

δ3

δ4

~ ~

Fig. 2. A network of four interconnecting clocks. Each clockhas an oscillation frequency ωi. The coupling betweenclocks i and j is given by αij , and a measurementelectrode connects to each clock with strength δi.

εii =

0 0

+

N∑k=1

αik 0

, (6)

C = [ 0 δ1 0 δ2 · · · 0 δN ] , (7)

where δi indicates the relative importance of clock i in theEEG output signal (the entries of the measurement vectorC satisfy δi ≥ 0 and

∑i δi = 1). Coupling is chosen to be

symmetric (αij = αji) and positive (αij > 0 ∀ i, j).

For this coupling configuration it is assumed that theclocks are spatially organised along a 1-dimensional struc-ture (see Figure 3). Other spatial constructs, such asextending to 2 or 3 dimensions, would also be possiblefor alternative connectivity coefficients.

Consider now the discrete formulation of the system modelgiven in (9, 10), using the mapping,

A→ eA∆T = A. (8)

For simplicity and generic problem formulation we usea normalised sampling time ∆T = 1 and normalisedfrequency range ωi ∈ (0, 1].

xk+1 = Axk (9)

yk = Cxk (10)

The discrete version of the system in (9) is convenient forthe analysis undertaken in Section 3 and the discrete mea-surement in (10) is appropriate since all real measurementsare digital in nature.

Next the model presented here will be used to explore thequestion of: How observable is x ∈ RN given y ∈ RM?Of particular interest, given the motivational problem ofobserving the brain state from EEG measurements, iswhen system order N is particularly large compared to

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1165

the number of measurements M (with one state assignedper neuron N ≈ 1011, while typically M < 30).

3. STRUCTURE OF THE OBSERVABILITY MATRIX

The observability matrix, O(C, A), can be deconstructedusing Vandermonde matrices to gain an insight into theexpected observability properties as a function of networksize. See (Golub and Van Loan, 2013, Ch. 4) for back-ground information on Vandermonde matrices.

Since A (8) contains eigenvalues on the unit circle 1 , Acan be generically diagonalised to,

T−1AT = diag([ejω1 , e−jω1 , ..., ejωN , e−jωN ]). (11)

The diagonalising state transformation, T, also convertsthe C = [0, δ1, 0, δ2, . . .] given in (7) to the full vector,

CT = [δ1, δ1, δ2, δ2, . . .]. If δi = 1 ∀ i, O(CT,T−1AT) isa Vandermonde matrix, V,

V =

1 1 1 . . . 1

ejω1 e

−jω1 ejω2 . . . e

−jωN

ej2ω1 e

−j2ω1 ej2ω2 . . . e

−j2ωN

.

.

.

.

.

.

.

.

....

.

.

.

ej(2N−1)ω1 e

−j(2N−1)ω1 ej(2N−1)ω2 . . . e

−(2N−1)jωN

,(12)

Then for a C vector containing any δi, O(CT,T−1AT) =diag(CT)V. The determinant of the observability matrixis:

det(O(CT,T−1AT

))= det (diag(CT)) det (V)

=

N∏i=1

(δi)2

︸ ︷︷ ︸Channel Model

∏1≤i<j≤(2N−1)

(ejγj − ejγi)

︸ ︷︷ ︸Network Model

(13)

where {γ2i−1 = ωiγ2i = −ωi. (14)

(13) is factorised into two distinct components, a channelmodel and a network model. The network model gives usthe intrinsic information content in the network. The chan-nel model provides the read-out of information contentfrom the network.

Consider next the case where (13) is maximised. Themost well-connected channel model provides the maximum1 The clock network can be written in continuous form as, x +

Wx = 0 where x = [x1 x2 . . . xN ]′, x = [x1 x2 . . . xN ]

′(′

denotes transpose) and

W =

ω21 +∑

jα1j −α12 −α13 · · · −α1N

−α12 ω22 +∑

jα2j −α23 · · · −α2N

−α13 −α23 ω23 +∑

jα3j · · · −α3N

.

.

.

.

.

.

.

.

... .

.

.

.

−α1N −α2N −α3N · · · ω2N +∑

jαNj

W is a positive definite matrix for αij > 0 ∀ i, j, therefore,

there exists z = Tx and z = Dz such that D = TWT−1 is adiagonal matrix. Specifically, D = diag(ω2

1 , ω22 , . . . , ω

2N ), where ωi

are the natural frequencies of a purely oscillatory coupled network (anetwork with αij = 0 ∀ i, j), which are simply shifted or perturbedin frequency from the individual clock natural frequencies ωi.

1 2 3 4 N5

Fig. 3. The spatial organisation for a 1-dimensional net-work of N clocks. Each circle represents a clock andthe connection line thickness depicts the strength ofconnection.

read-out available. Since δi is constrained by∑i δi =

1, δi > 0 then a uniform measure of the state whereδi = 1

N ∀ i gives the maximum read out of informationcontent. A maximally informative oscillator network (pro-viding the most energy in the determinant) would haveeigenvalues uniformly separated around the unit circle(intuitively, multiple well-separated frequencies are eas-ier to observe than a dense spectral arrangement withsame number of frequencies). Next the determinant ofthe Vandermonde Matrix is evaluated for this case ofeigenvalues of A uniformly distributed around the unitcircle (ωi = kπ

2N , for i = 1, 2, . . . , N, and k = 2i− 1).

Theorem 1. For the Vandermonde matrix V in (12) thatrepresents a coupled oscillator network model,

det(V) = jNNN2N , (15)

under the condition that the network’s eigenvalues arechosen to be maximally separated around the unit circle.

Proof. From (13) we have that:

det(V) =∏

1≤i<j≤(2N−1)

(ejγj − ejγi), (16)

This can be expanded, as shown in (18), using γ2i−1 = ωi,γ2i = −ωi and (17).

ωi =kπ

2N, for i = 1, 2, . . . , N, and k = 2i− 1. (17)

These frequencies, ωi, are chosen such that ejγi are uni-formly distributed around the unit circle for maximumseparation between eigenvalues.

det(V) =(e−jω1 − ejω1)(ejω2 − e−jω1)

.(ejω2 − ejω1)(e−jω2 − ejω2)

.(e−jω2 − e−jω1)(e−jω2 − ejω1) . . .

=

Euler pairs︷ ︸︸ ︷(2j sin(ω1)) (2j sin(ω2)) . . .

.(

4(2 sin

(ω1+ω2

2

)sin(ω1−ω2

2

))2). . .︸ ︷︷ ︸

Remaining exponential pairs

(18)

There are N Euler pair terms and N !2!(N−2)! = N(N−1)

2

remaining exponential pairs terms for combinations of(ωi, ωj).

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1166

det(V) = jN22N2−N

Factor a︷ ︸︸ ︷N∏i=1

sin(ωi)

.∏

(i,j):i<j

(sin(ωi+ωj

2

)sin(ωi−ωj

2

))2

︸ ︷︷ ︸Factor b

, (19)

Consider the following identity on the geometry of the sinefunction from Bibak et al. (2009),

N−1∏k=1

sin(kπN ) =N

2N−1. (20)

As a corollary of this,N/2∏k=1

sin(kπN ) =

√N

2N−1. (21)

Using (20), factor a in (19) can be reduced to,N∏i=1

sin(ωi) =

∏2N−1k=1 sin( kπ2N )∏N−1k=1 sin(kπN )

=2N

22N−1

N2N−1

=1

2N−1. (22)

Due to the geometry of maximally separated eigenvaluesaround the unit circle, as defined in (17), factor b in (19)can be expressed as,∏i,j:i<j

(sin(ωi+ωj

2

)sin(ωi−ωj

2

))2

=

( N∏k=1

sin(kπ2N

))N−1N/2∏k=1

sin(kπN

)2

. (23)

Using the identity in (21), (23) becomes,( N∏k=1

sin(kπ2N

))N−1N/2∏k=1

sin(kπN

)2

=

[(√2N/22N−1

)N−1(√N/2N−1

)]2

= 2N−1

(2N

22N−1

)N. (24)

Substituting (22) and (24) into (19) gives,

det(V) = jN22N2−N 1

2N−12N−1

(2N

22N−1

)N= jNNN2N . (25)

Making the trivial assumption that N is even, gives,

det(V) = NN2N , (26)

which completes the proof. �

Corollary 1. As a corollary to Theorem 1, for the observ-

ability matrix, O(C, A

), with A defined in (8) and C

defined in (7),

det(O(C, A

))=

1

NN, (27)

under the condition that the network’s eigenvalues arechosen to be maximally separated around the unit circleand there is a uniform measurement of the state.

Proof. From (13) we have that

det(O(CT,T−1AT

))=

N∏i=1

(δi)2det(V), (28)

For a uniform measurement of the state δi = 1N ∀ i and

(28) becomes,

det(O(CT,T−1AT

))=

N∏i=1

(1

N

)2

det(V), (29)

Lastly the effect of the transformation T in (11) should beconsidered.

O(C, A

)= O

(CT,T−1AT

)T−1 (30)

where T is a block diagonal matrix with each diagonal 2×2block: [(−j, 1)′, (+j, 1)′]. Using (29), (30) and the resultsof Theorem 1 gives,

det(O(C, A)

)=

N∏i=1

(1

N

)2

︸ ︷︷ ︸1

N2N

det(V)︸ ︷︷ ︸jNNN2N

det(T−1︸ ︷︷ ︸(−1

2j )N

)

=(−1)N

NN, (31)

Making the trivial assumption that N is even gives,

det(O(C, A)

)=

1

NN, (32)

which completes the proof. �

det(O(C, A)

)thus converges to zero with increasing net-

work order N , with a rate that is faster than exponential,despite a very large determinant from the network modelalone. This indicates that observability from oscillatorynetworks is exceedingly ill-posed. That said, however, froma purely numerical representation viewpoint, the very largedeterminant from the network model is problematic inand of itself. V comprises of (2N)2 numerically-orderlyelements of order 1. Yet det (V) is exceptionally large(det (V)→ 2NNN ). Exceptionally large determinants areequally as problematic as exceptionally small determinants

(for example det(O(C, A)

)→ 1

NN ) in terms of numerical

representation.

4. SIMULATION RESULTS

In the previous section it was found through Theorem1 that, under the extreme case of maximally separatedeigenvalues, the determinant of the Vandermonde matrixthat represents the clock network, det(V), grows expo-nentially with network order N . In this section, throughsimulation over a range of networks sizes, the range ofexpected values for det(V) (defined in (16)) is exploredmore generally by considering (i) eigenspectra uniformly

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1167

10-100

100

10100

10200

2000

4000

6000

Histogram of Determinant Values for V

N=10Median=5.4e+001

10-100

100

10100

10200

2000

4000

6000 N=20Median=2.1e+003

10-100

100

10100

10200

2000

4000

6000 N=50Median=1.3e+008

10-100

100

10100

10200

2000

4000

6000 N=100Median=4.0e+019

Fig. 4. Histograms of values for determinant of V fornetworks of N clocks, where clock network frequencieswere drawn from a uniform distribution in the range(0 - π rad/s) over 100, 000 trials. Determinant valueswere distributed across 100 logarithmically spacedbins. The vertical dotted line (in red) is the theoret-ical limit for maximally spaced frequencies as shownanalytically in Theorem 1.

distributed around the unit circle and (ii) eigenspectrawith a truncated Gaussian distribution centred with meanµ = π

2 and variance σ2 = 0.5 on the unit circle.

4.1 Uniform Distribution

Figure 4 illustrates the range of determinant values fornetworks where clock network frequencies were drawn froma uniform distribution in the range (0 - π rad/s) over100, 000 trials. This choice of frequencies generates eigen-spectra that are uniformly distributed around the unitcircle. The absolute values of the resulting determinantvalues (|det(V)|) were distributed across 100 logarithmi-cally spaced bins. The vertical dotted line (in red) is thetheoretical limit for equally spaced frequencies as shownanalytically in Theorem 1 (det(V) = 2NNN , where N isthe number of clocks in the network).

The range of possible determinant values is exceptionallybroad, from very small values to very large values. Thisrange broadens as N increases. The median value of|det(V)| grows as N increases, however, the gap betweenthe maximum determinant found through simulation andthe theoretical 2NNN limit also increases with N . Thisis as expected since the likelihood of randomly obtainingN equally separated or near equally separated eigenvaluesis low for large N . It is more likely instead that at leastsome of the eigenvalues will be separated by angles thatare significantly smaller than perfectly uniform separation,thus lowering the determinant (since sin(ωi − ωj) factorscreates small numbers in the overall product in (18) forsmall ∆ = ωi − ωj .)

4.2 Gaussian Distribution

Biologically, the likelihood of brain networks with uni-formly distributed spectral content as described in Section

10-300

10-200

10-100

100

2000

4000

6000

Histogram of Determinant Values for V

N=5Median=3.0e-002

10-300

10-200

10-100

100

2000

4000

6000 N=10Median=8.2e-012

10-300

10-200

10-100

100

2000

4000

6000 N=20Median=3.9e-055

10-300

10-200

10-100

100

2000

4000

6000 N=30Median=4.0e-128

Fig. 5. Histograms of values for determinant of V fornetworks of N clocks, where clock network frequen-cies were drawn from a Gaussian distribution, withmean, µ = π

2 and variance σ2 = 0.5 over 100, 000trials. Determinant values were distributed across 100logarithmically spaced bins. The vertical dotted line(in red) is the theoretical limit for equally spacedfrequencies as shown analytically in Theorem 1.

(4) is low. An alternative distribution is therefore exploredhere. A Gaussian distribution of frequency values is morebio-realistic in the case of the brain’s oscillators, wheresimilar frequencies manifest around typical functional be-haviour (for example slower oscillations appear duringsleep and the auditory cortex oscillates with frequenciesto match external auditory stimuli).

Figure 5 illustrates the range of determinant values fornetworks where clock network frequencies were drawn froma truncated Gaussian distribution with range (0, π), withmean, µ = π

2 and variance σ2 = 0.5 over 100, 000 trials.This choice of frequencies generates eigenspectra that arenormally distributed on the unit circle, centred at π

2 .The absolute values of the resulting determinant valueswere distributed across 100 logarithmically spaced bins.The vertical dotted line (in red) is the theoretical limitfor equally spaced frequencies as shown analytically inTheorem 1 (det(V) = 2NNN ).

Under this Gaussian configuration, the determinant valuesare all small (predominantly < 1, for N > 10). Similar tothe case of uniform frequency allocation, the range broad-ens as N increases and the gap between the maximumdeterminant found through simulation and the theoretical2NNN limit also increases with N . Unlike the uniformcase, however, here the median value of |det(V)| decreasesas N increases and there exists markedly larger gaps be-tween the determinant values found through simulationand the theoretical 2NNN limit even for relatively smallnetwork sizes of N = 30 clocks.

These small determinants and their large distance fromthe theoretical 2NNN limit can be explained by thehigh likelihood of obtaining very small differences betweenangles with a Gaussian distribution (since sin(ωi − ωj)

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1168

factors creates exceptionally small numbers in the overallproduct in (18) for ∆ = ωi − ωj ≈ 0 .)

5. CONCLUSIONS

Using a highly abstracted model of a coupled oscillatorbrain network, practical observability of such systems isfound to be exceptionally poor. This abstracted problemformulation is a simplification of any real world prob-lem with all parameters known and by dealing with astationary environment. These systems are theoreticallyobservable. The pair (C,A) of form given in (7) and (3)can be shown to be observable using the Popov-Belevitch-Hautus test (Kailath, 1980, Ch 2), even in the case whereonly a single state is connected to the output (δi = 0 ∀ i 6=k, δk = 1), under the condition that the clocks oscillate atdistinct frequencies (i.e. ωi 6= ωj , ∀ i 6= j). Despite thisvast simplification and theoretical observability, from apurely mathematical point of view, practical observabilityof these systems is ill-posed.

Inferences from this work for oscillatory distributed engi-neering systems (including future power grids and telecom-munication systems) and oscillatory biological systems (in-cluding observation of neural activity in the brain) indicatethat large scale observability is utopian. Instead concen-trating on tracking dynamics within very localised sub-systems of the network seems to be more achievable. Thisparticularly has implications for tracking and predictingneural activity, for applications such as epileptic seizureprediction, where attempts to reconstruct underlying dy-namics across large areas of the brain using relatively fewelectrodes are problematic.

ACKNOWLEDGEMENTS

This work is based on an ongoing collaborative effortbetween St. Vincent’s Hospital, Melbourne and The Schoolof Engineering, The University of Melbourne towards re-search in epilepsy. We want to acknowledge in particularMichelle Chong, Prof Mark Cook, Prof Anthony Burkitt,Dr Karen Fuller, Dr Dean Freestone, A/Prof David Gray-den, Dr Levin Kuhlmann, Dr Alan Lai, Andre Petersonand Dr Andrea Varsavsky for many helpful discussions. Inaddition, many thanks to Prof Jonathan Manton for siftingout useful trigonometric identities from papers past.

REFERENCES

Bibak, K., Haghighi, M.S., et al. (2009). Some trigono-metric identities involving fibonacci and lucas numbers.Journal of Integer Sequences, 12(2), 3.

Butler, D. (2007). Energy efficiency: Super savers: Metersto manage the future. Nature, 445(7128), 586–588.

Golub, G.H. and Van Loan, C.F. (2013). Matrix compu-tations, volume 4. Johns Hopkins University Press.

Kailath, T. (ed.) (1980). Linear systems. Information &Science Series. Prentice-Hall.

Liu, Y.Y., Slotine, J.J., and Barabasi, A.L. (2013). Observ-ability of complex systems. Proceedings of the NationalAcademy of Sciences, 110(7), 2460–2465.

Monticelli, A. and Wu, F.F. (1985). Network observability:identification of observable islands and measurementplacement. Power Apparatus and Systems, IEEE Trans-actions on, 104(5), 1035–1041.

Niedermeyer, E. and Lopes Da Silva, F.H. (2005). Elec-troencephalography: Basic Principles, Clinical Appli-cations and Related Fields. Lippincott Williams &Wilkins, 5th edition edition.

OSullivan-Greene, E., Kuhlmann, L., Varsavsky, A., Gray-den, D.B., Burkitt, A.N., and Mareels, I.M.Y. (2011).Seizure Prediction and Observability of EEG Sources.In Epilepsy: The Intersection of Neurosciences, Biology,Mathematics, Engineering and Physics, Ed. Osorio, I.and Zaveri, H. and Frei, M. G. and Arthurs, S. CRCPress.

O’Sullivan-Greene, E., Mareels, I., Burkitt, A., and Kulh-mann, L. (2009a). Observability issues in networkedclocks with applications to epilepsy. In Proceedingsof the 48th IEEE Conference on Decision and Control(IEEE CDC), 3527–3532.

O’Sullivan-Greene, E., Mareels, I., Freestone, D., Kulh-mann, L., and Burkitt, A. (2009b). A paradigm forepileptic seizure prediction using a coupled oscillatormodel of the brain. In Proceedingsof the IEEE Engi-neering in Medicine and Biology Society (EMBC 2009),6428–6431.

Prehofer, C. and Bettstetter, C. (2005). Self-organizationin communication networks: principles and designparadigms. Communications Magazine, IEEE, 43(7),78–85.

Rohden, M., Sorge, A., Timme, M., and Witthaut, D.(2012). Self-organized synchronization in decentralizedpower grids. Physical Review Letters, 109(6), 64101.

Strogatz, S.H. and Stewart, I. (1993). Coupled oscillatorsand biological synchronization. Scientific American,269(6), 102–109.

Varsavsky, A., Mareels, I., and Cook, M. (2010). Epilepticseizures and the EEG: measurement, models, detectionand prediction. CRC Press.

Wright, J.J., Kydd, R.R., and Lees, G.J. (1985). State-changes in the brain viewed as linear steady-states andnon-linear transitions between steady-states. BiologicalCybernetics, 53, 11–17.

Wu, F.F. and Monticelli, A. (1985). Network observability:theory. Power Apparatus and Systems, IEEE Transac-tions on, 105(5), 1042–1048.

19th IFAC World CongressCape Town, South Africa. August 24-29, 2014

1169