26
Fast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow Center for Engineering Systems Advanced Research (CESAR) Oak Ridge National Laboratory John DuBose Paradigm Geophysical NGOTP Program Review Meeting March 24, 1999

Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Fast Global OptimizationApplied to Residual Statics.

David Reister, Jacob Barhen, and Ed OblowCenter for Engineering Systems Advanced

Research (CESAR)Oak Ridge National Laboratory

John DuBoseParadigm Geophysical

NGOTP Program Review MeetingMarch 24, 1999

Page 2: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Outline

A. Introduction.

B. Major Accomplishments.Paper on TRUST in Science. May 1997.R&D 100 Award. June 1998.

C. Significant Results.

D. Plans for Future Work.

Page 3: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Introduction.

A. Problem.Surface-consistent residual statics.Stack power maximization.Since many local maxima, need a

global optimization method.

B. Approach.TRUST (Terminal Repeller Unconstrained

Subenergy Tunneling).SPT (Stochastic Pijavskij Tunneling).

C. Results.1. Improved TRUST and Invented SPT.2. Two stack power bounds and

disaggregation of the problem.3. Have found many solutions with

high stack power.

Page 4: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

April 1996 Project Review

John DuBose provided ORNL with both FORTRANcode to calculate stack energy and with four syntheticdata sets (small or medium and clean or noisy).

The small data set contained 24 shots and 50receivers, for a total of 74 parameters.The medium data set contained 77 shots and 77receivers, for a total of 154 parameters.

By April 1996, we had solved the two small data setsand were beginning to work on the medium data sets.

The original version of TRUST could not solve theproblem for the medium data sets!

Technical Progress May 1996

Performed a careful review of the structure of theequations in the code from John DuBose.Upper bound on power and Coherence Factor.Decouple the Components of the Stack Energy.

Page 5: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Good Solution June 1996

The medium data set has 77 shots and 77 receivers.The number of CMP is 133 and the average fold is 11.The number of traces is 1462 and the number offrequencies is 49.

DuBose did not tell ORNL the values of the staticcorrections until after ORNL had given their bestestimate of the corrections. Initially, ORNL was toldthat the maximum value of the stack energy was morethan 1303.

We applied TRUST to the 133 decoupled problems.We were able to find solutions that gave values foreach coherence factor that were near 1.0.The total energy for the 133 decoupled problems was1327.6 (the maximum value).

The v coordinates were mapped back to the xcoordinates to determine an initial guess for the 154parameter global optimization problem.

The initial value for the energy was 1250.8. After 12iterations, TRUST found the maximum value at 1315.8.

Page 6: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

New Data Set Nov. 1996

The large data set has 100 shots and 216 receivers.The number of CMP is 423.The number of traces is 4776 and the number offrequencies is 118.

Time per iteration is 100 times longer than for themedium data set.

Base Energy (x = 0) = 882.Upper Bound. G = 6589.

We applied TRUST to the 423 decoupled problems.

Most of the best values for the coherence factor weremuch less than 1.0.

The total energy for the 423 decoupled problems is2706. (Decoupled Upper Bound)

Page 7: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Preliminary Solution Dec. 1996

The 4776 v coordinates were mapped back to the xcoordinates to determine an initial guess for the 316parameter global optimization problem.

The initial value for the energy was 1035.The initial valley was 2183.

After 98 iterations, TRUST found the maximum valueat 2366.

Page 8: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

New Method by Ed Oblow.SPT (Stochastic Pijavskij Tunneling)

Two phases:1. Descent to a local minimum.2. Stochastic search.

Many line searches.Rejection technique.

Use Pijavskij cones for rejection.Importance sampling.

Key Concept: Lipschitz constant (L)

L = max |df/dx|

L is the key parameter in the SPT algorithm.

Page 9: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Finding the global minimum for a1D example using the SPT algorithm.

1

2

3

4

5

f

f

f

L

1

2

3

ps

Page 10: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Discussion of Pijavskij figure.

1. Evaluate f(x) at point 1 (x1).

2. Find local minimum (f1). f* = f1.

3. P-Cone from x1 rejects part of x-axis.

4. Evaluate at point 2 (x2). f(x2) > f*.

5. P-Cone from x2.

6. Evaluate at point 3 (x3). f(x3) > f*.

7. P-Cone from x3.

8. Evaluate at point 4 (x4). f(x4) < f*.

9. Find local minimum (f2). f* = f1.

10. P-Cones from {xi} reject most of x-axis.

11. Evaluate at point 5 (x5). f(x5) < f*.

12. Find local minimum (f3). f* = f3.

13. Evaluate at more points until all of the domain is rejected.

14. f3 is the global minimum.

Page 11: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Current Solution Dec. 1997

Upper Bound. G = 6589.Decoupled Upper Bound = 2706.

Best Solution = 2441.

Have 22 points with energy above 2365.

Are the points distinct?Yes. Significant distance after removal of the nullspace components.

How to compare?Distance norm vs Energy norm.

Page 12: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow
Page 13: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow
Page 14: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow
Page 15: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

The stack power (E) and the upper bound (G)for each CMP.

E = kEk

∑ = 2441. G = kGk

∑ = 6589.

0

10

20

30

40

50

60

70

0 50 100 150 200 250 300 350 400

EG

Sta

ck E

ner

gy

K

Page 16: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

The best coherence factor.

The coherence factor (Qk) is: Qk = Ek/Gk

Best means use decoupled upper bound for Ek.

0.0

0.2

0.4

0.6

0.8

1.0

0 50 100 150 200 250 300 350 400

Bes

t C

oh

eren

ce F

acto

r

K

Page 17: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

The normalized coherence factor for two cases: 882and 2441.

0.0

0.2

0.4

0.6

0.8

1.0

0 50 100 150 200 250 300 350 400

8822441N

orm

aliz

ed C

oh

eren

ce F

acto

r

K

Page 18: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

The Euclidean distance between the 22 vectors afternull space corrections.

0

20

40

60

80

100

120

140

0 5 10 15 20

Eu

clid

ean

Dis

tan

cew

ith

nu

ll sp

ace

corr

ecti

on

N

Page 19: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Power Norm.

Two cases: c and d.

Ec = ∑k

cEk Ed = ∑

k

dEk

∆∆cd = ∑k

| cEk - dEk |

εεcd = | Ec - Ed | ≤≤ ∆∆cd

ββ = ∆∆cd - εεcd

Page 20: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

The power norm distancebetween the 22 vectors.

0

20

40

60

80

100

0 5 10 15 20

Po

wer

No

rm

N

Page 21: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Correlation between the power norm and Euclideandistance.

0

20

40

60

80

100

0 20 40 60 80 100 120 140

Po

wer

No

rm

Euclidean Distance

None zero but cluster in lower left corner.

Weak correlation (R2 = 0.22)

Page 22: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

The disrupting statics that were applied to the originalseismic data to produce the input data for this project.

-30

-20

-10

0

10

20

30

0 40 80 120 160 200 240 280 320

Dis

rup

tin

g S

tati

cs

N

Page 23: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

The difference between the statics for the 2441 caseand the disrupting statics.

-10

0

10

20

30

40

50

60

0 40 80 120 160 200 240 280 320

Sta

tics

(24

41 -

Dis

rup

tin

g)

N

Page 24: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

The difference between the statics for the 2427 caseand the disrupting statics.

-20

-10

0

10

20

30

40

50

60

0 40 80 120 160 200 240 280 320

Sta

tics

(24

27 -

Dis

rup

tin

g)

N

Although we have cycle skips, the disruptingstatics do not maximize the stack power!!

The power is 2349 for the disrupting statics.(Less than the 22 cases.)

Page 25: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Plans for Future Work.

Develop a methodology for predicting uncertainty inthe forecasts of artificial neural networks (ANN).

Apply to ANN that are used to predict well logvariables throughout an oil field using seismic data asinputs.

Initially, Chuck Glover and UNOCAL.

Recently, Jacob Barhen and DeepLook.

Page 26: Fast Global Optimization Applied to Residual Statics. David ...neum/glopt/mss/ReiBO99.pdfFast Global Optimization Applied to Residual Statics. David Reister, Jacob Barhen, and Ed Oblow

Nonlinear Uncertainty Analysis

The uncertainty analysis consistently combines fieldmeasurements with model predictions tosimultaneously determine best estimates andcovariance matrices for both model parameters andmodel predictions.

The problem is formulated in terms of a Bayesian lossfunction and solved as a constrained optimizationproblem that links the parameters to the predictions.

Sensitivity matrices are used to propagate theuncertainties.

The solution to the optimization problem ensuresuncertainty minimization and best parameterestimates.

We expect our method to be significantly better thanthe current state-of-the-art methods.