An exploratory investigation on the Invasiveness of Environmental Modeling Frameworks

An exploratory investigation on the Invasiveness of Environmental Modeling Frameworks18th IMACS World Congress, MODSIM09Cairns, AustraliaJuly 2009

Wes J. Lloyd, Olaf David, James C. Ascough, Ken Rojas, Jack Carlson, George Leavesley, Peter Krause, Tim Green, Lajpat Ahuja

Framework InvasivenessCoupling between application code and framework codeUse of framework functions/methodsUse of framework specific data typesImplementation of framework interfacesExtension of framework classesImport/Include of framework libraries

Framework InvasivenessObject-oriented coupling correlates inversely with software quality (Briand, 2000; Basil, 1996).Framework invasiveness may impactUnderstandabilityMaintainabilityUpgrading the framework Ease of bug defects / Feature EnhancementsPortabilityReusability

Framework Design Classification

Heavyweight FrameworksLightweight FrameworksOverloads/wraps native language data types

Large programming interface (API)

Components tightly-coupled / bound to framework at compile time

May use many external libraries

Uses native language data types

Small programming interface (API)

Components loosely-coupled, largely framework independent

Components bound to framework dynamically:language annotations, dependency injection, IoC design pattern

Research QuestionsHow does framework design (lightweight vs. heavyweight) impact invasiveness?How does framework to application invasiveness impact Software Quality? in terms of:MaintainabilityUnderstandabilityPortabilityReusability

Measuring InvasivenessAre Object Oriented Coupling Measures useful?Coupling Between Object Classes (CBO)Efferent Coupling / Fan OutAfferent Coupling / Fan InResponse for a Class (RFC)Message Passage Coupling (MPC)Framework Invasiveness measures needed

Invasiveness Metrics Count # Used, # of UsesFramework Data Types (FDT)Framework Functions (FF)Framework Dependent Lines of Code (FDLOC)Three scalingsRaw countPer 1000 LOC (kloc)As a % of all data types used

Empirical StudyEnvironmental Modeling FrameworksSupport aggregation of models into classes (components)Component interaction/communicationTime/spatial data loopingRegridding arrays and spatial dataMultithreading/multiprocessor supportCross language interoperability

Environmental Modeling FrameworksCCA 0.6.6: Common Component Architecture - JavaESMF-C/Fortran 3.1.1: Earth Science Modeling FrameworkOpenMI 1.4: Open Modeling Interface - JavaOMS 2.2: Object Modeling System - JavaOMS 3.0: Object Modeling System- Java

Modeling Application: ThornthwaiteThornthwaite Water balance modelModels allocation of water among components of hydrological systemModel8 ComponentsClimate, Daylen, HamonET, Snow, Soil moisture, Runoff, Output, ControllerFORTRAN Implementation = 244 LOC

Modeling Application: ThornthwaiteEight implementations

Sheet51

SUMMARY OUTPUT

Regression Statistics

Multiple R0.659176385

R Square0.4345135065

Adjusted R Square0.2460180087

Standard Error0.0895421439

Observations5

ANOVA

dfSSMSFSignificance F

Regression10.01848235360.01848235362.30516649740.2262421713

Residual30.02405338660.0080177955

Total40.0425357402

CoefficientsStandard Errort StatP-valueLower 95%Upper 95%Lower 95.0%Upper 95.0%

Intercept0.18727752410.09398487871.99263463130.1403246333-0.11182430580.4863793539-0.11182430580.4863793539

% FDT Used0.50611958060.33335117471.51827747710.2262421713-0.55475263371.5669917948-0.55475263371.5669917948

RESIDUAL OUTPUT

ObservationPredicted % FDLOCResiduals

10.3406470939-0.0321548929

20.3253101370.0888910465

30.2113784565-0.0629685625

40.3981606826-0.071494016

50.30636448420.0777264249

Sheet51

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

% FDLOC

Predicted % FDLOC

% FDT Used

% FDLOC

% FDT Used Line Fit Plot

Sheet53

SUMMARY OUTPUT



R Square0.528504543



Observations5

ANOVA


Regression10.02248033190.02248033193.36273362870.1640513944

Residual30.02005540830.0066851361

Total40.0425357402


Intercept0.19369385640.07624003812.54057921710.0846366433-0.04893597130.4363236841-0.04893597130.4363236841

% FDT Uses0.30756279260.16772104591.83377578470.1640513944-0.22620043020.8413260154-0.22620043020.8413260154

RESIDUAL OUTPUT


10.3462249975-0.0377327964

20.35333359160.0608675918

30.1978501104-0.0494402164

40.3914127945-0.0647461278

50.29303936020.0910515489

Sheet53

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

% FDLOC

Predicted % FDLOC

% FDT Uses

% FDLOC

% FDT Uses Line Fit Plot

Sheet54

SUMMARY OUTPUT



R Square0.5472390376



Observations5

ANOVA


Regression10.02327721750.02327721753.62601294950.1529957059

Residual30.01925852270.0064195076

Total40.0425357402


Intercept0.12784875080.10528816841.2142746210.3115083319-0.20722519180.4629226934-0.20722519180.4629226934

% FF Used0.39373734120.20677209541.90420927150.1529957059-0.26430374981.0517784321-0.26430374981.0517784321

RESIDUAL OUTPUT


10.3106553735-0.0021631725

20.4372138046-0.0230126212

30.2328453751-0.0844354811

40.32471742140.0019492453

50.27642887960.1076620295

Sheet54

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

% FDLOC

Predicted % FDLOC

% FF Used

% FDLOC

% FF Used Line Fit Plot

Sheet55

SUMMARY OUTPUT



R Square0.9442503656



Observations5

ANOVA


Regression10.04016438830.040164388350.81201210570.0056829874

Residual30.0023713520.0007904507

Total40.0425357402


Intercept-0.04446013680.0521581773-0.85240970990.4566309202-0.21045073530.1215304618-0.21045073530.1215304618

% FF Uses0.49408032190.06931294657.12825449220.00568298740.27349559160.71466505230.27349559160.7146650523

RESIDUAL OUTPUT


10.3322149602-0.0237227591

20.4303703025-0.0161691191

30.1550723009-0.0066624069

40.31786543270.008801234

50.3463378580.0377530511

Sheet55

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

% FDLOC

Predicted % FDLOC

% FF Uses

% FDLOC

% FF Uses Line Fit Plot

Sheet56

SUMMARY OUTPUT



R Square0.0393997523

Adjusted R Square-0.2808003302


Observations5

ANOVA


Regression10.00167589760.00167589760.12304728980.7489394932

Residual30.04085984260.0136199475

Total40.0425357402


Intercept0.2831352110.10817486782.6173843960.0791795257-0.06112549730.6273959193-0.06112549730.6273959193

FDT Ref/KLOC0.0036817950.01049599420.35078097130.7489394932-0.02972114290.0370847329-0.02972114290.0370847329

RESIDUAL OUTPUT


10.3462877845-0.0377955834

20.29930707790.1148941055

30.2956158721-0.1472059782

40.32404404470.002622622

50.3166060750.0674848341

Sheet56

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

% FDLOC

Predicted % FDLOC

FDT Ref/KLOC

% FDLOC

FDT Ref/KLOC Line Fit Plot

Sheet57

SUMMARY OUTPUT



R Square0.3850328195



Observations5

ANOVA


Regression10.0163776560.0163776561.87830911190.264070016

Residual30.02615808420.0087193614

Total40.0425357402


Intercept0.21883078650.08251810412.65191243480.0768679989-0.04377864910.4814402221-0.04377864910.4814402221

FDT Refs/KLOC0.00079276560.00057844391.37051417790.264070016-0.00104810120.0026336324-0.00104810120.0026336324

RESIDUAL OUTPUT


10.3847268528-0.0762346518

20.34534828790.0688528955

30.2215181276-0.0731082336

40.345673287-0.0190066204

50.28459429880.0994966103

Sheet57

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

% FDLOC

Predicted % FDLOC

FDT Refs/KLOC

% FDLOC

FDT Refs/KLOC Line Fit Plot

Sheet58

SUMMARY OUTPUT



R Square0.5221955646



Observations5

ANOVA


Regression10.02221197490.02221197493.27871944570.1678691146

Residual30.02032376530.0067745884

Total40.0425357402


Intercept0.63312602710.17876295973.5417070080.03831692910.06422250661.20202954770.06422250661.2020295477

FF Used/KLOC-0.01525710710.0084259731-1.81072345920.1678691146-0.0420723140.0115580998-0.0420723140.0115580998

RESIDUAL OUTPUT


10.29291609140.0155761096

20.38740395060.0267972328

30.2193739697-0.0709640758

40.3957932498-0.0691265831

50.28637359270.0977173164

Sheet58

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

% FDLOC

Predicted % FDLOC

FF Used/KLOC

% FDLOC

FF Used/KLOC Line Fit Plot

Sheet59

SUMMARY OUTPUT



R Square0.4927991699



Observations5

ANOVA


Regression10.02096157750.02096157752.91481681840.1863074746

Residual30.02157416280.0071913876

Total40.0425357402


Intercept0.20484475590.07553519722.71191131370.0730464142-0.03554195340.4452314651-0.03554195340.4452314651

FF Uses/KLOC0.00068719530.0004025081.70728346160.1863074746-0.00059376490.0019681554-0.00059376490.0019681554

RESIDUAL OUTPUT


10.29560639730.0128858037

20.35375383670.0604473467

30.2537637423-0.1053538483

40.25523907680.0714275899

50.4234978011-0.0394068921

Sheet59

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

% FDLOC

Predicted % FDLOC

FF Uses/KLOC

% FDLOC

FF Uses/KLOC Line Fit Plot

Sheet61

SUMMARY OUTPUT



R Square0.0060805948



Observations6

ANOVA


Regression10.00256336560.00256336560.02447117860.8832698235

Residual40.41900156910.1047503923

Total50.4215649346


Intercept0.32698586150.26538329131.23212678520.2853770629-0.40983627851.0638080016-0.40983627851.0638080016

% FDT Uses0.09796046170.62621487570.15643266480.8832698235-1.64069076451.836611688-1.64069076451.836611688

RESIDUAL OUTPUT

ObservationPredicted % FDT UsedResiduals

10.34763687190.5549605307

20.3755678792-0.0725375761

30.377832006-0.1051047332

40.3283096516-0.2806906039

50.38996044410.0267062226

60.3586279576-0.1233338399

Sheet61

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used

Predicted % FDT Used

% FDT Uses

% FDT Used

% FDT Uses Line Fit Plot

Sheet62

SUMMARY OUTPUT



R Square0.6858467312



Observations6

ANOVA


Regression10.28912893240.28912893248.73263848250.0417569893

Residual40.13243600220.0331090006

Total50.4215649346


Intercept-0.14717791790.1879427966-0.78309954160.4773369354-0.66899077550.3746349397-0.66899077550.3746349397

% FF Used0.91081302630.30821693152.95510380230.04175698930.05506563551.76656041720.05506563551.7665604172

RESIDUAL OUTPUT


10.7333151010.1692823016

20.27569955870.0273307444

30.5684608886-0.2957336158

40.0957055558-0.0480865082

50.30822859530.1084380713

60.1965251110.0387690067

Sheet62

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


% FF Used

% FDT Used


Sheet63

SUMMARY OUTPUT



R Square0.4001164318



Observations6

ANOVA


Regression10.16867505740.16867505742.66796060450.1777249778

Residual40.25288987720.0632224693

Total50.4215649346


Intercept-0.3396047880.4422235093-0.76794829070.4853431194-1.56741408570.8882045096-1.56741408570.8882045096

% FF Uses0.9189363210.56259479671.63338929980.1777249778-0.64307724842.4809498903-0.64307724842.4809498903

RESIDUAL OUTPUT


10.52041210630.3821852963

20.360970427-0.0579401239

30.5435288191-0.2708015464

40.03150411080.0161149368

50.33428184730.0823848193

60.3872374997-0.1519433821

Sheet63

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


% FF Uses

% FDT Used


Sheet64

SUMMARY OUTPUT



R Square0.8137020927



Observations6

ANOVA


Regression10.34302826950.343028269517.47098729250.0139202055

Residual40.07853666510.0196341663

Total50.4215649346


Intercept0.01645127530.10072713580.16332515720.8781821361-0.2632120880.2961146385-0.2632120880.2961146385

FDT Ref/KLOC0.02841326280.00679770614.17983101240.01392020550.00953980490.04728672060.00953980490.0472867206

RESIDUAL OUTPUT


10.813191950.0894054526

20.503814273-0.20078397

30.14125330790.1314739648

40.1127674203-0.0651483726

50.33215419490.0845124717

60.2747536641-0.0394595464

Sheet64

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


FDT Ref/KLOC

% FDT Used


Sheet65

SUMMARY OUTPUT



R Square0.4530401566



Observations6

ANOVA


Regression10.1909858440.1909858443.31315113560.1428428512

Residual40.23057909060.0576447727

Total50.4215649346


Intercept0.0250381560.20995103580.11925712060.9108211905-0.55787936970.6079556817-0.55787936970.6079556817

FDT Refs/KLOC0.00249503810.00137074471.82020634420.1428428512-0.00131075920.0063008355-0.00131075920.0063008355

RESIDUAL OUTPUT


10.51780441320.3847929894

20.5471559139-0.2441256108

30.423221402-0.1504941293

40.03349591240.0141231352

50.4242442581-0.0075775914

60.23201291060.003281207

Sheet65

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


FDT Refs/KLOC

% FDT Used


Sheet66

SUMMARY OUTPUT



R Square0.6765019288



Observations6

ANOVA


Regression10.28518949140.28518949148.36483415460.04446447

Residual40.13637544330.0340938608

Total50.4215649346


Intercept0.04064771260.13455049110.30210006870.777632174-0.33292433990.4142197651-0.33292433990.4142197651

FF Used/KLOC0.01092466010.00377728082.89220230180.044464470.00043724740.02141207280.00043724740.0214120728

RESIDUAL OUTPUT


10.8406581260.0619392766

20.28425076820.0187795348

30.21659392230.0561333505

40.3369096816-0.289290634

50.21058686980.2060797968

60.2889354423-0.0536413247

Sheet66

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


FF Used/KLOC

% FDT Used


Sheet67

SUMMARY OUTPUT



R Square0.4656540544



Observations6

ANOVA


Regression10.1963034210.1963034213.48578712540.1352957455

Residual40.22526151360.0563153784

Total50.4215649346


Intercept0.07488636980.18220261580.41100600810.702133641-0.4309891910.5807619306-0.4309891910.5807619306

FF Uses/KLOC0.00140415010.00075207841.86702627870.1352957455-0.00068395420.0034922545-0.00068395420.0034922545

RESIDUAL OUTPUT


10.66407988440.2385175182

20.26034015940.0426901436

30.3791531603-0.1064258876

40.1748428191-0.1272237715

50.17785737870.238809288

60.5216614084-0.2863672907

Sheet67

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


FF Uses/KLOC

% FDT Used


Sheet68

SUMMARY OUTPUT



R Square0.0308896086



Observations6

ANOVA


Regression10.00825127960.00825127960.12749675920.7390828947

Residual40.25887025310.0647175633

Total50.2671215327


Intercept0.28134449560.26276270721.07071699240.3446030544-0.44820173671.0108907279-0.44820173671.0108907279

% FF Used0.15386651180.43091790070.35706688340.7390828947-1.04255338421.3502864078-1.04255338421.3502864078

RESIDUAL OUTPUT

ObservationPredicted % FDT UsesResiduals

10.4300889531-0.2192793062

20.35278251890.1431524404

30.4022396120.116808007

40.3223755654-0.3088620519

50.35827775150.2845793914

60.3394073302-0.0163984807

Sheet68

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses

Predicted % FDT Uses

% FF Used

% FDT Uses


Sheet69

SUMMARY OUTPUT



R Square0.2724315707



Observations6

ANOVA


Regression10.07277233870.07277233871.49776466210.2881731321

Residual40.1943491940.0485872985

Total50.2671215327


Intercept-0.09396119450.3876747145-0.24237122240.8204124675-1.17031875790.9823963689-1.17031875790.9823963689

% FF Uses0.60359154850.49319806071.22383195830.2881731321-0.7657457931.97292889-0.7657457931.97292889

RESIDUAL OUTPUT


10.4709298835-0.2601202367

20.36620265930.1297323

30.48611380020.0329338189

40.1497969309-0.1362834174

50.34867260780.2941845351

60.3834558495-0.060447

Sheet69

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses


% FF Uses

% FDT Uses


Sheet70

SUMMARY OUTPUT



R Square0.0000458154



Observations6

ANOVA


Regression10.00001223830.00001223830.00018327020.9898470894

Residual40.26710929440.0667773236

Total50.2671215327


Intercept0.36959850640.18576109271.98964433810.117498428-0.14615697020.885353983-0.14615697020.885353983

FDT Ref/KLOC-0.00016971360.0125363369-0.01353773090.9898470894-0.03497616490.0346367378-0.03497616490.0346367378

RESIDUAL OUTPUT


10.3648395424-0.1540298956

20.36668746770.1292474917

30.36885305880.1501945602

40.3690232062-0.3555096927

50.36771280020.2751443427

60.3680556559-0.0450468063

Sheet70

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses


FDT Ref/KLOC

% FDT Uses


Sheet71

SUMMARY OUTPUT



R Square0.4285046947



Observations6

ANOVA


Regression10.11446283080.11446283082.99918260550.1583461145

Residual40.15265870190.0381646755

Total50.2671215327


Intercept0.10589993530.17083184960.61990744410.5688871858-0.36840531740.580205188-0.36840531740.580205188

FDT Refs/KLOC0.00193156280.00111534031.731814830.1583461145-0.00116511820.0050282439-0.00116511820.0050282439

RESIDUAL OUTPUT


10.4873806726-0.2765710258

20.5101034787-0.0141685194

30.41415813290.1048894862

40.1124476059-0.0989340924

50.41494998880.227907154

60.26613185220.0568769973

Sheet71

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses


FDT Refs/KLOC

% FDT Uses


Sheet72

SUMMARY OUTPUT



R Square0.2448796007



Observations6

ANOVA


Regression10.06541261430.06541261431.29716850950.3183100507

Residual40.20170891840.0504272296

Total50.2671215327


Intercept0.52190473850.16363633733.18941835930.03323467860.06757743070.97623204620.06757743070.9762320462

FF Used/KLOC-0.00523205050.0045938174-1.13893305750.3183100507-0.01798653240.0075224314-0.01798653240.0075224314

RESIDUAL OUTPUT


10.13876285140.0720467954

20.40523808910.0906968703

30.43764038180.0814072372

40.380018623-0.3665051095

50.44051728610.2023398567

60.4029944997-0.0799856501

Sheet72

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses


FF Used/KLOC

% FDT Uses


Sheet73

SUMMARY OUTPUT



R Square0.0464405633



Observations6

ANOVA


Regression10.01240527440.01240527440.1948093070.6817528974

Residual40.25471625820.0636790646

Total50.2671215327


Intercept0.43995331780.19374898762.27073866680.0856577287-0.09798011040.9778867461-0.09798011040.9778867461

FF Uses/KLOC-0.00035298220.0007997384-0.44137207320.6817528974-0.00257341190.0018674476-0.00257341190.0018674476

RESIDUAL OUTPUT


10.2918389423-0.0810292954

20.39333302830.102601931

30.36346522940.1555823897

40.414825772-0.4013122585

50.41406795710.2287891858

60.3276408022-0.0046319526

Sheet73

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses


FF Uses/KLOC

% FDT Uses


Sheet74

SUMMARY OUTPUT



R Square0.6770107274



Observations6

ANOVA


Regression10.23595470210.23595470218.38431223440.0443145287

Residual40.1125696160.028142404

Total50.3485243181


Intercept-0.27086246980.295043938-0.91804112840.4105442361-1.09003576740.5483108278-1.09003576740.5483108278

% FF Uses1.08686174340.37535359582.89556768780.04431452870.04471308982.1290103970.04471308982.129010397

RESIDUAL OUTPUT

ObservationPredicted % FF UsedResiduals

10.74631297510.2203980769

20.5577350969-0.0934493826

30.77365401080.0120602749

40.1680624650.0986042017

50.5261694753-0.0261694753

60.588802186-0.2114436954

Sheet74

0.96671105190

0.46428571430

0.78571428570

0.26666666670

0.50

0.37735849060

% FF Used

Predicted % FF Used

% FF Uses

% FF Used


Sheet75

SUMMARY OUTPUT



R Square0.3721761708



Observations6

ANOVA


Regression10.12971244610.12971244612.37121404770.1984317018

Residual40.2188118720.054702968

Total50.3485243181


Intercept0.34702608350.16813018772.06403197540.1079578397-0.11977815320.8138303201-0.11977815320.8138303201

FDT Ref/KLOC0.01747217520.01134649161.53987468570.1984317018-0.01403073590.0489750863-0.01403073590.0489750863

RESIDUAL OUTPUT


10.8369660380.1297450139

20.646720341-0.1824346267

30.42377063050.3619436552

40.4062537961-0.1395871294

50.5411613636-0.0411613636

60.50586404-0.1285055494

Sheet75

0.96671105190

0.46428571430

0.78571428570

0.26666666670

0.50

0.37735849060

% FF Used

Predicted % FF Used

FDT Ref/KLOC

% FF Used


Sheet76

SUMMARY OUTPUT



R Square0.4644673515



Observations6

ANOVA


Regression10.1618781670.1618781673.4691991450.1359939025

Residual40.18664615110.0466615378

Total50.3485243181


Intercept0.24898885450.18889374631.31814239180.257871726-0.27546426270.7734419718-0.27546426270.7734419718

FDT Refs/KLOC0.00229705150.00123326421.86257862790.1359939025-0.00112703880.0057211419-0.00112703880.0057211419

RESIDUAL OUTPUT


10.70265305670.2640579952

20.7296754531-0.2653897388

30.61557540950.1701388762

40.25677546990.0098911968

50.6165170997-0.1165170997

60.4395397203-0.0621812297

Sheet76

0.96671105190

0.46428571430

0.78571428570

0.26666666670

0.50

0.37735849060

% FF Used

Predicted % FF Used

FDT Refs/KLOC

% FF Used


Sheet77

SUMMARY OUTPUT



R Square0.3987611433



Observations6

ANOVA


Regression10.13897795560.13897795562.65292995560.1786908629

Residual40.20954636250.0523865906

Total50.3485243181


Intercept0.3351020810.16678510512.00918469760.1149057567-0.12796760770.7981717696-0.12796760770.7981717696

FF Used/KLOC0.00762630440.00468221381.62878173970.1786908629-0.00537360530.020626214-0.00537360530.020626214

RESIDUAL OUTPUT


10.89357464190.07313641

20.5051568953-0.040871181

30.4579268950.3277873907

40.5419171146-0.2752504479

50.45373348220.0462665178

60.5084271802-0.1310686896

Sheet77

0.96671105190

0.46428571430

0.78571428570

0.26666666670

0.50

0.37735849060

% FF Used

Predicted % FF Used

FF Used/KLOC

% FF Used


Sheet78

SUMMARY OUTPUT



R Square0.4387064723



Observations6

ANOVA


Regression10.15289987410.15289987413.12639608860.1517646307

Residual40.1956244440.048906111

Total50.3485243181


Intercept0.30585742420.16979412881.80134275790.1460100839-0.16556665350.777281502-0.16556665350.777281502

FF Uses/KLOC0.00123923360.00070085981.76816178240.1517646307-0.00070666530.0031851324-0.00070666530.0031851324

RESIDUAL OUTPUT


10.82585053240.1408605195

20.4695297833-0.005244069

30.57438827220.2113260135

40.3940740516-0.127407385

50.39673455310.1032654469

60.7001590165-0.3228005259

Sheet78

0.96671105190

0.46428571430

0.78571428570

0.26666666670

0.50

0.37735849060

% FF Used

Predicted % FF Used

FF Uses/KLOC

% FF Used


Sheet79

SUMMARY OUTPUT



R Square0.2177523238



Observations6

ANOVA


Regression10.043495350.043495351.11346996830.3508468156

Residual40.15625154260.0390628857

Total50.1997468927


Intercept0.64117530190.14207655364.51288608450.01071639050.246707551.03564305380.246707551.0356430538

FDT Ref/KLOC0.01011760140.00958822711.05521086440.3508468156-0.01650358480.0367387877-0.01650358480.0367387877

RESIDUAL OUTPUT

ObservationPredicted % FF UsesResiduals

10.92488452080.0109984939

20.8147190656-0.052342828

30.68561571810.2754232429

40.6754722559-0.271626102

50.7535930955-0.0202597622

60.73315349660.0578069553

Sheet79

0.93588301460

0.76237623760

0.9610389610

0.40384615380

0.73333333330

0.7909604520

% FF Uses

Predicted % FF Uses

FDT Ref/KLOC

% FF Uses


Sheet80

SUMMARY OUTPUT



R Square0.6011559396



Observations6

ANOVA


Regression10.12007903090.12007903096.02898224310.0700371653

Residual40.07966786170.0199169654

Total50.1997468927


Intercept0.49660269790.12340979794.02401354190.01581174740.15396216870.83924322720.15396216870.8392432272

FDT Refs/KLOC0.00197838220.00080572752.45539859150.0700371653-0.0002586760.0042154403-0.0002586760.0042154403

RESIDUAL OUTPUT


10.88733018060.048552834

20.9106037668-0.1482275292

30.81233279330.1487061678

40.5033090781-0.0994629243

50.8131438431-0.0798105097

60.66071849050.1302419615

Sheet80

0.93588301460

0.76237623760

0.9610389610

0.40384615380

0.73333333330

0.7909604520

% FF Uses

Predicted % FF Uses

FDT Refs/KLOC

% FF Uses


Sheet81

SUMMARY OUTPUT



R Square0.0752099522



Observations6

ANOVA


Regression10.01502295420.01502295420.32530606220.5989464574

Residual40.18472393840.0461809846

Total50.1997468927


Intercept0.69059086130.15659532394.4100350130.0116003010.25581254081.12536918180.25581254081.1253691818

FF Used/KLOC0.00250737240.00439615270.57035608370.5989464574-0.00969830420.0147130491-0.00969830420.0147130491

RESIDUAL OUTPUT


10.87420518320.0616778315

20.74650139580.0158748418

30.73097314060.2300658204

40.7585874019-0.354741248

50.72959443250.0037389008

60.74757659840.0433838535

Sheet81

0.93588301460

0.76237623760

0.9610389610

0.40384615380

0.73333333330

0.7909604520

% FF Uses

Predicted % FF Uses

FF Used/KLOC

% FF Uses


Sheet82

SUMMARY OUTPUT



R Square0.4499090987



Observations6

ANOVA


Regression10.08986794440.08986794443.27152547050.1447599027

Residual40.10987894820.0274697371

Total50.1997468927


Intercept0.56963978750.12725309554.47643167590.01102003050.21632855340.92295102150.21632855340.9229510215

FF Uses/KLOC0.00095006210.00052526311.80873587640.1447599027-0.00050830190.0024084262-0.00050830190.0024084262

RESIDUAL OUTPUT


10.9682940645-0.0324110498

20.69511969270.0672565449

30.7755097680.185529193

40.6372713296-0.2334251758

50.63931101110.0940223223

60.8719322865-0.0809718346

Sheet82

0.93588301460

0.76237623760

0.9610389610

0.40384615380

0.73333333330

0.7909604520

% FF Uses

Predicted % FF Uses

FF Uses/KLOC

% FF Uses


Sheet83

SUMMARY OUTPUT



R Square0.4642193551



Observations6

ANOVA


Regression1197.2472426709197.24724267093.46574188140.1361401113

Residual4227.653702345856.9134255864

Total5424.9009450167


Intercept1.3356223146.5969838280.20245954040.8494382299-16.980541143419.6517857714-16.980541143419.6517857714

FDT Refs/KLOC0.08018295730.04307090161.86165031130.1361401113-0.03940103650.1997669511-0.03940103650.1997669511

RESIDUAL OUTPUT

ObservationPredicted FDT Ref/KLOCResiduals

117.171635061210.8695188626

218.1149032565-0.9622445944

314.13202399-9.73963746

41.60742894891.7824015596

514.1648954805-3.0537843694

67.98716308931.1037460017

Sheet83

28.04115392370

17.15265866210

4.392386530

3.38983050850

11.11111111110

9.09090909090

FDT Ref/KLOC

Predicted FDT Ref/KLOC

FDT Refs/KLOC

FDT Ref/KLOC


Sheet84

SUMMARY OUTPUT



R Square0.6604174367



Observations6

ANOVA


Regression1280.6119929666280.61199296667.77916781510.0493565814

Residual4144.288952050136.0722380125

Total5424.9009450167


Intercept2.08514694654.3765685920.47643419790.6586229642-10.066155497614.2364493906-10.066155497614.2364493906

FF Used/KLOC0.34268436380.1228648682.78911595580.04935658140.00155680240.68381192530.00155680240.6838119253

RESIDUAL OUTPUT


127.17984617490.8613077489

29.72647924497.4261794172

37.6042216204-3.2118350903

411.3782822371-7.9884517287

57.41579260623.6953185049

69.8734279429-0.782518852

Sheet84

28.04115392370

17.15265866210

4.392386530

3.38983050850

11.11111111110

9.09090909090

FDT Ref/KLOC


FF Used/KLOC

FDT Ref/KLOC


Sheet85

SUMMARY OUTPUT



R Square0.3627871073



Observations6

ANOVA


Regression1154.1485847185154.14858471852.27733689260.2057794551

Residual4270.752360298267.6880900746

Total5424.9009450167


Intercept4.12300125186.31680156670.6527039370.5495588551-13.415251537621.6612540412-13.415251537621.6612540412

FF Uses/KLOC0.03934770240.02607388451.50908478640.2057794551-0.03304500660.1117404115-0.03304500660.1117404115

RESIDUAL OUTPUT


120.63363693657.4075169872

29.31986761277.8327910494

312.6492969504-8.2569104204

46.9240241379-3.5341936294

57.00849943134.1026116799

616.6427247576-7.5518156667

Sheet85

28.04115392370

17.15265866210

4.392386530

3.38983050850

11.11111111110

9.09090909090

FDT Ref/KLOC


FF Uses/KLOC

FDT Ref/KLOC


Sheet86

SUMMARY OUTPUT



R Square0.0651916205



Observations6

ANOVA


Regression12000.03952269542000.03952269540.27895180190.6253328274

Residual428679.35620656137169.8390516403

Total530679.3957292568


Intercept108.455136487661.70237754461.75771405910.1536261813-62.8581276157279.7684005908-62.8581276157279.7684005908

FF Used/KLOC0.91487226851.73219139950.52815887940.6253328274-3.89446206375.7242066006-3.89446206375.7242066006

RESIDUAL OUTPUT

ObservationPredicted FDT Refs/KLOCResiduals

1175.451027843622.0474591445

2128.8553757580.4070599275

3123.18953612636.4005077978

4133.2652319035-129.875401395

5122.686482885937.3135171141

6129.2476880435-46.293142589

Sheet86

197.49848698810

209.26243567750

159.59004392390

3.38983050850

1600

82.95454545450

FDT Refs/KLOC

Predicted FDT Refs/KLOC

FF Used/KLOC

FDT Refs/KLOC


Sheet87

SUMMARY OUTPUT



R Square0.0914465973



Observations6

ANOVA


Regression12805.5263470562805.5263470560.40260307010.5602247122

Residual427873.86938220076968.4673455502

Total530679.3957292568


Intercept101.007040879164.09287292531.57594809330.1901638456-76.9433024224278.9573841807-76.9433024224278.9573841807

FF Uses/KLOC0.16786369690.26455638180.63451010240.5602247122-0.56666257430.9023899681-0.56666257430.9023899681

RESIDUAL OUTPUT


1171.44409747926.0543895091

2123.177717829186.0847178485

3137.381604776922.208439147

4112.956659981-109.5668294725

5113.317045318946.6829546811

6154.4182171676-71.4636717131

Sheet87

197.49848698810

209.26243567750

159.59004392390

3.38983050850

1600

82.95454545450

FDT Refs/KLOC


FF Uses/KLOC

FDT Refs/KLOC


Sheet88

SUMMARY OUTPUT



R Square0.5217558639



Observations6

ANOVA


Regression11246.76611264511246.76611264514.36392900230.1049490429

Residual41142.7922974762285.6980743691

Total52389.5584101213


Intercept6.545636709112.97761126340.50437916320.6405111301-29.485988558342.5772619766-29.485988558342.5772619766

FF Uses/KLOC0.11190309610.05356773262.08900191530.1049490429-0.0368247730.2606309651-0.0368247730.2606309651

RESIDUAL OUTPUT

ObservationPredicted FF Used/KLOCResiduals

153.501142014819.7286340595

221.32529090540.9731653553

330.7940381975-14.6886209208

414.511619818312.6070242495

514.75186375340.8036918022

642.1511672729-19.4238945457

Sheet88

73.22977607420

22.29845626070

16.10541727670

27.11864406780

15.55555555560

22.72727272730

FF Used/KLOC

Predicted FF Used/KLOC

FF Uses/KLOC

FF Used/KLOC


Sheet89

SUMMARY OUTPUT



R Square0.8373372785



Observations6

ANOVA


Regression145.018349047245.018349047220.59076033870.0105154627

Residual48.7453495272.1863373818

Total553.7636985742


Intercept-1.67791079980.7078983323-2.37027087550.0767982732-3.64335165940.2875300597-3.64335165940.2875300597

Total LOC0.00078621360.00017326244.53770430270.01051546270.000305160.00126726710.000305160.0012672671

RESIDUAL OUTPUT

ObservationPredicted Inv 2Residuals

16.1166105603-0.0860331894

2-1.21954828691.8517692141

3-1.14092692960.0711562133

4-1.4459777959-2.2539764605

5-1.3241146921-0.0526531029

6-0.98604285580.4697373253

Sheet89

6.03057737090

0.63222092720

-1.06977071630

-3.69995425630

-1.3767677950

-0.51630553050

Inv 2

Predicted Inv 2

Total LOC

Inv 2

Total LOC Line Fit Plot

Sheet90

SUMMARY OUTPUT



R Square0.0276075522



Observations6

ANOVA


Regression11.48428411561.48428411560.11356547360.7530607615

Residual452.279414458613.0698536146

Total553.7636985742


Intercept-2.15533954946.5638499946-0.32836514410.7591060728-20.37950873716.0688296383-20.37950873716.0688296383

Avg CC/method1.20860161653.58641062580.33699476790.7530607615-8.748870610311.1660738432-8.748870610311.1660738432

RESIDUAL OUTPUT


10.40689587755.6236814934

20.22560563510.4066152921

3-0.4149532217-0.6548174947

40.7211322978-4.4210865542

5-0.7291896419-0.6475781531

6-0.2094909469-0.3068145836

Sheet90

6.03057737090

0.63222092720

-1.06977071630

-3.69995425630

-1.3767677950

-0.51630553050

Inv 2

Predicted Inv 2

Avg CC/method

Inv 2

Avg CC/method Line Fit Plot

Sheet91

SUMMARY OUTPUT



R Square0.8590408659



Observations6

ANOVA


Regression146.185214178646.185214178624.3770188170.0078318208

Residual47.57848439551.8946210989

Total553.7636985742


Intercept-3.13849995070.848437826-3.69915137520.0208509105-5.4941409995-0.7828589018-5.4941409995-0.7828589018

Total CC0.0261905420.00530461894.93730886380.00783182080.01146255880.04091852520.01146255880.0409185252

RESIDUAL OUTPUT


15.97580866820.0547687027

2-1.43611472012.0683356473

3-1.67182959820.6020588819

4-2.3265931484-1.3733611079

5-0.4408741238-0.9358936712

6-0.1003970777-0.4159084528

Sheet91

6.03057737090

0.63222092720

-1.06977071630

-3.69995425630

-1.3767677950

-0.51630553050

Inv 2

Predicted Inv 2

Total CC

Inv 2

Total CC Line Fit Plot

Sheet92

SUMMARY OUTPUT



R Square0.3850914665



Observations6

ANOVA


Regression11.1866817711.1866817712.50503250860.1886496007

Residual41.89487644080.4737191102

Total53.0815582117


Intercept0.17155707270.32951315050.52063801550.6301096555-0.74331810091.0864322464-0.74331810091.0864322464

Total LOC0.00012764770.00008065031.5827294490.1886496007-0.00009627360.0003515689-0.00009627360.0003515689

RESIDUAL OUTPUT


11.4370560689-0.0289575592

20.24597566410.1677500599

30.25874043110.6678862172

40.2092131353-1.0894692439

50.2289985240.4519571285

60.283887022-0.1691666025

Sheet92

1.40809850970

0.4137257240

0.92662664820

-0.88025610860

0.68095565260

0.11472041950

Inv 1

Predicted Inv 1

Total LOC

Inv 1


Sheet93

SUMMARY OUTPUT



R Square0.1668461337



Observations6

ANOVA


Regression10.51414607330.51414607330.80103395270.4213736071

Residual42.56741213840.6418530346

Total53.0815582117


Intercept1.71250759021.45459163311.17731159130.3043395554-2.32608622945.7511014098-2.32608622945.7511014098

Avg CC/method-0.7113247380.7947718022-0.89500500150.4213736071-2.91796501771.4953155418-2.91796501771.4953155418

RESIDUAL OUTPUT


10.20449914581.2035993639

20.31119785650.1025278675

30.68819996760.2384266807

40.0195547139-0.8998108226

50.8731443995-0.1921887469

60.5672747621-0.4525543427

Sheet93

1.40809850970

0.4137257240

0.92662664820

-0.88025610860

0.68095565260

0.11472041950

Inv 1

Predicted Inv 1

Avg CC/method

Inv 1


Sheet94

SUMMARY OUTPUT



R Square0.4505236098



Observations6

ANOVA


Regression11.38831472931.38831472933.27965763640.1443822677

Residual41.69324348240.4233108706

Total53.0815582117


Intercept-0.10016648560.4010407912-0.24976632750.8150706089-1.21363422721.013301256-1.21363422721.013301256

Total CC0.00454084810.00250739481.81098250580.1443822677-0.00242079590.011502492-0.00242079590.011502492

RESIDUAL OUTPUT


11.4800486411-0.0719501314

20.19498863860.2187370854

30.15412100610.7725056422

40.0405998044-0.9208559131

50.36754086510.3134147874

60.42657189-0.3118514705

Sheet94

1.40809850970

0.4137257240

0.92662664820

-0.88025610860

0.68095565260

0.11472041950

Inv 1

Predicted Inv 1

Total CC

Inv 1


Sheet95

SUMMARY OUTPUT



R Square0.6995757169



Observations5

ANOVA


Regression10.0297569710.0297569716.98587720210.0774512059

Residual30.01277876930.0042595898

Total40.0425357402


Intercept0.09263186460.08954197111.03450776710.3769781128-0.19233065050.3775943796-0.19233065050.3775943796

X Variable 10.00038696010.00014640492.64308100560.0774512059-0.00007896570.0008528859-0.00007896570.0008528859

RESIDUAL OUTPUT

ObservationPredicted YResiduals

10.3182295791-0.0097373781

20.35692558510.0572755984

30.2067850821-0.0583751881

40.26676389120.0599027754

50.4331567167-0.0490658076

Sheet95

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

Y

Predicted Y

X Variable 1

Y

X Variable 1 Line Fit Plot

Sheet96

SUMMARY OUTPUT



R Square0.6271408914



Observations5

ANOVA


Regression10.0266759020.0266759025.04593459160.1103138398

Residual30.01585983820.0052866127

Total40.0425357402


Intercept0.61512078230.13691228624.49280922470.02057866580.17940478311.05083678160.17940478311.0508367816

X Variable 1-0.17409592740.0775028733-2.24631578180.1103138398-0.42074466020.0725528053-0.42074466020.0725528053

RESIDUAL OUTPUT


10.27215180530.0363403958

20.36442264680.0497785366

30.200772475-0.052362581

40.4096875879-0.0830209213

50.33482633920.0492645699

Sheet96

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

Y

Predicted Y

X Variable 1

Y


Sheet97

SUMMARY OUTPUT



R Square0.3641382



Observations5

ANOVA


Regression10.01548888790.01548888791.71800633410.2812600657

Residual30.02704685230.0090156174

Total40.0425357402


Intercept0.18389241720.10963105281.67737527330.1920621211-0.16500252170.5327873561-0.16500252170.5327873561

X Variable 10.00178544140.0013621761.31072740650.2812600657-0.00254961060.0061204934-0.00254961060.0061204934

RESIDUAL OUTPUT


10.29994610970.0085460913

20.28387713690.1303240465

30.2392411013-0.0908312073

40.3677928839-0.0411262172

50.3910036224-0.0069127133

Sheet97

0.3084922010

0.41420118340

0.1484098940

0.32666666670

0.38409090910

Y

Predicted Y

X Variable 1

Y


Sheet98

SUMMARY OUTPUT



R Square0.8378278623



Observations6

ANOVA


Regression10.3531988480.35319884820.6651493670.0104501657

Residual40.06836608660.0170915217

Total50.4215649346


Intercept0.21436692110.06258967033.42495686660.02665862990.04059013730.38814370480.04059013730.3881437048

Total LOC0.00006963950.00001531924.54589368190.01045016570.00002710650.00011217240.00002710650.0001121724

RESIDUAL OUTPUT


10.9047725264-0.0021751238

20.25496672620.0480635768

30.26193067220.0107966005

40.2349105617-0.1872915141

50.2457046780.1709619886

60.2756496458-0.0403555281

Sheet98

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


Total LOC

% FDT Used


Sheet99

SUMMARY OUTPUT



R Square0.0000216202



Observations6

ANOVA


Regression10.00000911430.00000911430.00008648260.9930254237

Residual40.42155582030.1053889551

Total50.4215649346


Intercept0.35764817760.58941452640.60678548220.5767479942-1.2788288991.9941252542-1.2788288991.9941252542

Avg CC/method0.00299492940.32204918180.00929960260.9930254237-0.89115694510.8971468039-0.89115694510.8971468039

RESIDUAL OUTPUT


10.36399742790.5385999746

20.3635481885-0.0605178855

30.361960876-0.0892336032

40.3647761096-0.317157062

50.36118219430.0554844724

60.362470014-0.1271758963

Sheet99

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


Avg CC/method

% FDT Used


Sheet100

SUMMARY OUTPUT



R Square0.8993308725



Observations6

ANOVA


Regression10.37912636050.379126360535.73412803730.0039356231

Residual40.04243857410.0106096435

Total50.4215649346


Intercept0.07863297810.06349057121.23849851530.2832467541-0.09764510740.2549110637-0.09764510740.2549110637

Total CC0.00237293040.00039695695.9778029440.00393562310.00127080120.00347505950.00127080120.0034750595

RESIDUAL OUTPUT


10.9044127495-0.0018153469

20.23287345270.0701568504

30.21151707930.0612101934

40.1521938198-0.1045747722

50.3230448070.0936218596

60.3538929019-0.1185987843

Sheet100

0.90259740260

0.3030303030

0.27272727270

0.04761904760

0.41666666670

0.23529411760

% FDT Used


Total CC

% FDT Used


Sheet101

SUMMARY OUTPUT



R Square0.1000412995



Observations6

ANOVA


Regression10.02672318530.02672318530.44464840220.541381595

Residual40.24039834740.0600995869

Total50.2671215327


Intercept0.40840931010.11736755093.47974637780.02535783180.08254474790.73427387230.08254474790.7342738723

Total LOC-0.00001915530.0000287264-0.66681961740.541381595-0.00009891270.000060602-0.00009891270.000060602

RESIDUAL OUTPUT


10.2185032688-0.0076936219

20.39724174680.0986932125

30.39532621280.1237214062

40.4027584848-0.3892449713

50.39978940710.2430677358

60.3915526108-0.0685437613

Sheet101

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses


Total LOC

% FDT Uses


Sheet102

SUMMARY OUTPUT



R Square0.7475104007



Observations6

ANOVA


Regression10.19967612390.199676123911.84223671660.0262635697

Residual40.06744540870.0168613522

Total50.2671215327


Intercept1.15806206450.23575965414.9120451470.00797473610.50348832711.8126358020.50348832711.812635802

Avg CC/method-0.44328978090.1288163089-3.44125510770.0262635697-0.8009411912-0.0856383707-0.8009411912-0.0856383707

RESIDUAL OUTPUT


10.2182877289-0.0074780821

20.28478119610.2111537633

30.51972478-0.0006771609

40.1030323859-0.0895188724

50.6349801230.0078770198

60.4443655172-0.1213566677

Sheet102

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses


Avg CC/method

% FDT Uses


Sheet103

SUMMARY OUTPUT



R Square0.0361162528



Observations6

ANOVA


Regression10.00964742880.00964742880.14987804440.7183676678

Residual40.25747410390.064368526

Total50.2671215327


Intercept0.4128889760.15638518922.64020511270.0575680242-0.0213059170.8470838689-0.0213059170.8470838689

Total CC-0.00037852870.0009777544-0.38714085870.7183676678-0.00309321020.0023361528-0.00309321020.0023361528

RESIDUAL OUTPUT


10.2811609935-0.0703513467

20.38828461140.1076503479

30.39169136960.1273562495

40.4011545867-0.3876410732

50.37390052140.2689566215

60.3689796485-0.0459707989

Sheet103

0.21080964690

0.49593495930

0.5190476190

0.01351351350

0.64285714290

0.32300884960

% FDT Uses


Total CC

% FDT Uses


Sheet104

SUMMARY OUTPUT



R Square0.5853719015



Observations6

ANOVA


Regression10.20401634280.20401634285.64719953760.0762888404

Residual40.14450797530.0361269938

Total50.3485243181


Intercept0.44716741370.09099723824.91407676420.00796312660.19451857720.69981625030.19451857720.6998162503

Total LOC0.00005292710.00002227212.37638371010.0762888404-0.00000891020.0001147645-0.00000891020.0001147645

RESIDUAL OUTPUT


10.9718868467-0.0051757947

20.4780239227-0.0137382084

30.48331663430.3023976514

40.4627809131-0.1961142464

50.47098461620.0290153838

60.4937432763-0.1163847857

Sheet104

0.96671105190

0.46428571430

0.78571428570

0.26666666670

0.50

0.37735849060

% FF Used

Predicted % FF Used

Total LOC

% FF Used


Sheet105

SUMMARY OUTPUT



R Square0.0121514105



Observations6

ANOVA


Regression10.0042350620.0042350620.04920353410.8353195916

Residual40.34428925610.086072314

Total50.3485243181


Intercept0.67525232030.53266605951.2676841490.2736812144-0.80366575322.1541703938-0.80366575322.1541703938

Avg CC/method-0.06455866470.2910424853-0.22181869660.8353195916-0.87262214850.743504819-0.87262214850.743504819

RESIDUAL OUTPUT


10.53838795110.4283231009

20.5480717508-0.0837860365

30.58228784310.2034264426

40.5216026982-0.2549360316

50.5990730959-0.0990730959

60.5713128701-0.1939543795

Sheet105

0.96671105190

0.46428571430

0.78571428570

0.26666666670

0.50

0.37735849060

% FF Used

Predicted % FF Used

Avg CC/method

% FF Used


Sheet106

SUMMARY OUTPUT



R Square0.5288962048



Observations6

ANOVA


Regression10.18433318910.18433318914.49069789090.1014417879

Residual40.1641911290.0410477822

Total50.3485243181


Intercept0.36184566760.12488310462.89747495350.04422981410.01511458320.70857675190.01511458320.7085767519

Total CC0.00165460670.00078079652.11912668120.1014417879-0.00051323190.0038224453-0.00051323190.0038224453

RESIDUAL OUTPUT


10.93764879260.0290622593

20.4693951018-0.0051093876

30.45450364170.331210644

40.4131384747-0.146471808

50.5322701557-0.0322701557

60.5537800426-0.176421552

Sheet106

0.96671105190

0.46428571430

0.78571428570

0.26666666670

0.50

0.37735849060

% FF Used

Predicted % FF Used

Total CC

% FF Used


Sheet107

SUMMARY OUTPUT



R Square0.2066904339



Observations6

ANOVA


Regression10.04128577190.04128577191.04216786360.3650357686

Residual40.15846112070.0396152802

Total50.1997468927


Intercept0.71376008910.09528919657.49046182840.001699020.44919486590.97832531230.44919486590.9783253123

Total LOC0.00002380930.00002332261.0208662320.3650357686-0.00004094470.0000885632-0.00004094470.0000885632

RESIDUAL OUTPUT


10.9498051263-0.0139221117

20.72764088970.0347353479

30.7300218160.231017145

40.7207838218-0.316937668

50.72447425770.0088590757

60.73471224090.0562482111

Sheet107

0.93588301460

0.76237623760

0.9610389610

0.40384615380

0.73333333330

0.7909604520

% FF Uses

Predicted % FF Uses

Total LOC

% FF Uses


Sheet108

SUMMARY OUTPUT



R Square0.2196572827



Observations6

ANOVA


Regression10.04387585970.04387585971.12595288120.3484599153

Residual40.1558710330.0389677582

Total50.1997468927


Intercept1.13514280360.35840659863.1671928140.0339490160.14004655732.130239050.14004655732.13023905

Avg CC/method-0.20779613730.1958291604-1.06110926920.3484599153-0.75150505120.3359127766-0.75150505120.3359127766

RESIDUAL OUTPUT


10.69461499250.2412680221

20.72578441310.0365918245

30.83591636590.1251225952

40.6405879968-0.236741843

50.8899433616-0.1566100283

60.8005910225-0.0096305706

Sheet108

0.93588301460

0.76237623760

0.9610389610

0.40384615380

0.73333333330

0.7909604520

% FF Uses

Predicted % FF Uses

Avg CC/method

% FF Uses


Sheet109

SUMMARY OUTPUT



R Square0.2600209646



Observations6

ANOVA


Regression10.05193837970.05193837971.40555854750.3014115087

Residual40.1478085130.0369521282

Total50.1997468927


Intercept0.6593247850.11848914515.56443195360.00510859090.33034617820.98830339190.33034617820.9883033919

Total CC0.00087828850.00074082011.18556254480.3014115087-0.00117855770.0029351347-0.00117855770.0029351347

RESIDUAL OUTPUT


10.9649691882-0.0290861736

20.71641353850.0459626991

30.70850894190.2525300192

40.686551729-0.2827055752

50.7497885021-0.0164551687

60.76120625280.0297541992

Sheet109

0.93588301460

0.76237623760

0.9610389610

0.40384615380

0.73333333330

0.7909604520

% FF Uses

Predicted % FF Uses

Total CC

% FF Uses


Sheet110

SUMMARY OUTPUT



R Square0.7157486356



Observations6

ANOVA


Regression1304.1222716717304.122271671710.07205206840.0337396435

Residual4120.77867334530.1946683362

Total5424.9009450167


Intercept7.83521999682.63073698692.97833650260.04080599180.53112316715.13931682660.53112316715.1393168266

Total LOC0.00204347750.00064388883.17364964490.03373964350.00025575560.00383119950.00025575560.0038311995

RESIDUAL OUTPUT


128.0942562864-0.0531023627

29.02656740028.1260912619

39.2309151537-4.8385286237

48.4380458699-5.0482153614

58.75478488792.3563262232

69.6334802283-0.5425711374

Sheet110

28.04115392370

17.15265866210

4.392386530

3.38983050850

11.11111111110

9.09090909090

FDT Ref/KLOC


Total LOC

FDT Ref/KLOC


Sheet111

SUMMARY OUTPUT



R Square0.05509914



Observations6

ANOVA


Regression123.411676670823.41167667080.23324834330.6543686772

Residual4401.4892683459100.3723170865

Total5424.9009450167


Intercept3.636348096418.18989787180.19991030860.8513026307-46.866904810954.1396010037-46.866904810954.1396010037

Avg CC/method4.79999637839.93874678180.48295791050.6543686772-22.794388474432.394381231-22.794388474432.394381231

RESIDUAL OUTPUT


113.812340418414.2288135053

213.09234096174.0603177004

310.5483428812-6.1559563512

415.0603394768-11.6705089683

59.30034382281.8107672883

611.3643422655-2.2734331746

Sheet111

28.04115392370

17.15265866210

4.392386530

3.38983050850

11.11111111110

9.09090909090

FDT Ref/KLOC


Avg CC/method

FDT Ref/KLOC


Sheet112

SUMMARY OUTPUT



R Square0.7571362377



Observations6

ANOVA


Regression1321.7079028898321.707902889812.4701393140.0242020198

Residual4103.193042126925.7982605317

Total5424.9009450167


Intercept3.91307750773.13079080691.24986872290.2794828209-4.779391303212.6055463185-4.779391303212.6055463185

Total CC0.06912320550.01957438913.53130844220.02420201980.01477598870.12347042240.01477598870.1234704224

RESIDUAL OUTPUT


127.96795303420.0732008896

28.40608586758.7465727946

37.7839770177-3.3915904877

46.0558968793-2.6660663708

511.03276767790.0783434332

611.9313693498-2.8404602589

Sheet112

28.04115392370

17.15265866210

4.392386530

3.38983050850

11.11111111110

9.09090909090

FDT Ref/KLOC


Total CC

FDT Ref/KLOC


Sheet113

SUMMARY OUTPUT



R Square0.1614268853



Observations6

ANOVA


Regression14952.47929463384952.47929463380.77000744450.4297595471

Residual425726.91643462296431.7291086557

Total530679.3957292568


Intercept117.850327891538.39513255393.06940802260.037314491211.2483500548224.452305728211.2483500548224.4523057282

Total LOC0.00824626120.00939744140.87750068060.4297595471-0.0178452190.0343377415-0.0178452190.0343377415

RESIDUAL OUTPUT


1199.6037618445-2.1052748564

2122.657898195686.604537482

3123.482524319836.1075196041

4120.2829749579-116.8931444494

5121.561145450438.4388545496

6125.1070377844-42.1524923299

Sheet113

197.49848698810

209.26243567750

159.59004392390

3.38983050850

1600

82.95454545450

FDT Refs/KLOC


Total LOC

FDT Refs/KLOC


Sheet114

SUMMARY OUTPUT



R Square0.1083883507



Observations6

ANOVA


Regression13325.28910230413325.28910230410.4862581180.5240062242

Residual427354.10662695266838.5266567382

Total530679.3957292568


Intercept237.4660674475150.14281627981.58160126030.1889006548-179.3972198701654.3293547652-179.3972198701654.3293547652

Avg CC/method-57.205706741482.0362732455-0.69732210490.5240062242-284.9749160298170.5635025471-284.9749160298170.5635025471

RESIDUAL OUTPUT


1116.189969155881.3085178323

2124.77082516784.4916105105

3155.089849744.5001941839

4101.3164854031-97.9266548946

5169.9633334927-9.9633334927

6145.3648795939-62.4103341394

Sheet114

197.49848698810

209.26243567750

159.59004392390

3.38983050850

1600

82.95454545450

FDT Refs/KLOC


Avg CC/method

FDT Refs/KLOC


Sheet115

SUMMARY OUTPUT



R Square0.1953573076



Observations6

ANOVA


Regression15993.44414813655993.44414813650.97115059610.3801845815

Residual424685.95158112036171.4878952801

Total530679.3957292568


Intercept99.696521148648.42323261742.05885720060.1085932114-34.7479260224234.1409683196-34.7479260224234.1409683196

Total CC0.29835356840.30275264490.98546973370.3801845815-0.54222253071.1389296674-0.54222253071.1389296674

RESIDUAL OUTPUT


1203.5235629427-6.0250759546

2119.089503092990.1729325846

3116.404320977643.1857229463

4108.9454817682-105.5556512597

5130.426938691129.5730613089

6134.30553508-51.3509896254

Sheet115

197.49848698810

209.26243567750

159.59004392390

3.38983050850

1600

82.95454545450

FDT Refs/KLOC


Total CC

FDT Refs/KLOC


Sheet116

SUMMARY OUTPUT



R Square0.9526678203



Observations6

ANOVA


Regression12276.45540213462276.455402134680.5091020180.0008537451

Residual4113.103007986728.2757519967

Total52389.5584101213


Intercept17.57411697592.54577126966.90325842920.002309386210.505922795824.64231115610.505922795824.642311156

Total LOC0.00559081770.00062309298.97268644380.00085374510.00386083430.0073208010.00386083430.007320801

RESIDUAL OUTPUT


173.00148323430.2282928399

220.83356367041.4648925904

321.3926454361-5.2872281594

419.22340818497.8952358829

520.0899849219-4.5344293663

622.49403651470.2332362126

Sheet116

73.22977607420

22.29845626070

16.10541727670

27.11864406780

15.55555555560

22.72727272730

FF Used/KLOC


Total LOC

FF Used/KLOC


Sheet117

SUMMARY OUTPUT



R Square0.2814786323



Observations6

ANOVA


Regression1672.6096331239672.60963312391.56698823430.2788502267

Residual41716.9487769974429.2371942494

Total52389.5584101213


Intercept-16.375763804237.6159434981-0.43534103580.6857755175-120.814366001188.0628383928-120.814366001188.0628383928

Avg CC/method25.728009793220.55291019351.25179400630.2788502267-31.336017107982.7920366943-31.336017107982.7920366943

RESIDUAL OUTPUT


138.167616957435.0621591168

234.3084154884-12.0099592277

320.6725702981-4.5671530213

444.8568995037-17.7382554359

513.98328775181.5722678037

625.0463319629-2.3190592356

Sheet117

73.22977607420

22.29845626070

16.10541727670

27.11864406780

15.55555555560

22.72727272730

FF Used/KLOC


Avg CC/method

FF Used/KLOC


Sheet118

SUMMARY OUTPUT



R Square0.8507985293



Observations6

ANOVA


Regression12033.03278094852033.032780948522.80938720360.0088018138

Residual4356.525629172889.1314072932

Total52389.5584101213


Intercept8.68287587295.81934653391.49207059970.209958025-7.474220325624.8399720713-7.474220325624.8399720713

Total CC0.17376615680.03638382784.77591742010.00880181380.07274845630.27478385730.07274845630.2747838573

RESIDUAL OUTPUT


169.15349843244.0762776418

219.97767606362.3207801971

318.4137806526-2.3083633759

414.069626733113.0490173347

526.5807900212-11.0252344657

628.8397500594-6.1124773321

Sheet118

73.22977607420

22.29845626070

16.10541727670

27.11864406780

15.55555555560

22.72727272730

FF Used/KLOC


Total CC

FF Used/KLOC


Sheet119

SUMMARY OUTPUT



R Square0.6033647957



Observations6

ANOVA


Regression160073.197913281260073.19791328126.08483351190.06918811

Residual439490.44640004379872.6116000109

Total599563.6443133249


Intercept143.885955252547.56947133033.02475413810.038980754811.8119294279275.959981077111.8119294279275.9599810771

Total LOC0.02872011210.01164291642.46674553040.06918811-0.00360580630.0610460305-0.00360580630.0610460305

RESIDUAL OUTPUT

ObservationPredicted FF Uses/KLOCResiduals

1428.6171466152-9.0085123606

2160.629780607-28.5543089089

3163.50179181753.189276997

4152.3583883221-81.1719476441

5156.8100056977-83.4766723643

6169.1596539008149.022164281

Sheet119

419.60863425460

132.07547169810

216.69106881410

71.1864406780

73.33333333330

318.18181818180

FF Uses/KLOC

Predicted FF Uses/KLOC

Total LOC

FF Uses/KLOC


Sheet120

SUMMARY OUTPUT



R Square0.0118356753



Observations6

ANOVA


Regression11178.40296094211178.40296094210.04790974520.8374559783

Residual498385.241352382924596.3103380957

Total599563.6443133249


Intercept144.4493479487284.74641683230.50729118760.638640726-646.1334472442935.0321431416-646.1334472442935.0321431416

Avg CC/method34.0542690904155.58210133340.21888294860.8374559783-397.9108945891466.0194327699-397.9108945891466.0194327699

RESIDUAL OUTPUT


1216.6443984204202.9642358342

2211.5362580569-79.4607863587

3193.487495438923.2035733751

4225.4985083839-154.312067706

5184.6333854754-111.3000521421

6199.2767211843118.9050969975

Sheet120

419.60863425460

132.07547169810

216.69106881410

71.1864406780

73.33333333330

318.18181818180

FF Uses/KLOC


Avg CC/method

FF Uses/KLOC


Sheet121

SUMMARY OUTPUT



R Square0.6475980647



Observations6

ANOVA


Regression164477.223369871764477.22336987177.3506754620.0534701741

Residual435086.42094345328771.6052358633

Total599563.6443133249


Intercept87.913002889357.72957720021.52284162040.202462784-72.3699991444248.1960049229-72.3699991444248.1960049229

Total CC0.9785796240.36093794742.71121291340.0534701741-0.02354477331.9807040213-0.02354477331.9807040213

RESIDUAL OUTPUT


1428.4587120259-8.8500777714

2151.5206784464-19.4452067483

3142.713461830873.9776069833

4118.2489712319-47.0625305539

5188.7067041567-115.3733708234

6201.4282392681116.7535789137

Sheet121

419.60863425460

132.07547169810

216.69106881410

71.1864406780

73.33333333330

318.18181818180

FF Uses/KLOC


Total CC

FF Uses/KLOC


Sheet122

SUMMARY OUTPUT



R Square0.1442521212



Observations5

ANOVA


Regression17.55742738327.55742738320.50570544690.5283086178

Residual344.832979928314.9443266428

Total452.3904073116


Intercept3.88824484065.44839995970.71364893720.5269538451-13.450995478721.22748516-13.450995478721.22748516

Fan In/method-1.73152247762.4348898426-0.71112969770.5283086178-9.48042865996.0173837047-9.48042865996.0173837047

RESIDUAL OUTPUT


11.15243932614.8781380448

2-1.35826826641.9904891935

3-1.1678007938-2.5321534625

41.5853199455-2.9620877405

50.8580805049-1.3743860354

Sheet122

6.03057737090

0.63222092720

-3.69995425630

-1.3767677950

-0.51630553050

Inv 2

Predicted Inv 2

Fan In/method

Inv 2

Fan In/method Line Fit Plot

Sheet123

SUMMARY OUTPUT



R Square0.919131641



Observations5

ANOVA


Regression148.153681042548.153681042534.09732750070.0100077725

Residual34.23672626911.4122420897

Total452.3904073116


Intercept-5.26571877611.0784568618-4.8826420070.0164257555-8.6978498309-1.8335877213-8.6978498309-1.8335877213

Total Fan In0.04287693990.00734283235.83929169510.01000777250.01950877030.06624510950.01950877030.0662451095

RESIDUAL OUTPUT


15.83940865830.1911687126

2-0.9780247861.6102457132

3-3.6363950599-0.0635591965

4-0.2919937476-1.0847740474

50.1367756514-0.6530811819

Sheet123

6.03057737090

0.63222092720

-3.69995425630

-1.3767677950

-0.51630553050

Inv 2

Predicted Inv 2

Total Fan In

Inv 2

Total Fan In Line Fit Plot

Sheet124

SUMMARY OUTPUT



R Square0.0669864736



Observations5

ANOVA


Regression13.50944863583.50944863580.21538746770.6741803492

Residual348.880958675816.2936528919

Total452.3904073116


Intercept1.85776588043.97543806160.4673109860.6721265601-10.793852289114.5093840498-10.793852289114.5093840498

Fan Out/method-0.5845703191.2595822895-0.46409855390.6741803492-4.5931233223.423982684-4.5931233223.423982684

RESIDUAL OUTPUT


10.71785375835.3127236127

2-0.8897146191.5219355462

3-0.5682009436-3.1317533127

41.3901096251-2.7668774201

50.4197228956-0.936028426

Sheet124

6.03057737090

0.63222092720

-3.69995425630

-1.3767677950

-0.51630553050

Inv 2

Predicted Inv 2

Fan Out/method

Inv 2

Fan Out/method Line Fit Plot

Sheet125

SUMMARY OUTPUT



R Square0.9185165084



Observations5

ANOVA


Regression148.12145399548.12145399533.8172735280.0101241707

Residual34.26895331661.4229844389

Total452.3904073116


Intercept-4.86568640691.0235242391-4.75385557190.0176661009-8.1229973396-1.6083754743-8.1229973396-1.6083754743

Total Fan Out0.03277187450.0056354945.81526212030.01012417070.01483721760.05070653140.01483721760.0507065314

RESIDUAL OUTPUT


15.58854156410.4420358068

20.21395414330.4182667839

3-3.096005183-0.6039490733

4-2.57165519071.1948873957

Documents

An exploratory investigation on the Invasiveness of Environmental Modeling Frameworks