Intelligent DevOps - Driving Continuous Delivery by Harnessing the Power of Analytics and Autonomics

World®’16

Pre-ConEducation:IntelligentDevOps–DrivingContinuousDeliverybyHarnessingthePowerofAnalyticsandAutonomicsShamimAhmed- Sr.DirectorPreSales- CATechnologies

DO5X48E

DEVOPS

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation


Abstract

Digitaltechnologiesarerapidlytransformingbusinesses.Thesesystemsneedtobeextremelyresponsivetoficklecustomersentiment,workacrossavarietyofdevices(fromlaptopstowearables)andnetworkconditions.SuchscenariosputevenmorepressureonITsystemsandprocessestobenotonlymoreresponsive,butadaptivetomeetdigitalbusinessneeds.WhileautomationsolutionswithincurrentDevOpsimplementationshelptoaddressagilityneed,suchautomationistypicallydrivenbystaticrulesusingconventionalscriptingandorchestrationtechniques.

Suchtechniquesincurhighmaintenanceoverheadstokeepthemupdatedrelativetochangingcircumstances.Therecentemergenceofpredictiveanalyticsandcognitivetechnologies(suchasautonomics)haveopenedthepossibilitytodriveadaptiveautomationwithinContinuousDeliveryimplementations.Suchautomationisabletoself-healandself-configurebasedonchangingsituations.

JointhissessionandlearnhowCAishelpingtopowerthenextgenerationofsuchintelligentDevOpsimplementations.

ShamimAhmedCATechnologiesSr.DirectorPreSales


DIGITALTRANSFORMATIONIMPACT

CHALLENGESFORDEVOPS

SOLUTIONFOUNDATIONS:ANALYTICSANDAUTONOMICS

WHATINTELLIGENTDEVOPSLOOKSLIKE

CASOLUTIONSFORINTELLIGENTDEVOPS

Agenda

1

2

3

4

5


DigitalTransformationanditsImpact


AUTONOMICS GENOMICS

ROBOTICS

INTERNETOFTHINGS AV/VR

OMNICHANNEL

DigitalTransformation


TheDigitalEcosystem

"Theexplosionofdatasourcesandcomplexityofinformationmakesmanualclassificationandanalysisinfeasibleanduneconomical"

- Gartnertop10StrategicTechnologyTrendsfor2016


IntelligentAnalyticsistheNewBattleground

>50%largeorganizationsgloballywillcompeteusingadvancedanalytics&proprietaryalgorithms

40%enterprises'net-newanalyticsinvestmentwillgotopredictive/prescriptive

75%technology-orientedbusinessintelligencecompetencycenterswillevolvetofocusoninformationvaluegeneration

Source:Gartner


HowEnterprisesareTransforming

AGILE ADAPTIVE COGNITIVE


ChallengesPosedforDevOps


KeyChallengesPosedbyAdaptiveDigitalSystems

AUTOMATIONMAINTENANCE

STATICRULES BIG(un-structured)DATA

IOT,IOE

CX SECURITY

STRUCTUREDAUTOMATION


Whatweneedfornext-genDevOps

AUTOMATED&SELF-HEALINGAUTOMATION

DYNAMIC/ADAPTIVERULES

BIGDATAANALYTICS

IOT-Ops

CX-Ops SEC-Ops

INTELIGENT/ADAPTIVE/COGNITIVEAUTOMATION

+ +

+

+

+

+

+


ClassicDevOpstechniquesdonotfullyexploitdataoneithersideofthe“releaseboundary”

People

Process

Tools

Data


TheKeyTransformationsNeeded

TRADITIONALDEVOPS

INTELLIGENTDEVOPS

Focusonautomation,efficiencies,metrics,

speed,quality

FocusonCX,adaptiveautomation,predictiveoutcomesandinsight


CONTINUOUSDE

LIVE

RYM

ATURITY

ManualScripted

Orchestrated

Continuous

Intelligent

BUSINESSVALUE

LEVEL1 LEVEL2 LEVEL3 LEVEL4 LEVEL5

?

Organizationdepthandbreadthof

agilepractice

*Applicationreleaseautomationview

ContinuousOptimization

End-to-EndConnection

Consistency&Collaboration

Heroes&HeavyLifting

IntelligentDevOpsExtendstheMaturityJourney

MAT

URITY


IntelligentDevOpsispartofthe“ThirdWay”


SystemofIntelligenceforDevOps

FoundationforIntelligentDevOps

DevOpsInsight/Analytics

DevOpsAutonomics


SolutionFoundations:AnalyticsandAutonomicsOverview


SystemsofIntelligence

SOI

Visualization

(Big)Data

Analytics

Inference

IntelligentProcess

Automation

DigitalTechnologyIntegrations


AnalyticsOverview

Whatishappening?

Whyisthishappening?

Whatwillhappenandwhy?

Whatshouldwedo?

Areweaskingtherightquestions?

Predictiveanalytics

DescriptiveAnalytics

DiagnosticAnalytics

PrescriptiveAnalytics

DeepLearning


ExamplesofAnalyticsUsecases

Whatarethepastdefecttrends?

Whatweretherootcauseofthepastdefects?

Whatdefectsarewelikelytofind?

Whatpreventivemeasuresshouldwetake?

Haveweoverlookedanythingfordefectprevention?

Predictiveanalytics

DescriptiveAnalytics

DiagnosticAnalytics

PrescriptiveAnalytics

DeepLearning


AutonomicsOverview

DO THINK LEARN

StructuredData Un-StructuredData


ExamplesofAutonomicsUseCases

DO THINK LEARN

Scripting Orchestration Autonomic Cognitive

• Self-healingvirtualservices

• Self-healingtests/suites

• Self-healingtestdata• Self-healing

topologies• Autonomousrelease

decisionmaking

• Buildautomation• TestAutomation

scripting• Environment

provisioningscripting• Deployment

automationscripting

• Buildsofbuilds• Model-based

topologydeployment• E2EContinuous

Delivery

• Automatedtestautomation

• NLP-basedtestreverseengineering

• Dynamicbuildpromotion


HowAnalyticsandAutonomicsworktogether

Model Progressive Refinement


WhatDoesNext-GenIntelligentDevOpsLookLike?


IntelligentDevOpsCharacteristics

§ Failuredetectionandprevention

§ Scriptedautomation

§ Limitedprocessautomationbasedonstaticrules

§ Individualmetricsbasedonstructureddatainlifecyclesilo

§ Limitedinsightandperspectives

§ Reactive:dealswith“Past”

§ Failureprediction

§ Automatedautomation

§ Intelligentprocessautomationbasedondynamicinference

§ Analyticsbasedonlargescalestructuredandunstructureddataacrossthelifecycle

§ FocusonInsights

§ Predictive:from“Whatdidhappen?”to“Whatwouldhappen?

TRADITIONALDEVOPS

INTELLIGENTDEVOPS


PortfoliobacklogprioritizationandvalueanalysisImproved

schedulingandcapacity

Validatedrequirementsin

backlogImprovedestimates

Predictfailuresbasedoncode

commitsDynamiccodepromotioncriteria

Predictdefects/failuresOptimizedTests

Scenarioidentificationbasedontrends

CXScoresAnomalydetectionBetterloadbalancing

ExamplesofDevOpsIntelligence

PLAN DEFINE DEVELOP TEST RELEASE OPERATEProcess

IntelligentDevOpsbasedonContinuousInsight

ExamplesofDevOps

Intelligence

ExamplesofOutcomes

Investmentdecisionanalytics

Codequalityanalytics

TestOptimization&Defectprediction

A/BTesting

Log&CXAnalytics

CX-basedrequirements


DefineIntelligenceExample

OMNI-CHANNELFEEDBACKINGESTION

FEATUREREQUESTS

HATEDFEATURES USABILITY NPS

ReqValidation UXFixes Remediation

BIGDATAPROCESSING

INSIGHTS

SOLUTIONS A/BTestScenarios

SOI


DevelopIntelligenceExample

Code

Coveragedata

CodeQualitydata

Builddata Unittestdata

SOISCMdata

§ Failuremodeanalytics

§ Qualityriskprediction

§ Promotiondecisionanalytics

§ Teamperformanceanalytics


SOI

§ Identifymissingtestcases

§ Performancescenarios

§ Testdata

§ Defect/scheduleprediction

§ Appstabilityprediction

§ Testoptimization

§ Fixrateprediction

§ Rootcaseprediction

§ Self-healingtests/testdata

§ Self-healingvirtualservices

TestIntelligenceExample

Testexecutiondata

Defectdata

Testscheduledata

Testenvironmentdata

Productionlogdata


SOI

§ Correlatingdata(requirementsthrurelease)acrosslifecycle

§ Deploymentfailureprediction

§ Self-healingtopologies/workflows

§ Deploymentworkflowoptimization

§ A/Bscenarioidentification

Release/DeployIntelligenceExample

Testexecutiondata

Builddata

Topologydata

Releasepayloadandscheduledata

Deploymentdata


SOI

§ Capacityallocation

§ Anomalydetection

§ Automatedeventcorrelation

§ CX/NPSscores

§ Testscenarios/data

§ Mobileanalytics

OpsIntelligenceExample

Logdata Ticketdata

CXData Incidentdata

Monitoringdata


HowWeCandoBetterX-LifecycleIntelligence:DataHubIntegration

DevHub TestHub OpsHub

DEPLOYMENTHUB


ExampleofDevelopmentHub

IDE

Build

CodeTest

Testing

Backlog

CI

SCM

Data

Virtualization

TestData

Topology

Deployment


WhyweNeedaHub

IntegratedOrchestration:

FocusofControl

IntegratedChangemanagement:

UnderstandImpact

Scale:

SupportAgileatScale

IntegratedReporting:

OneSourceofTruth

IntegratedAnalytics:

IntelligentInsight


BeyondHubs– DevOpsDataLake

PLAN DEVELOP TEST RELEASE OPERATEPROCESS

X-LIFECYLEINSIGHT

DATAHUBS

LIFECYCLEDATALAKE


ExampleofX-LifecycleIntelligence:ContinuousAdaptiveTestOptimization

ExistingManualTestCases

StaticallyOptimizedTestCases

OptimizerwithNLP

UnstructuredPartialcoverage

TestbloatLoweffectiveness

Analog–difficulttomaintain

Dynamically-OptimizedTestCasesbasedonContinuousInsight

NewRequirementsandBizProcesses

Fewestteststeps(reduceby>30%)Greatercoverage

HighereffectivenessFullydigitized–easytomaintain

ContinuousoptimizationHighesteffectivenessReduction>50%

PLAN OPSDEV RELEASE


CASolutionsforIntelligentDevOps


CASolutionsAcrosstheDevOpsLifecycle

Define Develop Build DIT QA Release OperatePlan

Process

Stage

CAAPIM

CADevTest (SV+AppTest +CAI),Blazemeter

CATDM

CAARD

CARA/CDE

CAUnifiedMonitoringCAITSM

CAPPM,AgileCentral


AnalyticsasPartofCA’sDNA

REALTIME,BIGDATAANALYTICSEMBEDDEDTHROUGHOUTOURPORTFOLIO

AGILEMANAGEMENT AGILEOPERATIONS DEVELOPERPRODUCTS

CONTINUOUSDELIVERY MAINFRAME SECURITY

APIanalyticsReleasemanagementanalytics AccessincidentresponseIntelligentOperations


CAAnalyticsisaCommonTechnologyComponentembeddedinourproducts

BestofBreedOpenSourceTechnologies

(Hadoop,Spark,Kafka,Elasticsearch)

IndustryProvenArchitecture

(Lambda&MicroServices)

SingleCodeLine,MultipleDeploymentOptions

(Cloud,OnPrem,Mainframe)

EncapsulatedComplexTechnologythroughSimpleConsumableInterfaces

(RESTfulAPIs)

CAAnalytics


Jarvis:CAReferenceArchitectureforSOIDATACOLLECTORS

DataAggregator

Agents

…

Probes

Machine/LogFileData

DATA-DRIVENAPPS

ExistingCAApps

Custom-buildApps

NewCAApps

PartnerApps

ANALYTICSENGINE

DataIn

jectionAP

I

DataAccessA

PI

ServiceLayer

DataExtraction

DataProcessing(Speed)

DataProcessing(Batch)

DataBus

SessionIET03T:“AnalyticsatCA– What’sCooking?ProjectJarvis”Wednesday,November16:04:30PM- 05:15PMCAAcceleratorZone


§ Realtimeadvisorforcodedelivery

§ Architecturalmodeling

§ Riskreporting

§ Teamoptimizer

CADevelopIntelligence:CodePilot.ai

CodeDeepmachinelearningNeuralmapofcode

SessionIET07TV:“UnlockDeveloperProductivitywithCodePilot.ai”Thursday,November17:04:30PM- 05:15PM,CAAcceleratorZone


CAAppsHubusingAgileCentral

IDE

Build

CodeTest

Testing

Backlog

CI

SCM

Data

Virtualization

TestData

Topology

Deployment

AgileCentral

Studio Visual

Eclipse

IntelliJ

Electric Cloud

CloudBees

Junit

Nunit

TestNG CA AppTest

ALM,UFT

CA TDM

CA SV

CA Rally CA

RA

CA RA


Plan Define Unittest Code Checkin Build Provision Test Release

ScalingAgileDevelopmentwithaCAEnterpriseAppsHub

IntegratedanalyticsDecisionengine

IDE BuildUnittestAgilePod

2

SCM

Unittest BuildAgilePod

N

IDE SCM

Unittest IDE BuildAgilePod

1

SCM

IntegratedtoCAACHub

IntelliJ

…

AgileCentral


CATestIntelligence:LearningVirtualService

BRINGSTRUEARTIFICIALINTELLIGENCE(AI)TOSERVICEVIRTUALIZATION§Virtualizeserviceswithoutrequiringanyknowledgeordecodingoftheserviceprotocols§Appliesagenomesequencealignmentalgorithm,discoversbyte-levelpatternsinmessageprotocols§NowvirtualizeamuchwiderrangeofprotocolswithoutrequiringanewDPH

HIGHACCURACY:99.6– 100%§IncreasedspeedandaccuracywithEntropyWeighting+MessageClustering§Themoredataaserviceobservesthedata,moreintelligentitbecomes§Perfectforperformancetestingwherewedealwithtonsofdata


CATestIntelligence:Self-HealingVirtualService

§ Automaticallylearnthedifferencesbetweentestandliveenvironments

§ Self-heal asneeded


CATestIntelligence:ReverseEngineeringofLegacyTests

ExistingManualTestCases

StaticallyOptimizedTestCases

CAAgileReq.Designer(NLP)

OptimizedcoveragepathsIdentifytestdatacoverage

SessionD05X275:“What'sNewinCAAgileRequirementsDesigner?”Thursday,November17:12:45PM– 1:30PM,LagoonL(L2)


CAApplicationInsightforActionableIntelligence

AUTOMATETHEAUTOMATION

MineDefectsinLive

App

AutomateTest

Creation

AutomateVirtualServiceCreation

Provision Configure Deploy Test

EnvironmentApp,MW,DB

Build/CIDevelop

DevTestProd

Environments


Numerous,uncoordinatedtoolsandtechnologiesalongtheSDLC

CARelease/DeploymentHubwithCARA+CDE

CAReleaseAutomationDeploymentHub

125Out-of-boxintegrationsworkseamlesslywithanyenvironment

CommunityForintegrationinfo&community-supportedactionpacks

RDK(RapidDevelopmentKit)toadapttonewtools&technology

1800Actionstoorchestratetheentirereleasepipeline

InfrastructureProvisioning

ConfigurationManagement

ApplicationPlatforms/PaaS

vSphere

VersionControl/ ArtifactRepository

Planning&Requirements

ChangeManagement

TestAutomation

DatabasesCI/BuildAutomation


ScalingEnterpriseDeploymentacrossapps

ReleaseA

ReleaseB

ReleaseC

Manageand monitormulti-applicationcontentthrough thereleasecycle

CACDEDeploymentHub

Feature1

Story2

Feature3

Feature4

Featuren

§ Releaseandtrackfeaturesindependentlyorgroupedbasedonbusinessrequirements

§ Mapcustomerfeedbacktouserstories,featuresandbugfixesmovingthroughthereleasepipeline

§ Gainvisibilityofandreconciledependencies


AnalyticsScorecardinCAReleaseAutomation


CAAppExperienceAnalytics

USERBEHAVIOR&EXPERIENCEOutside-InView

OPERATIONALPERFORMANCEInside-OutView

CAAppExperienceAnalytics

Optimizecustomerjourney

Designfortheexperience

Improvedigitalperformance


MobileAnalytics

CAAppExperienceAnalyticsKeyCapabilities

UserExperienceAnalyticsacrossweb,mobile,wearables

PerformanceAnalytics

DataStudio&Blueprints

FlexibleDynamicDashboards

§ CrashAnalytics§ UserSessionPlayback§ AppFlows§ HeatMaps

SaaS&onpremise

end-to-endencryption,

flexibleofferings


Example:CNNPoliticsApp– PoweredbyCATechnologies

CAMobileAppAnalyticswillenabletheCNNPoliticsappwith–

§ Visibilityintoreal-timeusageandappbehavior

§ Proactivealerting

§ Symbolication – Showsreasonforcrashincludinglinenumberandclass/methodwithoutneedtotroubleshoot

§ Captureuserfeedback,sessionreplayandrealtimeappperformanceanalytics

CAAPIManagementtoolswillenabletheCNNPoliticsappwith–

§ AllowingdeveloperstoeasilyandquicklybuildAPIsusingCALiveAPICreatortomultiplepollingandelectionfundingdatasets

§ HelpingCNNstreamlinetheprocessingofthevariouselectionrelateddatastreamsintousablecontentbyorchestratingCNN’suseofAWSLambdacapabilitiesusingCAMobileAPIGateway

§ ManagingandsecuringthedataAPIsaswellasotherfunctionalAPIsusingCAMobileAPIGateway,forconsumptionbyvarioususersglobally


Questions?


RecommendedSessions

SESSION# TITLE DATE/TIME

DO5T01SKeynote:End-to-EndIntegratedContinuousDeliveryEcosystem:HowtoDriveInnovationandDifferentiation 11/16/2016at10:30am

DO5T02PLeadershipPanel:DevOpsLeadersDiscusstheJourneytoContinuousDelivery 11/16/2016at01:45pm

DO5T14SAnalystKeynote: ContinuousDelivery:MakingDevOpsAwesome 11/17/2016at10:30am


MustSeeDemos

ModernizeAppDelivery

IntegratedCDTheater5- DOV501P

DeliverTestDataFaster

TestDataManagerTheater5- DOV513P

DeliverBetterApps

ServiceVirtualizationTheater5- DOV510P

OrchestrateYourReleaseReleaseAutomationTheater5- DOV512P


Thankyou.

Stayconnectedatcommunities.ca.com

@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.60 @CAWORLD#CAWORLD

DevOps– ContinuousDelivery

FormoreinformationonDevOps– ContinuousDelivery,pleasevisit:http://cainc.to/PiTFpu