Upload
splunk
View
91
Download
2
Embed Size (px)
Citation preview
Copyright©2016SplunkInc.
MOLINAHEALTHCAREBenGordonVicePresidentEnterpriseInfrastructureServices
JonHansonAVPEnterpriseInfrastructureServices
2
AboutMolinaHealthcare• Fortune500company• Foundedin1980byDavidMolina,MD,stillledbyfamily• CEOJ.MarioMolina,MD,startedoutsweepingfloorsasachild• Providesqualityhealthcaretopeoplereceivinggovernmentaid• Medicaid&StateChildren’sHealthInsuranceProgram(SCHIP)• Providesplansin13states+1U.S.territory,operatesin26states+Washington,D.C.+2USTerritories(PuertoRico,USVI)
3
AboutUs/OurTeam
• BenGordon,VicePresidentEnterpriseInfrastructureServices• JonHanson,AVPofEnterpriseandInfrastructureServices
• MainPurpose:Weowndesign,build &engineeringofallinfrastructureplatforms,fromdatabasestothenetwork
• Mainchallenges:keepingupwithgrowth&movingtowardsautomationandself-healing
4
Splunk atMolinaHealthcare• SplunkEnterprise&ITSI• 4TBlicense• 98%virtualizedenvironment• 20,000virtualmachines&servers– V-blockshop,hyperconverged&cloud
• In-houseenvironmentduetoPHIdata• Highperformance,highdensityhardwarefromCisco– Expandableplatform,petabyteinaquarterrack
• Primary&secondarydatacenters• 32indexers,6searchheads
5
BeforeSplunk• Constantlyconcernedhowtomeasure,monitorand
keepvisibilityaroundourdiverseinfrastructure• Challengedtomanageservicesthatweredistributed,deciding
exactlywhattomonitorandmanage• De-centralizedlogs• Toomanytoolstomanageeffectively• Difficulttotrackdownissues• Lackofcollaboration
“Thechallengeofwhattomanageandmonitorinourdiverse
infrastructureisaneedle-in-a-
haystackproblemthatcouldmoveonadailybasis.”
6
ChoosingSplunk• Tryingtosolvetwoproblems:
– Neededarobustloggingtool– Neededacentralaggregationandcorrelationtoolprovidingactionabledatatoourengineersinrealtime
• RealizedSplunkcandoalotmorethantracklogs• Soughtaflexibleplatform,unencumberedbytraditionalsystemcostsandissues
• Conducted“before/after”toolsrationalizationexercisetoconfirmvalue
“ThetruthisSplunkshinedinourbigbake-off.One
advantagewehadwaswehadalreadyusedSplunk&it hadprovenitsvalue.
Wewentwithwhatweknew.It'stried.It'strue.It'sflexible– it’sagreattool.”
7
Splunk Benefits• Valueatalllevels,allusers,CEOondown• DramaticallyreducedMTTR(speedofdelivery)>150%• Resolvingissuestakesminutesonaverage,nothours• Retiringold,classicaltoolssavestime&$$• Real-time&historicalinfoimprovesbusinessinsights• Automatedprocessesimproveprocesstimes,outcomes,andcustomersatisfaction(theonlystatthatreallycounts)
“YoucanderivevaluefromSplunkatanylevelofthebusiness,fromtheCEOdowntoanyuserthefirstdaystartingout.”
8
9
Congrats,MolinaEmployees!
10
Timetogettowork!
UMK2?
11
12
SplunkVisibility
“AnyonecanjoinMolinaandnowderiveknowledgeandvaluefromSplunkonDay1.”
• Singlepaneofvisibility– Cannowseeendtoendfrombusinessprocesstosupportinginfrastructureandservices
• Nowhaveasmallersetoftoolsandmeanstomanage• Technicalfolksseehowtheireffortsaffectbottomline• Nolimitationtodrillingdownintothedata
13
14
CentralizedLogginginSplunk
“Splunkgivesusthelogs,
centralizesandindexesthemand
allowsustoflexiblyaddinnewsourcesofinformationandtrynewthings–there’srealpower
inthat.”
• Neededareallygood,robustloggingtool• Flexibleplatformadjuststoanytypeofmachinedata• Canaddinnewsourcesofinforapidlyandevaluate• Abletogetrightdownintothelogs– 100%• Unencumberedbytraditionalsystemintegrationandsetupcosts
15
16
17
18
19
MTTR&TroubleshootingGainsinSplunk
“Thisplatformishelpingtheballbouncemuchless—lesshighandlessoften.”
• GettingrighttoolsandvisibilityinplacedramaticallyreducesMTTR>150%
• Resolvingissuestakesminutesonaverage,nothours• Dev,Ops,&Businessstaffsharesameviewandvocab• Speakingsamelanguageisinvaluableintroubleshooting• ViewingKPIsinshareddashboardskeepsfocusonkeyitems• Improvesserviceforendusersandcustomers(internalandexternal)
20
21
HowtoRepresentKeyMetricsinSplunk“Shared
dashboardsthateveryone'slooking
atreallycontributeto
resolutiontimesandmakesurethefocusofalltheteamsareonthemostimportantbusinessitems.”
• Privateandpublicdashboardsautomateprocesses• SinglepaneofglasswithinSplunkITSI
• ViewingKPIsonashareddashboardcontributestoimprovedresolutiontimes
• Customdashboards– Trackstoragecapacity,consumptionandthresholds– Reclamationofstorageonthefloor– AutomationroutinesinSaltStack cleanwastedspace
• LotsofroomtogrowwithintheSplunk ecosystem
22
23
24
SuccessStory- Splunk&QNXT
“Themethodologytheteamputinplacewasn’ta
bunchofinfrastructurethatOperationsbuiltout.
Thiswasajointeffortbetweenthedevelopmentandinfrastructurecommunity.”
• GainedvisibilityandimmediaterecognitionofQNXT– Whatitis,whereitflows,whatcomprisesitsecosystem– Shattersthelearningcurve,liftsthepeopleupbythebootstraps
• Phenomenalcollaborationindevelopmentcommunity– Everyonein1roomworkingtogetherisapowerfulinstrument– Theyunderstandadjudicationprocesses,queuesandworkflows
• Changedfromthepasttoreal-timeviews• Abletoleveragealltoolsinthetoolbelt
• Causedashiftintheorganizationandthoughtprocess– Focusonbusinessoutcomesfirst– Canseeandunderstanddependenciesandassociations
25
Splunk forMetrics,CallCenterMgmt
“Weonlyneedafewtoolstoget95percentofwhatyoureallywant,andthen
Splunk candotherest.”
• Splunk atcenteroftelemetry/metricsaggregationplatform• Focusedonservicesandwatchingwherethemoneyflows
– Monitorinfrastructureandapplicationdependenciesaroundservices
• ITSMcoretovisuallyrepresentingourprocesses• Trackingcallcenterinformation
– BuildingourowndashboardsinSplunk– Savesmoney(millions)vscompetitortools– Co-innovatingwith80%ofteamsunderstandingdatasets– SupportsCiscoTACpartnership
Splunk UseCases
CallCenterManagement
BusinessIntelligence&Visibility
Dashboards
CentralLogging
MTTR,CustomerServiceandTroubleshooting
ApplicationMgmt (QNXT)
27
Users• Infrastructureteam• IT• Operations• Developers• Business• OtherSupportstaff• Partners(Cisco)
28
Splunk Tips&Tricks….• Oneofthefewtoolsthathasvalueforanyuserandlevelinthebusiness• Understandwhatoutcomesyouwantandwhatyouneedtogetthere
• MakeuseofProfessionalServices
• Tounlockvalue,committoputtinginformationinandleveragingtheSplunkplatformtogetthedesiredresultsout
• Re-examineallofyourtoolsandaskyourselvesifthetoolisfitforitspurposeandaretheyrobustandflexibleenough?
• Getridofoldtoolsrequiringmanualeffortandleveragesmarttoolsthatintegrategracefullytogether—otherwise,you'llnevergetyourhandsaroundtheITbeast
29
Splunking Ahead….• Incorporatesecurityvisibilityintotheplatform• Incorporatemoreanddifferenttoolsintothetool• NewdatamodelswithCisco• IntroduceCiscoTACintoITSI• Increasinglyleverageplatformtobeproactiveandresponsive
– Continuouslyimprovecustomerexperienceandprocesses
• Lookatlong-termtrends
ThankYou