Transform IT with a New Generation of IT Assessment Tools (242310030)

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 1/44

!"#$%&'"( *! +,-. # /0+ 10$0"#2'$ '& *!

3%%0%%(0$- !''4% Leah Lang and Ron Yanosky, EDUCAUSE



"Efficiency, effectiveness, and value

are what all higher educationinstitutions are striving for.

However, these are hard to attain

without measures of efficiency,

productivity, and maturity!"

— Diana Oblinger,

President and CEO, EDUCAUSE







"Efficiency, effectiveness, and value

are what all higher educationinstitutions are striving for.

However, these are hard to attain

without measures of efficiency,

productivity, and maturity!"

— Diana Oblinger,

President and CEO, EDUCAUSE



Current Practices for

Measuring IT Costs inHigher Education

!"#$%&' )* +,-

!"#$%#&! $()*(+ ,-+ %)./0121 .)3

4(1(.+567 8.0 9:7 ;<9=7 .>.2/.?/(

,+-@ 6ABCDDEEEF(3G5.G1(F(3GD(5.+





5%6

76



86



96



:6



EDUCAUSE IT Assessment Tools

%>.2/.?/( )-E

H

$-+( ".*.&(+>25(

I) "(>(/-B@()*

H

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

H

&*+.*(L25 IM%11(11@()*4(B-+*1




%>.2/.?/( )-E

H

$-+( ".*.&(+>25(



K4!!

N!O$P8%4QIOR

&!4SI$!



IT financials, staffing, and services

Step 1: Complete the survey

Administration and Management of IT

IT Support ServicesEducational Technology Services

Research Computing Services

Data Center services

Communications Infrastructure

Enterprise Infrastructure and ServicesInformation Security

Identity Management

Information Systems and Applications

+,- ./'#0& 1&234&5&"



Complete CDS 2014 by 10/17/14!

Go to www.educause.edu/coredata to get started.



CDS Reporting is powered by

Step 2: Access the data



Over 66% of CDS participants use

CDS Reporting!

TU9

VUU

<

;<

W<

:<

T<

9<<

9;<

9W<

9:<

$"&4 ;<9= G)2XG( G1(+1 Y)(E *-$"&4Z

$"&4 ;<9= G)2XG( G1(+1 YG1(3 $"&4;<9;Z

$"&4 ;<9= 5G@G/.[>( G)2XG( G1(+1

$"&4 ;<9; 5G@G/.[>( G)2XG( G1(+1



CDS Executive Summary Report

CDS Almanacs ECAR analysis of Core Data (accessible to ECAR subscribing institutions)

Step 3: Gain additional insight



CDS collects metrics on over 100 IT topics!

All Non-Specialized U.S. Institutions Associate's Colleges (AA)

Baccalaureate Colleges (BA)

Doctoral Institutions (DR EXT and DR INT)

Master's Institutions (MA I and MA II)



CDS Usage at VCCS

Virginia Community College System



About VCCS

•

23 Community Colleges across Virginia (very independentcolleges)

• 400,000 students

•

Single instance for ERP (PeopleSoft)• Single instance for LMS (Blackboard)

• Private, statewide network – controlled by system to the edgerouter

• Colleges control edge-router in

•

Mature governance model in place for technology decisions



CDS @VCCS

•

Annual expectation for colleges

• System Office reminds CIOs and provides “standardized”answers for some questions

•

Accuracy is about 90%

•

Gives us consolidated data and access to data from otherinstitutions



VCCS and CDS at Work

•

Create snapshots and technology tidbits go shareacross our system or on the VCCS blog

•

FY10 we spent $78M for IT

•

35+% of colleges exceeded overall average for

spending per employee and student, 3 othercolleges were were within a few dollars

• National average is $534, VCCS average is $528

• VCCS IT staff support an average of 431computers/person. This is 29.4% more per support

staff than peers at other 2 year institutions• Recently completed a benchmarking and were able tovalidate those results using CDS data



CDS at the

University of Maine System



University of Maine System Participation

•

Seven institutions and University Services

• Historical participation spotty

• Last year: new focus on metrics and benchmarks

• Re-energized interest in providing data to tell the UMS IT

story and validate it



CDS Value to the University of Maine

System

While our data is developing, use Executive Summary andDashboards

• Cost for IT per Institutional FTE

•

Cost of IT as % of Institutional Spend• IT staff as a % of Institional FTE

•

Products in use at other institutions

• Cruise responses by other institutions to specificquestions—the gut check



University of Maine System Commitment

• Follow VCCS model of providing information to campuses

• Support campuses in completing CDS

• Evangelize the value of using the data EDUCAUSE CDS

provides to support decision making and the value of IT




%>.2/.?/( )-E

H

$-+( ".*.&(+>25(

I) "(>(/-B@()*

H

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

H

&*+.*(L25 IM%11(11@()*4(B-+*1




%>.2/.?/( )-E

H

$-+( ".*.&(+>25(

I) "(>(/-B@()*

H

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

H

&*+.*(L25 IM%11(11@()*4(B-+*1



Moving Forward with IT Assessment

•

Outputs v. inputs: What are we getting forour investments?

• Synthesis: How can we succinctly measure

capabilities composed of many elements?

•

Objectivity: Can we find assessmentsformulated by an external party?

•

Validity: Can we find assessmentsgrounded in empirical research and expertopinion?



New EDUCAUSE Assessments

Goal: Provide standard benchmarks of institutionalcapability based on empirical research and expertopinion.

•

Maturity Index (MI): Measures organizationalcapacity to deliver a service, taking into accountmultiple factors, including culture, policy, andorganization.

• Deployment Index (DI): Measures the degree to

which institution has deployed technologies relatedto delivering a service.



How It Would Work

• Data collection via CDS*

• Separate online tool forreport generation

• MI and DI scores usestandardized 5-point scales

• Peer comparison available

• Index reporting could bepart of a largercomprehensive IT

assessment report

*By default; standalone tool also available.

;'(<40-0

;'"0 =#-#

>0"5,?0 >@"50A

10$0"#-0 B0<'"-%

;=> =#-#

B0<'%,-'"A

;=> C00"

1"'@<

D#$#E0(0$-

B0<'"-

3%%0(F4A

D*G=* B0<'"-

76

86



Maturity Index Reporting

\((+ .)./0121%3>25( ?.1(3 -)

+(1B-)1(17

B+2-+2[](3 ?0

2@B+->(@()*-BB-+*G)2*0

WF=

;F=

=

W

=

;FV

;

9

=

V

>A$0"EA '& 0H40#"$,$E%A%-0(%

C",'",-A <4#?0I '$ 0H40#"$,$E

B0#I,$0%% &'" 0H40#"$,$E

J$E',$E -0?.$'4'EA05#4@#2'$ K -"#,$,$E

C'4,?,0%G1'50"$#$?0

*$50%-(0$- ,$ &#?@4-A#$I %-#L

J@-?'(0% #%%0%%(0$-

MHN0#"$,$E D#-@",-A ;'(<'%,-0 >?'"0O 96P

"2@()12-) 15-+(1

@(.1G+( @.*G+2*0

2) 1B(52^5 .+(.1

-, *6( 1(+>25(

$-@B-12*( 15-+(

@(.1G+(1 ->(+.//

@.*G+2*0



Deployment Index Reporting&G@@.+0 15-+( 2) B((+ 5-)*(J*

"(*.2/ *(56 1*.*G1 2) B((+ 5-)*(J*

"(B/-0@()* &5./(C

9F O-)(

;F !JB(5*(3

=F I)2[./

WF

M.+L(*(3

VF I)1[*G[-)_E23(



Toward an Assessment Library

D* C,4'-% 35#,4#F40 /0+ ,$ ;=> 8P7: Q@-@"0R

3$#4A2?%

MHN0#"$,$ES

B0%0#"?. ;'(<@2$E

*$&'"(#2'$ >0?@",-AS

*! 1'50"$#$?0

B,%T D#$#E0(0$-

>-@I0$- >@??0%% !0?.$'4'E,0%S

;4'@I >0"5,?0% DE(-

*! C'4,?A D#$#E0(0$-

*! >-#L D#$#E0(0$-

U%0" >@<<'"- >0"5,?0%

RR

Check out our pilot maturity indexes at:http://www.educause.edu/focus-areas-and-initiatives/enterprise-and-infrastructure/higher-education-it-assessment-and-benchmarking-projects

6,&/4789&*0 )*'&: '&;&47/&'



MI/DI Research: A Community Process




%>.2/.?/( )-E

H

$-+( ".*.&(+>25(

I) "(>(/-B@()*

H

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

H

&*+.*(L25 IM%11(11@()*4(B-+*1




%>.2/.?/( )-E

H

$-+( ".*.&(+>25(

I) "(>(/-B@()*

H

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

H

&*+.*(L25 IM%11(11@()*4(B-+*1



A Strategic IT Assessment Report

$-)*(J*H

<72 '7&3 0=)3 "&/7"0 27"%> <72 $79/#"#?4& )3 /&&" '#0#>

`>(+>2(EH @=#0 #"& 0=& %&8 A*')*B3 #*' "&$799&*'#C7*>

&*+.*(L0

H !"#$"%&'( $**%**+%,"- ./0 1/ /2# 34 ($5$6'7'8%* (/,"#'62"% "/ /2# *"#$"%&'( 5#'/#'8%*9

`B(+.[-)1H

34 /5%#$8/,* $**%**+%,"- ./0 1/ /2# 34 ($5$6'7'8%* :" /2# /5%#$8/,$7 &/$7*9

"(*.2/H <72 #"& 0=&3& #33&339&*03 /&"D7"9&'> @=&"&E3 0=& '&0#)4&' '#0#>



Strategic Assessment by Capability



Operational Assessment



Use Cases

•

Strategic conversations about IT andinstitutional priorities

• Targeted conversations with executive

colleagues•

IT strategy & planning

• IT operational health check

•

Others?



Documents

Transform IT with a New Generation of IT Assessment Tools (242310030)