Transform IT with a New Generation of IT Assessment Tools (242310030)

Preview:

Citation preview

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 1/44

!"#$%&'"( *! +,-. # /0+ 10$0"#2'$ '& *!

3%%0%%(0$- !''4% Leah Lang and Ron Yanosky, EDUCAUSE

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 2/44

"Efficiency, effectiveness, and value 

are what all higher educationinstitutions are striving for.

However, these are hard to attain

without measures of efficiency,

productivity, and maturity!"

— Diana Oblinger,

President and CEO, EDUCAUSE

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 3/44

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 4/44

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 5/44

"Efficiency, effectiveness, and value 

are what all higher educationinstitutions are striving for.

However, these are hard to attain

without measures of efficiency,

productivity, and maturity!"

— Diana Oblinger,

President and CEO, EDUCAUSE

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 6/44

Current Practices for

Measuring IT Costs inHigher Education 

!"#$%&' )* +,-

!"#$%#&! $()*(+ ,-+ %)./0121 .)3

4(1(.+567 8.0 9:7 ;<9=7 .>.2/.?/(

,+-@ 6ABCDDEEEF(3G5.G1(F(3GD(5.+ 

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 7/44

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 8/44

5%6

76

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 9/44

86

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 10/44

96

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 11/44

:6

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 12/44

EDUCAUSE IT Assessment Tools

%>.2/.?/( )-E

$-+( ".*.&(+>25(

I) "(>(/-B@()*

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

&*+.*(L25 IM%11(11@()*4(B-+*1

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 13/44

EDUCAUSE IT Assessment Tools

%>.2/.?/( )-E

$-+( ".*.&(+>25(

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 14/44

 

K4!!

N!O$P8%4QIOR

&!4SI$!

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 15/44

IT financials, staffing, and services

Step 1: Complete the survey

 Administration and Management of IT

IT Support ServicesEducational Technology Services

Research Computing Services

Data Center services

Communications Infrastructure

Enterprise Infrastructure and ServicesInformation Security

Identity Management

Information Systems and Applications

+,- ./'#0& 1&234&5&"  

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 16/44

Complete CDS 2014 by 10/17/14!

Go to www.educause.edu/coredata to get started.

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 17/44

CDS Reporting is powered by

Step 2: Access the data

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 18/44

Over 66% of CDS participants use

CDS Reporting!

TU9

VUU

<

;<

W<

:<

T<

9<<

9;<

9W<

9:<

$"&4 ;<9= G)2XG( G1(+1 Y)(E *-$"&4Z

$"&4 ;<9= G)2XG( G1(+1 YG1(3 $"&4;<9;Z

$"&4 ;<9= 5G@G/.[>( G)2XG( G1(+1

$"&4 ;<9; 5G@G/.[>( G)2XG( G1(+1

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 19/44

CDS Executive Summary Report 

CDS Almanacs ECAR analysis of Core Data (accessible to ECAR subscribing institutions)

Step 3: Gain additional insight

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 20/44

CDS collects metrics on over 100 IT topics!

 All Non-Specialized U.S. Institutions  Associate's Colleges (AA) 

Baccalaureate Colleges (BA) 

Doctoral Institutions (DR EXT and DR INT) 

Master's Institutions (MA I and MA II) 

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 21/44

CDS Usage at VCCS

Virginia Community College System

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 22/44

 About VCCS

• 

23 Community Colleges across Virginia (very independentcolleges)

•  400,000 students

• 

Single instance for ERP (PeopleSoft)•  Single instance for LMS (Blackboard)

•  Private, statewide network – controlled by system to the edgerouter

•  Colleges control edge-router in

• 

Mature governance model in place for technology decisions

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 23/44

CDS @VCCS

• 

 Annual expectation for colleges

•  System Office reminds CIOs and provides “standardized”answers for some questions

• 

 Accuracy is about 90%

• 

Gives us consolidated data and access to data from otherinstitutions

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 24/44

VCCS and CDS at Work

• 

Create snapshots and technology tidbits go shareacross our system or on the VCCS blog

• 

FY10 we spent $78M for IT

• 

35+% of colleges exceeded overall average for

spending per employee and student, 3 othercolleges were were within a few dollars

•  National average is $534, VCCS average is $528

•  VCCS IT staff support an average of 431computers/person. This is 29.4% more per support

staff than peers at other 2 year institutions•  Recently completed a benchmarking and were able tovalidate those results using CDS data

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 25/44

CDS at the

University of Maine System

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 26/44

University of Maine System Participation

• 

Seven institutions and University Services

•  Historical participation spotty

•  Last year: new focus on metrics and benchmarks

•  Re-energized interest in providing data to tell the UMS IT

story and validate it

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 27/44

CDS Value to the University of Maine

System

While our data is developing, use Executive Summary andDashboards

•  Cost for IT per Institutional FTE

• 

Cost of IT as % of Institutional Spend•  IT staff as a % of Institional FTE

• 

Products in use at other institutions

•  Cruise responses by other institutions to specificquestions—the gut check

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 28/44

University of Maine System Commitment

•  Follow VCCS model of providing information to campuses

•  Support campuses in completing CDS

•  Evangelize the value of using the data EDUCAUSE CDS

provides to support decision making and the value of IT

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 29/44

EDUCAUSE IT Assessment Tools

%>.2/.?/( )-E

$-+( ".*.&(+>25(

I) "(>(/-B@()*

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

&*+.*(L25 IM%11(11@()*4(B-+*1

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 30/44

EDUCAUSE IT Assessment Tools

%>.2/.?/( )-E

$-+( ".*.&(+>25(

I) "(>(/-B@()*

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

&*+.*(L25 IM%11(11@()*4(B-+*1

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 31/44

Moving Forward with IT Assessment

• 

Outputs v. inputs: What are we getting forour investments?

•  Synthesis: How can we succinctly measure

capabilities composed of many elements?

• 

Objectivity: Can we find assessmentsformulated by an external party?

• 

Validity: Can we find assessmentsgrounded in empirical research and expertopinion?

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 32/44

New EDUCAUSE Assessments

Goal: Provide standard benchmarks of institutionalcapability based on empirical research and expertopinion.

• 

Maturity Index (MI): Measures organizationalcapacity to deliver a service, taking into accountmultiple factors, including culture, policy, andorganization.

•  Deployment Index (DI): Measures the degree to

which institution has deployed technologies relatedto delivering a service.

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 33/44

How It Would Work

•  Data collection via CDS*

•  Separate online tool forreport generation

•  MI and DI scores usestandardized 5-point scales

•  Peer comparison available

•  Index reporting could bepart of a largercomprehensive IT

assessment report

*By default; standalone tool also available.

;'(<40-0

;'"0 =#-#

>0"5,?0 >@"50A

10$0"#-0 B0<'"-% 

;=> =#-#

B0<'%,-'"A

;=> C00"

1"'@<

D#$#E0(0$-

B0<'"-

3%%0(F4A

D*G=* B0<'"-

76

86

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 34/44

Maturity Index Reporting

\((+ .)./0121%3>25( ?.1(3 -)

+(1B-)1(17

B+2-+2[](3 ?0

2@B+->(@()*-BB-+*G)2*0

WF=

;F=

=

W

=

;FV

;

9

=

V

>A$0"EA '& 0H40#"$,$E%A%-0(%

C",'",-A <4#?0I '$ 0H40#"$,$E

B0#I,$0%% &'" 0H40#"$,$E

J$E',$E -0?.$'4'EA05#4@#2'$ K -"#,$,$E

C'4,?,0%G1'50"$#$?0

*$50%-(0$- ,$ &#?@4-A#$I %-#L

J@-?'(0% #%%0%%(0$-

MHN0#"$,$E D#-@",-A ;'(<'%,-0 >?'"0O 96P

"2@()12-) 15-+(1

@(.1G+( @.*G+2*0

2) 1B(52^5 .+(.1

-, *6( 1(+>25(

$-@B-12*( 15-+(

@(.1G+(1 ->(+.//

@.*G+2*0

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 35/44

Deployment Index Reporting&G@@.+0 15-+( 2) B((+ 5-)*(J*

"(*.2/ *(56 1*.*G1 2) B((+ 5-)*(J*

"(B/-0@()* &5./(C

9F  O-)(

;F  !JB(5*(3

=F  I)2[./

WF 

M.+L(*(3

VF  I)1[*G[-)_E23( 

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 36/44

Toward an Assessment Library

D* C,4'-% 35#,4#F40 /0+ ,$ ;=> 8P7: Q@-@"0R

3$#4A2?%

MHN0#"$,$ES

B0%0#"?. ;'(<@2$E

*$&'"(#2'$ >0?@",-AS

*! 1'50"$#$?0

B,%T D#$#E0(0$-

>-@I0$- >@??0%% !0?.$'4'E,0%S

;4'@I >0"5,?0% DE(-

*! C'4,?A D#$#E0(0$-

*! >-#L D#$#E0(0$-

U%0" >@<<'"- >0"5,?0%

RR

Check out our pilot maturity indexes at:http://www.educause.edu/focus-areas-and-initiatives/enterprise-and-infrastructure/higher-education-it-assessment-and-benchmarking-projects 

6,&/4789&*0 )*'&: '&;&47/&'

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 37/44

MI/DI Research: A Community Process

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 38/44

EDUCAUSE IT Assessment Tools

%>.2/.?/( )-E

$-+( ".*.&(+>25(

I) "(>(/-B@()*

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

&*+.*(L25 IM%11(11@()*4(B-+*1

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 39/44

EDUCAUSE IT Assessment Tools

%>.2/.?/( )-E

$-+( ".*.&(+>25(

I) "(>(/-B@()*

8.*G+2*0I)3(J(1

H "(B/-0@()*I)3(J(1

KG*G+(

&*+.*(L25 IM%11(11@()*4(B-+*1

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 40/44

 A Strategic IT Assessment Report

$-)*(J*H

  <72 '7&3 0=)3 "&/7"0 27"%> <72 $79/#"#?4& )3 /&&" '#0#>

`>(+>2(EH  @=#0 #"& 0=& %&8 A*')*B3 #*' "&$799&*'#C7*>

&*+.*(L0

H  !"#$"%&'( $**%**+%,"- ./0 1/ /2# 34 ($5$6'7'8%* (/,"#'62"% "/ /2# *"#$"%&'( 5#'/#'8%*9

`B(+.[-)1H

 

34 /5%#$8/,* $**%**+%,"- ./0 1/ /2# 34 ($5$6'7'8%* :" /2# /5%#$8/,$7 &/$7*9

"(*.2/H  <72 #"& 0=&3& #33&339&*03 /&"D7"9&'> @=&"&E3 0=& '&0#)4&' '#0#>

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 41/44

Strategic Assessment by Capability

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 42/44

Operational Assessment

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 43/44

Use Cases

• 

Strategic conversations about IT andinstitutional priorities

•  Targeted conversations with executive

colleagues•

 

IT strategy & planning

•  IT operational health check

• 

Others?

8/11/2019 Transform IT with a New Generation of IT Assessment Tools (242310030)

http://slidepdf.com/reader/full/transform-it-with-a-new-generation-of-it-assessment-tools-242310030 44/44

Recommended