1

Semantic Intelligence: Application to Survey Data

ITEC810 - Information Technology Project

Supervisor: Gary Lau

Gianmario Zullo (40291502)

13th June 2012

Contents

2

1.0 Problem Specification

2.0 Related work

3.0 Our Approach

4.0 Evaluation & Recommendation

5.0 Survey Findings

01 Overview

3Source: The Times Higher Education Review

Fierce competition

Universities compete globally for student enrolments!

16 Universities in Australia alone!

Government Response

Created the Advancing Quality in Higher Education (AQHE) initiative.

Aimed at measuring a university's performance via a number of assessments and surveys.

01 Overview

4

Quantitative

Qualitative

Vs

The fact I didn’t have to turn up to class ;-)

01 Overview

5

Irony What were the best aspects of the degree? Answer: Lecturer A (name with held)

What aspects of the degree were most in need of improvement? Answer: Lecturer A (name with held)

Language is complex!

Ambiguity - The word ‘Unlockable’ can mean ‘capable of being unlocked’ or ‘impossible to lock’. (Pollatsek A, 2010)

- The fisherman went to the bank. (Lexical)

- Principal: Leader of a school vs Principle: Standards or code. (Homonyms)

02 Related Work

6

03 Our Approach

7

Part 2 - Survey AnalysisPart 1 - Software Evaluation

03 Our Approach

8

High Level Criteria (Section) Section Weight %

1.0 Functionality 30%

2.0 Usability 20%

3.0 Ease of Learning 10%

4.0 Accuracy 5%

5.0 Pricing 20%

6.0 Reporting 10%

7.0 Support 5%

 Total: 100%

Products

9

Market is rapidly changing. Consolidation of products and vendors occurring.

• 2012 - Oracle => Vitrue Inc. & Collective Intellect. • 2012 - HP (Fusion) => Automony • 2009 - IBM => SPSS Inc.

Larger players muscling in and have aggressive roadmaps over the next 6-12months. (I.e Oracle).

Exalytics

SPSS

Text Analytics

Products Shortlisted

10

Product Supplier CommentsCogito Expert Systems Server licence

DiscoverText Textifter Professional Edition - $99.00 user/month (Pay as you go)

GATE University of Sheffield Open Sourced

Leximancer Leximancer Academic Edition - Lexiportal

SPSS Text Analytics IBM IBM SPSS Text Analytics, part of SPSS suite of products.

04 Evaluation Results

11

# Key Criteria* Gate VOC Cogito SPSS Text Analytics

Leximancer DiscoverText

1.0 Functionality24 28 25 22 27

2.0 Usability10 18 18 19 14

3.0 Ease of Learning3 8 10 10 7

4.0 Accuracy0 0 10 11 5

5.0 Pricing13 8 5 10 10

6.0 Reporting3 5 5 4 4

7.0 Support3 3 5 4 4

Total 56 70 78 80 71

12

Tactical – Short Term

For General PopulationConsolidating existing licences for Leximancer under one enterprise wide license ($12,000) for all staff and students across the board.

MQ Analytical DeptRetaining and expanding academic licensing with SPSS text Analytics’ for use by MQ Analytical department and faculty staff, as well as postgraduate coursework and research students.

Strategic – Long term

Introduce Contestability. Wait 18 months for market to mature. Release RFP with bigger players (oracle, IBM, SAS).

04 Recommendation

“Capitalise & consolidate on current investments already in place across various departments within the university.”

05 Survey Insights

13

Responses by Top 3 Course %

0801 Accounting 24%0803 Business and Management 11%0811 Banking, Finance and Related Fields 9%

2009 2010 2011Total

(3 years)Attendance Type Full time 2577 3239 3928 9744Part Time 983 1224 1131 3338Level of Degree Completed Master of Philosophy 20 18 15 53Advanced diploma or diploma 12 10 12 34Bachelor degree (honours) 145 149 149 443

Bachelor degree (not honours or graduate entry) 1726 2272 2778 6776Graduate certificate 170 253 158 581Master degree by coursework 1164 1390 1593 4147PhD 99 110 109 318Postgraduate diploma 214 246 242 702Other 10 15 3 28Attendance Mode External (distance) 332 416 402 1150Internal (on-campus) 2949 3740 4336 11025Mixed mode (internal and external) 279 307 321 907Australian citizen or permanent resident NO - 1060 1505 1588 4153YES - Aust. Citizen/ Perm. Resident 2500 2958 3471 8929

Quick Insights (Respondents)

Categories here mean: Occur often and unique to tag

Categories here mean: Occur seldom and unique to tag Sentiment

Categories here mean: Occur often, not unique to tag

Categories here mean: Occur seldom, not unique to tag

International & Domestic

Over 3 year period

Questions?

17