AACSB Asia Regional Conference, Singapore, May 24, 2011

byProf. Stephen Cheung, Dean and Chair Professor School of Business, Hong Kong Baptist University

AACSB Asia Regional Conference, Singapore, May 24, 2011

Assurance Strategies for Continuous Improvement:Assurance Strategies for Continuous Improvement:

Assurance of Learning in HKBUAssurance of Learning in HKBU

2

Presentation Outline

About the HKBU School of Business

Assurance of Learning (AOL) in Our School

Setting Up and Implementing AOL System

Build the AOL Culture

3


Hong Kong Baptist University (HKBU) was founded in 1956

School of Business - the 2nd largest academic unit of HKBU

5 Academic Departments

Participating Full-time Faculty: 79 (2010-11)

Supporting Faculty: 49 (2010-11)

Business Student Enrolment: over 1900 (2010-11)

- Undergraduate: 69%

- Postgraduate: 31%

4


We are accredited by We are accredited by AACSB International in April 2010AACSB International in April 2010

Best Practices (as identified by the AACSB PRT) Best Practices (as identified by the AACSB PRT)

Integrated mission-driven extracurricular activities complementing the traditional academic curriculum to support the School’s whole-person focus

Honors project as a graduation requirement for BBA students

Well developed structure for assessment of learning process

Integrated mission-driven extracurricular activities complementing the traditional academic curriculum to support the School’s whole-person focus

Honors project as a graduation requirement for BBA students

Well developed structure for assessment of learning process

5

Our Academic Program Portfolio (2010-2011)Undergraduate

ProgramsPostgraduate

ProgramsResearch Postgraduate

Programs BBA (Honors) BCom (Honors) in

Accountancy BCom in Marketing (2009)

BCom in HRM (2010)

BSoSc (Honors) in China Studies, Economics Option

Generalist Program: MBA

Specialist Programs: MSc in Applied Accounting

& Finance MSc in CG and Directorship MSc in Strategic HRM MSc in Applied Economics

(2010) Master in HRM (2010)

DBA (2008)

PgD in Professional Accounting

MPhil PhD


6

AOL Process of Academic Programs

Assurance of Learning in Our School

(Adapted from AACSB Assessment Seminar Material)

Program Goals State Learning

Objectives

Develop Measurement

Collect Data

Analyse Data

Identify needed improvement

Implement improvement

Collect Data

Evaluate Improvement

Closing the Loop

Closing the Loop

7

• Implemented AOL system to all programs under AACSB review

The Development of the AOL System in Our School

Assurance of Learning in Our School

• Developed/refined program learning goals• Aligned curriculum with goals, pedagogical & assessment methods

• Pilot Run – AOL system for BBA & MBA programs

• Completed first round of program learning goals assessment

2007/08

Fall, 2008

Spring, 2009

Fall, 2009

2010-2015• Maintenance review cycle• Assess all program learning goals 2 times within 5 years

8

Develop the Framework for Program Assessment and Closing the Loop

Align Curriculum with the Framework

Assessment Measures

Closing the Loop

Administration of AOL System


9

Develop Framework for Program Assessment and Closing the Loop

Mission-driven Program Learning Goals

Learning Goal (LG) - what do we want our students to learn?

LG describes the desired educational outcomes that fulfill the missions of the School

include board statements of accomplishment that reflect the depth and breadth of student knowledge and skills

Set the framework for closing the loop


N

S

EW

10

Example of Mission-driven LGs:


University MissionHKBU is committed to academic excellence in teaching, research and service and the development of whole person in all these endeavors built upon the heritage of Christian higher education.

School Mission (extracts)

• be the leader in whole person business education• nurture visionary and ethical business leaders:

- cultivate and encourage students’ academic curiosity and integrity

- unleash students’ leadership potential and prepare the ground for them to become all-rounded, values-conscious business graduates

11

Program Learning Goals (BBA)LG1: Student will have fundamental knowledge and skills required for managing a

business.LG2: Student will have in-depth understanding of an area of specialization such as

accounting, economics, China business studies, finance, human resources management, information systems management, and marketing.

LG3: Student will have oral and written communication skills and IT skills necessary for working in a business environment.

LG4: Student will be analytical and critical thinkers able to solve real-world business problems.

LG5: Student will have a sold understanding of a) how business is influenced by its environment, including economic, social-

cultural, legal-political, technological, and other general conditions, as well as by an organization’s stakeholders;

b) the global nature of contemporary business and c) the value of business ethics and good corporate governance.

LG6: Student will have a broad exposure to non-business disciplines.


12


Program Learning Goals (MBA)LG1: Student will be analytical and critical thinkers with enhanced communication,

presentation and information processing skills. LG2: Students will be decision makers and team workers equipped with strategic

thinking, and managerial and leadership skills, who can respond effectively to a changing environment.

LG3: Students will be knowledgeable in major functional areas of modern business, with emphasis on the integration of the multiple dimensions of international business.

LG4: Students will enhance his/ her understanding of corporate sustainability issues affecting business, such as social responsibility, ethic, corporate governance and cultural diversity.

LG5: Students will enhance his/her understanding of the critical issues for doing business in Hong Kong and mainland China.

LG6: Students will acquire the ability to relate his/ her areas of special interest and knowledge to corporate strategies and business planning.

13

Measurable Learning Objectives Learning Objective (LO) – what do we want our students

to do?

Describe observable behaviors that demonstrate students’ mastery of the LGs

Short and clear statements to articulate the expected learning outcomes - make reference to Bloom’s Taxonomy of cognitive learning for writing objectives

Indicators of LGs and framework for assessment


14

Examples of LOs


BBA LG3 and LOs LG3: Student will have the oral and written communication skills and information technology skills necessary for working in a business environment.

LO1: Students will prepare and deliver a business-related speech and presentation, demonstrating full understanding of the

speech/ content structure and the required verbal and non-verbal cues.

LO2: Students will compose professional-quality business correspondence, demonstrating good format construction and

appropriate grammar and tone.

LO3: Students will understand the role of information technology in business organizations, will demonstrate competency in

using information technologies to support their work, and will identify the ethical and legal issues involved in their use.

15

MBA LG1 and LOs LG1: Students will be analytical and critical thinkers with enhanced communication, presentation and information processing skills.

LO1: Students will communicate a complex (business) issue in a coherent oral presentation.

LO2: Students will assemble reasonable assumptions, identify key problems, provide personal perspective and analyze the data gathered to arrive at meaningful conclusions and

implications.LO3: Students will learn to compose professional-quality business

correspondence with appropriate grammar and tone.LO4: Students will acquire and demonstrate competence in using

analytical tools and information processing technology.


16

Align Curriculum with the Framework Develop Course Template

Clearly present the course learning outcomes, pedagogical methods, assessment methods and their contribution to School mission and respective learning

goals.

Provide students/faculty staff the learning expectation and outcomes of the courses.

Distribute to students at the beginning of a course, available in program document and student e-

learning platform.


Example

17

Assessment Measures AACSB emphasizes the use of direct assessment measures:

course-embedded measures (e.g. assignment, presentation, case analysis) selection (e.g. standardized examination or test for admission) demonstration (e.g. assessment project/paper, stand-alone examination)

Develop Rubric for Performance Evaluation: scoring tool used in course-embedded/demonstration

assessment activities performance standard with detailed descriptions of what

constitutes acceptable or unacceptable levels of performance


18

Examples of Rubrics


(Extract)

19


20

Closing the Loop

Disseminate the assessment results among stakeholders

Work out action plans, implement the actions and follow up the process

Evaluate the effectiveness of changes and report the results in the assessment report

Encourage open communication and engage faculty staff


21

Ways to Close the Loop Changes to curriculum

(e.g. changes in pedagogical practices, revision of course design, content/methodology of existing courses)

Changes to assessment processes(e.g. revision of learning objectives/measurement approaches, changes

of data collection methods) Changes to academic processes

(e.g. additional faculty training, revision of admission criteria, improvement of technology)

Examples: Self-regulated program to improve BBA students’ presentation skills Language Enhancement Program conducted by AIESEC for BBA students Chinese Business Case Research Centre to support case development and related pedagogy of MBA program


22

Administration of AOL System Designated committees/faculty staff to monitor the AOL

process

School Level:

School Board

Accreditation & Assessment Committee

Program Level:

Program Management Committee/Planning Team

Program Directors / Convenors of Planning Team


23

Guidelines and Documentations

Program Assessment Manual – School Guidelines

Program Assessment Plan – Timeframe

Individual Learning Goal Assessment Report (prepare by course instructor)

Program Assessment Summary Report (prepare by program director)


24

Build the AOL Culture

Staff Engagement Staff Training – AACSB seminars/conferences

(e.g. for Program Directors/Associate Directors, course co-ordinators/ instructors)

Communication – briefings, information sharing sessions, newsletters, website

Administrative support

School-wide Promotion Promotion to students/stakeholders – newsletter, website

Continue with annual assessment

Set up electronic system for data management

25

THANKTHANKYOUYOU

Documents

AACSB Asia Regional Conference, Singapore, May 24, 2011