Outline - lp3m.unud.ac.id · Outline About IABEE International Engineering Alliance (IEA) & ... Capaian Pembelajaran Mata Kuliah •Istilah lain: Course Outcome (CO); CPMK •Aspek-aspek

2/17/2019

1

1

Indonesian Accreditation Board for

Engineering Education (IABEE)

Awareness Seminar Kampus Universitas Udayana Denpasar, 18 Februari 2019

International-level Accreditation for

Engineering and Computing Programs in Indonesia

MUHAMMAD ROMLI

Outline

About IABEE

International Engineering Alliance (IEA) & International Agreements

OBE as A Platform for International Level Accreditation

IABEE Accreditation & Criteria

Program Eligibility

Accreditation Procedure & Online Evaluation System

IABEE Services and Supports

Towards IABEE Accreditation

2

About IABEE

IABEE

An accreditation agency for engineering and computing higher education programs

IABEE is not a LAM-PS. IABEE accreditation is voluntary, unlike the mandatory accreditation by LAM-PS

Accreditation is a means to improve quality of higher education and accountability to the society by implementing OBE

Currently in the process of applying for the provisional status of the Washington Accord (WA) in 2019

WA is a multilateral agreement between the institutions responsible for engineering higher education accreditation that works together to help the mobility of engineering practitioners

4

2/17/2019

2

IABEE …

WA requires that the accreditation body must be independent of the government (NGO)

Therefore, IABEE is established as an autonomous department within the Institution of Engineers Indonesia (PII)

IABEE was initiated by DGHE with the support from JICA

Declared in November 19, 2015; inaugurated in March 13, 2018

5

IABEE Organization Structure

6

IABEE Executive Committee

• Prof. Misri Gozan, professor in chemical engineering at UI, Chair of Executive Committee

• Prof. Muhammad Romli, professor in agroindustrial engineering at IPB, Chair of International Affairs Committee

• Prof. Satryo Soemantri Brodjonegoro, emeritus professor in mechanical engineering at ITB, former Chair of Executive committee

• Prof. Sudjarwadi, emeritus professor in civil engineering at UGM, Chair of Criteria Committee

• Prof. Tresna P. Soemardi, professor in mechanical/biomechanical, product innovation, design, prototyping and development at UI

• Prof. Siti Hartati, professor in computer science at UGM

• Dr. Heru Dewanto, President of PII

• Ir. Faizal Safa, Executive Director of PII

• Ir. Tjipto Kusumo, PII Chair of CPD, Chair of Finance Committee

• Dr. Arief Syaichu Rohman, ITB, Chair of Evaluation and Accreditation Committee

• Berlian Kushari, UII, Secretary General

7

IEA & International Agreements

2/17/2019

3

International Engineering Alliance (IEA) and WA

IEA is an umbrella organization for 7 international agreements which establish and enforce amongst their members internationally-benchmarked standards for engineering education and what is termed “entry level” competence to practice engineering and professional competence

“How do we build mutual understanding among nations about the quality of engineers who enter the globally connected workplace?”

George Peterson, WA Secretariat 2001-2007

Educational Accords Competence Agreements

Washington Accord: agreement between bodies responsible for accrediting engineering degree programs

IPEA: standard competencies for professional engineer APEC Agreement: standard competencies for PE within APEC Economies

Sydney Accord: engineering technology academic programs

IETA: standard competencies for engineering technologist

Dublin Accord: educational base for engineering technicians

AIET: standard competencies for engineering technicians

Engineer

Technologist

Technicians

IEA Graduate Attributes

• Graduate attributes form a set of individually assessable outcomes that are the components indicative of the graduate's potential to acquire competence to practice at the appropriate level

• Graduate attributes are clear, succinct statements of the expected capability, qualified if necessary by a range indication appropriate to the type of program

• The IEA Graduate Attributes are intended to assist Signatories and Provisional Members to develop outcomes-based accreditation criteria for use by their respective jurisdictions

11

1. Engineering Knowledge 2. Problem Analysis 3. Design/development of

Solutions 4. Investigation 5. Modern Tool Usage 6. The Engineer and

Society 7. Environment and

Sustainability 8. Ethics 9. Individual and Team

Work 10. Communication 11. Project Management

and Finance 12. Life-long Learning

“The education stage is followed by a period of supervised training while gaining experience in engineering practice”

Education: First Step To Professional

2/17/2019

4

means that two programs, while not meeting a single set of criteria, are both acceptable as preparing their respective graduates to enter formative development toward registration.

Training

and

Experience

Practice

Substantial Equivalence

Signatory A Accredited Program

Signatory B Accredited Program

Substantial Equivalence and WA

Substantial Equivalence & the Washington Accord

• Basis of agreement of the Washington Accord (WA): substantially equivalent accreditation systems leading to recognition of substantial equivalent of programs in satisfying academic requirements for the practice of engineering at professional level

• Graduates of accredited programs in any signatory country are recognized by the other signatory countries as having met the academic requirements for entry to the practice of engineering

XYZ

P1

P2 P3

JABEE

P1

P2

P3 P4

P5

ABET

P1 P2

P3 P4

P5

P6

IABEE

P1

P2

P3

P4

the WA

XYZ = accrediting bodies (ABET, JABEE, IABEE, etc.), P = study program

Process to be a Professional Engineer: Japan Case

WA Membership

16

Accreditation Bodies Provisional Status Signatory

6 Founding Members 1989

HKIE (Hong Kong) No system at that time 1995

ECSA (South Africa) 1994 1999

JABEE (Japan) 2001 2005

IES (Singapore) 2003 2006

BEM (Malaysia) 2003 2009

ASIIN (Germany) 2003 but was removed in 2013

ABEEK (RP Korea) 2005 2007

IEET (Chinese Taipei) 2005 2007

AEER (Russia) 2007 2012

NBA (India) 2007 2014

IESL (Sri Lanka) 2007 2014

MUDEK (Turkey) 2010 2011

PEC (Pakistan) 2010 2017

COE (Thailand) Submitted in 2010 but was differed

IEB (Bangladesh) 2011

CAST (PR China) 2013 2016

PTC (The Philippines) 2013

ICACIT (Peru) 2014 2018

CFIA (Costa Rica) 2015

CACEI (Mexico) 2016

ACREDITA CI (Chile) 2018

(Under Preparation)

Indonesia, Saudi Arabia, Nigeria, Myanmar, the Netherland

ABET (USA) Engineers Canada ECUK (UK) EA (Australia), EngIRE (Ireland) IPENZ (New Zealand)

2/17/2019

5

The Seoul Accord

• Computing and IT related fields are classified as a different category of profession from engineering.

• The Seoul Accord was established in 2008 as a multi-lateral agreement among agencies responsible for accreditation or recognition of tertiary-level computing and IT-related qualifications.

• ABEEK (Korea), ABET (USA), JABEE (Japan), Australian Computer Society, British Computer Society and Canadian Information Processing Society are the founding members. The first 3 are signatories of the WA and the last 3 are computer societies.

• The Hong Kong Institution of Engineers (HKIE) and the Institution of Engineering Education Taiwan (IEET), which are both signatories of WA joined the Seoul Accord latter. Engineers Ireland, Institute of IT Professional New Zealand and The Philippine Information and Computing Accreditation Board are provisional members.

17

IABEE Preparation for WA Membership

Accreditation Criteria established

Rules and Procedures for Accreditation Evaluation established

On-line Accreditation System established

Evaluators trained

Accredit Study Programs (at least 25)

18

WA Provisional Status

WA Signatory

2014 2015 2016 2017 2018 2019 2021

OBE as A Platform for International Level Accreditation

• An educational philosophy/model where the teaching

and learning approaches are based on a set of

"expected outcomes" that have been previously set.

• "Outcomes" are a set of values or attributes about

what must be achieved/mastered by students after

completing a certain level of learning.

• Educational system platform for international level

accreditation

Outcome-Based Education (OBE)

2/17/2019

6

Why OBE?

• The need for quality and accountable education, because the funds come from the community

• Accountability is indicated by the quality of graduates and knowledge for the welfare of society

• The community must know the performance of the university; accreditation provides objective information

• In global competition, mutual recognition plays an important role in increasing competitiveness

• OBE provides a mechanism for objective international recognition

principles

Focus on learning outcomes Deliver forward-design backward curriculum Constructive alignment Expanded learning opportunities

4

1 mulai dari akhir

profil profesional

capaian pembelajaran

lulusan

OBE Approach

vision, mission

Program Educational Objectives

Graduate Outcomes

Course-1

Outcomes

Course-2

Outcomes

Course-n

Outcomes

2/17/2019

7

Tujuan Pendidikan Program

• Istilah lain: Program Educational Objectives (PEO);

Profil Profesional Mandiri

• Pernyataan yang menjelaskan pencapaian kualitas

spesifik yang diharapkan dari lulusan setelah

beberapa tahun berkarir dalam profesinya

• Diukur 3-5 tahun setelah bekerja

• Bersifat spesifik untuk setiap program

• Knowledge

• Skill

• Competence

• Self development

• Responsibility

• Ethics

professional

Capaian Pembelajaran Program

• Istilah lain: Program Outcomes (PO); Program Learning

Outcomes (PLO); Student Outcomes (SO); Capaian

Pembelajaran Lulusan (CPL)

• Deskripsi serangkaian kualitas atau atribut lulusan yang

diharapkan diketahui, dapat dilakukan, dan dicapai pada

saat mahasiswa lulus, sebagai modal untuk mencapai PEO

• Kualitas atau atribut tersebut mencakup aspek pengetahuan

(kognitif), ketrampilan (skill/psikomotorik), dan

sikap/perilaku (behaviour/afektif) yang diperoleh mahasiswa

selama program pembelajarannya

Capaian Pembelajaran Mata Kuliah

• Istilah lain: Course Outcome (CO); CPMK

• Aspek-aspek teknis atau soft skills yang harus

dikuasai atau dicapai oleh setiap mahasiswa pada

saat menyelesaikan suatu mata kuliah

• CPMK dirancang untuk mendukung CPL

• Bersifat spesifik untuk suatu mata kuliah

• Bersifat terukur

2/17/2019

8

CP

kurikulum

Lulusan SMA

profesional

CP

CPL

CP

program

educational

objectives

2 CPL

Asesmen

Penyelarasan Konstruktif

Pembelajaran

3

Kurikulum

• Body of knowledge

• Struktur Kurikulum

• Mata kuliah

• Pendekatan pengajaran dan

pembelajaran

• Asesmen sistem mendukung

kesempatan belajar yang luas agar tujuan pembelajaran tercapai

4

2/17/2019

9

entry level

spectrum

Exit level

spectrum

4 years duration

Targeted

achievement

S1 program

Added Value Concept

program path

QUALITY ASSURANCE

SEMUA MAHASISWA

HARUS MEMENUHI CAPAIAN PEMBELAJARAN

YANG DITETAPKAN

jalan menuju

KEBERHASILAN

------------ by ------------

DESIGN !

IABEE Accreditation & Criteria

2/17/2019

10

BAN PT

• Compulsory

• Input-based evaluation

• One size fits all criteria

• Ranking system

• National level

IABEE

• Voluntary

• Outcome-based

• Field specific criteria

• No ranking

• International level

• Continual improvement

Engineering Program Accreditation

37

IABEE Accreditation Principles

Voluntary, internally driven (program attitude towards quality); and therefore accreditation is not the purpose, rather a means for improvement

Accreditation is based on Learning Outcomes, which is self-determined by the program according to the vision, identity and uniqueness, resources, and user needs; and therefore accreditation is not to rank nor to compare among programs

International equivalency (IEA graduate attributes)

Third-party evaluation (independent, autonomous, NGO)

Accountable to society (outcome-based, answering the need of stakeholders)

38

Concept of OBE Accreditation

P1

P3

P4

P2

Required level by the society

Actual knowledge and

abilities of the graduates

Designed learning outcomes

to be achieved

Importance of IABEE Accreditation

For students and graduates Gain education basics that meet global standards, in line with science and technology development, support career and professional success, and wider employment opportunities

For programs and education institutions By voluntary nature, programs demonstrate a commitment to provide quality education and global recognition.

For industry, government and stakeholders Opportunity to provide feedback on employment needs, facilitate professional mobility, more accountable to the community.

40

2/17/2019

11

IABEE Accreditation Criteria

To be accredited, a program shall meet

Accreditation Criteria

• Common Criteria

• Criteria Guide

• Discipline Criteria (13/19 Chapters of PII)

• Category Criteria (S1, S2 and S3)

Rule and Procedure of Evaluation and Accreditation

41

IABEE Accreditation Criteria

• Common Criteria – Adoption of Outcome-based Education (OBE) approach

• Orientation of the Graduate Outcomes • Learning Implementation: Curriculum, Faculty, Student, Academic

Atmosphere, Facility, Institutional Support • Assessment of the expected Learning Outcomes

– Implementation of P-D-C-A cycle: Continual Improvement based on Learning Outcomes Evaluation

• Criteria Guide – Explanation of the Common Criteria

• Discipline Criteria – Take into account specific needs for different engineering and

computing fields – Related mostly to curriculum content and faculty member

requirements

Central role of the Criteria in IABEE Accreditation: As the reference for Study

Program to conduct self-evaluation

As the reference for IABEE evaluators to review SP self-evaluation

As the basis for IABEE to award accreditation status

IABEE Common Criteria

High school graduates

Students & teaching-learning

Process

Graduates Autonomous Professional Profile

• Envisaged APP is defined (1.1.) and informed to all faculty, students, and general public (1.2.)

• Learning Outcomes are established based on the envisaged APP, General Criteria requirements (1.3.1 and 1.3.2), and Discipline Criteria (1.3.3.)

• Performance indicators, assessment plan and method are defined for each LO (1.3.3.)

• LOs attainment is measured (3.1.) and assured for the graduates (3.2.)

• Curriculum (2.1) • Faculty (2.2) • Students &

academic atmosphere (2.3)

• Facility (2.4) • Institutionla

responsibility (2.5)

• Entry requirements (2.3) are defined & announced

• Continual improvements based on LOs evaluation (4.1)

• Documents, records, and improvements are maintained (4.2)

IEA Graduate Attributes vs IABEE Learning Outcomes Criteria (a)–(j)

44

IEA GA IABEE Criterion

1 Engineering Knowledge 1.3 a

2 Problem Analysis 1.3 d

3 Design/development of solutions 1.3 b

4 Investigation 1.3 c

5 Modern Tool Usage 1.3 e

6 The Engineer and Society 1.3 i

7 Environment and Sustainability 1.3 b

8 Ethics 1.3 i

9 Individual and Team work 1.3 h

10 Communication 1.3 f

11 Project Management and Finance 1.3 g

12 Life long learning 1.3 j

2/17/2019

12

IABEE Discipline Criteria for Engineering

Chemical, biochemical, biomolecular and similarly named eng. programs

Environmental eng. and similarly named eng. programs

Ocean eng. and similarly named eng. programs

Agricultural and/or biosystem eng.

Civil eng. and similarly named eng. programs

Electrical, computer, communications, telecommunication eng. and similarly

named eng. programs

Engineering physics and similarly named eng. programs

Geodetic, geomatics eng.

Industrial eng. and similarly named eng. programs

Materials, metallurgical eng. and similarly named eng. programs

Mechanical eng.

Nuclear eng. and similarly named eng. programs

Computer science / informatics and similarly named

programs

Information systems and similarly named programs

Information technology and similarly named programs

Software engineering and similarly named programs

Computer systems and similarly named programs

IABEE Discipline Criteria for Computing

Discipline Criteria

47

Program Eligibility

2/17/2019

13

Accreditation Types

General Accreditation, intended for programs that have implemented outcome-based education system and at the time of the evaluation process has produced graduates with the system

A-accredited program; min B-accredited institution

Provisional Accreditation, intended for programs that have implemented outcome-based education system and at least the first year students have completed learning with the system.

Min B-accredited program and institution

49

Is Your Program Eligible to Apply?

50

General Accreditation Provisional Accreditation (1) The associated Program Operating Institution (POI)

has obtained National Accreditation for Institution

status with a minimum rank of “B”.

(2) The Program has obtained National Accreditation

status ranked “A”.

(3) The Program is a bachelor-level program in an

engineering or computing discipline with a curricular

study period of four years, and with a total course-

load of a minimum of 144 credit units.

(4) The Program is at least in the 4th year of continuous

Outcome-Based Education (OBE) implementation.

(5) The OBE shall include assessment and evaluation

of the Learning Outcomes of the students.

(6) By the time of the on-site visit evaluation, the

Program has produced at least one graduate under

its OBE system.

(7) The Program has established and publicized the

Autonomous Professional Profile statement

formulated as its educational objectives.

(8) The Program has established and publicized its

Learning Outcomes as the basis for developing its

curriculum and learning methods.

(1) The associated Program Operating Institution has

obtained National Accreditation for Institution status

with a minimum rank of „B‟.

(2) The Program has obtained National Accreditation

status at least ranked “B”.

(3) The Program is a bachelor-level program in an

engineering or computing discipline with a curricular

study period of four years, and with a total credit of a

minimum of 144 credit units.

(4) The Program has implemented Outcome-Based

Education (OBE) at least for one year before

applying for the evaluation.

(5) The Program has established and publicized the

Autonomous Professional Profile statement

formulated as its educational objectives.

(6) The Program has established and publicized its

Learning Outcomes as the basis for developing its

curriculum and learning methods

Accreditation Procedure & Online Evaluation System

Accreditation Procedure

Application/ Registration

Eligibility Check

Campus Visit

Program Profile & SER Submission

Desk/Initial Review

Evaluator Final Report

Program Response

Evaluator Exit

Statement

Discipline Harmonization

EAC Harmonization

Accreditation Council

Evaluation Team

52

2/17/2019

14

Evaluation Team

Consists of 3 evaluators, typically

• 2 academics

• 1 industry/practitioner

• (optional) observers: evaluator-in-training, interested parties

Evaluator competence

Ethics (evaluator code of conduct)

Conflict of interest

53

Online Evaluation System

54

Online Self-Evaluation Report Evaluation for General Accreditation

56

• Your program will be judged against each of these 12 criteria

• Four possible judgments for each criterion: (A)cceptable, (C)oncern, (W)eakness, or (D)eficiency

• Your program will be accredited if there is no “D”

• 5-year accreditation (full) will be granted if your program receives “A” or “C” judgments

• 2-year accreditation (interim) will be granted if your program has “W” (improvement report and evaluation required)

2/17/2019

15

General Accreditation Decision

Accredited for a 5-year period

Accredited for a 2-year period, followed by interim evaluation without site visit

Accredited for a 2-year period, followed by interim evaluation with site visits

Not accredited

57 58

• A program applying for PA will be evaluated to measure its potentials of meeting the Accreditation Criteria within a foreseeable future (2-4 years).

• Potential programs will be granted a “Provisionally Accredited” status

• Non-potential programs will be given a “Not Accredited” status

Evaluation for Provisional Accreditation

IABEE Services and Supports

IABEE Services

Training/seminar Topics Schedule

IABEE Awareness Seminar

About IABEE, introduction to OBE, IABEE Accreditation criteria and system

Surabaya: 12/2 Palembang: 14/2 Jakarta: 14/2

IABEE Evaluator Training on-line module, face-to-face training, observer (evaluator in training)

Juli – Agustus 2019

2/17/2019

16

Outcome-based Education Training (1)

Training Topics Schedule

Reguler Training (4 hari)

PRIORITIES (Program

for Redesigning and

Implementing

Outcomes-based

Curriculum, Teaching-

Learning-Assessment

and Evaluating

Systematically)

OBE, learning

outcomes, curriculum

design, teaching and

learning, assessment

methods, change

management, and

outcome-based quality

assurance system.

Jakarta

12-15/3

2019

Yogya

9-12/4

2019

Surabaya

Outcome-based Education Training (2) Training Materi Jadwal

In-house Training

1. Pengantar Pendidikan berbasis Capaian Pembelajaran (Outcome-based Education) untuk pimpinan PT.

konsep, dan prinsip OBE, sistem pengelolaan dan penjaminan mutu OBE

4 jam, tempat: menyeseuaikan lokasi PT

2. Pengantar Pendidikan berbasis Capaian Pembelajaran untuk pimpinan program, penjaminan mutu dan dosen

Konsep OBE, Capaian pembelajaran, redesain kurikulum dan asesmen.

1.5 hari, tempat: menyeseuaikan lokasi PT

3. Desain Kurikulum berbasis Capaian Pembelajaran (Outcome-based Curriculum)

tujuan pendidikan, capaian pembelajaran, redesain kurikulum

2 hari, tempat: menyesuaikan lokasi PT

4. Desain Pembelajaran dalam OBE (Outcome-based Teaching-Learning)

konsep dan implementasi pembelajaran aktif dalam sistem OBE


5. Desain Asesmen dalam OBE (Outcome-based Assessment)

konsep dan metoda asesmen capaian pembelajaran (tingkat MK dan Program studi)


6. Capstone Course/Design

definisi, tujuan dan konsep serta contoh capstone course, sesuai program studi


Candidate Evaluator Training

Application Eligibility

Check

Performance Evaluation

Online Module Training


Face-to-Face Training

Assignment as Observer


63

Towards IABEE Accreditation

2/17/2019

17

Possible strategy for preparing your program towards IABEE accreditation (fast option)

Learn IABEE Common & Discipline Criteria, RPEA

General review of your curriculum & education system

OBE+PDCA design

Staff conditioning

Implement OBE + PDCA

Recruit new students

Measure & assess PLOs development

Apply Provisional Accreditation to IABEE (optional)

Continue OBE+PDCA Implementation for 2nd year

PA granted (optional)

Continue OBE+PDCA for 3rd year

1st graduate of OBE system expected

Apply General Accreditation to IABEE

Submit Self Evaluation Report

Desk evaluation by IABEE

Onsite visit

65

Accreditation status granted

2024

Assumption: your program has just considered to adopt OBE in 2019

2019 2020 2021 2022 2023

Step no. Activity Evaluation Type*) Period or Completion Deadline

1 PR & POIR registration EGA, EPA, IE 1-15 April

2 PR & POIR registration verification EGA, EPA, IE 1-15 April

3 Application for Program evaluation EGA, EPA, IE 1-15 April

4 Program eligibility verification EGA & EPA 1-15 April

5 Evaluation scheduling EGA, EPA, IE 20 April

6 Notice of evaluation kickoff & invoicing EGA, EPA, IE 21 April

7 EAC Discipline assignment EGA, EPA, IE 15-20 April

8 Evaluation Team members selection EGA, EPA, IE 15-20 April

9 Evaluation Team Chair assignment EGA Only 15-20 April

10 Approval of evaluation observers EGA Only 15-20 April

11 Evaluation Team acceptance EGA, EPA, IE 8 May

12 Final Evaluation Team confirmation EGA, EPA, IE 8 May

13 Completed SER submission EGA, EPA, IE 30 June

14 Full payment reception EGA, EPA, IE 1 May

15 Program First Evaluation EGA, EPA, IE 31 July

16 Program Second Evaluation EGA only 15 August

17 Program First Response EGA, EPA, IE 15 September

18 Program Third Evaluation EGA Only 30 September

19 On-Site Visit Planning EGA, EPA, IE-V 7 October

20 On-Site Visit EGA, EPA, IE-V 7 November

21 Exit Meeting EGA, EPA, IE-V 7 November

22 Program First Evaluation EGA, IE-V 7-14 November

23 Program Second Response EGA, IE-V 14 November

24 Program Second Evaluation EGA, IE-V 28 November

25 Program Final Response EGA, IE 28 December

26 Program Final Report EGA, EPA, IE 15 January

27 EAC Discipline Harmonization EGA, IE 31 January

28 EAC Plenary Meeting EGA, EPA, IE 1 February

29 Accreditation Decision EGA, EPA, IE 15 March

30 Accreditation Announcement EGA, EPA, IE 31 March

IABEE Website

67

Mohon Peserta Mengisi Form Evaluasi https://goo.gl/yUpvej