67
1 Sustainable Higher Education Research Alliances (USAID SHERA) FY 2019 Annual Report (October 1, 2018 – September 30, 2019) Cooperative Agreement No: AID-497-A-16-00004 Prepared for: Tom Crehan, Director Jalu Cahyanto, AOR Education Office USAID/Indonesia Prepared by: Institute of International Education (IIE) Initial Submission-December 23, 2019 Revised Submission-February 6, 2020

Sustainable Higher Education Research Alliances (USAID SHERA)

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Sustainable Higher Education Research Alliances (USAID SHERA)

1

Sustainable Higher Education Research Alliances (USAID SHERA) FY 2019 Annual Report (October 1, 2018 – September 30, 2019) Cooperative Agreement No: AID-497-A-16-00004

Prepared for: Tom Crehan, Director Jalu Cahyanto, AOR Education Office USAID/Indonesia Prepared by: Institute of International Education (IIE) Initial Submission-December 23, 2019 Revised Submission-February 6, 2020

Page 2: Sustainable Higher Education Research Alliances (USAID SHERA)

2

Table of Contents

I. Report Overview .............................................................................................................................. 2

II. Program Overview ........................................................................................................................... 8 2.1 Program Goals and Objectives .............................................................................................................. 8 2.2 Program Administration ........................................................................................................................ 9 2.3 Program Activities .............................................................................................................................. 10 III. SHERA Key Performance Indicators (KPIs) ............................................................................... 32

IV. Challenges and Lessons Learned .................................................................................................. 36 4.1 Incremental Increase in Funds ..................................................................................................................................... 36 4.2 Communication with CCRs ......................................................................................................................................... 36 4.3 J2SR and Revised CDCS ............................................................................................................................................... 36 4.4 GOI- CCR Differing Research Approaches ............................................................................................................. 37 4.5 MEL and MIS .................................................................................................................................................................... 37 4.6 Timekeeping Guidelines ................................................................................................................................................ 37 4.7 CCR Operational and Program Capacity ................................................................................................................. 37

Annex I: Year Three Accomplishments ............................................................................................... 39 Annex II: SHERA Key Performance Indicators ................................................................................... 41 Annex III: Impact Stories ....................................................................................................................... 55 Annex IV: SHERA Media Coverage ......................................................................................................63

This document is the Annual Report for the USAID-funded SHERA project. This report covers the 12-month period from October 1, 2018 through September 30, 2019. This report is divided into four sections:

Section 1 Table of contents, road map of this report, and executive summary. Section II Main project activities and achievements during the reporting period. Section III Project’s results against its key performance indicators (KPIs). Section IV challenges and lessons learned Annexes 1) Activities completed per SHERA’s Year Three work plan; 2) Achievements of each KPI against SHERA’s targets for the year, broken out by CCR; 3) Impact stories from the year that illustrate programmatic results by highlighting individual activities, quotes, and photos; and, 4) SHERA Media Coverage in Year Three

Page 3: Sustainable Higher Education Research Alliances (USAID SHERA)

3

List of Acronyms, Abbreviations, and Terms ANBIOCORE AOR ADS BLU CCR CCR ARI CDCS CDSR CRM DQA FAA FY

Animal Biotechnology and Coral Reef Fisheries Agreement Officer Representative Automated Directives System Badan Layanan Umum/Semi-autonomous Public Universities Center for Collaborative Research CCR for Acute Respiratory Infections Country Development Cooperation Strategy Center for the Development of a Sustainable Region Cost-reimbursable Data Quality Assessment Fixed Amount Award Fiscal Year

GOI G&C HAKTEKNAS HEI

Government of Indonesia Grants and Contracts Hari Kebangkitan Teknologi Nasional/National Technology Day Higher Education Institutions

IIE Institute of International Education IIEF IPB IR ITB ITK KEMRISTEKDIKTI KPI MEL MIS MIT MOU MSU

Indonesian International Education Foundation Institut Pertanian Bogor/Bogor Agricultural University Intermediate Result Institut Teknologi Bandung/Bandung Institute of Technology Institut Teknologi Kalimantan/Kalimantan Institute of Technology Ministry of Technology, Research, and Higher Education Key Performance Indicator Monitoring, Evaluation and Learning Management Information System Massachusetts Institute of Technology Memorandum of Understanding Mississippi State University

NCSTT NICRA NGO PIRS PPP PVC R&D

National Center for Sustainable Transportation Technology Negotiated Indirect Cost Rate Agreement Non-governmental Organization Performance Indicators Review Sheets Public Private Partnerships Photo-Voltaic Cell Research and Development

SMART CITY Scientific Modeling, Application, Research, and Training for City-centered Innovation and Technology ST&I S&T UB UBB UCB UCD UF UGM UI UIUC UMGo UNDANA UNDIP UNG UNIPA UNLAM UNPAD UNPATTI UNRAM

Science, Technology, and Innovation Science and Technology Universitas Brawijaya/Brawijaya University Universitas Bangka Belitung/University of Bangka Belitung University of Colorado, Boulder University of Colorado, Denver University of Florida Universitas Gadjah Mada/Gadjah Mada University Universitas Indonesia/University of Indonesia University of Illinois, Urbana-Champaign Universitas Muhammadiyah Gorontalo/Muhammadiyah Gorontalo University Universitas Nusa Cendana/University of Nusa Cendana Universitas Diponegoro/Diponegoro University Universitas Negeri Gorontalo/University of Negeri Gorontalo Universitas Papua/University of Papua Universitas Lambung Mangkurat/Lambung Mangkurat University Universitas Padjadjaran/Padjadjaran University Universitas Pattimura/ Pattimura University Universitas Mataram/Mataram University

Page 4: Sustainable Higher Education Research Alliances (USAID SHERA)

4

UNS UNSRAT UNSRI UNSYIAH UNUD URI UTS

Universitas Sebelas Maret/Sebelas Maret University Universitas Sam Ratulangi/Sam Ratulangi University Universitas Sriwijaya/Sriwijaya University Universitas Syiah Kuala/ Syiah Kuala University Universitas Udayana/Udayan University University of Rhode Island Universitas Teknologi Sumbawa/Sumbawa University of Technology

USAID US USG

United States Agency for International Development United States United States Government

Page 5: Sustainable Higher Education Research Alliances (USAID SHERA)

5

Executive Summary The Institute of International Education® (IIE®) implements the United States Agency for International Development (USAID)-funded Sustainable Higher Education Research Alliances (SHERA) program to foster linkages between Indonesian higher education institutions (HEIs) and U.S.-based universities, and across diverse Indonesian universities to enhance the research capacity of Indonesian HEIs in science, technology, and innovation (ST&I); improve the enabling environment for quality research; and promote access to research and professional development opportunities for women.

SHERA is an unprecedented program within the university partnerships field in Indonesia. Top-tier Indonesian HEIs are consortia leads, which includes full responsibility for research and activity management, financial oversight, and monitoring between U.S. and Indonesian university partners. Learning from the challenges of the consortia’s Centers for Collaborative Research (CCR) during the first full year of implementation in FY2018, IIE focused on continued capacity building and process improvements during FY2019. As a result of the capacity building efforts, CCRs were able to efficiently implement activities and achieve higher results. However, funding limitations from USAID had a significant impact on IIE’s ability to implement SHERA, as well as the CCRs’ ability to conduct planned activities and expand their new partnerships with HEIs and external partners alike. The challenge associated with SHERA not receiving sufficient funds is a theme throughout the report.

Key activities and programmatic accomplishments are described per Goal Indicators and Program Outcomes below: Key Accomplishments during the Reporting Period Sustainability in Quality and Quantity of Science Technology Research in Indonesia HEIs

246 peer-reviewed scientific publications resulting from USG support to research and program implementation, consisting of 61 journal articles and 185 proceeding articles by Indonesian and U.S.-Indonesia joint publications.

29 publication citations produced by Indonesia researchers 2 academic research initiatives whose findings have been replicated, applied, or taken to market.

Improved Capacity of Faculty, PhD Students and Postdoctoral Researchers in Target Indonesian Universities

14 short-term trainings conducted in research methods, writing and presentation skills by Indonesian and U.S. partner representatives, in which 480 CCR scholars from Indonesian host and affiliate universities enhanced their ability to submit publications that meet international journal publication standards.

22 scholars from U.S. universities traveled to Indonesia to lead trainings for 304 scholars, of which 264 finalized papers that were later presented at international conferences, while 21 Indonesia scholars received faculty exchange to several U.S. HEIs

114 scholars received ongoing mentoring from their U.S. partners in writing and submitting their papers into journals and international proceedings indexes. As a result, many succeeded in gaining approval for international presentations and publications.

Strengthened, Inclusive Institutional Environments for Research and Management in Target Indonesian Universities

9 CCR members adopted and optimized SHERA practices for improving their own administrative and management systems.

Enhanced Collaboration in CCR/Consortium for Collaborative Research

8 university to university agreements were executed among U.S. and Indonesian institutions engaged in joint research.

15 Indonesian institutions obtained external resources in funding and in-kind for their joint research.

Page 6: Sustainable Higher Education Research Alliances (USAID SHERA)

6

These accomplishments contribute directly to USAID’s 2014-2020 Indonesia Country Development Cooperation Strategy (CDCS) Development Objective (DO) 2, “Essential human services to targeted populations improved and sustained.” These achievements also advance the GOI’s National Development Plan and, more specifically, the Ministry of Research, Technology, and Higher Education’s (Kemristekdikti) commitment to strengthening the capacity of its HEIs to produce world-class scientific research. Other Program Highlights Public Private Partnerships In November 2018, IIE successfully hired an Indonesia-based consultant who specializes in public-private sector partnerships (PPP). Throughout the year, he has assisted IIE in reviewing/updating program documents, developing a shared vision that clearly identifies the purpose and goals of the partnership, and providing a framework for all involved partners. He also worked closely with IIE’s U.S.-based PPP specialist to create U.S. Private Sector Engagement (PSE) outreach plans for each CCR and move forward with their strategic implementation. Research Initiatives Applied in the Market Two research initiatives were applied in the market in Year Three. CDSR’s sustainability energy methodology was adopted by the United Nations Development Program (UNDP) due to CDSR’s success networking and strong, cross-sectoral research. The new funding from the UNDP has brought their work to three different provinces across Indonesia: Bali, East Nusa Tenggara, and Southeast Sulawesi. SMART CITY’s Environment research cluster produced the TaLis (Electric Tube), which provides a sustainable energy storage system for the urban environment. The system has been applied in the Master Public School in Depok; Pertamina Gas Station in Cicoko South Jakarta; the Palu-Donggala Post-Tsunami Settlement; the Lombok Post-Earthquake Settlement; and, the Banten Post-Tsunami Settlement. Both initiatives have demonstrated that research can be used for more than publications by providing benefits to local communities. Patent The SMART CITY team, led by Program Director Prof. Heri Hermansyah, developed a successful patent entitled, “Metode Produksi Ekstrak Basah, Ekstrak Kering, dan Mobilisasi Lipase ekstraseluler sebagai Biokatalis unutk Reaksi Katalisis Minyak Nabati,” or “Production Method through Wet and Dry Extraction, and Vegetable Oil Extracellular Lipase.” CCR Capacity Development and Monitoring As the CCRs implemented their approved FY2019 Implementation Plans (IPs), IIE continuously monitored and mentored each CCR to support their respective needs. Throughout the year, IIE held workshops, strategic meetings, and followed up with both direct and virtual mentoring to ensure the CCRs’ capacity increased and proper operational management procedures were being followed by the CCRs. Based on lessons learned from Year Two implementation and CCR feedback, IIE revised its financial reporting and advance request processes. After IIE’s Finance Operations Specialist traveled to Indonesia to introduce the revised requirements and train the CCR leads during a Finance and Grants Workshop in November 2018, IIE subsequently modified its subagreements with each CCR. Those changes in turn decreased the CCRs’ administrative burden, streamlined the reporting and advance reconciliation processes, increased burn rates, and increased the CCRs’ program activities. SHERA Outreach IIE held a series of outreach events, called SHERA Talk Shows, at the U.S. Embassy’s Cultural Center, @america, to promote the program and highlight CCRs’ research and researchers to SHERA’s target audience, including scholars, students, and the greater HEI community. SHERA’s Program Director (PD), Prima Setiawan, also traveled to New York in February to conduct outreach and promote SHERA towards the CCRs increased sustainability. While there, he presented SHERA’s lesson learned in a panel discussion.

Page 7: Sustainable Higher Education Research Alliances (USAID SHERA)

7

Challenges Funding Limitations and CCR Communication Throughout FY2019, IIE experienced the strains of limited funding from USAID, as detailed throughout this report. IIE consistently communicated this point to USAID and highlighted the constraints that the lack of funding, as well as clarity surrounding future funding, placed on IIE’s implementation of SHERA. As the CCRs’ capacity, research activities, and burn rates increased, the funding decreased. When IIE’s request for additional funding was fulfilled in June 2019, IIE then learned that the limited funds were meant to support both IIE’s operational costs and CCR funding for the remainder of FY2019, as well as the entirety of FY2020. Due to SHERA’s limited funding, CCRs were forced to abandon many planned activities and partnerships, hampering the significant progress they had made. The CCRs have repeatedly shared their frustration with their inability to conduct planned activities with affiliates, both in Indonesia and the U.S. The funding constraints thereby damaged many of the relationships the CCRs worked very hard to build throughout the previous year with their partners. Moreover, two CCRs, ANBIOCORE and CCR ARI, will be forced to close in January 2020. While their closure is related to continued management issues, those problems were then compounded by SHERA’s lack of funding. With limited funds to distribute amongst the CCRs, IIE was forced to close its subagreement with the two CCRs so its resources could be better distributed amongst the other three high achieving CCRs. Finally, since the announcement of limited funding from USAID in June 2019, IIE has encountered general unresponsiveness in its communications with the CCRs. This includes both regular communications and reporting requirements, namely FY2020 KPIs and IPs. While IIE will continue to positively approach the CCRs to ensure that a good working relationship can still be maintained, its ability to efficiently implement the program has been significantly hindered. Revised CDCS and J2SR In October 2018, USAID shared its revised 2014-2020 CDCS called “The Journey to Self-Reliance (J2SR): Indonesia's Road Map." The J2SR requires USAID to reorient its programs to focus on systems and institutional strengthening that will enable institution partners to plan, finance and continue the programs when USAID ends its supports. IIE anticipates that the new USAID/Indonesia CDCS will impact CCR implementation. The SHERA team has conducted several meetings with USAID to address these concerns:

SHERA is a research partnership program which needs a significant amount of time to demonstrate lasting results. If the focus of the program is to show the immediate impact of CCR activities in local communities, the approach and indicators for SHERA will need to be revisited.

Adequate time and resources are also needed to cultivate PPP relationships.

Page 8: Sustainable Higher Education Research Alliances (USAID SHERA)

8

I. Program Overview

2.1 Program Goals and Objectives Implemented by IIE, SHERA is a research collaboration project that seeks to foster linkages between Indonesian HEIs and U.S.-based universities and across diverse Indonesian universities to enhance the research capacity of Indonesian HEIs in ST&I, improve the enabling environment for quality research, and promote access to research and professional development opportunities for women. IIE designed a university partnership program to engage five Indonesian HEIs over a four-year period. SHERA will achieve long-term improvement in the quality and quantity of technical research produced by Indonesian HEIs through three activities: Increased access to trainings in research methods, academic writing and presentation skills, and opportunities for professional exchange and collaboration; revision and creation of research and management policies at participating Indonesian HEIs and the creation and dissemination of research collaboration best practices among the participating Indonesian HEIs; and, formal relationships established among U.S. and Indonesian HEIs and between Indonesian HEIs.

When SHERA first began, it supported the achievement of USAID/Indonesia DO 4, “Collaborative achievement in ST&I increased.” Following the revised CDCS, which was announced at the beginning of Year Three, SHERA now supports DO 2, “Essential human services to targeted populations improved and sustained” through Immediate Result (IR) 2.3, “Capacity of educational institutions, and a cross-cutting theme.” SHERA also supports Kemristekdikti’s 2015-2019 strategy, which emphasizes increasing Indonesia’s international scientific publications as part of the third phase of the GOI’s National Medium-Term Development.

To be better aligned with the revised CDCS, IIE has been working with USAID throughout Year Three to revisit and adjust its Results Framework. Figure 1 below demonstrates the updated the Results Framework, which drops IR # 3.1.1. This removal was approved by USAID on August 20, 2019, as 3.1.1. was shown to overlap with other IRs during the previous year’s the data collection. To provide reasonable support for SHERA’s Public Private Partnership (PPP) KPI, SHERA also proposed revisions to 3.2. to better demonstrate the number of achievements. After gaining USAID approval. “Number of Indonesian institutions obtaining external resources for their joint research project” has been replaced by “Number of partnerships created to support external resources in improving the joint research project.” At the end of September, USAID also requested revisions to Goal Indicator #3, changing the numbers into a ratio, and changing the ratio into number of partnerships created under Output Indicator 3.2. The final changes were still pending at the end of the reporting period.

Figure 1: SHERA’s revised Results Framework

Page 9: Sustainable Higher Education Research Alliances (USAID SHERA)

9

2.2 Program Administration a. Project Office, Staffing, and Staff Travel

Project Office During the first quarter of the year, the SHERA project office moved from Menara Imperium to Gran Rubina Office Park due to a change in ownership of SHERA’s previous office space. On October 10, 2018, IIE held a small office welcoming event, inviting USAID, IIE’s implementing partner Indonesian International Education Foundation (IIEF), and staff from IIE’s other USAID/Indonesia programs. IIE Staff Travel In October 2018, IIE’s Controller, Kisook Bozsa, and Finance Operations Specialist Francisco Sequeira, traveled to Indonesia to meet IIE’s USAID/Indonesia project teams and provide relevant trainings on internal control and fraud prevention and best practices in subrecipient monitoring, meet with USAID/Indonesia representatives, and conduct monitoring during a field visit to the SMART CITY office at UI. Specific to SHERA, during the meeting with USAID, IIE’s Controller and Finance Operations Specialist met with the program AOR and discussed IIE’s financial oversight of the CCR leads and the project’s low burn rate. In addition, the Finance Operations Specialist had individual meetings with SHERA’s Grants and Finance team to discuss the developed new grant guidelines, and co-led a two-day Finance and Grants Workshop for all CCR leads in Bandung to increase the CCR lead’s capacity in financial management and oversight and budget forecasting, review their current month’s financial reports and provide input on areas of opportunity for strengthened internal systems and documentation, and share updates to financial reporting and advance requests processes and requirements mentioned above. In February 2019, SHERA Program Director (PD) Prima Setiawan traveled to New York City to conduct outreach and promote SHERA at IIE’s Centennial Global Summit. During this visit, he also traveled to Washington, D.C. to meet with IIE Home Office staff and visit key external stakeholders (see further details under Stakeholder Engagement). In April, IIE’s Grants and Contracts Director, Kristy Abellanas, traveled to Indonesia to provide trainings to IIE’s USAID/Indonesia project teams and meet with USAID/Indonesia representatives and CCRs. Later in the month, David Simpson traveled to Indonesia to meet with internal and external stakeholders for all USAID/Indonesia projects. For SHERA, he held internal meetings with the SHERA team, external meetings with USAID, and attended SHERA’s Talk Show on Transportation Technology on April 30, 2019. He also traveled to Bogor with SHERA’s PD and Grant Manager to meet directly with IPB and ANBIOCORE leadership to discuss continued performance issues. On June 14-17, Maxmillian Angerholzer III, IIE Executive Vice President, and Edith Cecil, IIE Senior Vice President, visited Jakarta to attend the Humphrey Fellowship Program’s 40th Anniversary celebration. During their trip, they met with USAID to discuss IIE’s implementation of the Mission’s projects, including SHERA. As a result of their meeting and discussion of J2SR, the SHERA team made strategic plans with the CCRs to reconfigure activities based on limited funding from USAID.

b. Project Deliverables IIE completed and submitted contractually required reports and several other documents to USAID during the reporting period. These included all quarterly performance reports and the following deliverables:

SHERA 2018 Annual Report (December 2018) SHERA Year Three Implementation Plan (Submitted July 2018)

Figure 2: Kisook Bozsa, IIE Controller (middle) and Francisco Sequeira, IIE Finance Operation Specialist (second from left) visited SMART CITY's office

Page 10: Sustainable Higher Education Research Alliances (USAID SHERA)

10

CCR Year Three Implementation Plans to seek USAID concurrence on the consortia’s planned activities and anticipated achievements (September 2018)

SHERA VAT Report (April 2019)

2.3 Program Activities Activity 1. University Partnerships

a. Grants Administration Monitoring and Support This reporting period was the second full year of CCR implementation and SHERA’s third year of implementation. IIE learned during the previous reporting period that it needs significantly more time and resources than initially expected providing capacity building and technical assistance to the CCRs. Accordingly, it has maintained its consistent direct and virtual mentoring to each CCR and focused on improving processes based on CCR feedback. In preparation for the start of SHERA’s third year of implementation, IIE spent significant time over the summer capturing the lessons learned and revising the financial reporting and advance request requirements, setting updated procurement approval thresholds, and creating new and revised templates and tools for CCR leads. At the beginning of Year Three, IIE finalized negotiations with the CCRs on their Year Two implementation plans and budgets and modified the terms of the CCRs’ subawards with IIE. The modifications primarily revised financial reporting requirements and the advance request process. Before executing the modifications, IIE’s Finance Operations Specialist traveled to Indonesia to introduce the revised requirements and train the CCR leads during a Finance and Grants (F&G) Workshop on November 5-8, 2018. The workshop also trained the CCR leads on the templates and tools IIE created to support these revisions. By the end of the workshop, the CCR leads reported that they felt the event was productive and that they had a solid understanding of the revisions and IIE’s expectations. Since this workshop, all CCRs have utilized the new advance template, which IIE has been able to approve with increased efficiency. The November 2018 F&G Workshop was then followed up by a series of virtual mentoring sessions in January 2019, as well as another workshop in February. The workshop acted as refresher course on financial report backup documentation requirements, as well a training on QuickBooks and Asset Management. Ultimately, these efforts decreased the CCR’s administrative burden, streamlined the reporting and advance reconciliation processes, increased their burn rates, allowing the CCRs to shift their focus to implementing program activities during the first half of the year. This renewed focus on program implementation led to the CCRs achieving, and oftentimes far exceeding, their set targets. At the beginning of Year Three, IIE also conducted visits to each CCR to evaluate their previous year and adjust their work plans for the year ahead. The visits were crucial since IIE had received an incremental increase from USAID in December 2018 that did not provide IIE with enough funds to fully obligate the CCRs for their full Year Two activities. During the second half of Year Three, IIE requested an additional incremental increase in funding from USAID, as the increase in December 2018 was not enough to sustain CCR activities beyond Year Three. IIE received an obligation increase in June 2019, but it was less than anticipated. The amount was also meant to last the project through September 2020. This then put pressure on the CCRs to stretch their obligations from IIE and led to much uncertainty about the funding of the project beyond Year Four. Subsequently, the CCRs have again slowed their burn rates and have halted many program activities. IIE therefore adjusted its CCR mentoring approach.

Figure 3: SHERA Grant Manager presenting to CCR Leads at November 2018 F&G Workshop

Page 11: Sustainable Higher Education Research Alliances (USAID SHERA)

11

While it maintained regular follow-up on financial processes and general grant support, IIE focused on aiding the CCRs in financial and programmatic sustainability planning, as well as subrecipient closeout procedures for CCR ARI and ANBIOCORE. IIE even sent one of its Grants Assistants directly to CCR ARI to work with the CCR Director on settling the CCR’s finances before closeout in January 2020, as the CCR was forced to lay off its Finance Manager and MEL Manager in July 2019 due to a lack of financial planning (see further information under the Challenges section). IIE extended itself by reaching out directly to UNPAD’s affiliates to request that they submit their final invoices to UNPAD. This intense level of monitoring by IIE persisted throughout the duration of reporting period and will continue into the next year as CCR ARI and ANBIOCORE prepare to close out by January 31, 2020. Finally, it should be noted that due to the limited funding it received from USAID, IIE was forced to decrease the number of direct, in-person monitoring and training activities and instead implement more virtual monitoring and training activities. See the list of key grants mentoring and training activities conducted in the table below:

Date (2018 -2019)

Location Topic Activity Objectives

Oct. 30 UI, Depok IIE HO Controller & Finance Specialist visit to SMART CITY

To receive feedback from UI on CCRs’ Payment Advance Request and process improvements

Nov. 5 Courtyard Marriot, Bandung

F&G Refreshment Training

-To increase the F&G Managers’ capacity in managing their roles and responsibility as a reviewer, budget manager, and fund manager

-To increase the Finance and Amin Assistants’ capacity on activity budget and additional budget preparation

-To produce more efficient processes and better report quality

-To work on real case of Advance (PAR) and expense reports, based on respective CCR needs

Nov. 28 SHERA Office, Jakarta

Direct F&G Mentoring-ANBIOCORE To mentor ANBIOCORE reconciliations in the QB system.

Dec. 6 IPB, Bogor

CCR Program Management Meeting for Y2 Implementation- ANBIOCORE

-CCR Management meeting in preparing the CCRs’ Y2 funds disbursement and its reconciliation

-To address the CCRs’ needs in requesting the additional obligation funds

Dec. 10 ITB, Bandung

CCR Program Management Meeting for Y2 Implementation- NCSTT

-CCR Management meeting in preparing the CCRs’ Y2 funds disbursement and its reconciliation

-To address the CCRs’ needs in requesting the additional obligation funds

Dec. 11 UNPAD, Bandung

CCR Program Management Meeting for Y2 Implementation- CCR ARI

-CCR Management meeting in preparing the CCRs’ Y2 funds disbursement and its reconciliation

-To address the CCRs’ needs in requesting the additional obligation funds

Dec. 12 UGM, Yogyakarta

CCR Program Management Meeting for Y2 Implementation- CDSR

-CCR Management meeting in preparing the CCRs’ Y2 funds disbursement and its reconciliation

-To address the CCRs’ needs in requesting the additional obligation funds

Page 12: Sustainable Higher Education Research Alliances (USAID SHERA)

12

Date (2018 -2019)

Location Topic Activity Objectives

Dec. 13 UI, Depok

CCR Program Management Meeting for Y2 Implementation- SMART CITY

-CCR Management meeting in preparing the CCRs’ Y2 funds disbursement and its reconciliation

-To address the CCRs’ needs in requesting the additional obligation funds

Jan. 24 SHERA Office, Jakarta

Performance Management report -IPB

Low performance of IPB, establish action items for ANBIOCORE

Feb. 07 SHERA Office, Jakarta

Meeting with URI Dean and Representative at IPB

URI to consult the payment of IPB to URI

Update from SHERA to URI on real situation

Feb. 13-14

ANBIOCORE Office, Bogor

Mentoring CCR ANBIOCORE Field Monitoring with CCR ANBIOCORE regarding the financial report

Feb. 17-18

CCR ARI Office, Bandung Mentoring CCR ARI Field Monitoring with CCR ARI regarding the financial report

Feb. 19-20

NCSTT Office, Bandung

Mentoring CCR NCSTT Field Monitoring with CCR NCSTT parallel with CCR SMARTCITY

regarding the financial report, Grant team is divided by 2 team SMARTCITY Office, Depok

Mentoring CCR SMARTCITY

Feb. 21-22

CCR CDSR Office, Yogyakarta

Mentoring CCR CDSR Field Monitoring with CCR CDSR regarding the financial report

March 13-15

UNPATTI, Kota Ambon

Grant Monitoring to CCR ARI - UNPATTI

-Create a strategy to leverage achievement and engagement on relation Affiliate Cost Reimbursement on CCR ARI; -Follow up the reporting cycle in Affiliate UNPATTI; -Feedback and discuss for the recommendation the Affiliate Agreement with Hospital sub-contract.

March 22 – 23 Mataram, NTB

Grant Support and Monitoring - CCR ARI - MATARAM

- Create a strategy to leverage achievement and engagement on relation Affiliate Cost Reimbursement on CCR ARI;

- Feedback and discuss for the recommendation the Affiliate Agreement with Hospital sub-contract.

March 29 IPB, Bogor

Meeting ANBIOCORE Management and Board of Advisor

Notify IPB Vice Rector on ANBIOCORE low performance and discuss performance improvement plan

Apr. 8-11

Courtyard Hotel, Bandung

Finance & Grant Refreshment for CCRs

1. To increase the F&G focal point's capacity in managing their role and responsibility as reviewer, budget manager and fund manager, 2. To increase the F&G in preparing the procurement plan, admin, back up support in completing the documents of procurement process, especially in restricted commodities and equipment, 3. To work in real case of procurement proposed to SHEAR, expense report, based on respective CCR's needs 4. To produce more efficient process and better report quality,

Page 13: Sustainable Higher Education Research Alliances (USAID SHERA)

13

Date (2018 -2019)

Location Topic Activity Objectives

5. to create pipeline related PAR and WBS, 6. To introduce the fraud and action needs,

May 3 IPB, Bogor SHERA & CCR ANBIOCORE - IPB Management Meeting

To meet the Vice Rector to discuss the lack of management at IPB

July 15 IPB, Bogor Meeting IPB Update on current condition on activities and funding

July 16 UGM, Yogyakarta Meeting UGM Update on current condition on activities and funding

July 23 ITB, Bandung Meeting ITB Update on current condition on activities and funding

July 24 UNPAD Bandung Meeting UNPAD Update on current condition on activities and funding

August 9

UNPAD Bandung Assistance to UNPAD for finalization of July 2019 Report

- Follow up pending Items for the June 2019 report. - Completion of submitting and preparing July 2019 reports - Identification of payable to local vendor

Table 1: F&G Mentoring and Support Activities

b. CCR Activity Highlights and Best Practices During Year Three, the CCRs were able to shift from planning to fully implementing research activities and sharing best practices. The section below highlights some examples of their achievements and best practices in Year Three. CCR ARI Through SHERA, CCR ARI has developed hospital protocols, hospital accreditation standards, and training programs for its affiliates and researchers. The potential impact of its work is far-reaching, as CCR ARI seeks to increase hospitals’ and researchers’ knowledge so they can then provide quality services to patients. For example, when CCR ARI worked with Zainal Abidin Hospital, they were able to record patients’ data in a more detailed manner than ever before, thereby creating a culture of better data management throughout the hospital. This also contributed to the hospital’s accreditation process under the Joint Commission of International Accreditation. Additional CCR ARI activities included:

Surveillance Study- This research was a part of CCR ARI’s broader Burden of Disease and Influenza Surveillance study, to serve as a baseline reference for future studies and evaluate the influenza disease prevention program for healthcare workers in hospitals.

Hospital Mortality Study- This study was intended to estimate the mortality and the burden of diseases in participating hospitals, to then help guide public health and healthcare policies. After receiving ethical clearance by UNPAD in March 2019, this study surveyed the hospitals in the surrounding Bandung area and expanded as other participating hospitals received study permits.

Post Discharge Study- Part of the aforementioned Burden of Disease study, this research aimed to collect post-discharge information on hospital patients. An innovative aspect of this study was that data was gathered by phone and text messaging, and data was then inputted into the RedCap database, which is a browser-based, metadata-driven software solution and workflow methodology for designing clinical and translational research databases.

Immunogenicity Study- This study aimed to assess and characterize the immunogenicity of the Trivalent Influenza Vaccine over a 12-month period. The findings of this research will ultimately help to better determine a course of treatment for influenza.

Page 14: Sustainable Higher Education Research Alliances (USAID SHERA)

14

Although CCR ARI is closing under SHERA in January 2020 (see further information under Challenges section), it did make important strides in its research and hospital capacity development. Whenever fund is available, IIE’s goal is to continue to support CCR ARI’s sustainability under an MoU, or a similar mechanism, in the year to come.

SMART CITY In Year Three, SMART CITY made significant achievements across all KPIs through the following activities:

International Conference on SMART CITY Innovation- In October 2018, SMART CITY held an international conference, hosted by UNPAD in Bandung. This activity increased Indicator 3.1. Scholars from across five university members of SMART CITY gathered to present on their research within the CCR’s topics. The event also included input from important external stakeholders, including The Governor of West Java, the Rector of UNPAD, and USAID Acting Deputy Mission Director, Betty Chung.

Academic Writing Capacity Development- In November 2018, 82 scholars from 22 Indonesian HEIs

attended SMART CITY’s short-term training course to improve their scientific research papers’ quality, thereby enhancing their ability to write and publish international journal articles. This mentoring series was supported by the CCR’s US partners. Additionally, SMART CITY created a collaborative opportunity with Universitas Maarif Hasyim Latif, whose own consortium had previously faced challenges in producing high-quality journal manuscripts for publication and international conferences. Through collaboration with SMART CITY, the CCR is now able to help increase the scholars’ capacity in academic research writing.

External Stakeholder Engagement- As part of its research consortium practice, SMART CITY reached out to the Ministry of Internal Affairs (KEMENDAGRI), through the representative from the DG of Local Autonomy, to promote the establishment of an Association of Southeast Asian Nations (ASEAN) Smart City Center (ASCC).

Consortium Research Fellowship- CCR SMART CITY conducted selections for the 2019-2020 Consortium Research Fellowship, which provides opportunities for researchers (both at the lead and affiliate level) to carry out collaborative research activities. As a university partnership best practice, SMART CITY required that collaborative research be a key feature in the research proposals submitted and that each research team consist of at least 30% women researchers (as stated in the CCR’s research policy). Eight proposals were approved and these Indonesian HEIs are now partnered with U.S. researchers at Harvard University, the University of Washington, Purdue University, the University of Illinois at Urbana-Champaign, the University of Florida, and Alabama A&M University.

Figure 4: Ridwan Kamil, Governor of West Java (middle), attending International Conference.

Page 15: Sustainable Higher Education Research Alliances (USAID SHERA)

15

Research Solutions for Real-World Problems- SMART CITY has also progressed in developing the Smart Land Surveillance System and Adaptive Traffic Management System prototypes. The surveillance system is an automated system using Light Detection and Ranging to estimate the value of land and buildings. The output is then synchronized with construction permits to identify any tax violation and mass or land appraisal (see further information under Annex III: Impact Stories). Its Adaptive Traffic Management System is a solution to congestion problems in Indonesia, as it adjusts traffic lights in a region based on real-time traffic conditions.

CDSR CDSR made great progress during Year Three in developing, conducting, publishing, and replicating its research. During quarter three alone, CDSR produced 22 peer-reviewed scientific publications, the highest yet amongst the CCRs. Additionally, it was one of only two CCRs (SMART CITY being the other) to replicate its research findings. Through CDSR’s work (highlighted below), the CCR learned that it must have a clear strategy and approach on how to market its research findings for when it makes first contact with an external stakeholder. This step helps ensure that the needs of the research program and community are met.

Research Replication- CDSR’s study on energy sustainability methodology was selected by the Small Grants Program of the United Nations Development Program (UNDP) to be replicated in four of UNDP’s assisted provinces (see further information under Annex III: Impact Stories). This is an important milestone in Indicator 3.1 and demonstrates CDSR’s systematic efforts to provide an enabling environment to strengthen and enlarge the research and design program network as a strategy to achieve its own sustainability.

Sustainable Energy Spotlight- As part of its research activities, CDSR also conducted algae experiments that examined algae’s role in sustainable photovoltaics. CDSR’s research on the creation of an algae wall was presented in Australia and published in a sustainable energy journal, raising the global profile of CDSR’s work. If further funding is secured, the scholars will expand the research into a prototype to then test it on a building. In addition to CDSR scholars presenting their research at several international conferences in 2019, CDSR affiliate UBB also managed an international conference in September 2019, at which CDSR representatives provided monitoring and evaluation support for the attendees. By UBB conducting its first international conference, this action boosted the quality assurance of UBB’s rating for university accreditation. The conference itself had a high participation rate (46.8% of 4,766 total participants) of women attendees. This demonstrates the strong, inherent characteristics of gender inclusion in CDSR’s design.

SMART CITY requires that collaborative research be a key feature in research proposals submitted and that each research team consist of at

least 30% women researchers, per its research policy).

Figure 5: ICoGEE delegation during the opening session at UBB, September 11, 2019.

Page 16: Sustainable Higher Education Research Alliances (USAID SHERA)

16

NCSTT NCSTT made significant gains in achieving KPIs in Year Three through international conferences, trainings, and partnership with both the private and public sector. Information on each can be found below.

International Research and Industry Exposure- In October 2018, NCSTT hosted the 5th International Conference on Electric Vehicular Technology (ICEVT), as well as the “Life at MIT & MIT Professional Education Sharing” seminar. Both events inspired NCSTT scholars to pursue opportunities in international joint research. Additionally, ICEVT hosted keynote speakers from private sector companies, such as a Toyota. This kind of exposure and networking at the beginning of the year fueled further events and pushed NCSTT to expand their partnerships. It also led to continued capacity development and research activities with NCSTT U.S. affiliate MIT throughout the year (see further information in Annex III: Impact Stories).

Affiliate Capacity Development- In addition to exposing scholars to new networks and partnerships NCSTT also focused on increasing its scholars’ capacity in understanding intellectual property (IP) rights, as well as scientific writing skills. Its short-term training course on Strategic Management of IP Rights, Copyright and Patent Process in December 2018 triggered the enactment of new policies related to IP in its affiliate, Universitas Diponegoro. Later during its two-day workshop on scientific writing, the participants produced 23 article drafts, which they aim to publish in the International Journal of Sustainable Transportation Technology.

Public/Private Partnerships- As a Center of Excellence, NCSTT has enlarged their partnership to other private and public sector, national and international, to support their research work in developing the prototype of electric vehicles (e-bus and e-trike). For example, under its private partnership with PT Bakrie and Brother, NCTT designs the e-bus and e-trike, while PT Bakrie and Brothers provides the production facility. NCSTT lead university ITB and affiliates UNDIP and UNS have signed MoUs with several transportation industries, while UNS established a MoU with the Agency for Assessment and Implementation of Technology on Light Rapid Transportation development. UNDIP itself also established a MoU with the State Electricity Company on potential electric vehicle development.

ANBIOCORE ANBIOCORE progressed in Year Three by achieving its target for knowledge-sharing events on best practices and engaging in joint research projects.

Affiliate Support and Training- ANBIOCORE learned that to better manage and support its affiliates, direct visits for observation and training must systematically take place. For example. ANBIOCORE sent a monitoring team to UNSYIAH in the second quarter to observe the laboratories supported by SHERA and conduct focus group discussions with researchers and management personnel. During this visit, ANBIOCORE observed that

Figure 6: NCSTT's affiliate, Universitas Diponegoro, collaborating with a local bus manufacturer.

Page 17: Sustainable Higher Education Research Alliances (USAID SHERA)

17

UNSYIAH’s Veterinary research had a clear research plan and collaborative networking with BPTU Indra Puri, with additional plans in plans to collaborate with the Aceh Provincial government on genome research. ANBIOCORE identified this collaboration as one with potential for funding sustainability beyond the end of the SHERA program. UNSYIAH and BPTU also noted that well-established and regular communications between both parties’ high-level management is essential for progress in their research. As a result of its collaboration with other institutions and training under SHERA, UNSYIAH and the other affiliates have made significant gains. Before SHERA, UNSYIAH typically had 5 publications per year. This year alone, it produced 35 publications. Another affiliate scholar from University Mataram had never succeeded in submitting an article to an international journal. After joining the ANBIOCORE workshop on scientific writing methodology, he revised his draft article, and, with additional mentoring from Prof. Erdogan from U.S. affiliate Mississippi State University, he submitted two articles, and both were accepted by the journal and have since been published.

International Collaborative Research- In May 2019, ANBIOCORE team carried out data collection for fish ecology, eDNA, fish gut content, and oceanography data in Misool, Raja Ampat, Papua. The activity was intended to investigate fishing impacts and innovation strategies in fisheries biodiversity management. ANBIOCORE’S end goal is to eventually create a government regulation to protect biodiversity and ecological sustainability. The activity was the result of collaborative research between IPB, Universitas Papua, and URI. To continue these research efforts beyond SHERA, ANBIOCORE is also proactively looking for sustainable collaboration opportunities outside the academic sector, including the government, private sector, and local communities. Further collaborative opportunities would contribute to their efforts in maximizing livestock production and identifying key food web components for coral reef fisheries.

Second-tier Recipients During the previous year, one of the program’s milestones was negotiating and executing the CCR leads’ agreements with their U.S. and Indonesian affiliates. In Year Three, those partnerships were able to expand and, in many cases, flourish (see further information under CCR Activity Highlights and Best Practices). On April 1-7, IIE conducted in-depth monitoring on three CCR affiliates to assess the gains they had made under SHERA and to hear how the lead CCRs were performing their activities. The affiliates each noted that they had learned a significant amount from their respective CCR lead under SHERA and the following gains had been made:

Data expansion and research developments within its research focus

Figure 7: Subhan Beginner, ANBIOCORE's researcher, collecting samples and data during the Misool expedition.

UNSYIAH and BPTU also noted that well-established and regular communications between both parties’ high-level management is essential

for progress in their research.

Page 18: Sustainable Higher Education Research Alliances (USAID SHERA)

18

Improved and expanded research, management and policy enabling environment within the institution Increased participation in the international journal publication index Scopus Increased institutionalized research networking among Indonesian and international HEIs. Increased opportunities for academic accreditation through exposure to U.S. HEIs

Based on the discussions this meeting, the SHERA team learned that it should further incorporate how the research consortiums work when drafting and implementing its management plan. More specifically, the affiliate emphasized that their work spans multiple sectors, is multi-disciplinary, and involves multiple affiliates. As such, this affects its planned activities, output/outcomes, management compliance, and equal opportunity to research grants. Indonesian university affiliates have reported to IIE that SHERA changes the mind set of researchers and management. Research collaboration should be managed properly and comply with international procedures. Though it is difficult in the beginning, it results in better operations and research results. Accordingly, universities have begun to adopt the SHERA approach in day-to-day operations and programming. For example, the Dean of ANBIOCORE affiliate, the University of Brawijaya, Malang, informed IIE the researchers had previously conducted research just for the need for increasing publications. After joining SHERA, the affiliate knew all research must conducted per international standards, as the CCR had created a research methodology document for internal use by the lead and affiliates institutions. The Dean then proposed to the Rector that the university change their simple laboratory into a biotechnology lab, to accommodate the ANBIOCORE standard. After few months, and the work of the research spread throughout the university and more researchers visited and used the lab. Now, researchers and students from outside of the university use the laboratory for a fee, bringing business to the lab and turning into one of the most modern labs in East Java.

c. Strategic Meetings During the previous year, IIE conducted quarterly meetings with all CCR leads as an opportunity to report on progress, successes, challenges, and solutions over the prior quarter and conduct planning for the upcoming quarter. As the CCRs’ capacity increased, IIE proposed to replace those meetings with biannual planning meetings. However, after the start of Year Three, IIE decided to instead hold a strategic meeting to disseminate, discuss, and devise a plan for USAID’s new CDCS. This decision was made since the revised CDCS was the more immediate matter at hand, and IIE felt that the CCRs were continuing to make steady progress administratively and programmatically. Similar to the first biannual meeting, the second was also replaced by a strategic meeting. The second strategic meeting was called to discuss the limited funding available under SHERA. See more information on both strategic meetings below: February 2019 Strategic Meeting, Jakarta The two-day meeting was attended by USAID, Kemristekdikti, CCR Program Directors and Partnership Managers, and IIE staff. USAID presented its revised CDCS plan to the participants and the ensuing discussions resulted in the following takeaways:

IIE and the CCRs will need to adjust program implementation to meet USAID’s strategic shift, particularly in regard to expected targets of outcomes and outputs.

CCRs, as the real implementors at the field level, should propose and submit ideas for altered programs not in line with the new USAID strategy.

Indonesian university affiliates have reported to IIE that SHERA changes the mind set of researchers and management. Research collaboration

should be managed properly and comply with international procedures. Though it is difficult in the beginning, it results in better operations and

research results. Accordingly, universities have begun to adopt the SHERA approach in day-to-day operations and programming.

Page 19: Sustainable Higher Education Research Alliances (USAID SHERA)

19

Research programs behave differently from traditional development programs, as they start slowly and become increasingly fast in the middle and towards the end of the program period. Therefore, CCR management should work with USAID on how to optimize their funding.

Kemristekdikti works with the National Planning Agency in developing the road map for Indonesia’s overall research programs. All CCRs have submitted information on how SHERA supports their research so that information can be incorporated in Indonesia’s research blueprint. However, the GOI never updated the CCRs nor IIE on the submission of its next plans.

Figure 8: Tom Crehan – USAID/Indonesia Human Capacity and Partnership Director (third from left, below) with USAID SHERA AOR, Jalu Cahyanto (far left, below) attended and discussed USAID’s new direction with CCRs and the GOI.

August 2019 Strategic Meeting, Semarang On August 1 and 2, 2019, IIE held a Strategic Meeting in Semarang. This meeting was attended by representatives from each CCR, USAID, Kemristekdikti, and Monitoring and Evaluation Support Program (MESP) Advisors. Also other items were discussed, the primary focus of the meeting was IIE’s latest obligation increase from USAID, the ambiguity of SHERA’s future funding from USAID, and how the CCRs can proceed with activities when they had expected much higher funding levels during their period of peak activities. USAID noted its commitment to supporting the GOI’s targets for increasing the quality and quantity of research and publications, as well as its support for the CCRs to become permanent institutions at their universities. It remarked that USAID will try its best to find additional funding for SHERA but could make no further promises; rather, Kemristekdikti and HEIs need to be involved in maintaining the CCRs and their research. USAID MESP Advisors were also present to report the findings of the recent Sustainability Review. The key takeaway and action items from the Strategic Meeting were:

‐ CCRs requested that USAID issue a letter detailing the budget cuts to IIE. If that is not possible, they asked that IIE provide a letter to the CCRs for CCR Management to use as a tool in meetings and communications regarding their reduction of activities.

‐ Kemristekdikti, USAID, and IIE will meet as a follow-up to discuss options for Kemristekdikti and University support

Page 20: Sustainable Higher Education Research Alliances (USAID SHERA)

20

‐ Kemristekdikti agreed to provide additional grant support for next year based on Indonesia’s budget cycle (Submitted October 2019). If the additional funding is available, those funds could be transferred in April 2020.

‐ Based on the latest obligation from IIE in July 2019, UI, ITB, and UGM will continue to operate but will likely be forced before the end of the project if no further funding becomes available

‐ UNPAD cannot continue research activities based on current funding levels. IPB will work within its current obligation from IIE but will also be forced to close ahead of its subagreement period of performance end date.

Following this meeting, USAID Programs Director David Simpson wrote a letter to the CCRs in September 2019 stating that IIE did not yet know whether further funding was available or when it would arrive, but that IIE had requested additional funding from USAID. By the end of the reporting period, IIE had not yet received a response from USAID on its request for additional funding.

Activity 2. Monitoring, Evaluation and Learning (MEL) a. Direct/Virtual Mentoring

Throughout the year, the SHERA MEL team carried out several activities to ensure that direct mentoring was in place and ongoing for the CCRs. These activities were in addition to the ongoing virtual mentoring that the SHERA team provides to the CCRs. They were largely focused on building capacity and providing technical support for the new Management Information System (MIS) web application (see further information below) and were also designed to streamline and enhance current practices, such as impact story reporting. Further information on each activity can be found below:

November 2018 MEL Training: SHERA conducted a MEL training for CCR MEL and Communications representatives from November 12-17 in Pangkal Pinang on Bangka Island, off the coast of Sumatra (see further information on the Communications portion of the training under Activity 3: Outreach and Communications). Representatives from Universitas Bangka Belitung (UBB) also attended, along with local community members from Semujur Island. The training was held to improve the CCR MEL Specialists’ knowledge of the program’s Monitoring and Evaluation concepts, the Theory of Change (ToC) and results-based Management (RBM). A unique aspect of the training was that the participants had the opportunity to practice their newly acquired knowledge and skills by taking photographs of researchers’ activities at UBB’s lab and interviewing the researchers and the communities in Semujur. Overall, the participants agreed that the interactive sessions helped them to better understand the materials and appreciated the newly acquired knowledge. They also noted that these topics are very important for the CCRs and should be presented for the senior level management team to better design CCR activities.

January 2019 Virtual Mentoring with CCR Leads: SHERA MEL Specialist led a series of video calls with CCR Leads to ensure that updated CCR research clusters and topics were properly stored in their databases.

Figure 9: Kemristekdikti delegation led by DG M. Dimyati, USAID delegation led by Tom Crehan, and Lead CCRs delegations led by the Vice Rectors.

Page 21: Sustainable Higher Education Research Alliances (USAID SHERA)

21

Additionally, due to the CCRs’ uniqueness in multiple fields and sectors, and to ensure an aligned technique for all CCRs in updating databases on journal references, the SHERA team shared its decision to use the Oxford British standard bibliography.

May 2019 MEL Training- The SHERA MEL team held a training with CCR MEL Specialists to enhance CCR MEL Specialists’ knowledge and skills on the newly-developed MIS web application and their ability to perform data entry for events, mentorship logbook, and research logbook; ensure that the MIS web application’s database is correct and instruct MEL Specialists on how to correct any errors that occur; and, improve CCR MEL Specialists’ knowledge and skills on how to better identify impact for their respective CCR’s outcomes.

As a result of this training, the SHERA MEL team received valuable input from the CCRs on how to improve the quality of MIS web application in regard to the data entry process, further ensuring the validity of the data. The team then took immediate actions on site and post-event to ensure this feedback was sufficiently accommodated. SHERA also hired temporary, short-term daily workers to perform data entry for all submitted data between FY2017 and FY2019.

June 2019 Virtual Mentoring- On June 19, the SHERA MEL team held a virtual mentoring session that was attended by each CCR’s MEL Specialists. Using feedback from May reporting, the SHERA MEL team learned that all of the CCRs’ MEL Specialists were able to operate the MIS platform very well. They also gave a presentation on their upcoming annual MEL online survey for collecting data on indicator 3.1.2. Finally, the team also provided updated formats for the KPI tools in the SHERA scientific publication booklet. With the goal of capturing regularly updated data and the sustainability KPIs, the SHERA MEL team embedded and integrated the new data template into existing data recording and reporting tools.

b. Monitoring Impact Stories SHERA developed a mechanism flow for impact story data collection using the Most Significant Change (MSC) approach. The MSC is a method of identifying impact through stories, where the most significant stories are expected to be acknowledged as SHERA’s impact stories. Since SHERA is focused on building the capacity of Indonesian HEIs and how their research can be utilized and sustained, the MSC approach is particularly useful for identifying impact within the context of SHERA. This mechanism flow allows CCRs to select stories that they believe have potentially significant change for their respective programming, as shown in the diagram below:

Figure 10: The Mechanism of Impact Stories

Page 22: Sustainable Higher Education Research Alliances (USAID SHERA)

22

As detailed in the diagram, affiliate partners will draft and submit impact stories to their respective CCR’s management team, who will then review and validate the story. They will decide which story shows MSC. During this process, CCRs will involve the SHERA MEL team to review the accuracy and effectiveness of the selected story angle. Over time, this data will also be utilized as a monitoring tool by the SHERA Communication and Outreach Specialist to better gather and detail SHERA’s impact to targeted stakeholders.

c. Performance Indicator Review

Outcome 1.2 and 3.1.1 Definition Updates In the SHERA MEL virtual training on January 16, 2019, the SHERA team provided updates to the definitions of Indicator Outcome 1.2, “Scholars participated in collaborative research,” and Output 3.1.1, “Selected affiliates institutions included in research consortium.” The indicators now emphasize the essential collaborative research efforts consisting of multiple institutions within CCRs and how data is recorded with specific disaggregation.

MEL Online Survey to Collect Data for Indicator 3.1.2. The MEL online survey is an annual survey conducted to collect data for Indicator, 3.1.2., which is the “Number of scholars at CCR institutions with increased access to external resources and academic research engines.” The survey has been carried out since FY18. This survey holds a very significant role in measuring the extent to which SHERA’s scholars use external resources access in carrying out research funded by the U.S. Government. These external resources include websites, books, encyclopedias, and journals. Beginning in June 2019, the SHERA MEL team put together an online, quantitative questionnaire using Google Forms. They then coordinated with each CCR MEL Specialist on the implementation of the survey and encouraged the CCR MEL Specialists to communicate intensively with their researchers, regularly reminding them to respond to the survey. Overall, access to external academic research engines increased (93%) during this collection period. Of those resources, academic journal publications were accessed more than any other type of resources. Comparing these FY19 results against the findings in FY18, there was only a marginal decrease of 1%, as seen below:

Figure 11: Comparison of Survey Results in FY19 vs. FY18

The decrease was due to the increased number of respondents in FY19 period compared to FY18, which controlled the number of the denominator in analysis. Below is the list of SHERA’s recommendations for the CCRs based on the finding of the FY19 rapid survey report:

1. Since journals are the most frequently accessed external resources across all five CCRs, it is recommended that each respective institution ensure that scholars are able to continuously access those journals.

94%increase in access 

to external academicresearch engines‐FY2018

93%increase in access 

to external academicresearch engines‐FY2019

Page 23: Sustainable Higher Education Research Alliances (USAID SHERA)

23

2. The respective Lead CCR should encourage and mentor their respective affiliates to regularly update the content of their knowledge management platform by considering what are the resources most needed by the scholars. This is particularly relevant since the survey found that websites are the second most frequently used resource by scholars.

3. SHERA will encourage the CCRs to report their continued findings as part of their success stories for SHERA in the fiscal year ahead.

Updated PIRS Consistent program monitoring by SHERA revealed that several indicators should be updated based on the CCRs’ current practices. Accordingly, the following indicator descriptions were adjusted:

1. Goals 3 Indicator: # of academic research initiative who findings have been replicated, applied or taken to the market;

2. Output Indicator 1.2.2: # of Indonesia scholars who receive ongoing mentoring from US partner universities; 3. Output Indicator 1.2.3: # of scholars who participate in virtual knowledge exchange; and, 4. Output indicator 3.1.1: # of selected affiliates institutions included in research consortium.

The PIRS on the Goal Indicator 3 and Output Indicator 1.2.2 were adjusted to make them more precise and based on current CCR techniques and practices. Additionally, IIE proposed to USAID that output indicators 1.2.3 and 3.1.1 should be deleted since they were a redundant measurement and inapplicable to the CCRs’ needs. These changes were approved by USAID in September 9, 2019. At the end of September, USAID also requested revisions to Goal Indicator #3, changing the numbers into a ratio, and changing the ratio into number of partnerships created under Output Indicator 3.2. The final changes were still pending at the end of the reporting period.

d. MEL Information System (MIS) Development Over the course of Year Three, the development of the MIS progressed rapidly. In addition to the aforementioned capacity building provided for the CCR MEL Specialists, the SHERA MEL team also performed the data entry processes for activity reports, research logbooks, and mentoring logbooks. The system now features data backdated as far back as FY17. To ensure that the data was stored correctly in a timely manner, SHERA hired temporary, short-term daily workers to perform data entry for all data between FY2017 and FY2019. Ten undergraduate students, largely recruited from SHERA’s HEI partners, participated in the program and inputted backdated and current data into the new MIS web application system. As a result, the activities reported during the third and fourth quarters of this reporting period utilized data extracted from the MIS web application.

During the fourth quarter, SHERA adjusted the data entry process to optimize the functionality of the system. Accordingly, those changes then required SHERA’s MIS Specialist to alter the programming codes and master data. This delay pushed back the full integration of the platform until December 2019; however, the finished product will be a powerful system which not only allows the user to access key figures quickly and filter the data, but also allows the user to export data as a Microsoft Excel spreadsheet. Throughout the year, SHERA MEL team has worked closely with the CCRs in a virtual capacity to ensure that as changes are made to the system, the CCR MEL Specialists are also continuously trained. The appearance of the MIS MEL Dashboard is displayed below.

Page 24: Sustainable Higher Education Research Alliances (USAID SHERA)

24

Figure 12: The MIS MEL Dashboard

Activity 3. Outreach and Communications SHERA’s outreach and communications efforts support the program’s overall objective: To increase the capacity, quality, and collaboration among individuals and institutions in Indonesia to develop world- class research skills and strengthen the institutional environment that enables and encourages university research in Indonesia. The strategy and implementation of the program’s communications efforts are based on the outcome results framework (Output 2.2), “CCR best practices documented and disseminated to Indonesian Higher Institutions.” The activities included in the following section highlight SHERA’s successful communications strategy and implementation in Year Three.

a. Communications Direct Mentoring Communications and MEL Training In November 2018, SHERA’s Communications Specialist, with the MEL team, organized a training attended by 13 CCR Communications and MEL representatives. The training was held at the University of Bangka Belitung and was conducted in the field in order to provide participants with hands-on experience. There, the participants practiced interviewing beneficiaries, developing communications content in a laboratory, and capturing stories from the local community. There were also sessions on USAID Branding and Marking, event management, photography, videography, storytelling, and digital portal management. Based on the results from the pre/post surveys taken during the training, participants reported increased knowledge in capturing research activity, captioning photos and videos, and complying with USAID branding requirements. 100% of respondents found the training useful overall. On May 15-17, 2019, SHERA conducted a follow-on training in Bandung. While the training material was more focused on the practice and utilization of the monitoring and evaluation results, it also taught the participants how to incorporate

Figure 13: Training participants how to capture a story in the field by interviewing laboratory researchers.

Page 25: Sustainable Higher Education Research Alliances (USAID SHERA)

25

these results into a Most Significant Change (MSC) story. The SHERA Communication & Outreach Specialist, as well as the MEL Specialists, then reviewed each CCR’s MSC story to assess how they collected and gathered data for the story. Digital Content Production Support Throughout the third quarter of Year 3 (April-June) 2019, SHERA’s Communications Specialist also worked closely with CDSR and ANBIOCORE to teach them how to create new digital content for their outreach efforts. CDSR collaborated with SHERA to create four videos on its research activities. SHERA helped CDSR with the story board through the framing, video editing, and final production. SHERA also assisted ANBIOCORE in its efforts to document its data collection and sample gathering activity in Misool, Papua. This activity was part of a research collaboration between IPB, Universitas Papua, and URI.

b. Events and Outreach International Conference on SMART CITY Innovation (ICSCI) 2018 In October 2018, SMART CITY conducted the first International Conference on SMART CITY Innovation (ICSCI) in Bandung. The objectives of the event were to further facilitate urban planning and development research in Indonesia and abroad, as well as share current research. ICSCI 2018 key speakers traveled from universities in the U.S., Wales, Singapore, and Indonesia, and 123 researchers from Indonesian universities participated in the conference. To support this event, the SHERA Communications and Outreach Specialist worked with public relations teams from UNPAD and the West Java provincial government to hold a press conference, where the governor and UNPAD’s rector spoke. Please see the media coverage regarding this event in the attached Annex 1V. International Conference on Electric Vehicular Technology (ICEVT) 2018 NCSTT conducted the 5th International Conference on Electric Vehicular Technology (ICEVT) in October 2018, where 41 presentations were given by researchers from across Indonesia and from abroad. To support this event, SHERA Communications and Outreach Specialist worked with ICEVT 2018 communications team to review all communications materials and ensure they met branding requirements. SHERA also assisted NCSTT in drafting the press release and highlighting the event on SHERA’s social media accounts. SMART CITY Public Lectures Over the course of the second quarter (January-March 2019), SMART CITY conducted a public lecture series with various partner institutions, including UI, UNPAD, UNDIP, and UNUD to disseminate research results and encourage scholars to continue conducting research in urban planning. In total, 590 scholars and researchers attended the lecture series. The SHERA Communications and Outreach Specialist supported the event at UNDIP by inviting and coordinating the national media outlets’ attendance, including Kompas, Jawa Pos, Suara Merdeka, and Radar Semarang, a local Central Java media outlet. The media interviewed Prof. Heri Susanto, SMART CITY’s partnership manager at UNDIP, and Prof. Christopher Silver and Dr. Sheila Bosch, researchers from UF. During his interview, Pro. Susanto explained SHERA’s impact on Indonesian research in the urban planning field. Prof. Silver provided details on the challenges and opportunities in Indonesia’s rapid urbanization to develop increasingly sustainable cities and the role of SMART CITY in addressing them through advocacy in the public and private sector.

Figure 14: ANBIOCORE's data collection activity in Misool, Papua (May 2019)

Page 26: Sustainable Higher Education Research Alliances (USAID SHERA)

26

SHERA Talk Show: Solution for Mobility in Indonesia SHERA, with in cooperation with NCSTT, held a talk show on “Transportation Technology: Solution for Mobility in Indonesia” on 30 April 2019 at @america in Jakarta. Dr. Eng. Bentang Arief Budiman and Dr. Annisa Jusuf, NCSTT researchers, offered innovative solutions for Indonesia’s transportation issues, in addition to highlighting the importance of sustainable transportation technology. 170 participants attended the event, including GOI officials from Kemristekdikti and the Ministry of Transportation. Four media outlets were also represented. The SHERA Communications and Outreach Specialist supported this event by liaising with @america’s event coordinator to design a poster for social media, ensuring all presentation materials met the USAID branding and marking guideline, drafting press release, and inviting the national media outlets to attend this event. Additionally, SHERA’s Communication and Outreach Specialist worked closely with SMART CITY’s communications team to invite representatives from PT Transportasi Jakarta (Transjakarta), Kemristekdikti, and the Ministry of Transportation.

Figure 16: All presenters and representatives from Kemristekdikti – Windy Nababan (fifth from right), USAID, Tom Crehan (far left) and Ester Manurung (third from right). IIE, David Simpson (far right), Prima Setiawan (middle holding plaque), and IIEF, Diana Yusuf

(second from right) at the closing of the event. HAKTEKNAS 2019 SHERA attended RiTech EXPO 2019 (Research and Technology Expo) organized by Kemristekdikti to celebrate Indonesia’s National Technology Day (HAKTEKNAS). It was held at Lapangan Puputan in Denpasar, Bali on August 25-28, 2019. Representatives from the GOI, Embassies, local government, researchers, scholars, and the private sector attended the event to discover and celebrate the technological innovations being made in Indonesia. This is the third year in a row that SHERA participated in the event.

Figure 15: April 2019, @america SHERA Talk Show. Dr. Jusuf sharing her expertise on sustainable transportation systems.

Page 27: Sustainable Higher Education Research Alliances (USAID SHERA)

27

All CCRs were invited to join this event but only CCRs CDSR, SMART CITY, and ANBIOCORE chose to participate. CDSR brought diversification products of microalgae, bioplastics, bioethanol products, and research videos; SMART CITY brought the traffic simulation apps and their “pirzi” (perbaikan gizi/improve nutrition) doll; and, ANBIOCORE brought instruments used for cattle sperm collection and the fisheries’ fossil prototype. Throughout the event, SHERA’s Communication and Outreach specialist also provided printed material and video documentation. Over the course of 3 days, SHERA’s booth was visited by more than 250 participants. Additionally, some of SHERA’s researchers who were already attending the event also assisted with SHERA’s booth and greeted the audience.

c. Website Development and Social Media CCR Websites During Year Three, each CCR developed and launched its own website, with the exception of ANBIOCORE. Despite SHERA’s support and guidance, ANBIOCORE’s website was never launched because the CCR did not have a dedicated team member who could maintain and manage the website. Throughout the website development process for the other four CCRs, SHERA’s Communications and Outreach Specialist organized several meetings with each CCR to strategize and work through challenges. Since then, each CCR has skillfully utilized its website to provide updates on articles, events, and information related to project/research. Please find links to each CCR’s website below:

CCR Website Link Status

NCSTT - ITB http://ncstt.itb.ac.id Active

CCR ARI - UNPAD http://ccr-ari.fk.unpad.ac.id Active

CSDR - UGM http://cdsr.pse.ugm.ac.id Active

SMART CITY - UI http://smartcity.ui.ac.id Active

SHERA Website and Social Media SHERA’s website, www.shera-research.org, gained 736 new users in Year Three. Of the 736 users, 85.4% were new visitors and 14.6% were returning visitors, many of whom revisited the website. SHERA Communications and Outreach

Figure 17: Dr. Jumain Appe, DG for Innovation Strengthening (center) and Kemristekdikti colleagues visited USAID SHERA booth.

Page 28: Sustainable Higher Education Research Alliances (USAID SHERA)

28

Specialist also worked closely with CCRs to increase website traffic. Each CCR’s website includes a SHREA website link on their website page so that visitors are easily directed to the SHERA’s home page. While SHERA’s website has proven to be an excellent landing page for the program, SHERA has also maximized social media as a tool to further engage its audience and expand its outreach. SHERA’s Communications and Outreach Specialist manages two social media accounts: USAID SHERA on Facebook (11,457 followers) and @PenelitianSHERA on Twitter (538 followers). In order to boost social media engagement, SHERA’s Communications and Outreach Specialist schedules posts every Monday through Friday during lunch time (12 p.m. – 1 p.m.) as this time period typically solicits the most engagement with followers. If there’s a large event featuring SHERA or one of the CCRs, such as HAKTEKNAS, the social media posting schedule then becomes more frequent. Additionally, every time a CCR posts any content on their own social media handles, they tag SHERA’s handles so that the SHERA Communications and Outreach Specialist can then re-post it, further boosting the profile of both the CCR and the overall program.

Figure 18: SHERA Twitter account, number of views, August 2019 In Year Three, the largest spike in social media interest for SHERA occurred in August 2019. As seen in the graph below, SHERA’s Twitter account was viewed 10,300 times by Twitter users that month. This was largely due to the HAKTEKNAS 2019 event in Bali. SHERA’s Communications and Outreach Specialist was very active during the event, highlighting both SHERA’s booth and its high-profile visitors at HAKTEKNAS each day. In addition to SHERA’s own posts, the CCRs actively posted the event on their social media pages and tagged SHERA’s social media handle on Twitter, bringing in new traffic to SHERA’s page.

d. Media Coverage In Year Three, 40 articles were published about SHERA, both in Bahasa Indonesia and English. This includes both online and printed publications. Indonesian media outlets published 34 articles. The remaining were on local government official websites (two articles), the Indonesian Embassy in Washington, D.C.’s official website (one article), affiliated universities’ official websites (two articles), and on IIE’s Opening Minds Blog (one article). Of the 40 articles, ten focused on SMART CITY’s research due to its International Conference on SMART CITY Innovation 2018 (ICSCI), held in Bandung, West Java on October 2018. Additionally, SMART CITY’s research has received attention from the press due to the changing capital of Indonesia, as the GOI is moving the capital city Jakarta to Kalimantan. With SMART CITY’s innovative work on city planning, the media has turned to the CCR to hear its researchers’ thoughts on innovative city planning. Please see Annex IV for the full list of publications relating to the USAID SHERA program published in Year Three.

Page 29: Sustainable Higher Education Research Alliances (USAID SHERA)

29

Activity 4. Stakeholder Engagement

a. USAID/Indonesia CDCS In October 2018, USAID/Indonesia invited all implementing partners to a meeting to share information on their 2014-2020 CDCS called “The Journey to Self-Reliance: Indonesia's Road Map." The revised CDCS moves SHERA from DO 4, “Collaborative achievement in science, technology and innovation increased,” to DO 2, “Essential human services to targeted populations improved and sustained,” and IR 2.3, “Capacity of educational institutions, and a cross-cutting theme.” USAID/Indonesia later held a State-of-Mission COP Meeting in March 2019 with all implementing partners, where it provided updates on the CDSR, J2SR, Domestic Resource Mobilization, and PSE. USAID’s current stage of its strategic plan includes working with technical ministries and sub-governments to share information on its new approach in order to start to explore new sources for PPP and discuss how to best measure PSE. Updates to SHERA PIRS On December 3, 2018, SHERA MEL Specialist and PD met USAID AOR to review and finalize the SHERA PIRS, namely Outcome Goal 3, Outcome 1.2, Outcome 3.1, and Output 3.1.1. on the number of selected affiliates included in research consortium. The team finalized the revised PIRS, which were then reviewed by Kemristekdikti and disseminated to the CCRs in the January 2019 MEL training. As SHERA monitored the CCRs throughout the year, the numbers showed that several indicators should be updated based on the CCRs’ current practices (see more details under Activity 2: Monitoring, Evaluation and Learning). After consulting with the AOR in August 2019, the PIRS on the Goal Indicator 3 and Output Indicator 1.2.2 were adjusted to make them more precise and based on current CCR techniques and practices. Additionally, IIE proposed to USAID that output indicators 1.2.3 and 3.1.1 be deleted since they were a redundant measurement and inapplicable to the CCRs’ needs. These changes were approved by USAID on September 9, 2019. Limited Financial Review During the second quarter, USAID/Indonesia conducted a Limited Financial Review (LFR) of SHERA’s locally incurred costs to better understand the program’s financial management systems and internal controls, thereby assuring that the costs billed to USAID comply with USAID regulations. The USAID LFR team sampled transactions for the period October – December 2018. USAID representatives spent two days conducting field work at the SHERA project office in February, followed-up by two-day meetings with UGM in Yogyakarta and IPB at Bogor in March. They later provided the SHERA team with a brief on March 25, 2019. USAID recommended the following actions be taken by IPB: 1) stop any transactions through the Project Manager Assistant's personal bank account, and 2) follow clear and transparent procurements as outlined in their subaward with IIE. IIE then shared the above recommendation with ANBIOCORE management during a meeting between USAID, SHERA and ANBIOCORE on March 29 at IPB. On June 4, 2019, USAID sent IIE the summary of its Limited Financial Review. As per USAID protocol, IIE responded to the recommendations on August 3, 2019. SHERA Knowledge Products In April, David Simpson, Director of USAID Programs at IIE, met with USAID/Indonesia to discuss SHERA program implementation and funding. During this meeting, Thomas Crehan, USAID/Indonesia Director of Education, asked that SHERA required to produce a booklet. The goal of the booklet is to highlight the work of each scholar and CCR, as well as their greater impact on Indonesia, in layman’s terms. The SHERA Communication Specialist then worked with the SHERA MEL Specialist and a consultant to develop an approach and timeline for creating the booklets. After establishing a timeline, they used part of their mid-May training with the five CCRs’ MEL and Communication teams to discuss and draft content. The booklets were projected to be completed after the start of the next reporting period (FY2020).

Page 30: Sustainable Higher Education Research Alliances (USAID SHERA)

30

USAID Sustainability Assessment During the second quarter, USAID/Indonesia informed IIE that in April and May, the USAID Monitoring Evaluation and Support Program (MESP) would conduct a sustainability assessment of SHERA to determine how the CCRs’ research capacities supported by SHERA can be sustained beyond the current USAID funding. The assessment addresses the following questions:

What are the key factors that will enable the five existing SHERA partnerships (CCRs) to continue effectively beyond the terms of current USAID support?

How effectively are the capacity and commitment of system stakeholders aligned to ensure sustainability of the CCRs once donor funding ends?

What lessons and best practices can be identified regarding effective partnership establishment, as well as the administration and operation of the partnerships?

A total of 74 interviews were held (key informants and groups), while a survey of SHERA scholars secured 61 respondents. On June 26th, MESP reported its preliminary findings to USAID and SHERA. It found that sustainability planning was needed to become more of a functionalized part of SHERA and CCRs’ organizational planning. As a result, the SHERA team coordinated a strategic meeting in Semarang on August 1-2, 2019, with CCR directors and GOI officials to discuss the report’s findings and critically plan program activities. See further information in the section below.

b. Government of Indonesia On November 29, the USAID AOR and SHERA team visited Kemristekdikti to report on program achievements and challenges during the program’s second year. The meeting included the Secretary of the Director General Research and Development, Director of Research & Development (R&D), and Staff Head of Monitoring. The meeting and presentation focused on the important role of the GOI in supporting international publications and collaboration with the U.S. HEIs, as well as the program challenges with low spending, inconsistencies in achievements across the CCRs, and the need to include more HEIs.

SHERA again met with Kemristekdikti representatives on July 2, 2019. The purpose of the meeting was to update the GOI on SHERA’s achievements and challenges, namely funding. Following that meeting, Kemristekdikti representatives were invited to attend the SHERA Strategic Meeting in Semarang (see further details in Strategic Meetings subsection). Dr. M. Dimyati, Director General of Research and Development at Kemristekdikti, was accompanied by Prof. Ocky, Director of Research and Community Service; Mr. Prakoso, Secretary of Directorate General; Dr. Mustangimah, Head of Division – Research; and, Mr. Hali Aprimadya – Head of Partnership. Mr. Dimyati addressed his concern on USAID’s funding challenges for SHERA and noted his willingness to find support through the Kemristekdikti research fund to avoid the cancellation of the scholars’ research and publications. Prof. Ocky then led a discussion on the parameters of the 2020 Kemristekdikti funding. The funding application cycle opened in August 2019, but recipients will not be announced until January 2020.

As noted in the Activity 3 Outreach and Communications section above, SHERA again participated in the science and technology exhibition, Ritech Expo 2019, the annual event organized by Kemristekdikti. It was held at Lapangan Puputan Renon, Bali, on August 25-28, 2019. Kemristekdikti provided SHERA with 3 booths, each around 9x3 square meters, which SHERA’s Communication and Outreach Specialist then merged into one large installation for the CCRs. Over the course of 3 days, SHERA’s booth was visited by more than 250 participants from a variety of backgrounds, including students, lecturers, scientists, university faculty, government officials, and private sector representatives. Figure 19: CDSR greeted US Ambassador for US – ASEAN Business

Council, Amb. Michael Michalak (left)

Page 31: Sustainable Higher Education Research Alliances (USAID SHERA)

31

This year’s VIPs visitors included the U.S. Ambassador for the ASEAN Business Council, Kemristekdikti’s DGs, directors of other research centers, and local government representatives. Following this event, SHERA also encouraged the CCRs to follow up with these new contacts and take action for potential collaboration.

c. Private Sector As the university consortia move forward with their activities and research, the need for strong private and public sector partners has increased. Throughout Year Three, the SHERA team worked to implement its public-private sector engagement strategy into specific activities, utilizing the expertise of SHERA’s PPP expert consultant and leveraging its private sector network to further foster mutually beneficial relationships for the CCRs. The consultant visited the CCRs to map their past, current and potential public and private sector partners, to then use the map as a blueprint for the CCRs’ PPP and sustainability plan.

SHERA’s PPP consultant in Indonesia met American Chamber of Commerce (AMCHAM) officials on March 26 to share relevant information about the program and explore opportunities for collaboration between the CCRs and AMCHAM members in Indonesia. AMCHAM then invited SHERA to meet the committee members during a meeting on April 9 and to a networking event on April 11. On May 21, 2019, SHERA met with AMCHAM Education Committee members and Thomas Crehan, USAID HCP Director. USAID presented the first session, which focused on the USAID Partnership Division and J2SR and highlighted collaborative action through collaborative research. SHERA then presented the second section on the program’s objectives, CCR work, and the PPP approach for post-project sustainability. The AMCHAM Education Committee noted that the intervention SHERA is implementing is timely and necessary given that it is the first intervention of its kind in Indonesian HEIs. A few members also mentioned that SHERA should further be linked with the GOI’s Industrialization 4.0 Initiative. While the AMCHAM participants were not themselves private sector representatives, they did offer to distribute SHERA’s information to all members listed in other taskforces connected to the private sector.

In the U.S., IIE’s PPP specialist worked with the CCRs on drafting introductory letters to targeted industries and companies. The goal was for IIE’s Head of Corporate and Foundation Programs to send these letters to potential private sector and foundation contacts, then the individual CCRs would lead the next steps of collaboration. However, the only two CCRs to initially engage with IIE’s U.S. PPP specialist were CCR ARI and ANBIOCORE, both of which are closing in January 2020. This lack of engagement and follow-through with SHERA’s PPP consultants was very evident towards the end of the reporting period, as the CCRs generally had low morale due to the limited funding situation. Despite this resistance, SHERA continued to try to work one-on-one with the CCRs, conducting mapping exercises to determine their needs and arranging exploratory meetings with industry officials when possible.

Figure 20: USAID and SHERA discussing collaborating research and industry at AMCHAM's forum

Page 32: Sustainable Higher Education Research Alliances (USAID SHERA)

32

The SHERA PD also introduced the SHERA program to Partnerships for Sustainable Community (CCPHI) on August 5. CCPHI is a non-profit organization which promotes and facilitates partnerships among companies, NGOs, and local governments for healthy and sustainable communities. Both parties agreed that following the meeting, they will try to seek collaboration through a partnership building session.

Finally, SHERA’s PD attended the Indonesian Development Forum, organized by the Australian Department of Foreign Affair and Trade (DFAT) on July 22. There, he met the Presidential Staff Office/ Kantor Staff President (KSP) team and Knowledge Sector Initiatives (KSI) Program Director. The meeting was followed up with a more thorough discussion with KSP on September 19 and the KSI Program Director on September 26. As a result, KSI and SHERA agreed to collaborate by planning to promote SHERA at a future KSI conference, which can later be developed into a national/ local policy brief.

d. Partnership Outreach SHERA’s PD traveled to New York in February 2019 to present SHERA’s lessons learned at IIE’s Centennial Global Summit. Therefore, he was part of a panel discussion with Dr. Mangala Sharma, Program Director, Bilateral and Multilateral Cooperation, Office of International Science and Engineering / Office of the Director, National Science Foundation (NSF); Alison Corbett, Head of Education Programmes, British Council; and Dr. Katja Simons, Executive Director, German Alliance University. SHERA’s PD connected with several key institutions that expressed interest in research collaboration with the CCRs, namely University of California, Davis, Colorado State University (CSU), University of Arizona, Kansas State University, and University of Kentucky. Knowing such high interest, and also UGM plan to visit its affiliate UCB in April and UNPAD plan to visit University of Colorado, Denver on April, SHERA’s PD introduced the Program Director and Partnership Manager of UGM and UNPAD to the International Director of CSU the and Associate Provost of UC Davis. They agreed to meet and explore any possible collaboration when UGM and UNPAD visit them in April. While visiting Washington D.C. for a strategic and operational meeting at IIE’s office, SHERA’s PD also visited the Indonesian Embassy for a meeting with Dr. Popy Rufaidah, the new Education and Culture Attaché, and IIE’s USAID Program Director, David Simpson, and SMART CITY Program Director and Partnership Manager. The delegation reported on SHERA’s achievements and its plan to increase its U.S. network by working with more U.S.-based HEIs and private sector entities. Dr. Popy committed to support SHERA, and informed IIE that she will visit UC Denver to witness the signing of new a MOU between UNPAD affiliates with UC Denver in April 2019. In April, researchers from CDSR-UGM and the University of California, David (UCD) met to develop a MoU. A formalized partnership would allow them to collaborate on research within their joint fields of interest, with the possibility of future collaboration in other areas as opportunities arise. In mid-June, the UCD International Training and Education Outreach Manager visited CDSR – UGM and met with the Director of International Cooperation to finalize and sign the MoU.

II. SHERA Key Performance Indicators (KPIs) Goal: Sustainable Improvement in Quality and Quantity of Science and Technology Research in Indonesian Higher Education Institutions SHERA had a strong Year Three in comparing its results against last year’s KPIs. In Year Two, SHERA reported positive KPI achievements against its targets, but in Year Three, SHERA was able to take those initial investments and maximize their potential. In addition to producing an ample number of international publications, CCRs also generated more citations, created public-private partnerships, and had its research initiatives replicated.

Figure 21: From left to right: Mangala Sharma, PhD, Alison Corbett Ph.D., Dr. Katja Simons, and Prima Setiawan.

Page 33: Sustainable Higher Education Research Alliances (USAID SHERA)

33

Year Three targets for 11 of SHERA’s 22 indicators (50%) were achieved during the reporting period. Goal Indicators 1 and 2 (increasing international publications and citations) made tremendous progress. Goal Indicator 3 (academic initiatives replicated, applied, or taken to market) did not reach the targeted 7.7%. With 78 research clusters funded by SHERA as the denominator for Goal Indicator 3, only two CCRs had research findings that were replicated (2.6%). The reasons behind the slow progress of this Goal Indicator 3 have been well-documented in previous reports, but the underlying factor is that the CCRs are still in the early stages of their research; therefore, if their research is to be applied, it will take years to test their results, take them to the market, and have them accepted by the market. Goal Indicator 1: Number of peer-reviewed scientific publications resulting from USG support to research and implementation program A total of 246 international publications were produced this fiscal year. This is a 132% rise from the target of 106 publications. That soaring number is impressive due to the fact that the CCRs were able to publish that many articles with two or less years of preparation, as the CCRs only received funds in FY2018. Of the 246 publications, 205 are published in Scopus Index and the remaining 41 are in non-Scopus Index. SMART CITY led with 123 publications, followed by NCSTT with 73, CDSR with 24, ANBIOCORE with 22, and 4 for CCR ARI. In regard to the publication type, 61 were journal articles, increasing 53% from last year’s 40 journal articles. The other 185 were proceeding articles, an increase of 400% from last year’s 37 proceeding articles. The table above demonstrates the CCRs’ achievements surpassing their FY2019 targets. Goal Indicator 2: Ratio of citations to publications produced by Indonesia researchers This year, several publications produced by SHERA researchers were positively cited by 29 researchers. This brought a ratio of 0.12 from the 246 publications. It is a 58 % increase from the target of 0.08. Since the start of the program, many scholars warned IIE that there is no control for this indicator, as citations only occur when other researchers or scholars cite the CCR’s publication. Ultimately, though, IIE was committed to increasing the capacity of the scholars’ competency, which resulted in them producing respected international publications. The CCRs were challenged to create good publications which would then attract interest and subsequently be cited. In looking at the increasing number of citations, IIE is convinced that this number will only continue to rise in Year Four.

Table 3: Goal Indicator 2 FY19 Targets vs. FY19 Actuals

106

246

T A RGET   2 0 1 9 ACH I EV EMENT   2 0 19

Goal Ind icator 1Ra t i o o f P ee r - r e v i ewed S c i en t i f i c

Pub l i c a t i on s Re su l t i n g F rom USG Suppor t To Re se a r ch And Imp l emen t a t i on P rog r am

Table 2: Goal Indicator 1 FY19 Targets vs. FY19 Actuals

0.08

0.12 

T A RGET   2 0 1 9 ACH I EV EMENT   2 0 19

Goal Ind icator 2Rat io Of C i t a t ion To Pub l i c a t ion Produced

By Indones i a Researchers

Page 34: Sustainable Higher Education Research Alliances (USAID SHERA)

34

Goal Indicator 3: Number of academic research initiatives whose findings have been replicated, applied, or taken to market. Out of 78 research clusters funded by SHERA, only two CCRs successfully had their research replicated, applied, or taken to market, which provided the ratio of 0.03. While this number is still below the target of 0.08, it was an improvement from the previous year in which no CCRs were able to replicate their findings. The first CCR to achieve this goal was CDSR. Ms. Dintani Yudhitya Noorzakiah Naimah, S.T., M.Sc, had her research results applied by other parties. A CDSR scholar, she conducted the Methods for Sustainability Assessment, which evaluated the methods used to measure the sustainability of a renewable energy system (see further information on her study in Annex III: Impact Stories). Impressed with her team’s work at CDSR, UNDP adopted and applied their study. Through UNDP’s Small Grant Program, the organization funded $200,000 in November 2018 for collaborative work with UGM to analyze sustainable energy systems in 4 different locations: Nusa Penida Island, Bali; Semau Island– East South West Nusa; Wakatobi Island, South West Sulawesi: and, Kabupaten, Bone Bolango, Gorontalo. SMART CITY also succeeded in implementing the results of its research in the energy and environment cluster. Its TaLis and DC House System for Rural Areas in Indonesia research has been used to implement sustainable energy storage systems in urban built environments. It’s been applied in the five following areas: 1) Master Public School in Depok; 2) Pertamina Gas Station in Cicoko South Jakarta; 3) Palu-Donggala Post-Tsunami Settlement; 4) Lombok Post-Earthquake Settlement; and, 5) Banten Post-Tsunami Settlement.

Outcome 1: Improved Capacity of Faculty, PhD Students, and Researchers in Target Indonesian Universities Activities in Year Three for Indicator 1.1 “% of scholars who present at conferences” decreased from the target’s 43% to 36%. This decrease was due to the fact that 165 scholars were focused on writing articles, which had not yet been submitted to journals. In many instances, the research and writing processes are still being conducted with the support of U.S. scholars, as seen in Indicator 1.1.3, “Number of U.S. scholars from different universities visiting Indonesian institutions to lead short-term training courses for Indonesian partner institutions.” 22 U.S. scholars supported their CCR partners, an increase from the target of 13 scholars. This support was seen across all five CCRs. The increasing numbers for Indicator 1.1.3 are in line with an increase in 1.2., “% of scholars who participate in collaborative research,” which increased from 72 % to 103%. Table 5: Outcome Indicator 1 FY19 Targets vs. FY19 Actuals

0%500%

1000%1500%2000%2500%

1.1 %of

scholarswho

presentat

confe…

1.2 %of

scholarswho

participate incollab…

1.1.3.Number of U.S.scholarsvisitingIndones

ian…Target 2019 43% 72% 18

Achievement 2019 36% 103% 22

43% 72%

1836% 103%

22

Outcome 1Improved capacity of faculty, PhD students and postdoctoral

researchers in target Indonesian universities

0.08

0.03 

T A RGET   2 0 1 9 ACH I EV EMENT   2 0 19

Goal Ind icator 3Ra t i o o f Ac adem i c Re se a r ch I n i t i a t i v e s Whose

F i nd i n g s Have Been Rep l i c a t ed , App l i ed , Or Taken To Marke t

Table 4: Goal Indicator 3 FY19 Targets vs. FY19 Actuals

Page 35: Sustainable Higher Education Research Alliances (USAID SHERA)

35

Outcome 2: Strengthened, Inclusive Institutional Environment for Research and Management in Target Indonesian Universities Two indicators contribute to Outcome 2. The first is Indicator 2.1, “% of Indonesian institutions with improved research policies and system in place”. Indicator 2.1 showed a decrease from the target of 52% down to 13% this year. This drop was due to the long process Indonesian researchers must go through to get approvals from high-level officers, such as Vice Rectors or Rectors, before draft regulations can be approved. Indicator 2.2., “% of CCR members with improved administrative and management systems in place,” saw a slight reduction, from 59% to 41%. However, that is due to a lot of increase of denominator in this period. In Year Two, 4 of the targeted 15 institutions saw an improvement, while 5 out of 32 saw an improvement in Year Three. This demonstrates that the Lead and Affiliates institutions’ administrative and management practices, which were introduced to them by SHERA, are still showing a higher acceptance rate at their universities. They have adopted such daily research practices as defining research protocols, creating Standard Operation Procedures for selecting the scholars, and establishing processes for scholar incentives and publications.

Outcome 3: Enhanced Collaboration in CCR/Consortium for Collaborative Research Last year, when the CCRs had only just been created, 43 institutions against the targeted 42 engaged in joint research projects, which resulted in a102% achievement rate. A year later, with a100% target rate, the rate grew to 151%, with 65 institutions engaging in collaborative research against the targeted 43. This tremendous jump was due to IIE’s effective outreach efforts, which continuously highlighted the program across its website, Facebook, Twitter, print media, seminars, and talk shows. Lastly, 3.2. “Number of partnerships created to support joint research projects,” saw an increase from its target of 11 partnerships, to 15 achieved partnerships. The increase of 36% was due in large part to the growth of the CCRs and the programs since its inception in 2017, but also because the CCRs had built more trust amongst themselves and the public and private sectors.

0.00

5.00

10.00

15.00

3.1 % ofinstitutions

engaged in jointresearch projects

3.2.  Number ofpartnerships

created to supportjoint research

project.

1.00

11.001.51

15.00

Outcome 3 Enhanced collaboration in CCR/Consortium for

collaborative research

Target 2019 Achievement 2019

0.00

0.50

1.00

Target 2019 Achievement2019

0.52

0.13

0.590.41

Outcome 2Strengthened, inclusive institutional environment for

research and management in target Indonesian universities

2.1. % of Indonesian institutions with improved research policiesand systems in place.

2.2. % of CCR members with improved administrative andmanagement systems in place.

Table 6: Goal Indicator 2 FY19 Targets vs. FY19 Actuals

Table 7: Outcome Indicator 3 FY19 Targets vs. FY19 Actuals

Page 36: Sustainable Higher Education Research Alliances (USAID SHERA)

36

III. Challenges and Lessons Learned

4.1 Incremental Increase in Funds In January 2019, IIE began to experience the strains of limited funding from USAID. At that point, as the CCRs finally began to increase their burns rate, IIE had advanced funds to its subrecipients up to their total level of obligation. IIE could not provide them with additional incremental increases because IIE had yet to receive its own incremental funding increase from USAID. In February, IIE submitted a formal request to USAID for an incremental increase so it could then obligate those funds to the subrecipients for their upcoming activities, while also accounting for IIE’s commitments. In response to IIE’s request, USAID asked that IIE send a request when it reached 75% of its obligation. That request was then submitted in mid-April. As IIE first advances its own funds to the CCRs, not USAID funds, IIE had no choice but to only approve CCR advance requests up to the limit of the subrecipients’ total obligations. This, in turn, provided less funds than they needed to implement the approved and planning activities for the second half of Year Three. The funding limitations hampered the CCRs’ progress they had made in overcoming administrative learning gaps during the previous year, leaving them with planned activities but limited to no ability to execute those plans. On June 26, 2019 USAID sent IIE Modification No. 3 to Cooperative Agreements No. AID-497-A-16-00004/SHERA. The modification provided an incremental funding increase of $2,089,870.58, thus increasing the total obligated amount from $7,388,912.26 to $9,478,782.84. IIE was told that the increase was intended to support IIE expenses through September 2020, in addition to the five CCRs’ programmatic and operational expenses. During July 2019 through September 2020 the CCRs were supposed to be spending at their highest rate to support, their main research activities. However, without funding, the CCR’s were unable to implement their activities.

After IIE received the June 2019 incremental increase from USAID, it modified its own subagreements with ITB, UI, UGM, and UNPAD in July 2019 to cover both operational costs and programmatic activities. IIE did not modify its subagreement with IPB at the time due to their grant management issues and additional funding was not needed. Shortly afterwards, IIE held a strategic meeting in Semarang with USAID, the CCRs, and Kemristekdikti representatives to discuss the funding situation. The CCRs shared their frustration with their inability to conduct planned activities with affiliates, both in Indonesia and the U.S., when the activities had been planned well in advance. The funding constraints damaged many of the relationships the CCRs worked very hard to build throughout the previous year with their partners. IIE repeatedly raised the CCR’s concerns to USAID as well as its own concerning about implementing a program without sufficient funding. IIE also sent a formal request for additional funding to USAID in September 2019, but that request was not responded to within this reporting period.

4.2 Communication with CCRs Throughout Year Three, as funding concerns increasingly became a concern for the CCRs, IIE encountered general unresponsiveness in its communications with the CCRs. The CCRs have pinned their frustrations and general unwillingness to engage with SHERA on the lack of clarity from USAID and IIE on the availability of future funding for SHERA, either in FY2020 or FY2021. On September 20, 2019, IIE sent an official communication to each CCR detailing the current level of funding from USAID, as well as IIE’s request for additional funds from USAID. As IIE continues to receive updates from USAID on funding, it will continue to share this information with the CCR’s in a transparent manner. IIE will continue to positively approach the CCRs and maintain an open dialogue with each to ensure that a good working relationship can still be maintained, despite the current challenges of the program.

Additionally, CCR leads and their affiliates have had many achievements, such as policy recommendations, but have not been including these achievements in their reports to IIE. IIE only later hears about these achievements anecdotally during direct visits to the CCRs. IIE’s Communication and MEL Specialists will be more proactive in consistent follow-up with both the CCR leads and their affiliates to make sure that all activities are captured in its reporting to USAID.

4.3 J2SR and Revised CDCS In mid-2018, USAID informed all implementing partners of the upcoming shift in its strategic approach to development. The USAID Administrator launched the Journey to Self-Reliance (J2SR) in October 2018 to guide missions to develop and implement an assistance strategy based on capacity and commitment of host country government. On March 14,

Page 37: Sustainable Higher Education Research Alliances (USAID SHERA)

37

USAID/Indonesia also held a State-of-Mission COP Meeting with all implementing partners. As IIE anticipates that the new CDCS will impact CCR implementation, IIE has brought the following concerns to USAID through the year:

SHERA is a research partnership program which needs a significant amount of time to demonstrate lasting results. If the focus of the program is to show the immediate impact of CCR activities in local communities, the approach and indicators for SHERA will need to be revisited.

Adequate time and resources are also needed to cultivate PPP relationships. USAID has presented J2SR to the CCRs during SHERA’s strategic meeting in August 2019, but J2SR and the revised CDCS’ impact on SHERA has to be fully realized.

4.4 GOI- CCR Differing Research Approaches In Year Three, IIE identified that the Ministry of Health is conducting national-level research on the same topic as CCR ARI. However, it found that the Ministry of Health has its own methodologies for collecting samples, which differ from CCR ARI’s approach to focus sampling. As UNPAD and its affiliates followed their own approach, confusion in the field was generated. IIE proposed to facilitate a discussion between the Ministry of Health and Kemristekdikti on this issue, but for an inter-ministry agreement to be generated, IIE would need further data and human resources. With CCR ARI announcing its closure in August 2019, IIE was forced to instead refocus its support on subrecipient closeout procedures.

4.5 MEL and MIS AS IIE developed the online MIS, it was challenged to improve website functions to better support research incentive management. The main purpose of the MIS is to compile all CCRs data and indicator achievement. However, in seeing that the system had a gap in tracking incentives claims on research products for proceedings and papers, IIE’s MIS Specialist sought to bridge that gap. Accordingly, a standard operating procedure for claims has been created and the procedure will soon be functionalized in the MIS.

4.6 Timekeeping Guidelines As IIE worked to streamline its processes and reduce administrative burdens for the CCRs in Year Three, it examined CCR timekeeping practices. When the Director of IIE Grants and Contracts (G&C), Kristy Abellanas, visited Indonesia in April 2019, she met with SMART CITY CCR lead, UI, to better understand the context of timekeeping practices within Indonesian higher education. As a result of that meeting and continued conversations with UI after her return to the U.S., IIE developed a new timekeeping model for CCR faculty. This model, which is being tested in the Fall 2019 semester with UI staff, is based on the university’s own system and effort reports. Rather than submitting a new timesheet each month, CCR faculty staff members at UI now submit an initial report at the beginning of the semester and again at the end of the semester. The second report demonstrates whether the credits (i.e. level of effort) changed in the semester. If so, those changes are then reflected in the proceeding invoice. If IIE G&C deems the practice a success at the end of the semester, the model will be rolled out with the remaining CCRs.

4.7 CCR Operational and Program Capacity ANBIOCORE – IPB Well documented in previous reports, IIE has had continuous management issues with IPB under ANBIOCORE. These management issues, compounded by the limited funding situation, has forced IPB to close ANBIOCORE under SHERA. IPB experienced high turnover among its Finance Managers, which led increasingly junior finance staff joining the project with insufficient backgrounds in accounting to manage the CCR’s finances and cash flow. This impacted their burn rate, procurement processes, and ability to run activities per their Implementation Plan. This then reduced their ability to achieve their target indicators. The SHERA team met with ANBIOCORE management on December 6, 2018, to discuss their challenges and identify solutions. IPB agreed to create a management policy and a Standard Operating Procedures to achieve adequate implementation of program and research management.

After the CCRs learned in July 2019 that IIE had received limited funding from USAID, ANBIOCORE communicated to IIE at the strategic meeting in Semarang that within its current obligation, it would only be able to sustain activities through the end of the year. IIE and IPB agreed that IIE would close out its subagreement with IPB by January 31, 2020.

Page 38: Sustainable Higher Education Research Alliances (USAID SHERA)

38

CCR ARI As previously noted in this report, CCR ARI announced in Year Three that it would be closing under SHERA by January 31, 2020. This closure due to two primary factors. First, CCR ARI faced financial management issues within its internal structure, as well as with its affiliates. This led CCR ARI to overspend its obligation. Second, when CCR ARI learned in July 2019 that IIE would not be receiving additional funds from USAID through September 2020, it realized that it would not be receiving an incremental obligation increase from IIE, which would have covered its overspending. Therefore, CCR ARI was forced cease program activities as of August 2019 and close out with IIE by January 31, 2020. CDSR Understanding that enlarging and strengthening its international and Indonesian networks is crucial for its sustainability beyond SHERA, CDSR conducted exchange visits to the University of California (Berkeley and Davis), Colorado State University, University of Texas at Austin, Auburn University, and California Polytechnic to explore the possibility of future research collaborations. Following the visit, University of California David visited UGM and discussed and agreed to have further collaboration in near future. Through this process, CDSR also gained the capacity to manage and fulfill all procedures for processing the U.S. J-1 Visas for the visit. Throughout Year Three, CDSR had originally planned to speed up its performance and achieve its KPIs while enlarging its network. However, CDSR noted in its reporting to IIE that despite the gains it has made, this period has been marked by the uncertainty of USAID funding. This has therefore forced CDSR to significantly modify its program in order to mitigate risk while maintaining opportunities for sustainability. It is now simultaneously thinking ahead to program costs (based on current funding levels), while also trying to plan for CDSR sustainability. NCSTT NCSTT noted in its reporting that while previous administrative hurdles have been cleared by IIE, the major barrier for activity implementation is SHERA’s lack of funding. The impact of the cuts and the uncertainty of future funding is that most programmatic activities have been terminated. NCSTT prioritized its remaining budget for the 6th ICEVT conference (November 2019) and research product incentives. However, due to the lack of funds, NCSTT had to cut plans for its e-bus testing in October 2019, as it only had funds available for the e-trike. All other programs are suspended until more funding is available or otherwise terminated. This has had severe implications on NCSTT’s ability to achieve its KPIs. Ties with Indonesian and US Universities have also been severely affected due to the budget cuts. The partnerships between universities under NCSTT were still at an early phase, particularly in terms of funding. Cutting the budget during this phase of partnership undermines the integrity the CCR, particularly in its relationship with Massachusetts Institute of Technology (MIT). NCSTT feels that if this relationship is damaged, this also has potential to damage the overall credibility of Indonesian Higher Education. SMART CITY Since October 2018, SMART CITY has organized a total of 33 research groups which conduct their own research on SMART CITY’s four themes and ten topics. Due to SHERA’s limited funding, SMART CITY has been forced to minimize its number of research groups, beginning in August 2019. Only 10 research groups from UI remain, as their work is set to conclude by October 2019. Additionally, based on the budget cuts, SMART CITY has discontinued all affiliate research activities and publications, all research cluster assistance, and has discontinued all short courses (academic writing, research design, and method/research) cluster assistance.

Page 39: Sustainable Higher Education Research Alliances (USAID SHERA)

39

Annex I: Year Three Accomplishments

DESCRIPTION 

SHERA YEAR Three IMPLEMENTATION PLAN  REMARKS 

ACHIEVEMENT 

I. OPERATIONS ACTIVITIES 

I.1  Administrative Deliverable Requirements 

I.1.1 Submit Quarterly Performance Report    30 days after the close of the reporting period 

I.1.2  Submit Quarterly Financial Report    30 days after the close of the reporting period 

I.1.3 Submit Quarterly Communications Report   

30 days after the close of the reporting period. Submitted in the body of the Quarterly Performance Report beginning July 30, 2019, per the AOR’s request 

I.1.4 Submit Annual Performance Report    On 90 days after the USG FY close 

I.1.5 Submit Annual Reporting on Foreign Taxes    April 15, 2019 

II. PROGRAM ACTIVITIES 

II.1  Stakeholder Engagement 

II.1.1  Regular USAID ‐ IIE meeting    Monthly and quarterly meetings 

II.1.2  SHERA Annual Work Planning    Submitted and approved by USAID 

III.1.3  SHERA – CCR Semi‐Annual Meeting   

Semi‐Annual meetings were replaced by strategic meetings in January 2019 (Jakarta) and August 2019 (Semarang) due to the urgency of planning for the revised CDCS and funding limitations. Annual meeting (see below) was also combined with the August strategic meeting in Semarang.  

II.1.4  Private Sector Engagement   

Regular meeting with USAID PSE to design PPP strategy, meeting in AMCHAM on April 9, and continued with a presentation by Thomas Crehan, Prima Setiawan, and Hendry Predy on May 21. 

II.1.5  IIE Summit in the U.S.    February 16‐19, 2019. New York City. 

III. CCR PROGRAM IMPLEMENTATION 

III.1  Grants Management 

III.1.2  Direct Mentoring to CCRs    In person meeting 

III.1.3  Virtual Mentoring to CCRs    Phone Call, Skype Call, GoToMeeting 

III.1.4  CCR Performance Assessment   Feedback provided to CCRs by Grants team and PD during Q3 and Q4 after the announcement of the funding limitations.  

   

Page 40: Sustainable Higher Education Research Alliances (USAID SHERA)

40

DESCRIPTION 

SHERA YEAR Three IMPLEMENTATION PLAN  REMARKS 

ACHIEVEMENT 

 

III.2 

 

Monitoring, Evaluation, and Learning 

III.2.1.  Direct/Virtual Mentoring to CCRs    In person meeting, Phone Call, Skype Call, GoToMeeting 

III.2.2.  PIRS Review    December 2018 

III.2.3. PIRS data collection for Annual Report    Ongoing 

III.2.4 MIS Maintenance / Google Storage Management   

Google storage management is ongoing and each CCR has access to the storage 

III.2.5.  CCR Quality Benchmarking Review   Ongoing and being used as the basis to determine the availability of evidence for data inclusion 

III.2.6. Data Collection and analysis for Quarterly Technical Reports   

Ongoing and collected once an activity is completed 

Data being used as the basis of program's discussions on progress and findings being disseminated to CCRs during meetings/calls 

III.2.7. Monitoring Visit to CCR Affiliate Institutions   

Visits to UNSYIAH, UNPATTI, Universitas Brawijaya, and Universitas Udayanato assess and mentor on progress 

III.2.8.  MEL Refreshment Trainings    Online monthly basis and during program meetings 

III.3  Communications and Outreach 

III.3. 1 University Research Partnership Best Practices   

Communication Specialist and MEL Specialist documented based on CCRs activities 

III.3.2  SHERA Knowledge Products   MEL and Communication Specialist collaborated in compiling and documenting CCR's knowledge products 

III.3.3  Website Maintenance    Managed regularly by Communication Specialist 

III.3.4  SHERA Talk Shows    Transportation Technology: Indonesians' Solution for Mobility. April 30, 2019. 

III.3.5  Media Coverage     Regular coverage. Details in Annex IV 

III.3.6  SHERA Annual Conference    Replaced by Strategic Meeting, held in Semarang on August 1‐2, 2019. 

Page 41: Sustainable Higher Education Research Alliances (USAID SHERA)

41

Annex II: SHERA Key Performance Indicators

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

Sustainable Improvement in Quality

and Quantity of Science

and Technology Research in Indonesian

Higher Education

Institutions.

1. Number of peer-reviewed

scientific publications

resulting from USG support to

research and implementation

program

132 0.8 106 33 24 10 22 25 73 10 4 54 123 246 1.32

Journal Articles 40 22 11 9 4 15 61

Proceeding Articles

37 2 11 64 0 108 185

Status of Scopus

Indexed Scopus 23 9 50 4 119 205

Non-Indexed Scopus 1 13 23 4 41

2. Ratio of citation to publication produced by

Indonesia researchers

0.08 0.12 0.56

Number of Citation

1 15 0.5 8 5 12 0 5 4 5 0 0 13 29

Page 42: Sustainable Higher Education Research Alliances (USAID SHERA)

42

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

Journal Articles 1 1 8 9

Proceeding Articles

0 3 5 8

Academic Level: 0 0

Master 0 0

Ph.D. Students 1 0

Postdoctoral Students 0 0

Sex: 0 0

Male 1 3 10 13

Female 0 1 3 4

Period of Citation 2018 0

3. Ratio of academic research initiatives whose

findings have been replicated, applied,

or taken to market.

0 0.153846 0.5 0.08 1 1 6 0 3 0 2 0 0 1 0.03 -0.67

12 0.5 6 1 1 6 0 3 0 2 0 0 1 2

78 78 78

Country of Origin 0

Sectors: 0

Page 43: Sustainable Higher Education Research Alliances (USAID SHERA)

43

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

Governments 1 1

Private Sectors 0

NGO 0

Bilateral organization 0

Types: 0

Replicated 0

Taken to the Market 0

Applied 1 1

Outcome I Improved capacity of faculty, PhD students and postdoctoral researchers in target Indonesian universities

Outcome 1.1

1.1 % of scholars who present at

conference 0.41 0.27 0.43 0.13 0.07 0.26 0.61 0.52 0.11 0.04 0.10 0.42 0.32 0.36 -0.15

numerator 68 103 0.8 82 20 11 6 14 50 11 3 5 25 19 60

denominator 165 380 0.5 190 150 150 23 23 97 97 50 50 60 60 165

Increased trainings in research methods,

writing and presentation

s skills

Male 47 5 10 8 2 2 10 35

Female 21 6 4 3 1 3 9 25

Age 0 0

25 - 45 41 11 7 11 3 3 19 51

46 - 65 26 7 2 9

Page 44: Sustainable Higher Education Research Alliances (USAID SHERA)

44

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

up to 66 1 0

1.1.1. Number of short-term training

courses held 38 31 1 31 4 4 9 0 5 3 11 4 2 2 13 -0.58

Training 32 2 0 4 1 7

Workshop 6 2 3 0 1 6

Others 0 0

Duration (Hrs) 832 64 52 98 52 266

1.1.2. % of researchers

participating in short-term training

courses

0.89 0.64 0.63 0.58 0.81 0.90 0.00 0.33 0.53 0.59 0.42 0.48 0.87 0.43 -0.32

numerator 1153 606 0.8 485 87 97 270 0 50 64 139 80 60 87 328

denominator 1294 961 0.8 769 150 120 300 240 150 120 236 189 125 100 769

Male 565 48 41 36 42 167

Female 588 49 23 44 45 161

Academic Level: 0 0

Master 587 66 26 24 65 181

Ph.D. Students 360 28 38 21 17 104

Sp1 67 26 2 28

Page 45: Sustainable Higher Education Research Alliances (USAID SHERA)

45

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

Sp2 17 5 5

Postdoctoral Students

122 3 4 3 10

1.1.3. Number of U.S. scholars

visiting Indonesian institutions to lead short-term training

courses for Indonesian partner

institutions

13 18 1 18 2 5 0 4 3 2 3 5 16 22 0.22

Male 12 3 2 12 17

Female 1 1 4 5

Age 0

25 - 45 5 1 3 4

46 - 65 6 3 1 12 16

up to 66 2 1 1 2

Academic Level: 0

Master 3 2 2

Ph.D. Students 8 1 16 17

Postdoctoral Students

2 3 3

Number of visits 6 1 1 3

Page 46: Sustainable Higher Education Research Alliances (USAID SHERA)

46

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

Outcome 1.2

1.2 % of scholars who participate in

collaborative research

0.68 0.72 0 0.72 0.47 0.47 0.86 0.43 1.00 0.65 1.00 0.88 0.50 0.85 1.03 0.43

numerator 239 253 0.8 202 70 71 120 60 97 63 50 44 30 51 289

denominator 350 350 0.8 280 150 150 140 140 97 97 50 50 60 60 280

Increased professional exchanges

and collaboratio

ns

Male 124 39 38 51 20 26 174

Female 115 32 22 12 24 25 115

Age 0 0

25 - 45 70 0

46 - 65 49 0

up to 66 0 0

1.2.1. Number of Indonesian

scholars who participate in in-person faculty

exchanges held in the U.S.

4 71 0.8 57 20 10 13 0 7 0 6 8 30 0 18 -0.68

Male 3 3 5 8

Female 1 7 3 10

Age 0 0

25 - 45 4 6 8 14

Page 47: Sustainable Higher Education Research Alliances (USAID SHERA)

47

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

46 - 65 0 4 4

up to 66 0 0

Academic Level: 0 0

Master 0 4 2 6

Ph.D. Students 4 6 5 11

Postdoctoral Students

0 1 1

1.2.2. Number of Indonesian

scholars who receive ongoing mentoring from U.S. university

partners

18 89 0.8 71 6 7 14 1 3 0 36 5 30 35 48 -0.32

Male 4 2 0 3 9 14

Female 8 5 1 2 26 34

Age 0 0

25 - 45 13 5 1 3 29 38

46 - 65 3 2 1 6 9

up to 66 1 1 1

Academic Level: 0 0

Master 13 1 1 32 34

Page 48: Sustainable Higher Education Research Alliances (USAID SHERA)

48

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

Ph.D. Students 3 3 3 6

Postdoctoral Students

1 1 1

1.2.3. Number of scholars who participate in

virtual knowledge exchange

155 451 0.5 226 20 0 60 0 105 0 66 0 200 9 9 -0.96

Male 89 3 3

Female 66 6 6

Age

25 - 45

46 - 65

up to 66

Academic Level:

Master

Ph.D. Students

Postdoctoral Students

Outcome 2 Strengthened, inclusive institutional environment for research and management in target Indonesian universities

Outcome 2.1

2.1. % of Indonesian

institutions with

0.33 0.52 0.52 1.00 0.00 0.13 0.00 0.43 0.00 0.00 0.00 1.00 1.00 0.13 -0.76

Page 49: Sustainable Higher Education Research Alliances (USAID SHERA)

49

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

improved research policies and

systems in place.

numerator 5 12 1 12 7 0 1 0 3 0 0 0 1 1 1

denominator 15 23 1 23 7 0 8 0 7 7 0 0 1 1 8

Institutional policies in

support for research and management developed in

CCR members

Lead 1 1 1

Affiliates 4 0 0

2.1.1. Number of institutions that

develop improved research and management

policies developed

5 6 1 6 0 1 1 0 3 1 1 1 1 5 8 0.33

Lead 1 1 1 1 1 4

Affiliates 4 4 4

Outcome 2.2

2.2. % of CCR members with

improved administrative and

management systems in place.

0.27 0.59 0.59 1.00 0.14 0.13 0.13 0.71 0.14 0.20 0.20 0.60 1.00 41% -0.31

numerator 4 16 0.8 13 7 1 1 1 5 1 1 1 3 5 9

denominator 15 27 0.8 22 7 7 8 8 7 7 5 5 5 5 22

CCR best practices

Lead 5 1 1 1 1 1 5

Page 50: Sustainable Higher Education Research Alliances (USAID SHERA)

50

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

documented and

disseminated to

Indonesian higher

education institutions

Affiliates 0 4 4

Gender (Y/N) 2 1 1

2.2.1. Number of CCR websites that

are developed, operational and used regularly

3 5 1 5 1 1 1 1 1 1 1 1 1 1 5 0.00

2.2.2. Number of CCR knowledge products created

189 96 1 96 9 30 40 7 28 76 18 7 1 32 152 0.58

Gender (Issues) 16 4 2 6

IEC materials 35 1 1 3 5

Modules 14 1 7 8

Presentation Materials

2 23 23

Papers 50 2 6 76 84

Book 87 2 2

Patent 0 1 1

Research Report 0 26 3 29

2.2.3. Number of CCR knowledge

sharing events held on best-practices & lessons learned

44 14 1 14 2 5 2 3 8 12 1 0 1 4 24 0.71

Page 51: Sustainable Higher Education Research Alliances (USAID SHERA)

51

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

2.2.4. Number of people participated

in activities addressing gender equality or female empowerment in

science and technology research.

176 200 0.5 100 25 0 50 0 0 0 0 0 25 24 24

Male 40 10 10

Female 136 14 14

Age

25 - 45

46 - 65

up to 66

Academic Level:

Master

Ph.D. Students

Postdoctoral Students

Location

Outcome 3 Enhanced collaboration in CCR/Consortium for collaborative research

Page 52: Sustainable Higher Education Research Alliances (USAID SHERA)

52

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

Outcome 3.1

3.1 % of institutions

engaged in joint research projects

1.02 1.00 1.00 1.00 1.00 1.00 1.10 1.00 1.00 1.00 1.00 1.00 3.10 1.51 0.51

numerator 42 42 1 42 9 9 10 11 8 8 6 6 10 31 65

denominator 41 42 1 42 9 9 10 10 8 8 6 6 10 10 43

Formal relationships established among U.S.

and Indonesian institutions

in -country based 34 8 9 7 5 27 56

US based 8 1 2 1 1 4 9

Third country based

0 0

type of institution 0 0

Academic 41 8 11 8 6 31 64

Private Sectors 0 0

Public Sectors 0 5 12 17

3.1.1. Number of selected affiliate

institutions included in research

consortium

38 38 1 38 7 7 10 9 7 6 5 16 9 5 43 0.13

in -country based 38 7 9 6 16 5 43

Third country based

0 0

type of institution 0 0

Page 53: Sustainable Higher Education Research Alliances (USAID SHERA)

53

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

Academic 30 7 9 6 4 5 31

Private Sectors 0 0

Public Sectors 8 0

3.1.2. Number of scholars at CCR institutions with increased access

to external research resources

and academic research engines.

189 171 0.8 137 21 0 60 0 40 0 40 0 10 54 54 -0.61

Lead 0 0

Affiliates 0 0

Male 102 0

Female 87 0

Master 96 0

Ph.D. Students 68 0

Sp1 6 0

Sp2 12 0

Postdoctoral Students 7 0

Outcome 3.2

3.2. % Number of partnerships

created to support

9 11 1 11 5 1 0 2 2 5 2 3 2 4 15 0.36

Page 54: Sustainable Higher Education Research Alliances (USAID SHERA)

54

Key Performance Indicator - Tracking Records

# Target vs Actual in FY 2019 (October 2018 - Sept 2019)

Results Framework

Performance Indicators

Actual Target FY 2019 CDSR ANBIOCORE NCSTT ARI SMARTCITY Achieved

2019 Change %

FY 2018

CCRs Compiled

SHERA Adjust-

ed

Target 2019

CCR Target

Total CCR

Target Total

CCR Target

Total CCR

Target Total

CCR Target

Total Total

joint research project

numerator 9 11 1 11 5 1 0 2 2 5 2 3 2 4 15

denominator 30 27 1 27 10 10 0 0 7 7 5 5 5 5 27

Affiliates 6 3 2 3 3 11

Page 55: Sustainable Higher Education Research Alliances (USAID SHERA)

55

Annex III: Impact Stories

From Research to Knowledge Product, Building Sustainable Energy Systems for Community Impact

The Center for Development of Sustainable Region (CDSR) is a USAID SHERA-funded Center for Collaborative Research. CDSR is led by Universitas Gadjah Mada. CDSR is conducting a multidisciplinary research collaboration, with goals to implement hybrid energy system, energy efficiency and supporting networks to develop sustainable tropical archipelago.

Contrary to popular belief, the installation of sustainable energy technology does not necessarily solve the energy problems that many remote areas of the world face. Oftentimes, the approach or technology is not used by the local community because it was implemented without community buy-in. In understanding this challenge, CDSR’s research team, led by Ms. Dintani Yudhitya Noorzakiah Naimah, conducted the study "Sustainability Design for Renewable Energy" in Karimunjawa and Gorontalo. The research, which began in October 2018, aimed to measure the effectiveness of renewable energy in Indonesia using the economic, environmental, social, and institutional perspectives of local communities. In Karimunjawa, researchers focused on the sustainability of a Solar Power Plant (PLTS) system and biogas installations. The results showed that women play a crucial role in determining the use of renewable energy sources in the community, especially for household and cooking activities. Women are ultimately the decision makers because the majority of men in the community work as fishermen and are therefore rarely at home. However, the women are not involved in the maintenance of solar panels and biogas. Without their involvement, many solar panels in Karimunjawa are damaged without any improvement efforts from the local community. "When talking about renewable energy, it cannot stand alone. It must involve multi-disciplines and multi-sectors related to various aspects supporting the sustainability of renewable energy," said Dintani. The sustainability of

alternative energy installations cannot only seen through the lense of technical availability, but also through the installation’s economic, environmental, and social impact. CDSR affiliates, the University of Gorontalo and the University of Muhamadiyah Gorontalo, introduced CDSR UGM to the Local Government (LG) of Gorontalo. In the villages Dumati and Tanjung Harapan, both located in Gorontalo province, CDSR analyzed biogas (i.e. biofuel) sustainability. The biogas installations in those communities are namely used for home industries (producing pia1 Dumati) and household activities (namely cooking). Biogas

1 Pia is Indonesia’s traditional pastry filled with various beans.

Figure 22: 6 m3-capacity biogas digester in Dumati village

Figure 23: “Pia Dumati” made in a biogas oven

Page 56: Sustainable Higher Education Research Alliances (USAID SHERA)

56

waste, or "sludge, " is also used for organic fertilizer. After examining the way in which biogas is utilized in those communities, the research team found several barriers to sustainability. The results showed three technical obstacles: No water trap in the biogas system, the bad quality of biogas holders, and the absence of spare parts. To address those issues, the supply chain for biogas equipment parts needs to first be considered before the biogas is installed. On top of the technical challenges, the interviews with the community revealed that biogas operational training was only given to operators, meaning the community was helpless in their absence. Additionally, women, who are the primary direct biogas users, have never been involved in biogas planning or even in biogas operations. To overcome these challenges, positive biogas governance must involve contribution from many parties, particularly women. The LG was very interested in Dintani’s work and subsequently introduced CDSR and Dintani to the United Nations Development Program (UNDP), which had previously approached the LG of Gorontalo on how the UNDP could support them in creating a local sustainable energy system. After CDSR presented its model to the UNDP, Dintani’s research team received $200,000 through the Small Grant Program (SGP) to analyze sustainable energy systems in four new locations: Nusa Penida Island, Bali; Semau Island– East South West Nusa (NTT); Wakatobi Island, South West Sulawesi: and, Kabupaten. Bone Bolango, Gorontalo. While Dintani’s original project ran from October 2018 through December 2018, this grant allowed her team to extend through December 2019.

Since the work involves communities in remote areas, CDSR is now collaborating with its other partner institutions, including Vocational College (Sekolah Vokasi), Community Service Directorate/ Direktorat Pengabdian Kepada Masyarakat (DPKM), and the Department of Politics and Social Sciences. The consortium will conduct the research, analysis, and provide consultation. The results will then be submitted to UNDP, who will then

procure the appropriate energy system for that area and implement it.

CDSR’s approach was significant for several reasons. First, as a CCR, CDSR increased the value of the work not only through its rigorous technical content for the sustainable energy systems, but it combined that content with other social components. This was seen, for example, in increasing the competency of vocational students and the wider DKPM institution. Second, this is an important milestone in indicator 3.1, and a systemic effort to provide enabling environment to strengthen and enlarge the research and design program network as a strategy to achieve the sustainability. CDSR’s ability to successfully network and promote the research allowed it to be adopted by UNDP for funding and implementation, which then brought the work to three different provinces in Indonesia. Most importantly, CDSR shifted a paradigm. It showed that research can be used for more than publication. When research findings are enriched by other disciplines, it be marketed and have more impact on a larger scale for a variety of communities.

"When talking about renewable energy, it cannot stand alone. It must involve multi-disciplines and multi-sectors related to various aspects supporting the sustainability of renewable energy."

Dintani Yudhitya Noorzakiah Naimah, Research Team

Page 57: Sustainable Higher Education Research Alliances (USAID SHERA)

57

SMART Land Surveillance System for Local Cities Scientific Modeling, Application, Research, and Training for City-centered Innovation and Technology (SMART CITY) is a USAID SHERA-funded Center for Collaborative Research. SMART CITY is led by the University of Indonesia. SMART CITY’s goals are to encourage research groups, technical laboratories and individual researchers to use interdisciplinary approaches in their work, collaborate on a global scale, and create scientific and technological innovations to address the challenges facing Indonesia’s urban centers.

Monitoring urban city dynamics is a challenge faced by almost every city in Indonesia. City governments have yet to build a surveillance system for land development. The step of building construction usually starts from owners submitting a proposal to local government. A surveyor will then go and check the actual site to confirm it. If confirmed, the government will issue the Building Construction Permit and the owner can start the construction. However, many people misuse the permit and construct a building which is different from what they proposed, which then becomes a problem in regional land development. Unfortunately, most governments do not have enough manpower nor funds to monitor these developments. Despite these challenge, SMART CITY has developed prototype to overcome this problem. SMART CITY’s Feasibility Study team (FS) from the ICT & Mobility cluster collaborated with the private company PT. Pangripta Geomatika Indonesia (PT. PGI) and Depok City Regional Financial Office (BKD Kota Depok) to establish the ‘Smart Land Surveillance System’ prototype in Depok City. The goal is to establish a surveillance system to support the local government in controlling and monitoring land development.

PT PGI provides three-dimensional (3D) data of existing buildings, using drones to sweep over areas which the Depok City government has permitted to be used for the prototype trial. Depok City Regional Financial Office provides existing regulatory Urban Design Guidelines (UDGL/persil) so the team can compare that data to the buildings. The FS team then creates the framework to input the 3D data and UDGL, which they then use to detect any misappropriation of the UDGL after building construction stage. The framework can also be used as a long-distance monitoring method for future building construction.

Figure 24: Graphics showing the surveillance system prototype developed by SMART CITY

Page 58: Sustainable Higher Education Research Alliances (USAID SHERA)

58

The prototype is expected to establish a long-distance surveillance system, which will be used by government personnel to reinforce better land development. It is also expected to become a sustainable method for land development in Indonesian cities to increase governmental readiness for Smart City development, starting with Depok City. This system will be integrated with the existing government structure and will be operated by their personnel. The prototype is currently being finalized, with input from SMART CITY’s FS team, PT. PGI, and BKD Kota Depok. Once it’s ready, it will be implemented in Depok City. This innovative partnership between higher education, private industry, and local government under USAID SHERA demonstrates that regardless of scope of the challenge, innovative solutions can always be found.

The prototype is expected to establish a long-distance surveillance system, which will be used by government personnel to reinforce better land development. It is also expected to become a sustainable method for land development in Indonesian cities to increase governmental readiness for Smart City development, starting with Depok City.

Figure 3: SMART CITY’s researchers held a meeting with local government and PT. PGI discussing the prototype.

Page 59: Sustainable Higher Education Research Alliances (USAID SHERA)

59

CCR Partnership Leads to Expanded Global Opportunities for Indonesian HEIs The National Center for Sustainable Transportation Technology is a USAID SHERA-funded Center for Collaborative Research. NCSTT is led by Institut Teknologi Bandung. Its goal is to develop advanced technologies for the next generation electric vehicles in Indonesia through the creation of integrated transportation solutions that address technology, policy, infrastructure, and planning development. When Institut Teknologi Bandung (ITB) established the National Center for Sustainable Transportation Technology (NCSTT) as a Center for Collaborative Research (CCR) in 2017, it sought to forge a partnership with one of the premiere thought leaders in global higher education—Massachusetts Institute of Technology (MIT). In addition to housing experts on electric vehicles and emerging sustainable transportation technologies, partnering with MIT would also connect ITB to MIT’s global network of scholars. At the onset of the program ITB was able to establish an agreement with MIT, making MIT a U.S. SHERA affiliate partner for NCSTT. Within the SHERA program, the role of MIT has been to conduct research on the "Mechanical Integrity of Electric Vehicle Battery Packs.” Throughout the program, MIT and ITB have collaborated closely, with new connections to MIT professors emerging as MIT became invested in the interesting research topics that NCSTT has been tackling. The partnership has been executed both virtually and in-person, including several visits to MIT beginning in January 2018. NCSTT’s proactive efforts to maintain and expand this partnership were recognized by the Minister of Research, Technology and Higher Education (Kemristekdikti), Prof. H. Mohamad Nasir. Interested in the greater potential for this relationship, the Minister traveled to MIT with an NCSTT delegation in May 2018. This visit widened the government’s perspective on the benefit of increasing access to international HEIs and creating wider collaboration in not only research, but also management and teaching for the benefit of its national higher education sector.

Figure 25: Prof. Richard Lester, Prof. Bruce Tidor, and Prof. John Fernandez with ITB representatives

Page 60: Sustainable Higher Education Research Alliances (USAID SHERA)

60

Due to the demonstrated support of this relationship by Kemristekdikti, three MIT professors, including the Vice Provost for International Cooperation (Prof. Richard Lester), visited ITB on July 11, 2019 to give a speech and discuss potential collaboration with Indonesian Higher Education Institutions (HEIs) through a seminar. This seminar was attended by 11 representatives from Indonesian HEIs, all of whom are experienced researchers. Before the visit by the MIT delegation in July, the NCSTT-MIT partnership had been limited to the scope of the research project at hand, electric vehicle battery technology. However, as a result of this NCSTT activity, there are now new opportunities for Indonesian researchers to collaborate with MIT and create joint publications. Moreover, this in turn leverages the rank of Indonesian universities and expands the support of Kemristekdikti for future research collaboration, thereby enhancing the sustainability of NCSTT as a research center beyond the lifecycle of SHERA funding. The impact of the positive relationship between NCSTT and MIT extends well beyond NCSTT’s sustainability. As the expanded research collaboration with MIT and Indonesian universities is successfully executed, then many Indonesian researchers from different universities will have the opportunity to work with MIT professors and create high impact publications, increasing their global ranking and providing them with greater access to research funding. Moreover, now that the Ministry has buy-in to this relationship, its support has a significant effect on the ability of partnerships to be executed and expanded.

The impact of the positive relationship between NCSTT and MIT extends well beyond NCSTT’s sustainability. As the expanded research collaboration with MIT and Indonesian universities is successfully executed, then many Indonesian researchers from different universities will have the opportunity to work with MIT professors and create high impact publications, increasing their global ranking and providing them with greater

Figure 26: Prof. Richard Lester, Prof. Bruce Tidor, and Prof. John Fernandez with ITB representatives

Page 61: Sustainable Higher Education Research Alliances (USAID SHERA)

61

Rehabilitating Former Mines with Biodiesel-Producing Plants

The Center for Development of Sustainable Region (CDSR) is a USAID SHERA-funded Center for Collaborative Research. CDSR is led by Universitas Gadjah Mada. CDSR is conducting a multidisciplinary research collaboration, with goals to implement hybrid energy system, energy efficiency and supporting networks to develop sustainable tropical archipelago. Indonesia has around 24.3 million hectares of unproductive and critically damaged land due to mining activities. These activities can change the physical, chemical, and biological conditions of the soil. The mine tailings, the ore waste of mines, are dense, less fertile, and are polluted with heavy chemicals that change the life of soil microbes. Soil condition can be improved, however, and it is critical to find soil restoration methods so the land does not continue to degrade and can be reused in the future. One of USAID SHERA’s CCRs, CDSR, conducting a research to overcome this problem.

In his efforts to find soil restoration solutions for mine tailings, USAID SHERA researcher Muhammad Hilmi discovered that the plant Reutealis trisperma can be cultivated on gold mine tailings. Hilmi is a researcher from the Department of Biology at Institut Pertanian Bogor (IPB). The study observed the growth of Reutealis trisperma over three months in poly bags planted on gold mine tailings, in collaboration with PT. ANTAM in Pongkor, Bogor. The research revealed that Reutealis trisperma could survive in soils with high concentrations of waste. Although the plant’s growth was slightly hampered compared to the other Reutealis

trisperma growing in soils with low waste concentrations, it still survived. This study, entitled, "Growth, histochemical and physiological responses of a Reutealis trisperma to gold mine tailings," was published in the journal Biodiversity, Volume 19, in 2018. Hilmi showed that Reutealis trisperma sustained growth under gold mine tailing conditions for 90 days at a 100% success rate, meaning the plants showed no symptoms of toxicity. This then suggests that this plant is tolerant to gold mine tailing. In addition to its hardiness, Reutealis trisperma can also be processed into biodiesel fuel because of its high oil content. Between its great potential for phytoremediation, the elimination of hazardous contamination with living plants, and becoming a renewable energy source, Reutealis trisperma could usher in a wave of new opportunities for land restoration in Indonesia.

Figure 27: Muhammad Hilmi planting the Reutealis tripesma

Page 62: Sustainable Higher Education Research Alliances (USAID SHERA)

62

Solar-Powered Tap Saves Liters

The Center for Development of Sustainable Region (CDSR) is a USAID SHERA-funded Center for Collaborative Research. CDSR is led by Universitas Gadjah Mada. CDSR is conducting a multidisciplinary research collaboration, with goals to implement hybrid energy system, energy efficiency and supporting networks to develop sustainable tropical archipelago. Twenty-four percent of the world’s population is Muslim. Within the Islamic practice, Muslims conduct the daily act of ablution, the process of washing the face, hands, and feet in advance of worship, up to five times per day. This is typically done using flowing water from a tap. In doing so, communities face the modern challenge of conserving water while conducting ablution. To help address this challenge, USAID SHERA CCR CDSR, led by UGM and in partnership with a research team with Universitas Muhammadiyah Gorontalo (UMGo), is developing a prototype of a solar-powered faucet for more efficient water flow during ablution. This faucet utilizes solar power from a 10-Watt photovoltaic (PV) and a 12-Volt battery to activate a sensor that can detect an individual up to 20 inches away from the faucet. This research directly correlates to CDSR’s focus research area of environment, energy, and maritime sciences. The solar-powered sensor sends "on" and "off" signals to activate the faucet valves that control water flow, allowing water to flow only when needed. Additionally, the valve does not require activation by the user – the sensor automatically turns the water on when a person is present and turns off when a person is not present. In comparison to the conventional tap used for ablution, this prototype saves approximately 2 liters for every 50 seconds of use. UMGo is currently working towards publishing this research in the Asia Conference on Power and Electrical Engineering (ACPEE) journal as a scientific paper titled, “A Prototype of Solar-Powered Automatic Freedom Tap.” This paper was presented by researcher Risman Jaya at the 4th ACPEE, held March 26-30, 2019. Risman noted that this research enabled him to attend his first international scientific conference and shared, "In this event, I was involved in knowledge sharing with other researchers from all over the world, especially on energy and technology issues." The solar-powered faucet prototype developed by CDSR has been installed and is in use at a local Indonesian mosque.

"In this event (the Asia Conference of Power and Electrical Engineering), I was involved in knowledge sharing with other researchers from all over the

world, especially on energy and technology issues."

Risman Jaya, Researcher from Universitas Muhammadiyah Gorontalo (UMGo), the Center of Development for Sustainable Region (CDSR)

Figure 28: The prototype (green) being used for ablution

Page 63: Sustainable Higher Education Research Alliances (USAID SHERA)

63

Annex IV: SHERA Media Coverage

No. Date of News

Article

Name of News Outlet

Title of Article News Media Type

URL for Online News Articles

Language (English or

Bahasa Indonesia)

1 3-Oct-18 Jakarta Post Government Told Boost Fisheries Research Online https://www.thejakartapost.com/news/2018/10/03/govt-told-boost-fisheries-research.html English

2 9-Oct-18 Mother & Baby

Bahaya Infeksi Pneumokokus pada Bayi Online https://www.motherandbaby.co.id/article/2018/10/9/10981/Bahaya-Infeksi-Pneumokokus-pada-Bayi

Bahasa Indonesia

3 20-Oct-18 Tribun Kupang Mengenal Sistem Pertanian Lahan Kering di NTT ala Makasiswa FKH UNDANA

Online http://kupang.tribunnews.com/2018/10/20/mengenal-sistem-pertanian-lahan-kering-di-ntt-ala-mahasiswa-fkh-undana-kupang

Bahasa Indonesia

4 25-Oct-18 Tempo.Co Ridwan Kamil Minta Riset SMART CITY Bisa Diterapkan di Jawa Barat

Online https://nasional.tempo.co/read/1139931/ridwan-kamil-minta-riset-smart-city-bisa-diterapkan-di-jawa-barat/full&view=ok

Bahasa Indonesia

5 25-Oct-18 UNPAD Gubernur Jawa Barat Harapkan Peran Akademisi Wujudkan SMART CITY

Online http://www.unpad.ac.id/2018/10/gubernur-jawa-barat-harapkan-peran-akademisi-wujudkan-smart-city/

Bahasa Indonesia

6 25-Oct-18 Pikiran Rakyat Ridwan Kamil Minta Riset SMART CITY Bisa Diterapkan di Jawa Barat

Online http://www.pikiran-rakyat.com/jawa-barat/2018/10/25/ridwan-kamil-minta-riset-smart%C2%A0city%C2%A0bisa-diterapkan-di-jawa-barat-432357

Bahasa Indonesia

7 25-Oct-18 JabarProv Ridwan Kamil Minta Riset SMART CITY Bisa Diterapkan di Jawa Barat

Online http://humas.jabarprov.go.id/ridwan-kamil-minta-riset-smart-city-bisa-diterapkan-di-jawa-barat/1242

Bahasa Indonesia

8 27-Oct-18 Suara Merdeka Ridwan Kamil Minta Akademisi Terapkan Hasil Riset SMART CITY di Jabar

Online https://www.suaramerdeka.com/news/baca/139084/ridwan-kamil-minta-akademisi-terapkan-hasil-riset-smart-city-di-jabar

Bahasa Indonesia

9 11-Oct-18 Beritagar Bisakah Hidup Tanpa Vaksin? Online https://beritagar.id/artikel/berita/bisakah-hidup-tanpa-vaksin Bahasa Indonesia

10 14-Nov-18 Tempo.Co ITB dan MIT Gelar Riset Baterail Moda Listrik

Generasi Ketiga Online https://tekno.tempo.co/amp/1146132/itb-dan-mit-gelar-riset-baterai-moda-listrik-generasi-

ketiga

Bahasa Indonesia

Page 64: Sustainable Higher Education Research Alliances (USAID SHERA)

64

No. Date of News Article

Name of News Outlet

Title of Article News Media Type

URL for Online News Articles

Language (English or

Bahasa Indonesia)

11 14-Nov-18 Tempo.Co ITB MIT Partnered in Researching 3rd Gen Battery Technology

Online https://en.tempo.co/read/news/2018/11/14/310923428/ITB-MIT-Partnered-in-Researching-3rd-Gen-Battery-Technology

English

12 14-Nov-18 Sukabumi Update

ITB: Bahan Rahasia Baterai Kendaraan Listrik Ada di Indonesia

Online https://sukabumiupdate.com/detail/ototekno/news/48203-ITB-Bahan-Rahasia-Baterai-

Kendaraan-Listrik-Ada-di-Indonesia

Indonesia

13 15-Nov-18 Valid News Eksploitasi Kubur Persistensi Ekspor Rajungan Online https://www.validnews.id/Eksploitasi-Kubur-Persistensi-Ekspor-Rajungan-zhY Indonesia

14 15-Nov-18 Tempo.Co Konsorsium ITB dan MIT akan Bikin Bus dan

Motor Roda Tiga Listrik Online https://tekno.tempo.co/read/1146657/konsorsium-itb-dan-mit-akan-bikin-bus-dan-motor-

roda-tiga-listrik

Bahasa Indonesia

15 17-Nov-18 Tempo.Co Ada AS di Balik Riset Kendaraan Listrik Nasional Online https://tekno.tempo.co/read/1147145/ada-as-di-balik-riset-kendaraan-listrik-

nasional/full&view=ok

Bahasa Indonesia

16 19-Nov-18 Jakarta Post ITB and MIT Collaborate on Third Generation Electric Battery Research

Online http://www.thejakartapost.com/life/2018/11/18/itb-mit-collaborate-on-third-generation-electric-battery-research.html

English

17 22-Nov-18 Mobilina News ITB Bandung dan MIT Amerika Serikat adakan Riset Baterai Listrik untuk Otomotif

Online http://www.mobilinanews.com/artikel/20083/ITB-Bandung-dan-MIT-Amerika-Serikat-adakan-Riset-Baterai-Listrik-untuk-Otomotif/

Bahasa Indonesia

18 26-Nov-18 Indopos Tiga Dosen Muda IPB Didaulat Sebagai Pimpinan

ALMI Online

https://indopos.co.id/read/2018/11/26/156673/tiga-dosen-muda-ipb-didaulat-sebagai-pimpinan-almi

Bahasa Indonesia

19 1-Dec-18 Jakarta Post National Health Day Tackling a Wicked Problem Online http://www.thejakartapost.com/academia/2018/12/01/national-health-day-tackling-a-wicked-

problem.html

English

Page 65: Sustainable Higher Education Research Alliances (USAID SHERA)

65

No. Date of News Article

Name of News Outlet

Title of Article News Media Type

URL for Online News Articles

Language (English or

Bahasa Indonesia)

20 10-Feb-19 Berita Satu Transjakarta Siapkan 5 Rute Baru Terintegrasi MRT Jakarta

Online https://www.beritasatu.com/megapolitan/538900/transjakarta-siapkan-5-rute-baru-terintegrasi-mrt-jakarta

Bahasa Indonesia

21 19-Mar-19 Jawa Pos Profesor Universitas Florida Terpikat Dengan

Semarang Newspap

er Bahasa Indonesia

22 19-Mar-19 Harian

Kompas Jebakan Pembangunan Jangka Pendek

Newspaper

Bahasa Indonesia

23 19-Mar-19 Suara Merdeka Kota Besar Perlu Konsep Hijau Newspap

er Bahasa Indonesia

24 24-Mar-19 Bisnis

Indonesia BNBR Kerjasa Uji Coba Bus Listrik dengan

Transjakarta Online https://market.bisnis.com/read/20190324/192/903730/bnbr-kerja-sama-uji-coba-bus-listrik-

dengan-transjakarta Bahasa Indonesia

25 25-Mar-19 SMART CITY SMAFRT CITY UI Director Prof. Heri

Hermansyah Visited Waste-Impacted Kota Wetan, Garut

Online https://smartcity.ui.ac.id/what-we-do/events/events-detail/smart-city-ui-director-prof-heri-hermansyah-visited-waste-impacted-kota-wetan-garut.html

English

26 25-Mar-89 KBRI

Washington DC

Kunjungan Prof.Dr. Bana Goerbana Kartasasmita, Guru Besar ITB yang pernah menjadi Lokal Staff

di KBRI Washington DC Online http://education.embassyofindonesia.org/2019/03/kunjungan-prof-dr-bana-goerbana-

kartasasmita-guru-besar-itb-yang-pernah-menjadi-lokal-staff-di-kbri-washington-dc/ English

27 28-Mar-19 Harian

Kompas Dari Diaspora Untuk Indonesia

Newspaper

Bahasa Indonesia

28 01-Apr-19 Republika Bus Listrik Transjakarta diklaim Tekan Biaya

Operasional Online

https://nasional.republika.co.id/berita/nasional/jabodetabek-nasional/ppa3mg366/bus-listrik-transjakarta-diklaim-tekan-biaya-operasional

Bahasa Indonesia

29 02-Apr-19 Kabar Faktual Peneliti IPB: Kondisi Terumbu Karang Lombok

Memprihatinkan Online https://www.kabarfaktual.com/2018/08/02/peneliti-ipb-kondisi-terumbu-karang-lombok-

memprihatinkan/ Bahasa Indonesia

Page 66: Sustainable Higher Education Research Alliances (USAID SHERA)

66

No. Date of News Article

Name of News Outlet

Title of Article News Media Type

URL for Online News Articles

Language (English or

Bahasa Indonesia)

30 14-Apr-19 Biosains Kunjungan ANBIOCORE ke Institut Biosains Online http://biosains.ub.ac.id/kunjungan-anbiocore-animal-biotechnology-and-coral-reef-research-ke-institut-biosains/

Bahasa Indonesia

31 15-Apr-19 Wartakota Transjakarta Segera Uji Coba Penggunaan Bus

Listrik di Jakarta Online

https://wartakota.tribunnews.com/2019/04/15/transjakarta-segera-uji-coba-penggunaan-bus-listrik-di-jakarta

Bahasa Indonesia

32 26-Apr-19 JabarProv.go.id Kunjungan Perwakilan USAID dan ANBIOCORE

ke BPPIB Ciamis Online

http://dkpp.jabarprov.go.id/kunjungan-perwakilan-usaid-dan-anbiocore-peneliti-ipb-dan-unpad-ke-bppib-tsp-ciamis/

Bahasa Indonesia

33 23-Apr-19 Radar Madura Populasi Sapi Madura Harus Dijaga Online https://radarmadura.jawapos.com/read/2019/01/23/115395/populasi-sapi-madura-harus-dijaga Bahasa Indonesia

34 01-Jun-19 Agronet Terumbu Karang di Perairan Lombok Kritis Online http://www.agronet.co.id/index.php/detail/indeks/berita/2084-Terumbu-Karang-di-Perairan-

Lombok-Kritis Bahasa Indonesia

35 01-Jun-19 Antara Peneliti IPB: Terumbu Karang Lombok Memprihatinkan

Online https://megapolitan.antaranews.com/berita/42311/peneliti-ipb-terumbu-karang-lombok-memprihatinkan

Bahasa Indonesia

36 02-Jun-19 BPTU-HPTIndrapuri

Field Trip Training of Scientific Communication and Proposal Writing ANBIOCORE USAID

SHERA Online http://bptu-hptindrapuri.com/site/index.php/headline/364-field-trip-trainnig-of-scientific-

communication-and-proposal-writing-ambiocore-usaid-shera Bahasa Indonesia

37 31-Jun-19 DariLaut.id IPB dan UNRAM Teliti Perairan Lombok dengan

Metode E-DNA Online

https://darilaut.id/tips-dan-trip/ide-inovasi/ipb-dan-unram-teliti-perairan-lombok-dengan-metode-e-dna

Bahasa Indonesia

38 11-Jul-19 IIE SHERA Program Director Reflects on IIE Summit

2019 and Bi-national Research Partnership Development

Online https://www.iie.org/Learn/Blog/2019/07/SHERA-Program-Director-Reflects-on-IIE-Summit-

2019-and-Bi-national-Research-Partnership-Development English

39 22-Aug-19 Media Indonesia

Bappenas: Ibu Kota Baru Terapkan Konsep Smart City

Online

https://mediaindonesia.com/read/detail/254836-bappenas-ibu-kota-baru-terapkan-konsep-smart-city

Bahasa Indonesia

Page 67: Sustainable Higher Education Research Alliances (USAID SHERA)

67

No. Date of News Article

Name of News Outlet

Title of Article News Media Type

URL for Online News Articles

Language (English or

Bahasa Indonesia)

40 23-Aug-19 Republika Ibu Kota Baru Nanti Perlu Terintegrasi Online https://nasional.republika.co.id/berita/pwo050328/ibu-kota-baru-nanti-perlu-terintegrasi

Bahasa Indonesia