IPT Tools and Phases Worksheet

HPT Phase Section 1 – IPT Tool

Performance analysis

Cause analysis

Intervention Selection, Des.& Dev.

Intervention Implem. & Change

Evaluation

1. Gilbert's first, second and third leisurely

theorems X

2. A logic model for evaluation based on

Kellogg’s guidelines X

3. Evaluation conducted with the Key

Evaluation Checklist (KEC) X

Merchandise Unlimited Evaluation Project

IPT Learning Goals Worksheet

Master’s degree program learning goals

Demonstrated in this case?

Brief explanations

1. Conduct the HPT process in a way that is systematic.

X

Our team employed Scriven’s Key Evaluation Checklist, which provided a methodical, step-by step process for us to follow. The KEC acted as both a checklist of the necessary components for a complete evaluation and as a framework to guide evaluation planning and reporting of the merit, worth, and the significance of the evaluand. The key point of the KEC is that it an iterative checklist, meaning that it encouraged repeated checkpoint review, which at times led to modifications in our approach. For example, the original goal of our project was to measure the efficiency of the MU Truck Crew receiving process, however there were no metrics currently in place. Therefore we had to modify our approach instead to focus on developing an assessment rubric based on industry best practices and then evaluate how the UPS receiving process compared to those best practices.

2. Conduct the HPT process in a way that is systemic.

X

No solution occurs in a vacuum. Therefore as a team we had to look at the ripple effect of our recommendations. The MU Truck receiving process had several internal and external factors affecting its performance. By examining all facets of the system, we were able to analyze and determine which factors were feasible and within MU’s locus of control before we selected and recommended proper, cost-effective solutions. In addition, because the factors were interrelated, we as a team had to realize that a change in one area might have an effect in other areas. Thus causing us to continually reassess and re-evaluate our data and assumptions to ensure they still were in alignment with the goal of our evaluand

3. Conduct the HPT process in a way that is consistent with established professional ethics.

X

Our project adhered to the professional ethics of both the AEA and ISPI

AEA Systematic Inquiry - conducted a systematic, data-based

inquiry using accurate and credible data. As HPT professionals our job is to use science and data to support our conclusions.

Competence - conducted an evaluation within the scope of the evaluator’s abilities, and with attention to contextual appropriateness of data collection and phrasing of conclusions and recommendations. By conducting literature reviews, we were able to have adequate knowledge of new technologies (metrics, bar coding) that were beneficial to the

client.

ISPI

Add Value Principle. We prioritized our solutions from the most cost-effective and least time resources to most expensive and most time resources. By prioritizing our solutions, the stakeholders could focus their resources on small success that would have a systemic effect and have tremendous impact to their receiving process. Ultimately our goal was to help the organization move to where it needed to be in the future.

Collaboration Principle:

Work collaboratively with clients and users, functioning as a trustworthy strategic partner.

Integrate the company’s needs, constraints, and concerns when devising a solution.

Meet the interests of all parties involved in an intervention, project, or process, so there is a win-win outcome.

4. Conduct the HPT process in a way that is consistent with established professional standards.

X

We conducted the HPT process in a way that is consistent with established professional standards. According to ISPI’s professional standards, we approached our project from a :

Systems point of view: The team understood that changes affect the system. As HPT professionals we had to carefully consider “pressures, expectations, constraints, and consequences”

Value added perspective: The focus of HPT is for business results. At the onset we focused on providing solutions that met the organizations bottom line (increased efficiency and lowered cost)

5. Align performance improvement solutions with strategic organizational goals.

X

The performance solutions that the evaluation team recommended were aligned well with the organizational goal presented by the stakeholders of of increasing efficiency and reducing cost. The recommendations we presented were selected based on helping the organization move to where it needed to be in the future.

6. Make recommendations that are designed to produce valued results.

X

Based on stakeholder’s importance weighting of dimensions, we started our list of recommendation with the most important factor and then progressed down to the least important one. Within each dimension we also prioritized solutions from the least expensive and quickest to implement to the most expensive and highest time allocation. By giving the stakeholders a prioritized list, they could then begin to focus their actions in critical areas

7. Collaborate effectively with others, in person and virtually.

X

Our team members live in 3 different states and are in two different time zones. Therefore effective communication was essential. Our team employed various communication channels in order to successfully complete our project such as email, Skype, Google docs, and Drop box. In addition to our own team meetings, we had to successfully conduct interviews with the stakeholders and the truck crew. Therefore being geographically displaced from the MU headquarters, our primary modes of communication with the stakeholders and truck crew were through conference calls, email,

and Word and Excel documents to quickly display data and get feedback.

8. Communicate effectively in written, verbal, and visual forms.

X

Our final report was written to the point of view of our stakeholders. Based on our interviews, we were very particular to use their industry jargon in the final report in order to create an environment of partnership. In addition, we provided tables, graphics, and figures to help explain information in more efficient and effective manner

9. Use evidence-based practices.

X

Our project utilized many proven scientifically-based HPT theories, models, and strategies.

Gilbert’s BEM was an overarching theme in how we approached the problem. After conducting interviews, we determined that the problem was not an individual problem, the environment factors overwhelming were contributing to the problems within the MU UPS Truck Crew receiving process.

As novices to evaluation methodology, the principles of Scriven’s KEC provided a solid framework to conducting sound evaluations

10. Contribute to the

professional community of practice.

X

The ultimate goal is to get our evaluation project published in the IPT Tales from the Field because our projects is of professional quality and provided a concrete application of HPT