18
1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY 16-17 Contact: Professor Fizzinoglia, Dr. Piazza

NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

1

NYIT Program Assessment Report

June 2017

Name of Program: Carleton Group, Old

Westbury, Communication Arts

Year of Assessment report: AY 16-17

Contact: Professor Fizzinoglia, Dr. Piazza

Page 2: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

2

Carleton Group

1) Program Outcomes:

a. 1.) Apply tools and technologies to the Adv.PR and Fields

b. 2.) Demonstrate written, oral and interpersonal communication skills appropriate

to the profession;

c. 3.) Identify and incorporate legal requirements, ethical considerations and the

concepts of social responsibility to their own work.

2) Method:

a. 1.) Indirect from Clients

b. 2.) Direct from Facility

c. 3.) Attached find questionnaire for client and faculty evaluation of students

administered by professor Hanc.

3) Analysis:

a. 1.) A client’s questionnaire was administered to two organizations highlighting

eight areas of the student’s competency. The written categories rated from “below

expectations” as a score of one to excellent as a score of five.

b. 2.) The Faculty member scored a “Student Assessment” questionnaire with five

categories from “Below Expectations” scored as “one” to “excellent” scored as five.

c. 3.) Client Evaluation Results:

i. The two results were most favorable with the clients’ results reflecting

solid fives as excellent in all eight categories.

1. Team’s ability to analyze and interpret data (research client past

campaigns, competitors, trends) to determine client’s advertising

or public relations needs.

a. P.L.0.1

2. Team’s ability to develop a creative and strategic campaign to

meet client objectives.

a. P.L.0.1

Page 3: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

3

3. Team’s ability to organize and present campaign ideas effectively

(using written, oral and visual methods) to client.

a. P.L.02, P.L.0.3

4. Team’s responsiveness to client feedback

a. P.L.0.2

5. Team communication/collaboration with client ( frequent and

effective team/client meetings throughout semester)

a. P.L.0.2

6. Ability of team to meet deadlines/show progress in meeting

objectives (progress reports/drafts, revisions of deliverables)

a. P.L.0.1

7. Ability of team to produce deliverables/implement programs to

meet client objectives

a. P.L.0.1

8. Do you intend to use the materials produced by the Carleton

Group student team?

a. P.L.0.1

b. P.L.0.2

The measure of “excellent” which demonstrates the scoring is reflective of the clients satisfactory

with students and their “deliverables.”

Page 4: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

4

Client Questionnaire – See 2a; 3a Assessment of ADV 420 – The Carleton Group Spring 2017

Rate the Performance of the Student team in the following areas: Analysis and Ability to formulate strategy:

1. Team’s ability to analyze and interpret data (research client past campaigns, competitors, trends) to determine client’s advertising or public relations needs.

Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

2. Team’s ability to develop a creative and strategic campaign to meet client objectives.

Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

3. Team’s ability to organize and present campaign ideas effectively (using written, oral and visual methods) to client.

Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

Page 5: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

5

Team performance: Team’s ability to work effectively in a deadline oriented business environment: 4. Team’s responsiveness to client feedback : Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

5. Team communication/collaboration with client ( frequent and effective team/client meetings throughout semester) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

6. Ability of team to meet deadlines/show progress in meeting objectives (progress reports/drafts, revisions of deliverables) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

Quality Assessment of Student Semester Project: 7. Ability of team to produce deliverables/implement programs to meet client objectives

Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

8. Do you intend to use the materials produced by the Carleton Group student team? Yes No

Page 6: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

6

Student Assessment by Faculty – See2b; 3b ADV 420 Spring, 2017 Carleton Group

Participation: 1- Ability to display & enhance skills throughout semester

Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

2- Ability to receive constructive feedback and improve work Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

3- Ability to collaborate effectively with team members to achieve goals (volunteer for tasks, assist others) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

4- Ability to display responsibility to team (consistent attendance, assigned tasks completed within deadlines) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

Page 7: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

7

Professionalism: 5- Ability to effectively participate in client meetings (offer ideas, accept feedback) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

6- Ability to exhibit appropriate behavior in professional settings (appropriate attire, business etiquette) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

7- Ability to prepare professional quality presentation materials/deliverables within deadlines Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

Proficiency 8- Ability to present logical ideas confidently in team environment Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

9- Ability to strategize (brainstorm/negotiate/compromise/troubleshoot) effectively with team members to reach objectives Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

10- Ability to work effectively within a team (coordinates tasks with others/assists others within team) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

Page 8: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

8

Long Island Volunteer Center, Spring 2017. See 2a; 3a Rate the Performance by the client of the Student team in the following areas: Analysis and Ability to formulate strategy:

1. Team’s ability to analyze and interpret data (research client past campaigns, competitors, trends) to determine client’s advertising or public relations needs.

Below Adequate Good Very Good

👍Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

2. Team’s ability to develop a creative and strategic campaign to meet client objectives.

Below Adequate Good Very Good

👍Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

3. Team’s ability to organize and present campaign ideas effectively (using written, oral and visual methods) to client.

Below Adequate Good Very Good

👍Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

Page 9: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

9

Team performance: Team’s ability to work effectively in a deadline oriented business environment: 4. Team’s responsiveness to client feedback : Below Adequate Good Very Good

👍Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) 5. Team communication/collaboration with client ( frequent and effective team/client meetings throughout semester) Below Adequate Good Very Good

👍Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) 6. Ability of team to meet deadlines/show progress in meeting objectives (progress reports/drafts, revisions of deliverables) Below Adequate Good Very Good

👍Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) Quality Assessment of Student Semester Project: 7. Ability of team to produce deliverables/implement programs to meet client objectives Below Adequate Good Very

Good 👍Excellent

Page 10: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

10

Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) 8. Do you intend to use the materials produced by the Carleton Group student team?

👍Yes No I want to take the opportunity to recognize the fine young professionals at the NYIT

Carleton Group who over the years have given the Long Island Volunteer Center a much

needed facelift and workable game-plan for 3 different core business objectives: youth

volunteering, corporate engagement, and a volunteer generation campaign. A program to

recognize the contributions of youth volunteers became an integral part of the Long Island

Volunteer Hall of Fame with 6 Next Generation Award inductees. Carleton

Group members developed the award criteria, were part of the judges panel, and handed

out the awards at the annual induction ceremonies at Carlyle on the Green, Bethpage

State Park, and produced a you tube video to promote the nomination process. Our

corporate activation project was created by another Carleton Group team who

launched our Corporate Volunteers of Long Island with a logo, branding materials, and

tabling opportunity at the Long Island Society of Human Resource Managers Conference at

the Crest Hollow County Club. Their strategies became the foundation for rolling out our

corporate programming. Another project spearheaded by the Carleton Group to increase

the profile of volunteerism and recruit new volunteers via a 5-hour volunteer challenge

produced a campaign logo and process, a resource table at Roosevelt Field Mall during

National Volunteer Week, a contest with a prize for eligible participants, and a you tube

promotional video to promote the campaign. I cannot speak more highly of these

enthusiastic and gifted consultants who helped us meet core business objectives in such

practical ways. It was such a pleasure to work alongside them as they dissected and rebuilt

parts of our organization that needed specialized attention while listening carefully for

what was mission-centric and important to the organizational culture. Many thanks too to

Professor John Hanc who invited our participation and helped direct the work. We are

forever in their debt.

Page 11: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

11

Client Questionnaire – Maritime Museum. See 2a; 3a

Assessment of ADV 420 – The Carleton Group Spring 2017 Rate the Performance of the Student team in the following areas: Analysis and Ability to formulate strategy:

1. Team’s ability to analyze and interpret data (research client past campaigns, competitors, trends) to determine client’s advertising or public relations needs.

Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

2. Team’s ability to develop a creative and strategic campaign to meet client objectives.

Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations)

3. Team’s ability to organize and present campaign ideas effectively (using written, oral and visual methods) to client.

Below Adequate Good Very Good Excellent

Page 12: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

12

Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) Team performance: Team’s ability to work effectively in a deadline oriented business environment: 4. Team’s responsiveness to client feedback : Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) 5. Team communication/collaboration with client ( frequent and effective team/client meetings throughout semester) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) 6. Ability of team to meet deadlines/show progress in meeting objectives (progress reports/drafts, revisions of deliverables) Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) Quality Assessment of Student Semester Project: 7. Ability of team to produce deliverables/implement programs to meet client objectives

Page 13: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

13

Below Adequate Good Very Good Excellent Expectations (Minimum Effort) (Met Expectations) (Exceeded Expectations) 8. Do you intend to use the materials produced by the Carleton Group student team? Yes No

Page 14: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

14

L.I. Maritime Museum

Student assessment by Faculty - ADV 420

See2b,3b

Spring, 2017 Carleton Group

Participation :

1- Ability to display & enhance skills throughout semester

Below

Expectations

Adequate

(Minimum Effort)

Good

(Met Expectations)

Excellent

2- Ability to receive constructive feedback and improve work

Below

Expectations

Adequate

(Minimum Effort)

Good

(Met Expectations)

Excellent

3- Ability to collaborate effectively with team members to achieve goals (volunteer

for tasks, assist others)

Below

Expectations

Adequate

(Minimum Effort)

Good

(Met expectations)

Very Good

(Exceeded Expectations)

Excellent

4- Ability to display responsibility to team (consistent attendance, assigned tasks

completed within deadlines)

Below

Expectations

Adequate

(Minimum Effort)

Good (Met expectations)

Very Good

(Exceeded Expectations)

Excellent

Professionalism:

5- Ability to effectively participate in client meetings (offer ideas, accept feedback)

Below Adequate Good

Expectations (Minimum Effort) (Met Expectations)

Ability to exhibit appropriate behavior in professional settings (appropriate

attire, business etiquette)

Page 15: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

15

Below

Expectations

Adequate

(Minimum Effort)

Good (Met Expectations)

Very Good

(Exceeded Expectations)

Excellent

6- Ability to prepare professional quality presentation materials/deliverables within

deadlines

Below

Expectations

Adequate

(Minimum Effort)

Good Very Good

(Met Expectations) (Met Expectations)

Excellent

Proficiency

Ability to present creative ideas confidently in team environment

Below

Expectations

Adequate

(Minimum Effort)

Very Good

(Exceeded Expectations)

Excellent

7- Ability to strategize (brainstorm/negotiate/compromise/troubleshoot)

effectively with team members to reach objectives

Below

Expectations Adequate

(Minimum Effort)

Good

(Met Expectations)

Excellent

8- Ability to work effectively within a team (coordinates tasks with others/assists

others within team)

Below

Expectations Adequate

(Minimum Effort)

Good (Met Expectations)

Excellent

Page 16: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

16

I 4. Interpretation: P.L.0. 1b

As reflected in the evaluations of the clients’ responses, they seemed to be quite satisfied

with the professionalism and the “deliverables” of the students (see the review in the Long Island

Volunteer Center’s quite favorable comments).

On the other hand, the faculty member in assessing the student’s performance with the

L.I. Martine Museum had some reservations. While the assessments of ten questions rated

between “very good” and “good,” not one construct was rated “excellent.”

Perhaps the discrepancy can be reconciled since the clients were so grateful of the

assistance that perhaps any shortcomings were overlooked while the faculty member was seeking

to instill in the students a higher sense of professionalism and the elusive rating of “excellent”

remained just that since the faculty member reserved this rating for the highest level of

performance and he saw some room for improvement.

I 5. Improvements- Planed are initial student self-evaluations to create a three-pronged bank of

assessment (client, student, faculty) to be further evaluated.

Page 17: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

17

II. Summary of Improvements made in response to Assessment Results the past few years:

Over the last 4-5 years the Communication Arts department has been consumed with upgrading

our academic programs which were in desperate need of updating. While our flagship “BFA in

Communication Arts” (registered in NYS in 1966 as Television and Radio Production) and our

BS in Advertising, as well as our AAS in Communication Arts, our BFA/MA 5-year Combined

CA program and our MA in Communication Arts still appear as options, some are being taught

out and the BFA in CA and the BS in Advertising have been replaced and augmented with 4 new

BFAs:

BFA in Communication and Media Production replaces CA, the most generalized program.

BFA in Advertising, PR and Technology replaces the BS in Advertising.

The faculty saw the need for more specialized programs for students wishing to concentrate on

film and TV production or in journalism so we added:

BFA in Digital Film and TV Production

BFA in Electronic and Global Journalism

The AAS, the BFA/MA combined and the MA are all currently under review by faculty who are

in the process of updating them, but they remain the degrees of record for those disciplines.

The new degrees required a heavy dose of revision and approval, including the program learning

outcomes and assessment strategies: each degree faced rigorous departmental, school level and

university-wide review before submission and approval by New York State.

The new degrees were only introduced in AY 2015-16 on the Old Westbury campus and this past

year, 2016-17, on the Manhattan Campus so the new majors show a small, growing number of

students, while the older degrees’ numbers are shrinking but remain in place for another couple

of years while being phased out. This of course, coupled with the high number of degrees, has

resulted in some confusion, and small or underdeveloped patterns of assessment result.

In addition, our program is designed to utilize the experiential model, where hands-on and

practical patterns of education couples with theory, craft and even employability training, tied to

career goals, create a challenge in assessing the various program learning outcomes.

In short, then, we are in the process of remediating the deficiencies of our assessment reports of

the last few years, the skimpiness partially a result of time and effort limitations, but at the same

time, please keep in mind that assessment was an implicit feature of all the work on the new

degrees.

Furthermore, as we are reviewing the MA and BFA/MA, our next curriculum update projects,

assessment will be on the forefront, with revisions of PLOs explicitly required whether or not the

degrees are replaced or revised.

Page 18: NYIT Program Assessment Report June 2017...1 NYIT Program Assessment Report June 2017 Name of Program: Carleton Group, Old Westbury, Communication Arts Year of Assessment report: AY

18

This Assessment Report, 2016-17, should be viewed as a pilot, focusing on the learning

outcomes of one of the new degrees, with the small sample an expected deficiency but the

approach and execution a matter of “getting our feet wet”.

The CA faculty understands that ALL degrees will be part of next year’s assessment report (with

the possibility of folding in data from the small numbered programs due to the newness or the

oldness of their status).

III. The Communication Arts faculty on both campuses participated in the revision of the degrees

and will continue to work on revising the MA and BFA/MA degrees. The current report mostly

was the work of Dr. Piazza, John Hanc, the Chair and Julie Price, adjunct faculty.