B2B Report

Course Evaluation Survey Data Collection, 2016Boots to Business, IVMF

By Sabreen MereJuly 2016

EXECUTIVE SUMMARY

Introduction: This study reports the results of the program evaluation survey for Boots to Business. The results will be presented in a briefing of the findings for [insert staff]. This report will be used to further develop the Boots to Business program for future use.

Methods: The data were collected from a paper survey of instructors that taught one or more modules since 2013. The target population is unspecified. 110 responses were collected. The sample is representative of the instructors participating in the survey. Their may be accuracy concerns because of unanswered questions within the survey. Sample sizes per question vary. Also, some questions had inconsistence scales. The open-ended responses were coded to fit the best possible answer.

Findings:

1. 53% of respondents taught Boots to Business at least 2 or more years. (n=110)

2. 67% of respondents taught 2 or less modules per workshop. (n=110)

3. Module 1 is the most taught module (54% response). (n=114)

4. When asked the value of the course objective “Understanding the opportunities and challenges associated with pursuing business ownership, 68% responded it had “good” or “great” value. (n=77)

5. 64% of respondents reported the course objective “Identify the processes and elements required to pursue business ownership" had “good” or “moderate” value. (n=75)

6. 57% of respondents placed the course learning objective “Evaluate the feasibility of a business concept with the feasibility analysis tool” with having the “least” or “moderate” value. (n=83)

7. The course learning objective “identify the resources, services and access points available to support the formation of business ownership including services provided by the SBA and resource partners” was valued by 64% of respondents as having the “greatest” or “good” value. (n=100)

8. 62% of respondents thought Module 1 was the most comfortably taught module. (n=114)

9. 72% of respondents thought Modules 4 and 5 were the least comfortably taught modules. (n=114)

10. See Finding 10 for scale ratings of each module.

11. 69% of respondents “sometimes” or “never” use the introduction to Business Ownership book as part of their two-day instruction. (n=96)

12. 60% of respondents “sometimes” or “never” use their feasibility analysis tool as part of their two-day instruction. (n=97)

13. 552% encountered issues or constraints while delivering the course. *Other is specified (n=114)

14. 53% of respondents use additional aids in their presentations. (n=97)

15. 60% of respondents prefer Modules 6 and 4 to have additional training. (n=114)16.

16. See Finding 16 for scale rating.

17. 57% of respondents allocate “30-60 minutes” per module. (n=95)

18. 65% of respondents used 4 or more instructors in the duration of the course. (n=92)

19. 73% wanted more diversity of presenters or “Other” if they used additional instructors. (n=83)

20. Time allocated for workshop preparation was 0-1 week for 67% of respondents. (n=92)

21. 72% of respondents has “some” or “no” awareness of the 8-week online Foundations of Entrepreneurship course. (n=92)

22. 72% recommend the Boots to Business 8-week course at the conclusion of the two day workshop. (n=87)

23. 75% of respondents recommend the small business development center as a follow-on resource to workshop participants. (n=114)

24. See Finding 24 for scale rating general category response.

25. 44% of respondents had issues with technology and base access. (n=18)

26. 53% of respondents cancelled a workshop due to lack of attendance/registrants. (n=17)

27. 56% of respondents would not modify the time allocated to any of the modules. (n=66)

Finding 1

Comment: 4 respondents did not answer this question.

0-1 years 1-2 years 2-3 years 3+ years0%

5%

10%

15%

20%

25%

30%

18% 18%

26% 27%

Frequency of years taught for Boots to Business n=110

Years teaching Boots to Business

Per

cen

tage

of

resp

ond

ents

Finding 2

Comment: Modules taught that could not be specified include: 96, 8-Jan (4), 64, 60, 30 (2) 40, 14, Day2, 16, 15, 13, Reboot, Gov't contracting, 50

1 Module

2 Modules

3 Modules

4 Modules

5 Modules

6 Modules

7 Modules

8 Modules

0% 5% 10% 15% 20% 25% 30% 35% 40%

32%

35%

10%

9%

3%

0%

2%

7%

Frequency of modules taught per workshop n=110

Percentage of respondents

Nu

mb

er o

f m

od

ule

s ta

ug

ht

Finding 3

Comment: n/a

Module 1: Introduction to Business Ownership for Transition-ing Service Members

Module 3: Understadning Markets & Your Competetive Space

Module 5: Picking the Correct Legal Entity for Your Business

Module 7: Next Steps: Introduction to Business Planning

0% 10%20%30%40%50%60%

54%49%52%

49%38%

44%51%

40%

Percentage of the modules taught by respondents n=114


Mod

ules

taug

ht

Greatest value Good value Moderate value Least Value0%5%

10%15%20%25%30%35%40% 38%

30%

19%13%

Frequency of respondents' feelings on the course learning objective: "Understanding the opportunities and challenges associated with

pursuin business ownership as vocation"n=77

Value ranking

Perc

enta

ge o

f res

pond

ents

Finding 4

Comment: Of the four course learning objectives, this ranked 2nd.


10%15%20%25%30%35%

15%

32% 32%

21%

Frequency of respondents' feelings on the course learning objective: "Identify the processes and elements requiredto pursue business

ownership"n=75

Value ranking

Perc

enta

ge o

f res

pond

ents

Finding 5

Comment: Of the four course learning objectives, this ranked 3rd.


10%15%20%25%30%35%40%

19%24% 23%

34%

Frequency of respondents' feelings on thecourse learning objective: "Evaluate the feasibility of a business concept with the feasibility

analysis tool"n=83

Value ranking

Per

cen

tage

of

resp

onde

nts

Finding 6

Comment: Of the four course learning objectives, this ranked 4th.

Finding 7

Comment: Of the four course learning objectives, this ranked 1st.


10%15%20%25%30%35%40%45% 41%

23%18% 18%

Frequency of respondents' feelings on the course learning objective: "Identify the resources, services and access points available to support the formation of business ownership including services provided by the

SBA and resource partners" n=100

Value Ranking

Per

cen

tage

of

resp

ond

ents

Finding 8

Comment: Module 1 was the most comfortably taught module, followed by Modules 7, 3 and 2.

Module 1

Module 2

Module 3

Module 4

Module 5

Module 6

Module 7

Module 8

0% 10% 20% 30% 40% 50% 60% 70%

62%54%

56%39%

31%49%

57%44%

Frequency of respondents' most comfortably taught modulen=114


Mod

ule

Module 1Module 2Module 3Module 4Module 5Module 6Module 7Module 8

0% 5% 10% 15% 20% 25% 30% 35% 40%

3%7%

18%35%

37%28%

6%15%

Frequency of respondents' least comfortable taught modulen=114


Mod

ule

Finding 9

Comment: Revise Modules 4 and 5, since they are considered the last comfortably taught modules.

*Finding 10

Comment:Most value- Module 1Somewhat value- Module 2Slightly valuable- Module 2Neutral- Module 4Moderately valuable- Module 7Slightly invaluable- Module 4Least valuable- Module 6No value- Module 8

Never Sometimes Mostly Always0%5%

10%15%20%25%30%35%40%45%50%

25%

44%

9%

23%

Frequency of respondents who use the Introduction to Business Ownership book as part of their two-day instruction

n=96

Response

Per

cent

age

of r

espo

nden

ts

Finding 11

Comment: n/a

Never Sometimes Mostly Always0%5%

10%15%20%25%30%35%40%

34%

26%

15%

25%

Frequency of respondents who use the feasibility analysis tool as part of their two day instruction

n=97

Response

Per

cent

age

of r

espo

nden

ts

Finding 12

Comment: n/a

Base A

ccess/

Coo

rdina

tion

Audio

visua

l (com

puter

/inter

net, l

ack of

)

Classro

om (lo

cation

, size)

Other (S

pecif

y)0%

10%20%30% 27%

22%15%

25%

Percentage of respondents who have constraints while delivering the coursen= 114

Response

Perc

enta

ge o

f res

pond

ents

Finding 13

Comment: *Other is specified

Whiteboard

Gate access

Site challenges

Internet/Powerpoint

Course material

Response: None

0% 10% 20% 30% 40% 50% 60% 70%

4%

4%

4%

11%

4%

59%

Frequency of general category responses to: What types if any, facility constraints do you experience while delivering the course?

n=27

Series1

Yes No0%

10%

20%

30%

40%

50%

60% 53%47%

Frequency of respondents who used any additional aids in their presentations

n=97

Response

Per

cent

age

of r

espo

nden

ts

Finding 14

Comment: If yes, specified* see spreadsheet

Finding 15

Comment: Modules 6 and 4 need additional training, possible review.

Module 1

Module 2

Module 3

Module 4

Module 5

Module 6

Module 7

Module 8

0% 5% 10% 15% 20% 25% 30% 35%

7%

11%

16%

32%

22%

28%

13%

12%

Frequency of respondents preferences for modules with additional trainingn=114


Mo

du

le

Finding 16

Comment: Scale rating for interests in further professional development

Not at all- Peer Mentorship Not very- Peer Mentorship Somewhat- Live webinars Very- Learning on demand videos

Teach

ing C

onf...

Peer m

entor

s...

Learni

ng on

dem...

Live w

ebina

rs

Team te

achin

g opp

...0%5%

10%15%20%25%30%35%40%45%

26% 27%

15% 16%

21%

10%

23%

14%17% 19%

21%

29%26%

36%33%34%

21%

38%

31%26%

Frequency of respondents' interests in various types of professional development for continuous improvement of course instruction

Not at all Not very SomewhatResponse

Per

cent

age

of r

espo

nden

ts

0-30 minutes 30-60 minutes 60 minutes0%

10%

20%

30%

40%

50%

60%

2%

57%

41%

Frequency of time respondents' allocate per modulen=95

Time allocated

Per

cent

age

of r

espo

nden

ts

Finding 17

Comment: n/a

1 ins

tructo

r

2 ins

tructo

rs

3 ins

tructo

rs

4 ins

tructo

rs

5 ins

tructo

rs

5+ in

struc

tors

0%5%

10%15%20%25%30%

8%12%

15%

23%17%

25%

Percentage of instructors used in the duration of the coursen=92

Number of instructors used

Per

cent

age

of r

espo

nden

ts

Finding 18

Comment: See Finding 19 for reasons for additional instructors.

Finding 19

Comment: Diversity of presenters for more insight on course material.

Exposure to local resource/partners

Diversity of presenters

Schedule of constraints

Other (specify)0%5%

10%15%20%25%30%35%40%45%50%

18%

43%

8%

30%

Percentage of respondents' reasoning for using a certain number of instructors

n=83

Response

Perc

enta

ge o

f res

pond

ents

0-1 week 2-3 weeks 4-5 weeks 5+ weeks0%

10%20%30%40%50%60%70%80%

67%

22%

2%9%

Frequency of time allocated for preparation per workshopn=92

Time (weeks)

Perc

enta

ge o

f res

pond

ents

Finding 20

Comment: n/a

No awareness Some awareness Fully aware0%5%

10%15%20%25%30%35%40%45%

32%

40%

28%

Frequency of respondents reported awareness of the eight-week online Foundations of Entrepreneurship course

n=92

Response

Perc

enta

ge o

f res

pond

ents

Finding 21

Comment: n/a

Yes No Sometimes0%

10%20%30%40%50%60%70%80% 72%

18%9%

Percentage of respondents that recomend the Boots to Business eight work course at the conclusion of the two day workshop

n=87

Response

Perc

enta

ge o

f res

pond

ents

Finding 22

Comment: n/a

Finding 23

Comment: The small business development center and SCORE are the most used follow-on resources to workshop participants.

Finding 24

Comment: Video and Powerpoint updates were among the top issues respondents voiced. Some respondents thought the material can be too vague to participants, so look into giving examples such as, “John Doe has owned Xbusiness for 5 years, using this business model he has established his brand” etc.

Finding 25

Comment: Technology is a large issue that needs to be addressed. Recurring theme among respondents’ answers.

Technology/ Base Access

Attendance/Attendees Miscellaneous0%

10%

20%

30%

40%

50% 44%

33%

22%

Frequency of respondents who answered what issues negatively af-fected their experience with Boots to Business

n=18

General category open ended response

Perc

enta

ge o

f res

pond

ents

Finding 26

Comment: Most workshops get cancelled due to a lack of registrant application.

Instuc

tor un

able

Not en

ough

atten

dees/

registr

ants

Weat

her re

lated

Miscell

aneo

us0%

20%40%60%

12%

53%

24%12%

Frequency of respondents who answered, "yes" to "have you cancelled a workshop in the past year?"

n=17


Perc

enta

ge o

f res

pond

ents

No modification Yes, modify DK0%

10%

20%

30%

40%

50%

60% 56%

42%

2%

Frequency of respondents' who answered "would you modify the time allocated to any of the modules?"

n= 66


Per

cent

age

of r

espo

nden

ts

Finding 27

Comment: n/a

Documents

B2B Report