Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
eVALUATION REPORT 2019/20
INTRODUCTION
This report refers to events and act iv i t iesproduced by DOCA for the act iv i typer iod 01/04/19 - 15/05/20.
It refers specif ical ly to data col lect ionalong with audience and volunteer(Fest ival Maker) feedback, col lected,col lated and analysed at the fo l lowingevents: Devizes Carnival, Picnic in the Park,Devizes International Street Festival,Colour Rush, Confetti Batt le, t icketedshows and Festival of Winter Ales
METHODOLOGY
Who we work with (people)The nature, qual i ty, access ibi l i ty and impact of ourwork.
the aims of our monitor ing and evaluat ion seeksfeedback on:
The system of data col lect ion and feedback up to andincluding the t icketed shows descr ibed fol lowed theprocedures and forms that had been adopted pr ior tothe appointment of the Development Manager in June.Although onl ine audience feedback forms are avai labletheir use did not provide many responses, the vastmajor i ty of data col lected was via face to facequest ionnaires. The summer events were used to lookat the systems effect iveness in order to review andimprove our evaluat ion methods which would inform anew evaluat ion plan and strategy. We tr ia l led var iouscreat ive ways of data gather ing giv ing usefulsnapshot data or col lected informat ion in moreeff ic ient ways than c l ipboard surveys.
OUR ORGANISATION
The management of our organisat ion is overseen by 6Volunteer Trustees, a l l res idents of Wi l tshire andhave expert ise needed to ensure the successfulrunning of DOCA complying with char ity law.
3 part-t ime profess ional staff del iver the day to daywork in the equivalent of 7 .5 day working week, withaddit ional staff being brought in on a task and f in ishbasis such as Volunteer Co-ordinators, GraphicDesigners or Workshop Leaders.
Our Volunteers or Fest ival Makers jo in us for specif ictasks or events throughout the year. Dur ing th isf inancial year we clocked a total of 453 volunteershifts (of 4 hours or more)
We recruited 12 new Volunteer Fest ival Makersdur ing the project per iod and worked with twostudent placements over four-week per iods. We have73 act ive Fest ival Makers taking into considerat ionhaving also lost 5 due tp i l l health and change ofcircumstance. We worked with one work exper iencestudent from Devizes School and one UndergraduateStudent Placement from UWE dur ing 2019
OUR AUDIENCES
Our data shows either an increase or no change inattendance from 2018 for a l l events other than theInternat ional Street Fest ival Sunday only and theCarnival . The decrease in attendance at the Street Fest ivalon Sunday may have been due to extremely h ightemperatures and lack of shade on the Green. Our target for Carnival audience was not met. Webel ieve th is was s ignif icant ly impacted by the datechange which was apposed by many localtradit ional ists .We saw an increase in new attendees from thePewsey area, poss ibly result ing from acol laborat ion with Ginkgo Projects and the NewKings Carnival Project . Our audience numbers for indoor shows saw asignif icant increase - poss ibly due to lower t icketpr ices and increased market ing. Colour Rush and Confett i Batt le saw a s ignif icantgrowth in numbers - th is would have been impactedby the date change. Town centre audiences are measured throughsurvel l ience cameras analyt ics .
AUDIENCES IN NUMBERS
Carniva
l
Picnic
Int St. F
est
Confetti B
attle
ticke
ted sh
ows
Fest. W
inter A
les
Lanter
n Parade
20,000
15,000
10,000
5,000
0 Carnival 2018 Picnic 2018 Int. St. Fest 2018 Confetti Battle 2018 ticketed shows 2018 Fest. Winter Ales 2018 Lantern Parade
20,000
15,000
10,000
5,000
0 Item 1 Item 2 Item 3 Item 4 Item 5 Item 6 Item 7
20,000
15,000
10,000
5,000
0
Target for 2019Attendance 2018 Attendance 2019
UNDERSTANDING OUR REACH
We like to know where are audiences are from. These pins showaudience locality for all our events based on information collected.We know that different events appeal to different audiencedemographics.
This information helpsus to understand thepotential to expandour reach and targetour marketing moreeffectively.
We are now betterequipped to talk topotential partnersand sponsors andmake a stronger casewhich will appeal tothose consideringadvertising with us.
AUDIENCE ORIGINS
It is clear there is potential to attract audiences fromoutside Devizes, particularly villages in the wider AreaBoard boundary.It is important to retain our local audiences and give themnow and inspiring creative offers. With no railway station and poor public transport links tonearby towns and cities of Bath and Bristol we have tofocus on independently mobile audiences. There is potential to explore ways to coordinate grouptravel from nearby towns. Devizes is developing a reputation for tourism, our datashows that substantial audience members are visitorsrather than residents - there is scope to deepenrelationships with hospitality and tourism providers.
A total of 226 payingattendees at ticketedevents as part of 2019Festival Fortnight, with70 comps given tosponsors & supporters
42% of our audienceat We are Bronte hadnever attended a DOCAticketed show in thepast
UNDERSTANDING OUR REACH
Devizes Town38%
2 - 4 miles from Devizes32%
4 - 10 miles from Devizes20%
10 - 24 miles 10%
CARNIVAL
PICNIC IN THE PARK
Devizes Town45%
2 - 4 miles from Devizes45%
4 - 10 miles 7%
At each event we took a sample survey to work out the distancespeople travel to get to us and their age group. This helps usunderstand who the event appeals to so we can taylor ourcommunications appropriately.
We collected 107postcodes atCarnival
UNDERSTANDING OUR REACH
Devizes Town47%
2 - 4 miles from Devizes29%
4 - 10 miles from Devizes18%
10 - 24 miles 6%
INTERNATIONAL STREETFESTIVAL
CONFETTI BATTLE
Devizes Town37.6%
2 - 4 miles from Devizes37.6%
4 - 10 miles from Devizes21.5%
10 - 24 miles 3.2%
We collected 262postcodes atStreet Fest
UNDERSTANDING OUR REACH
Devizes Town47%
2 - 4 miles from Devizes29%
4 - 10 miles from Devizes18%
10 - 24 miles 6%
COLOUR RUSH
FESTIVAL OF WINTER ALES
4 - 10 miles from Devizes32.3%
10 - 24 miles from Devizes25.3%
Devizes Town22.2%
2 - 4 miles from Devizes20.2%
We collected 116postcodes atColour Rush
18 - 24 25 - 34 35 - 44 45 - 54 55 - 64 Over 65
30
20
10
0
18 - 24 25 - 34 35 - 44 45 - 54 55 - 64 Over 65
25
20
15
10
5
0
Our capacity to collect data varies at each event. The following data shows thebreakdown of audience age group at each event according to our survey sample.Ticketed events such as Colour Rush are 100% acurate, others are taken from asample of the audience through surveys.
UNDERSTANDING OUR AUDIENCES
CARNIVAL
CONFETTI BATTLE " Wowzers!! This is new!And different!!" (fromWestbury)
UNDERSTANDING OUR AUDIENCES
18 - 24 25 - 34 35 - 34 45 - 54 55 - 64 Over 65
30
20
10
0
18 - 24 25 - 34 35 - 44 45 - 54 Over 65
25
20
15
10
5
0
COLOUR RUSH
FESTIVAL OF WINTER ALES
"Plan to come again evenafter we’ve moved upnorth. Entertainment
excellent
"We're new to Devizes andeverything we’ve been to is
fun interesting andinspirational. Thank You."
Understanding how our audiences view our events is important tous, we use it to ensure our future planning evolves and responds
to their preferences. Audience reaction to the quality of our workand their experience at our events is collected through paper
questionnaires. Where rating has been cited as poor we have seenspecific comments relating to this.
Excellent/good83.6%
So-so7.3%
9.1%PICNIC IN THE PARK - MUSIC
Excellent/good90.9%
9.1%
OUR AUDIENCE EXPERIENCE
we asked 30 people what their opinion of
the quality of the music was at the event.
This represents 3% of our audience
we asked 10 people what their opinion of
the quality of the creative workshops was
at the event. This represents 33% of our
audience
PICNIC IN THE PARK - WORKSHOPS
OUR AUDIENCE EXPERIENCE
Excellent or good83.6%
So-so7.3%
9.1%
Excellent/good
95%
So-so
5%
PICNIC IN THE PARK - PERFORMANCE
we asked 30 people what their opinion of
the quality of the performance at the
event. This represents 3% of our audience
we asked 30 people what their opinion of
the quality of our indoor ticketed event 'we
are bronte' which was sold out. our sample
represents 25% of the audience.
WE ARE BRONTE
OVERALL - ALL EVENTS
Excellent or good81.7%
So-so6.5%
10%
We are quite pleased with our overall
feedback. This is a good snapshot of how we
are performing, for more details see the
breakdown on the following pages
OUR AUDIENCE EXPERIENCE
Excell
ent/g
ood
97%
So-so
3%
UDUL BY LOS GALINDOS - PERFORMANCE
we asked 37 people what their opinion
of the quality of the performance at
the event. This represents 27% of our
audience.
Excellent or good81.1%
So-so16%
Poor2.9%
we asked 89 people what their opinion of
the quality of our carnival was. our
sample represented 2.2% of the audience.
CARNIVAL
INTERNATIONAL STREET FESTIVAL
Excellent or good96.5%
Poor3.5%
we asked 87 people what their opinion of
the quality of our street festival was. our
sample represented 0.5% of the audience.
Excellent or good81.6%
So-so18.4%CONFETTI BATTLE
Excellent or good92.3%
So-so4.3%
They dislike the date change and the lack of event schedule leading up to the event.
2 respondents felt that the customary (and rescheduled) carnival week events added
to the atmosphere and it now felt disjointed.
1 person responded that there should be more floats, lights, a carnival queen and
carnival babies.
people who cited that the carnival did not meet their expectations commented:
OUR AUDIENCE EXPERIENCE
we asked 56 people what their opinion
of the quality of the event. This
represents 1% of our audience.
we asked 152 people what their opinion of
the quality of the event was. our sample
represented 26.5% of the audience.
FESTIVAL OF WINTER ALES
TO BE CONSIDERED
At our largest and smallest events we trialled collecting a snapshotof opinion for specific shows using speech bubble whiteboardsand audio recordings. Examples of this are shown below. We trialled ‘Whiteboard Counts’ at UDAL performances,and at ISF shows Circus Raj, Ockhams Razor, Ian Deadly, Dansi,Rin Tins and Kongo Dia Ntotiia.
QUALITY RATING ACTIVITY
More engaging for both evaluator and responderMore data collected quicker and with a potent focus on aspecific evaluation taskEffective in getting audience feedback on a show in a timelymannerLess invasive of audience timeWe need to refine the processIt's quick to collate the data at the end of the event.
Speech Bubble Whiteboards:
Some audience members disconcerted by beingrecordedAmbient noise effects qualityTransfer of information timelySome level of tech knowledge required to operateUseful snapshots gatheredNot suitable for all eventLimited by equipment available
Audio recording:
OUR LEARNING OUTCOMES
Trialing a variety of data gathering methodologyat different events gave us an insight to howour audiences like to communicate and whatworks with our available resources and for ourvolunteers. This is what we found:
THE WORD ON THE STREET
"WONDERFUL, LOVED IT. I’MA CHURCHGOER AT ST
MARY’S, SO THIS IS A BITDIFFERENT FROM MY
‘NORMAL" We Are Bronte
We Are Bronte
"VERY TALENTEDPERFORMERS"
Confetti Battle
"BRILLIANTLITTLE TOWN,AND BRILLIANT
EVENT"
"We bring visitors down each year for it,
have seen Some greatshows today"
Street Festival
"Club Shed had us all dancing, the oldies and thetots! How great is that! Great
concept!"Street Festival
"Came last year and had a great time, so back for more this year"
Street Festival
"LOVE THE VIBE"Festival of Winter Ales
UNDERSTANDING OUR PARTICIPANTS
Participation is key to DOCA’s work. We rely heavily on adedicated, skilled and willing team to make things happen, with thehelp of a huge team of volunteers, our appreciation of the goodwill and a pro active approach to nurturing a supportive cohesiveand caring team is key to this work. Public participation in our workshops and events is also central toour events. We aim to grow and improve the quality ofparticipation wherever possible year on year. Our mainparticipatory activities relevant to this report (excludingLantern Parade) are:
CARNIVALIn 2019 we ran our first series of schools Carnival workshops formany years. We engaged with 292 young people - this will be ourbenchmark to improve upon in future years.
COLOUR RUSH
PICNIC WORKSHOPS
As this is a ticketed event we have the contact details of all theparticipants which makes it easier to gather information andfeedback.
These workshops are delivered on a drop in basis, young peopleoften attend unaccompanied or with siblings as their families arewithin eyeshot, this can make it difficult to gather feedback. Weheld participatory performance with a mass kazoo session in 2018 &the Balloo Toss in 2019.
2018 2019
400
300
200
100
0
400
300
200
100
0
2018 2019
400
300
200
100
0
2018 2019
250
200
150
100
50
0
OUR PARTICIPANTS
PICNIC:
TARGETS
ACTUAL PARTICIPATION
COLOUR RUSH
TARGETS
ACTUAL PARTICIPATION
workshops & participatory
performance
MEASURING OUR IMPACT
TARGET 150
ACTUAL 216
NUMBER OF NEW COMMISSIONS
TARGET15
ACTUAL 35
DAYS EMPLOYMENT FOR ARTISTS & TECHNICIANS
TARGET 85
ACTUAL 93
NUMBER OF PERFORMANCE OR EXHIBITION DAYS
TARGET 80
NUMBER OF SESSIONS FOR EDUCATION, TRAINING OR PARTICIPATION
ACTUAL 156
TARGET 1500
ACTUAL 38,174
PARTICIPANTS
TARGET 1500
ACTUAL 2101
AUDIENCE MEMBERS - LIVE
TARGET 30,000
ACTUAL 6000
UNDERSTANDING WHO BENEFITS
ARTISTS, CREATIVES OR MUSEUM SPECIALISTS
TARGET165
ACTUAL 216
AUDIENCES ON LINE, THROUGH BROADCASTS OR WRITING
We aimed to touch the lives of 33,165 people we reached 40,491including online interactions
At our ticketed showUdul by Los Galindos
100% of the audience
agreed theirexpectations weremet or exceeded
TARGET 1500
ACTUAL 38,174
PARTICIPANTS
TARGET 1500
ACTUAL 2101
AUDIENCE MEMBERS - LIVE
TARGET 30,000
ACTUAL 6000
UNDERSTANDING WHO BENEFITS
ARTISTS, CREATIVES OR MUSEUM SPECIALISTS
TARGET165
ACTUAL 216
AUDIENCES ON LINE, THROUGH BROADCASTS OR WRITING
We aimed to touch the lives of 33,165 people we reached 40,491including online interactions
At our ticketed showUdul by Los Galindos
100% of the audience
agreed theirexpectations weremet or exceeded
DOCA understands the need to capture data to quantify andvalidate the effect of its activities on the economy of Devizes. So farlimited data has been collected to enable us to estimate the impactour events have on the town. Our Development Plan explores howthis work can be done better in the future.
We have some basic data collected from our Carnival event whichgives us some basic information to make some qualified estimates.
*Taking the midpoint of each Spend Range collected, multiplying itby the number of responders gives an approximate average spendof £20 per person. Taken further, multiplied by 65% (as an adult /child split of total attendance) of the total estimated audience size(3750) this gives a calculation of 2437 x £20 = £48,750
UNDERSTANDING WHO BENEFITS
GOING FORWARD
ECONOMIC IMPACT
Carnival brings £48,750* into Devizes
We now have benchmark figures to set targets agains for future years,though we know that Covid 19 will have a huge impact on our work we hopeto return to the successes we have seen this year, we will continue toimprove our data collection methods and bring further depth into ourresearch.