35
Vol:.(1234567890) Journal of Autism and Developmental Disorders (2019) 49:582–616 https://doi.org/10.1007/s10803-018-3724-5 1 3 ORIGINAL PAPER Telehealth as a Model for Providing Behaviour Analytic Interventions to Individuals with Autism Spectrum Disorder: A Systematic Review Jenny Ferguson 1  · Emma A. Craig 1  · Katerina Dounavi 1 Published online: 28 August 2018 © The Author(s) 2018 Abstract Interventions based on applied behaviour analysis are considered evidence based practice for autism spectrum disorders. Due to the shortage of highly qualified professionals required for their delivery, innovative models should be explored, such as telehealth. Telehealth utilises technology for remote training and supervision. The purpose of our study was to sys- tematically review the literature researching telehealth and ABA. We analysed intervention characteristics, outcomes and research quality in 28 studies and identified gaps. Intervention characteristics were: (1) research design (2) participants (3) technology (4) dependent variables (5) aims. Outcomes were favourable with all studies reporting improvements in at least one variable. Quality ratings were significantly low. Implications for future research and practice are discussed in light of identified methodological downfalls. Keywords Applied behaviour analysis · Telehealth · Autism spectrum disorder Autism spectrum disorder (ASD) is a neuro-developmental disorder categorised by impairments in social-communi- cation and restrictions in behaviours or thought patterns (American Psychiatric Association 2013). Recent esti- mates have suggested 1 in every 59 individuals now have a diagnosis of ASD (Centres for Disease Control and Pre- vention 2018). The high prevalence and lifelong nature of the condition mean a large demand on services to support individuals spanning across health, social care and educa- tion sectors. In the UK, the cost of these services have been estimated at £1.5 ($2.2) million across a lifetime (Buescher et al. 2014), making ASD the costliest medical condition to support (Knapp et al. 2009). More importantly, when com- pared to neuro-typical individuals, individuals with ASD have been shown to score considerably lower on indicators of life-quality and are less likely to be in paid employment, have rewarding social lives or achieve full independence from their families (Howlin et al. 2004). This highlights the significance of providing successful yet cost effective inter- ventions, which should be based solely upon sound empiri- cal evidence and guided by current evidence based practice (EBP). Research has indicated that best practice in autism inter- ventions should involve strategies based upon the princi- ples of applied behaviour analysis (ABA) (Makrygianni and Reed 2010; Reichow 2012; Reichow et al. 2018). ABA is an applied science aiming to determine environmental variables that shape socially significant behaviour and design inter- ventions accordingly. Teaching strategies derived from these principles have been identified as EBP (e.g., early intensive behavioural intervention, discrete trial training, functional communication training, functional behavioural assessment, extinction, naturalistic intervention, pivotal response train- ing and task analysis) (Wong et al. 2014). However, the vast majority of European governments do not fund ABA-based provision; estimates suggest only a third of children with ASD currently access behavioural interventions across Europe (Salomone et al. 2014). In the UK, where an ‘eclectic’ and often ill-defined selec- tion of services is available, access to funded ABA can often be either a postcode lottery or a testament of parental * Katerina Dounavi [email protected] Jenny Ferguson [email protected] Emma A. Craig [email protected] 1 School of Social Sciences, Education and Social Work, Queen’s University Belfast, 69-71 University Street, Belfast, Northern Ireland BT7 1HL, UK

Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

Vol:.(1234567890)

Journal of Autism and Developmental Disorders (2019) 49:582–616https://doi.org/10.1007/s10803-018-3724-5

1 3

ORIGINAL PAPER

Telehealth as a Model for Providing Behaviour Analytic Interventions to Individuals with Autism Spectrum Disorder: A Systematic Review

Jenny Ferguson1 · Emma A. Craig1 · Katerina Dounavi1

Published online: 28 August 2018 © The Author(s) 2018

AbstractInterventions based on applied behaviour analysis are considered evidence based practice for autism spectrum disorders. Due to the shortage of highly qualified professionals required for their delivery, innovative models should be explored, such as telehealth. Telehealth utilises technology for remote training and supervision. The purpose of our study was to sys-tematically review the literature researching telehealth and ABA. We analysed intervention characteristics, outcomes and research quality in 28 studies and identified gaps. Intervention characteristics were: (1) research design (2) participants (3) technology (4) dependent variables (5) aims. Outcomes were favourable with all studies reporting improvements in at least one variable. Quality ratings were significantly low. Implications for future research and practice are discussed in light of identified methodological downfalls.

Keywords Applied behaviour analysis · Telehealth · Autism spectrum disorder

Autism spectrum disorder (ASD) is a neuro-developmental disorder categorised by impairments in social-communi-cation and restrictions in behaviours or thought patterns (American Psychiatric Association 2013). Recent esti-mates have suggested 1 in every 59 individuals now have a diagnosis of ASD (Centres for Disease Control and Pre-vention 2018). The high prevalence and lifelong nature of the condition mean a large demand on services to support individuals spanning across health, social care and educa-tion sectors. In the UK, the cost of these services have been estimated at £1.5 ($2.2) million across a lifetime (Buescher et al. 2014), making ASD the costliest medical condition to support (Knapp et al. 2009). More importantly, when com-pared to neuro-typical individuals, individuals with ASD have been shown to score considerably lower on indicators of life-quality and are less likely to be in paid employment,

have rewarding social lives or achieve full independence from their families (Howlin et al. 2004). This highlights the significance of providing successful yet cost effective inter-ventions, which should be based solely upon sound empiri-cal evidence and guided by current evidence based practice (EBP).

Research has indicated that best practice in autism inter-ventions should involve strategies based upon the princi-ples of applied behaviour analysis (ABA) (Makrygianni and Reed 2010; Reichow 2012; Reichow et al. 2018). ABA is an applied science aiming to determine environmental variables that shape socially significant behaviour and design inter-ventions accordingly. Teaching strategies derived from these principles have been identified as EBP (e.g., early intensive behavioural intervention, discrete trial training, functional communication training, functional behavioural assessment, extinction, naturalistic intervention, pivotal response train-ing and task analysis) (Wong et al. 2014).

However, the vast majority of European governments do not fund ABA-based provision; estimates suggest only a third of children with ASD currently access behavioural interventions across Europe (Salomone et  al. 2014). In the UK, where an ‘eclectic’ and often ill-defined selec-tion of services is available, access to funded ABA can often be either a postcode lottery or a testament of parental

* Katerina Dounavi [email protected]

Jenny Ferguson [email protected]

Emma A. Craig [email protected]

1 School of Social Sciences, Education and Social Work, Queen’s University Belfast, 69-71 University Street, Belfast, Northern Ireland BT7 1HL, UK

Page 2: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

583Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

willingness to fight for services at tribunal (Dillenburger 2011; Keenan et al. 2015).

Another barrier to successful ABA treatment is a lack of appropriately trained professionals. To qualify as a Board Certified Behaviour Analyst (BCBA©) individuals must complete Master’s level training in behaviour analy-sis, undertake an extensive period of supervised practice and pass an exam (BACB 2014). Working under an appro-priately qualified supervisor has been shown to correlate with implementation fidelity, therapist job satisfaction and positive child outcomes (Plantiveau et al. 2018; Whiteford et al. 2012; Eikeseth et al. 2008). Difficulties in accessing this expertise is very problematic. In the UK there are cur-rently 314 BCBAs (BACB 2018); considering the number of individuals diagnosed with ASD is estimated to be 695,000 (National Autistic Society 2017), the ratio of 1 BCBA per 2213 individuals with ASD is worryingly small. These shortages are magnified in remote areas of the country, where the lack of local services results in parents travelling long distances to avail of the expertise of qualified profes-sionals. Parents of children with ASD living in rural areas have shown lower levels of service satisfaction and greater difficulties in accessing professional expertise when com-pared with their urban counterparts (Bulgren 2002; Mur-phy and Ruble 2012), highlighting the need to update the existing service dissemination model. Whilst it is clear that ABA-based services present best outcomes for individuals with ASD, it is not clear how best to resolve the gap between needs and service access. Alternative models of intervention and training should be explored which may extend the reach beyond a traditional face-to-face model; telehealth has the potential to do this.

Telehealth is the use of communication technology to assist in education and treatment of health related condi-tions. The availability of internet connections has been grow-ing exponentially in recent years. Current estimates suggest that 88% of all people in the UK accessed the internet at some point in the last 3 months (Office of National Statistics 2016). Researchers have capitalised on these advancements and demonstrated their usefulness for the delivery of health related interventions. These interventions utilise technology to provide remote communication, advice and training using tele-communications software and technology based train-ing platforms. The application of telehealth has been inves-tigated across numerous conditions, such as haemophilia, diabetes, heart disease and depression (Kessler et al. 2009; Webb et al. 2010), proving to be a promising advancement in healthcare government initiatives across the UK (Depart-ment of Health 2011; Department of Health, Social Services and Public Safety, Department of Health Northern Ireland 2011; Scottish Government 2011).

An initial examination of the literature indicated that there has been an emergence of a body of research

investigating the use of telehealth to provide behaviour analytic provisions to individuals with ASD and the initial findings appear promising; telehealth was shown to reduce costs associated with providing behaviour analytic inter-ventions by up to half (Horn et al. 2016; Lindgren et al. 2015) and was viewed favourably by parents living in rural communities (Salomone et al. 2017). However, a more extensive review capable of identifying the scope, effec-tiveness and limitations of using telehealth was required. To date there have been five published reviews summa-rising the body of literature in this area, these reviews have either been too broad (Boisvert et al. 2010; Knutsen et al. 2016) or too narrow (Meadan and Daczewitz 2015; Neely et al. 2016; Parsons et al. 2017). The subsequent paragraphs will discuss the limitations of these reviews in more detail identifying why a specific systematic review in this area in warranted.

Current reviews have not focused specifically on ABA-based interventions and have instead involved overarching reviews including research from wider fields, such as, educa-tion, occupational therapy or speech and language therapy. Boisvert et al. (2010) included five ABA-based studies in an overarching review of telehealth based support for indi-viduals with ASD and more recently Knutsen et al. (2016) identified 17 studies that utilised ABA-based interventions amongst a broader review of literature. The selected research investigated Functional Analysis (FA) and associated Func-tional Communication Training (FCT) (e.g., Barretto et al. 2006; Wacker et al. 2013a, b) or naturalistic teaching strate-gies (e.g. Vismara et al 2009, 2012, 2013). Outcomes varied within and between studies and individual differences were apparent in interventionist implementation fidelity and child outcomes (e.g. Meadan et al. 2016; Vismara et al. 2013). Despite these reviews indicating that practical limitations can be overcome, an ABA specific review by trained behav-iour analysts will allow for a unique analysis of the method-ology and outcomes reported in selected research.

Past reviews have also been limited to research utilising a parent training approach only (Meadan and Daczewitz 2015; Parsons et al. 2017). Meadan and Daczewitz (2015) selected six studies for their review, five of which were ABA-based interventions. Outcomes indicated that telehealth was an effective platform for parent training, increasing both par-ent’s knowledge and implementation skills. Parsons et al. (2017). ) reviewed research in using telehealth to conduct parent training in rural communities. The authors reviewed nine studies, all of which were behaviour analytic in nature, and concluded that, whilst parent training should be consid-ered a crucial factor in intervention and has itself been iden-tified as an EPB in the treatment of individuals with ASD (Wong et al. 2014), a more comprehensive review would provide a better insight into wider applications of telehealth across interventionists and beyond the home environment.

Page 3: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

584 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

The most recent review focused on procedural fidelity and only selected studies that contained this measure (Neely et al. 2017). The authors concluded that all studies showed increases in interventionist implementation fidelity, demonstrating tel-ehealth can be an effective platform. Admittedly, fidelity is an important factor for methodological rigor and high fidelity has been linked with optimal outcomes (Penn et al. 2007; Symes et al. 2006; Whiteford et al. 2012), however research focusing on outcomes for participants with ASD alone was overlooked.

Additionally, only one review to date investigated the qual-ity of the included research (Parsons et al. 2017). Measures of research quality are essential as they allow for the assessment of research validity and indicate ability to minimise research errors and bias. Although Parsons et al. (2017) utilised a measure capable of simultaneously assessing the quality of multiple study designs, questions were more geared towards group designs and were somewhat subjective in nature (Kmet et al. 2004). Overall assignments of level of evidence were conducted using a separate grading system where single-sub-ject research was automatically scored as the lowest level of evidence (National Health Medical Research Council 1999). ABA-based interventions are highly heterogeneous in nature; individuality of programming is prioritised over consistency of service between participants, allowing for optimal individual progress. Finding a quality rating capable of equitably com-paring single subject and group research designs is paramount when assessing EBP. One such rating is the Evaluative Method for Evaluating and Determining Evidence-Based Practices in Autism (Reichow 2011; Reichow et al. 2008) which includes rubrics allowing to assess key indicators of quality in both single subject and group research designs. Scores on these rubrics can be combined to provide an overall level of EBP for the selected population.

The purpose of the current study is to systematically review and synthesise extant literature studying the effects of using telehealth to provide ABA-based provisions to indi-viduals with a diagnosis of ASD. Main intervention com-ponents and outcomes will be extracted and combined to provide an overall picture of research aims, procedures, par-ticipants and effects. This will allow for analysis of success and identification of gaps in the literature. The Evaluative Method for Evaluating and Determining Evidence-Based Practices in Autism will be used to assess the methodologi-cal rigor of each study leading to an overall estimation of the status of telehealth as an EBP for the provision of ABA services to individuals with ASD.

Method

Commencing in October 2017 with search dates ending in February 2018, we conducted a systematic search using four databases, ERIC, Medline, PsycInfo and Scopus. The review

was conducted following the PRISMA checklist as a guide (Moher et al. 2009). Identified studies were screened by title and abstract, then merged with duplicates removed, followed by full text screening. Additionally, references of included studies and reviews on the topic were hand searched. A descriptive synthesis of eligible studies was then completed summarising the main objectives, variables and outcomes of each study. All selected studies were assessed for quality using standards set out by Reichow et al. (2008).

Search Terms

Search terms included Autis* OR ASD OR Asperger OR PDD-NOS OR Developmental Disabil* AND Telehealth OR Telemedicine OR Teleconferencing OR Telecare OR Elearn* OR Distance Learn* (Fig. 1).

Inclusion and Exclusion Criteria

For inclusion in the review, articles were examined against the following inclusion criteria: (1) peer review published journal article, (2) study involved telehealth technology in the provision of training, supervision or consultation to interventionists (parents or professionals) utilising behav-ioural principles in the treatment or education of at least one participant with a diagnosis of ASD, Asperger’s or PDD, (3) study was original empirical research with quantitative data and a primary analysis of the effect of an intervention conducted via telehealth and (4) was written in the English language.

Studies were excluded from the review if: (1) they did not include original research, (2) telehealth technology did not include a two-way communication system with a profes-sional, (3) participants without a diagnosis of ASD or PDD were included and outcomes for the participants with ASD were not reported in isolation from other diagnoses.

Data Extraction

Full texts of selected studies were reviewed and informa-tion was extracted (Table 1). The following measures were examined in order to develop an overview of the main inter-vention characteristics present in the research: (1) research design (2) participant characteristics (3) technology descrip-tions (4) dependent variables (5) intervention characteristics. Additionally, efficacy outcomes were reported to determine the overall success of the interventions. Research quality was scored following a quality assessment (Reichow et al. 2008) to provide an indication of research rigor. Additional infor-mation was collected, including measures of inter-observer agreement (IOA), generalisation and follow-up data.

Page 4: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

585Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Reliability of Search Procedures and Inter‑coder Agreement (ICA)

To ensure internal validity within the review, the first and second authors independently assessed identified studies against inclusion and exclusion criteria. The two resulting

lists of eligible studies were subsequently compared. ICA was calculated by dividing the total number of agreed eligi-ble studies by the sum of all studies and multiplying by 100. A total number of two studies were disagreed upon leading to an ICA of 93%. Consensus was reached by discussing disagreements as a team leading to a final ICA of 100%

Fig. 1 PRISMA diagram show-ing search strategy

Page 5: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

586 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

Des

crip

tive

info

rmat

ion

from

sele

cted

stud

ies

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Bar

retto

et a

l. (2

006)

Sing

le su

bjec

t res

earc

h;

mul

ti el

emen

t des

ign

Inte

rven

tioni

sts: t

wo

fem

ales

, one

teac

her

and

one

psyc

holo

gist

No

ages

repo

rted

Parti

cipa

nts w

ith A

SD:

one

mal

eA

ge: 5

 yea

rsD

iagn

osis

: ASD

tool

no

t rep

orte

d

Iow

a C

omm

unic

atio

ns

Net

wor

k (I

CN

)C

amer

a th

at tr

ansm

itted

an

d re

cord

ed a

udio

an

d vi

sual

info

rma-

tion.

Tou

ch to

spea

k M

icro

phon

es D

eskt

op

with

Pow

erPo

int

Func

tiona

l ana

lysi

sB

rief f

unct

iona

l A

naly

sis c

ondu

cted

vi

a vi

deo

conf

eren

c-in

g. 5

 min

sess

ions

. Fr

ee p

lay,

esc

ape

and

alon

e. In

terv

entio

nists

re

ceiv

ed c

ontin

uous

liv

e vi

deo

conf

eren

ced

coac

hing

thro

ugho

ut

Inte

rven

tioni

st va

ri-ab

les:

non

e re

porte

dA

SD p

artic

ipan

t var

i-ab

les:

chi

ld d

isru

ptiv

e be

havi

our;

scre

amin

g,

nonc

ompl

ianc

e an

d pr

oper

ty d

estru

ctio

n

Posi

tive

Succ

essf

ul fu

nctio

nal

anal

ysis

iden

tified

es

cape

func

tion

for

beha

viou

r

Wea

k

Bar

kaia

et a

l. (2

017)

Sing

le su

bjec

t res

earc

h;

mul

tiple

bas

elin

e de

sign

Inte

rven

tion-

ists:

thre

e fe

mal

e th

erap

ists.

Age

: 24–

32

(M =

27 y

ears

)Pa

rtici

pant

s with

ASD

: th

ree

mal

esA

ge: 4

–6 y

ears

(M

= 5 

year

s 4 

mon

ths)

Dia

gnos

is: A

SD n

o di

agno

stic

tool

pro

-vi

ded

Lapt

ops a

nd w

ebca

ms

used

from

cen

treSk

ype

Vib

er/M

obile

pho

ne

used

for c

alls

. vid

eos

sent

to se

cure

d dr

opbo

x

Nat

ural

istic

teac

hing

Did

actic

trai

ning

: sp

oken

and

writ

ten

instr

uctio

ns d

escr

ib-

ing

man

d an

d ec

hoic

op

eran

ts, p

ract

ice

exer

cise

to d

iscr

imi-

nate

. 1–2

 hC

oach

ing:

vid

eo

conf

eren

ced

coac

hed

sess

ions

focu

sed

on

man

d tra

inin

g an

d ec

hoic

s, te

achi

ng c

on-

tinge

ncie

s of p

ositi

ve

cons

eque

nces

, fee

d-ba

ck a

nd p

rom

ptin

g op

portu

nitie

s. 10

 min

at

end

of c

oach

ing

sess

ion

reco

rded

for

anal

ysis

Inte

rven

tioni

st va

ri-ab

les:

fide

lity/

corr

ect

impl

emen

tatio

n of

se

quen

ce a

nd fe

ed-

back

Soci

al v

alid

ity q

uesti

on-

naire

ASD

par

ticip

ant:

man

ds

and

echo

ic re

spon

ses

Mix

edA

ll th

erap

ists i

ncre

ased

co

rrec

t com

man

ds

from

bas

elin

eSm

all i

ncre

ase

in

feed

back

for t

wo

parti

cipa

nts l

arge

r in

crea

se fo

r one

Leve

ls o

f fide

lity

wer

e lo

w <

60%

Mix

ed in

crea

ses i

n m

ands

and

ech

oics

Wea

k

Page 6: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

587Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Bea

rss e

t al.

(201

7)G

roup

rese

arch

des

ign;

qu

asi e

xper

imen

tal

pre-

post

test

with

no

com

paris

on g

roup

Inte

rven

tioni

sts: 1

3 pa

rent

sG

ende

r not

spec

ified

Age

s: m

othe

rs

(M =

38.3

), fa

ther

s (M

= 39

.8)

Not

cle

ar w

hich

par

ent

took

par

t in

trial

Parti

cipa

nts w

ith A

SD:

13, 9

mal

es, 5

fem

ales

Age

: (M

= 5.

8 ye

ars)

Dia

gnos

is: A

SD D

iag-

nosti

c to

ol: A

DO

S

Equi

pmen

t: C

ompu

ters

, sc

anne

rs, p

roje

ctor

s, ca

mer

as. N

o de

taile

d sp

ecifi

cs re

porte

dV

ideo

conf

eren

cing

So

ftwar

e: n

ot re

porte

d

Beh

avio

ur su

ppor

t6-

mon

th d

irect

instr

uc-

tion

pare

nt tr

aini

ng

prog

ram

des

igne

d to

te

ach

pare

nts b

ehav

-io

ur m

anag

emen

t str

ateg

ies,

cond

ucte

d vi

a vi

deoc

onfe

renc

-in

g. T

rain

ers f

ollo

wed

m

anua

lised

trai

ning

te

chni

ques

incl

udin

g sc

ripts

and

vid

eos

Inte

rven

tioni

st va

ri-ab

les:

trea

tmen

t fide

l-ity

che

cklis

tC

oach

es ra

tings

of

succ

ess

Pare

nt tr

eatm

ent

enga

gem

ent s

cale

Tele

heal

th c

areg

iver

sa

tisfa

ctio

n su

rvey

Tele

heal

th p

rovi

der

satis

fact

ion

surv

eyH

ome

Situ

atio

ns

Que

stion

naire

-ASD

Pa

rent

Sat

isfa

ctio

n Q

uesti

onna

ireA

SD p

artic

ipan

t var

i-ab

leV

inel

and

Ada

ptiv

e B

ehav

iour

Che

cklis

tsA

bhor

rent

beh

avio

ur

chec

klist

Mix

edH

igh

pare

nt a

ccep

t-ab

ility

Trai

ners

scor

ed h

igh

leve

ls o

f fide

lity

train

-in

g vi

a te

lehe

alth

No

sign

ifica

nt d

iffer

-en

ces i

n sc

ore

of

Vin

elan

dSi

gnifi

cant

impr

ove-

men

ts o

n th

e So

cial

W

ithdr

awal

, Ste

reo-

typi

esH

yper

activ

ity, a

nd

Inap

prop

riate

Spe

ech

subs

cale

s of t

he

Abh

orre

nt b

ehav

iour

ch

eckl

ist

Wea

k

Page 7: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

588 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Ben

son

et a

l. (2

017)

Sing

le su

bjec

t res

earc

h de

sign

; mul

ti el

emen

t/fo

llow

ed b

y an

ABA

B

reve

rsal

des

ign

Inte

rven

tioni

stsFa

mili

es o

f ASD

par

-tic

ipan

t no

info

rma-

tion

prov

ided

Parti

cipa

nts w

ith A

SD:

one

mal

eA

ge: 5

 yea

rsD

iagn

osis

: ASD

di

agno

stic

tool

not

re

porte

d

Del

l™ D

eskt

op c

om-

pute

rex

tern

al L

ogite

ch

cam

era

and

Han

gout

s™ c

om-

mun

icat

ions

plat

form

for v

ideo

co

nfer

enci

ngD

ebut

vid

eoC

aptu

res s

oftw

are

to

reco

rd se

ssio

ns

Func

tiona

l Ana

lysi

s and

fu

nctio

nal c

omm

uni-

catio

n tra

inin

gH

ome

base

d as

sess

men

t an

d In

terv

entio

n co

m-

plet

ed b

y pa

rent

s with

vi

deo

conf

eren

ced

coac

hed

train

ing.

Pa

rtici

pant

s wer

e liv

e co

ache

d th

roug

h th

e fu

nctio

nal a

naly

sis

This

was

follo

wed

by

FCT

Bas

elin

e co

n-si

sted

of p

artic

ipan

t be

ing

give

n ac

cess

to

mai

ntai

ning

rein

-fo

rcem

ent (

tang

ible

) af

ter e

xhib

iting

SIB

. Th

e ch

ild w

as th

en

prom

pted

to u

se

pict

ure

card

as F

CT

to

rece

ive

the

item

. Par

-en

ts w

ere

live

coac

hed

thro

ugho

ut

Inte

rven

tioni

st va

riabl

esFi

delit

y of

par

ent

proc

edur

es a

gain

st ta

sk a

naly

sis o

f the

as

sess

men

t and

trai

n-in

g ph

ases

ASD

par

ticip

ant v

ari-

able

sSI

B b

ehav

iour

, fac

e sl

appi

ngM

ands

by

touc

hing

or

hand

ing

over

com

-m

unic

atio

n ca

rd

Posi

tive

SIB

dec

reas

ed a

fter

inte

rven

tion

intro

-du

ced

and

rem

erge

d up

on re

turn

to

base

line

and

man

ds

incr

ease

d an

d de

crea

sed

on re

turn

to

base

line

Wea

k

Gib

son

et a

l. (2

010)

Sing

le su

bjec

t res

earc

h de

sign

; ABA

B re

ver-

sal d

esig

n

Inte

rven

tioni

ststw

o fe

mal

es, o

ne p

re-

scho

ol te

ache

r, on

e te

achi

ng a

ssist

ant

Age

s not

pro

vide

dPa

rtici

pant

s with

ASD

one

mal

eA

ge: 4

 yea

rsD

iagn

osis

: ASD

di

agno

stic

tool

not

re

porte

d

Lap

top

with

dig

ital

cam

era

with

inbu

ilt

mic

roph

one.

Sky

peD

ell L

atitu

de D

820

note

book

com

pute

r w

ith a

Mic

roso

ft W

indo

ws X

PLo

gite

ch Q

uick

cam

Func

tiona

l com

mun

ica-

tion

train

ing

Witt

en d

irect

instr

uc-

tions

em

aile

d, in

clud

-in

g a

task

ana

lysi

s of

inte

rven

tion.

Vid

eo

cons

ulta

tion

took

pl

ace

just

befo

re

and

afte

r pro

vide

d de

scrip

tive

feed

back

Chi

ld ta

ught

to ra

ise

hand

to a

cces

s esc

ape

and

toys

dur

ing

circ

le

time

Inte

rven

tioni

st va

ri-ab

les:

Non

e re

porte

dA

SD p

artic

ipan

t var

i-ab

les

Elop

emen

t of A

SD p

ar-

ticip

ant f

rom

ass

igne

d w

ork

area

Posi

tive

ABA

B d

esig

n sh

owed

cl

ear r

etur

n to

bas

e-lin

e an

d im

prov

emen

t in

trea

tmen

t con

ditio

n

Wea

k

Page 8: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

589Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Hei

tzm

an-P

owel

l et a

l. (2

014)

Gro

up re

sear

ch d

esig

n;

quas

i exp

erim

enta

l de

sign

with

pre

-pos

t te

st, n

o co

mpa

rison

gr

oup

Inte

rven

tioni

stsse

ven

pare

nts f

rom

four

fa

mili

es, g

ende

rs n

ot

prov

ided

Age

s: 3

2–47

 yea

rs.

(M =

37.3

 yea

rs)

Parti

cipa

nts w

ith A

SD:

no d

etai

ls p

rovi

ded,

re

ferr

ed a

s ‘ch

ildre

n w

ith a

utis

m’ i

n th

e ab

strac

t onl

y

Onl

ine

train

ing

deliv

-er

ed th

roug

h an

onl

ine

lear

ning

man

agem

ent

syste

mPo

lyco

vid

eoco

nfer

-en

cing

softw

are

Com

preh

ensi

veTr

aini

ng p

acka

ge o

n pr

inci

ples

of A

BA

deliv

ered

thro

ugh

an o

nlin

e le

arni

ng

plat

form

OA

SIS.

Pr

e an

d po

st tra

inin

g kn

owle

dge

asse

ss-

men

ts c

ompl

eted

Vid

eo-c

onfe

renc

ed

coac

hing

sess

ions

w

ith d

iscu

ssio

n of

the

topi

c an

d liv

e co

ache

d se

ssio

ns w

ith p

artic

i-pa

nts o

wn

child

Inte

rven

tioni

st va

riabl

esPa

rent

skill

Ass

essm

ent

(Fid

elity

) com

plet

ed

befo

re a

nd a

fter

train

ing.

Sco

red

from

vi

deot

aped

sess

ion

Pare

nt K

now

ledg

e Te

stPa

rent

Sat

isfa

ctio

n w

ith

the

train

ing

ASD

par

ticip

ant v

ari-

able

s: n

one

Und

eter

min

edPa

rent

al g

ains

on

know

ledg

e an

d fid

elity

w

ere

repo

rted

and

appe

ared

hig

h, n

o st

atist

ical

mea

sure

s of

this

cha

nge

wer

e re

porte

d

Wea

k

Page 9: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

590 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Hig

gins

et a

l. (2

017)

Sing

le su

bjec

t res

earc

h de

sign

; mul

tiple

bas

e-lin

e de

sign

Inte

rven

tioni

sts: t

hree

fe

mal

e di

rect

-car

e st

aff. A

ll w

orke

d in

EI

BI f

or le

ss th

an

6 m

onth

s no

expe

ri-en

ce w

ith p

refe

renc

e as

sess

men

tsA

ge: 2

1–24

 yea

rs

(M =

22.6

6 ye

ars)

Parti

cipa

nts w

ith A

SD:

two

mal

es a

nd o

ne

fem

ale

Age

: 4–5

 yea

rs

(M =

4 ye

ars)

Dia

gnos

is: A

SD

diag

nosti

c to

ol n

ot

repo

rted

No

pre-

inte

rven

tion

asse

ssm

ent i

nfor

ma-

tion

prov

ided

Ado

be C

onne

ct 8

vi

deoc

onfe

renc

ing

softw

are

Secu

re fi

le e

ncry

pted

fil

e tra

nsfe

rrin

g so

ftwar

eLa

ptop

com

pute

r and

Lo

gite

ch W

ebca

m

Softw

are

v2.2

Pref

eren

ce a

sses

smen

tsPa

rtici

pant

s tau

ght t

o ad

min

ister

pre

fere

nce

asse

ssm

ents

via

vid

eo

conf

eren

cing

Parti

cipa

nts g

iven

ac

cess

to w

ritte

n in

struc

tions

prio

r to

vide

o co

nfer

enci

ngB

asel

ine

take

n on

im

plem

enta

tion

of

thes

e in

struc

tions

. Fi

rst b

asel

ine

was

co

nduc

ted

usin

g A

SD p

artic

ipan

t, al

l su

bseq

uent

trai

n-in

g in

volv

ed u

sing

a

conf

eder

ate

acto

r. Tr

aini

ng c

ompo

sed

of

mul

ti-m

edia

pre

sent

a-tio

n. F

eedb

ack

on

prev

ious

per

form

ance

an

d on

role

pla

y pr

actic

e se

ssio

ns.

Follo

wed

by

an

asse

ssm

ent a

nd tw

o po

st tra

inin

g as

sess

-m

ents

, one

with

ASD

pa

rtici

pant

Inte

rven

tioni

st pa

rtici

-pa

nts:

per

cent

age

of

mas

tere

d co

mpo

nent

sSo

cial

val

idity

que

stion

-na

ireA

SD p

artic

ipan

t var

i-ab

les:

non

e

Posi

tive

Incr

ease

d fid

elity

for

all p

artic

ipan

ts in

the

impl

emen

tatio

n of

sk

ills,

how

ever

onl

y th

ree

data

poi

nts w

ere

com

plet

ed w

ith P

ar-

ticip

ants

with

ASD

Wea

k

Page 10: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

591Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Inge

rsol

l and

Ber

ger

(201

5)G

roup

rese

arch

des

ign;

ra

ndom

ly a

ssig

ned

com

paris

on g

roup

Inte

rven

tioni

sts: 2

7 pa

rent

s, 96

% fe

mal

eA

ge: n

ot re

porte

dPa

rtici

pant

s with

ASD

: 27

par

ticip

ants

70%

m

ale

Age

: 23–

73 m

onth

s. (M

= 3.

7 ye

ars)

Dia

gnos

is: A

SD d

iag-

nosti

c to

ols:

AD

OS,

D

SM-I

V-TR

Tele

heal

th g

roup

n =

14

Com

paris

on g

roup

n =

13Pr

e in

terv

entio

n as

sess

-m

ent:

info

rmat

ion

on

verb

al m

enta

l age

, no

n-ve

rbal

men

tal a

ge

and

via

Mul

len

scal

e of

Ear

ly L

earn

ing

Hom

e co

mpu

ters

and

w

ebca

ms

ImPA

CT

onlin

e tra

inin

g w

ebsi

te a

s per

Inge

r-so

ll et

 al.

(201

6)Sk

ype

Nat

ural

istic

teac

hing

ImPA

CT

onlin

e tra

inin

g de

sign

ed to

incr

ease

so

cial

com

mun

icat

ion

Gro

up 1

: pro

vide

d w

ith

acce

ss to

web

site

for

6 m

onth

sW

ebsi

te c

onsi

sted

of

11 ×

75 m

in le

sson

s, vi

deo

libra

ry, e

xer-

cise

s and

add

ition

al

reso

urce

sG

roup

2: i

n ad

ditio

n to

th

e w

ebsi

te p

artic

i-pa

nts w

ere

prov

ided

w

ith 2

x w

eekl

y 30

 min

vid

eo c

onfe

r-en

cing

sess

ion

with

tra

ined

coa

chO

ne se

ssio

n in

trodu

ced

the

topi

c th

e se

cond

pr

ovid

ed li

ve fe

edba

ck10

-min

reco

rdin

g of

pa

rent

/chi

ld in

tera

c-tio

n du

ring

play

or

snac

k sc

ored

at

base

line,

pos

t tre

at-

men

t and

at 3

mon

ths

follo

w u

p

Inte

rven

tioni

st va

riabl

es: d

epre

ssiv

e sy

mpt

oms o

f par

ents

Inte

rven

tion

know

ledg

eIn

terv

entio

n fid

elity

Prog

ram

eng

agem

ent

Prog

ram

eva

luat

ion

ASD

par

ticip

ant v

ari-

able

s: N

one

Posi

tive

Pare

nt a

ssist

gro

up

mor

e lik

ely

to e

ngag

e w

ith th

e w

ebsi

tePa

rent

eng

agem

ent h

igh

for b

oth

grou

psB

oth

grou

ps si

gnifi

-ca

ntly

incr

ease

d th

eir

inte

rven

tion

know

l-ed

ge a

nd fi

delit

y, th

e vi

deo

coac

hed

grou

ps

had

sign

ifica

ntly

hi

gher

scor

es o

f fide

l-ity

pos

t tre

atm

ent

Wea

k

Page 11: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

592 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Inge

rsol

l et a

l. (2

016)

Gro

up re

sear

ch d

esig

n;

rand

omly

ass

igne

d co

mpa

rison

gro

upQ

uasi

exp

erim

enta

l pr

e-po

st an

alys

is fo

r w

ithin

gro

up a

naly

sis

Inte

rven

tioni

st pa

rtici

-pa

nts:

27

pare

nts

Ther

apist

Ass

isted

G

roup

(n =

14)

Self-

Dire

cted

gro

up

(n =

13)

Gen

der a

nd a

ge n

ot

prov

ided

Parti

cipa

nts w

ith A

SD:

ther

apist

ass

isted

gr

oup

(n =

14)

21%

fem

ale

and

79%

m

ale

Age

: (M

= 41

.57

mon

ths)

Self-

Dire

cted

gro

up

(n =

13)

13. 3

9% fe

mal

e an

d 61

% m

ale

Age

: (M

= 46

.08

mon

ths)

Dia

gnos

is: A

SD o

r PD

D-N

OS

Dia

gnos

tic to

ol: D

SM-

IV a

nd A

DO

SPr

e-as

sess

men

t sco

res

on th

e M

ulle

n Sc

ale

of

Early

lear

ning

ImPA

CT

onlin

e tra

inin

g w

ebsi

te w

ith 1

2 se

lf-di

rect

ed le

sson

sV

ideo

con

fere

ncin

g so

ftwar

e no

t spe

cifie

d

Nat

ural

istic

teac

hing

ImPA

CT

onlin

e tra

inin

g de

sign

ed to

incr

ease

so

cial

com

mun

icat

ion.

C

ompa

rison

of t

wo

grou

ps, o

ne u

tilis

ing

vide

o co

nfer

enci

ng o

n to

p on

onl

ine

train

ing

Gro

up 1

: pro

vide

d w

ith

acce

ss to

web

site

for 6

m

onth

sW

ebsi

te c

onsi

sted

of

11 ×

75 m

in le

sson

s, vi

deo

libra

ry, e

xer-

cise

s and

add

ition

al

reso

urce

sG

roup

2: i

n ad

ditio

n to

th

e w

ebsi

te p

artic

i-pa

nts w

ere

prov

ided

w

ith 2

x w

eekl

y 30

 min

vid

eo c

onfe

r-en

cing

sess

ion

with

tra

ined

coa

ch

Inte

rven

tioni

st va

ri-ab

les:

par

ent i

nter

ven-

tion

fidel

ityFa

mily

Impa

ct q

uesti

on-

naire

(soc

ial v

alid

ity)

ASD

par

ticip

ant

varia

bles

: rat

e of

use

of

indi

vidu

alis

ed

lang

uage

targ

ets,

prom

pted

and

in

depe

nden

t use

of

lang

uage

scor

edM

acA

rthur

Bat

es C

om-

mun

icat

ion

Dev

el-

opm

ent I

nven

tory

(P

aren

t sco

red)

Vin

elan

d A

dapt

ive

Beh

avio

ur sc

ales

(par

-en

t sco

red)

Posi

tive

Sign

ifica

nt p

re v

s pos

t-te

st in

crea

se in

par

ent

use

of in

terv

entio

n sc

ores

of fi

delit

y fo

r bo

th g

roup

sTh

erap

ist a

ssist

ed g

roup

sc

ored

sign

ifica

ntly

hi

gher

at p

ost i

nter

-ve

ntio

n fid

elity

but

th

is d

id n

ot h

old

for 3

m

onth

follo

w u

pIn

crea

se in

par

enta

l sc

ores

of s

elf-

effica

cy

and

decr

ease

in p

aren

-ta

l stre

ssSi

gnifi

cant

lang

uage

in

crea

ses i

n ch

ild la

n-gu

age

use

over

tim

e fo

r lan

guag

e ta

rget

s Sm

all s

igni

fican

t eff

ect f

or g

roup

, the

ra-

pist

assi

sted

grou

p sc

ored

slig

htly

bet

ter

MC

DI a

nd v

inel

and

scor

e si

gnifi

cant

ly

incr

ease

d

Wea

k

Page 12: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

593Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Kur

avac

kel e

t al.

(201

8)G

roup

rese

arch

des

ign;

ra

ndom

ised

con

trol

trial

Inte

rven

tioni

st: 3

3 pa

rent

sN

o ge

nder

or a

ge

repo

rted

Parti

cipa

nts w

ith A

SD33

par

ticip

ants

, sev

en

mal

es a

nd 2

6 fe

mal

esFa

ce to

face

com

paris

on

grou

p (n

= 13

)A

ge: 5

0–14

8 m

onth

s (M

= 10

4.62

mon

ths)

Wai

t list

com

paris

on

grou

p (n

= 10

)A

ge: 3

9–15

3 m

onth

s (M

= 10

1.8 

mon

ths)

Tele

heal

th g

roup

(n

= 10

)A

ge: 4

3–12

2 m

onth

s (M

= 82

.3 m

onth

s)D

iagn

ostic

tool

: M

odifi

ed C

heck

list f

or

Aut

ism

in T

oddl

ers

(M-C

HA

T), S

ocia

l C

omm

unic

atio

n Q

ues-

tionn

aire

(SC

Q),

DSM

-IV

and

A

DO

S

No

info

rmat

ion

pro-

vide

dPo

sitiv

e be

havi

our

supp

ort/b

ehav

iour

m

anag

emen

tR

ando

mis

atio

n to

face

-to

-face

, tel

ehea

lth

or w

aitli

st co

ntro

l. Pa

rent

s pro

vide

d w

ith

know

ledg

e of

ASD

, an

d ev

iden

ce b

ased

pr

actic

es. D

eliv

ered

vi

a te

lehe

alth

vid

eo

conf

eren

cing

in e

ither

a

grou

p or

indi

-vi

dual

ised

form

at. A

m

anua

lised

cop

y of

tra

inin

g pr

oced

ures

al

so p

rovi

ded

Inte

rven

tioni

st va

ri-ab

les:

par

enta

l stre

ss

inde

xB

eing

a p

aren

t sca

leC

onsu

ltatio

n sa

tisfa

c-tio

n qu

estio

nnai

reG

roup

sess

ion

ratin

g sc

ale

Pare

nt fi

delit

y ra

ting

form

ASD

par

ticip

ant v

aria

-bl

es: E

YEB

ERG

chi

ld

beha

viou

r inv

ento

ryM

odifi

ed c

heck

list f

or

autis

m in

todd

lers

Soci

al C

omm

unic

atio

n qu

estio

nnai

re

Mix

edSi

gnifi

cant

diff

eren

ce in

ch

ild p

robl

em b

ehav

-io

ur sc

ores

No

effec

ts o

n pa

rent

ou

tcom

es

Wea

k

Page 13: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

594 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Lind

gren

et a

l. (2

015)

Gro

up re

sear

ch d

esig

n;

quas

i-exp

erim

enta

l de

sign

with

com

-pa

rison

gro

ups,

no

rand

om a

ssig

nmen

t

Inte

rven

tioni

st; 5

0 pa

rent

’s g

ende

rs n

ot

prov

ided

Age

: 23–

51 y

ears

old

Parti

cipa

nts w

ith A

SD:

Gro

up 1

did

not

mee

t in

clus

ion

crite

ria fo

r A

SD d

iagn

osis

as

outc

omes

wer

e no

t re

porte

d se

para

tely

Gro

up 2

: 20

parti

ci-

pant

s, 19

mal

es a

nd

one

fem

ale

Age

: 29–

80 m

onth

s (M

= 50

.3 m

onth

s)G

roup

3: 3

0 pa

rtici

pant

sA

ge: 2

1–84

 mon

ths

(M =

50.3

)D

iagn

osis

: ASD

, di

agno

stic

tool

not

re

porte

d

Tele

heal

th w

orks

tatio

ns

equi

pped

with

Win

-do

ws b

ased

PC

, vid

eo

mon

itor a

nd h

eads

etSk

ype

Func

tiona

l Ana

lysi

s and

Fu

nctio

nal c

omm

uni-

catio

n tra

inin

gG

roup

2 p

aren

ts w

ere

coac

hed

via

tele

heal

th

to c

ondu

ct F

As

and

com

plet

e FC

T in

terv

entio

ns in

clin

ic

setti

ngG

roup

3 c

ondu

cted

in

hom

e se

tting

Inte

rven

tioni

st va

ri-ab

les:

acc

epta

bilit

y ra

tings

of t

he in

ter-

vent

ion

ASD

par

ticip

ant v

ari-

able

s: %

redu

ctio

n in

pr

oble

m b

ehav

iour

% in

crea

se in

man

ds%

incr

ease

in ta

sk

com

plet

ion

Posi

tive

Posi

tive

outc

omes

re

porte

d fo

r red

uc-

tion

and

incr

ease

s in

all

DV

s usi

ng

with

in g

roup

ana

lysi

s, ho

wev

er n

o st

atist

i-ca

l pre

-pos

t ana

lysi

s co

mpl

eted

No

sign

ifica

nt d

iffer

-en

ces b

etw

een

hom

e an

d ce

ntre

bas

ed

grou

ps fo

und

afte

r A

NO

VA

Wea

k

Mac

halic

ek e

t al.

(200

9a)

No

expe

rimen

tal d

esig

nIn

terv

entio

nist:

thre

e gr

adua

te st

uden

ts in

sp

ecia

l edu

catio

nN

o ag

e or

gen

der

prov

ided

Parti

cipa

nts w

ith A

SD:

thre

e m

ale

parti

ci-

pant

sA

ge: 3

4 m

onth

s to

7 ye

ars (

M =

4 ye

ars

11 m

onth

s)D

iagn

osis

: tw

o A

SD

and

one

PDD

-NO

Sdi

agno

stic

tool

not

re

porte

d

Mac

Boo

kTM

lapt

opiS

ight

TM c

amer

asiM

acTM

des

ktop

iCha

tTM

vid

eoco

nfer

-en

cing

softw

are

Jabr

aTM

blu

etoo

thw

ire-

less

head

set

Pref

eren

ce A

sses

smen

tTr

aine

e te

ache

rs ta

ught

pa

ired

choi

ce p

refe

r-en

ce a

sses

smen

ts v

ia

vide

o co

nfer

enci

ngPa

rtici

pant

s pro

vide

d w

ith ta

sk a

naly

sis

Tria

ls w

ere

run

thro

ugh

vide

o co

nfer

enci

ng

with

feed

back

and

de

scrip

tive

erro

r cor

-re

ctio

n

Inte

rven

tioni

st va

riabl

es: fi

delit

y of

pr

oced

ures

Soci

al v

alid

ity o

f the

ta

skA

SD p

artic

ipan

t var

i-ab

les:

freq

uenc

y of

ite

ms c

hose

n

Und

eter

min

edN

o gr

aphe

d da

ta in

re

port,

teac

hers

wer

e re

porte

d to

reac

h 10

0% fi

delit

y w

ithin

tra

inin

g pe

riod

Wea

k

Page 14: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

595Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Mac

halic

ek e

t al.

(201

0)Si

ngle

subj

ect r

esea

rch

desi

gn; m

ultip

le

base

line

desi

gn w

ith

addi

tiona

l em

bedd

ed

mul

ti el

emen

t com

-po

nent

s

Inte

rven

tioni

sts: s

ix

teac

hers

all

fem

ale

Age

: 22–

32

(M =

27 y

ears

)Pa

rtici

pant

s with

ASD

: si

x pa

rtici

pant

sN

o ge

nder

s pro

vide

dA

ge: 4

–10 

year

s (M

= 6 

year

s)D

iagn

osis

5 A

SD, 1

w

ith a

utist

ic li

ke

beha

viou

rs D

iagn

ostic

to

ols n

ot re

porte

d

Mac

Boo

k la

ptop

with

ad

ditio

nal s

peak

ers

and

mic

roph

one

iSig

ht c

amer

aiM

ac d

eskt

op u

sed

to

film

ass

essm

ents

iCha

t sof

twar

e us

ed in

vi

deo

conf

eren

cing

Func

tiona

l ana

lysi

sD

urin

g ba

selin

e pa

r-tic

ipan

ts w

ere

film

ed

com

plet

ing

an F

A fo

r ea

ch c

ondi

tion

seve

ral

times

Dur

ing

vide

o co

nfer

-en

ce tr

aini

ng p

ar-

ticip

ants

wer

e gi

ven

perfo

rman

ce fe

edba

ck

in re

al ti

me

and

wer

e er

ror c

orre

cted

by

the

supe

rvis

or

Inte

rven

tioni

st Va

ri-ab

les:

teac

her fi

delit

y ag

ains

t a ta

sk a

naly

sis

for e

ach

cond

ition

Supe

rvis

or/c

oach

be

havi

our w

as

asse

ssed

for fi

delit

y ag

ains

t a p

re-d

eter

-m

ined

task

list

ASD

par

ticip

ant v

ari-

able

s: N

one

Posi

tive

All

teac

hers

dem

on-

strat

ed a

larg

e in

crea

se

in th

e fid

elity

of

treat

men

t and

reac

hed

fidel

ity c

riter

ion

Wea

k

Mac

halic

ek e

t al.

(201

6)Si

ngle

subj

ect r

esea

rch

desi

gn; m

ulti-

elem

ent/

alte

rnat

ing

treat

men

ts

Inte

rven

tioni

ststh

ree

pare

nts,

one

mal

e an

d tw

o fe

mal

es. A

ges

not r

epor

ted

Parti

cipa

nts w

ith A

SD:

thre

e pa

rtici

pant

sA

ge: 8

–16 

year

s (M

= 11

 yea

rs)

Dia

gnos

is: A

SDD

iagn

ostic

tool

: DSM

-VPr

e-as

sess

men

t inf

o re

porte

d C

hild

hood

A

utis

m R

atin

g Sc

ale

(CA

RS)

2.4

Ghz

/250

 GB

har

d dr

ive/

Supe

rDriv

e M

acB

ook™

Logi

tech

Qui

ckC

am P

ro 9

000™

Supe

rDriv

e Mac

Boo

k™

lapt

op c

ompu

ter w

ith

a bu

ilt-in

iSig

ht™

web

cam

era

iCha

t™ v

ideo

conf

er-

enci

ngso

ftwar

eeC

amm

™ c

all r

ecor

d-in

g so

ftwar

e

Func

tiona

l Ana

lysi

s, FC

T an

d B

ehav

iour

su

ppor

t stra

tegi

esPh

ase

one:

initi

al te

l-ec

onfe

renc

ed P

aren

ts

cond

ucte

d an

FA

with

te

lehe

alth

supp

ort,

prom

ptin

g, e

rror

-cor

-re

ctio

n an

d pr

aise

Phas

e tw

o: tr

eatm

ent

com

paris

on p

aren

ts

wer

e tra

inin

g in

in

divi

dual

ised

supp

ort

plan

s inv

olvi

ng: a

nte-

cede

nt st

rate

gies

, FC

T an

d D

RA

pro

cedu

res

Vid

eo m

odel

ling

via

tele

heal

th w

as u

sed

to d

emon

strat

e ea

ch

proc

edur

e

Inte

rven

tioni

st va

ri-ab

les:

par

enta

l fide

lity

of F

A p

roce

dure

s ta

ken

on 3

9%, 3

5%

and

35%

of F

A se

s-si

ons

Pare

ntal

pro

cedu

ral

fidel

ity fo

r 89%

, 100

%

and

100%

of F

CT

cond

ition

sSo

cial

Val

idity

que

s-tio

nnai

reA

SD p

artic

ipan

t var

i-ab

les:

occ

urre

nces

of

indi

vidu

alis

ed ta

rget

be

havi

our t

hat c

hal-

leng

es

Mix

edFu

nctio

nal a

naly

sis

indi

cted

func

tion

for e

ach

parti

cipa

nt,

alth

ough

un-

labe

lled

grap

hs m

ake

hard

to

dete

rmin

eC

halle

ngin

g be

havi

our

was

low

for a

ll co

ndi-

tions

but

ther

e w

as n

o cl

ear d

iffer

entia

tion

betw

een

cond

ition

s as

the

inte

rven

tion

was

im

plem

ente

d

Wea

k

Page 15: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

596 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Mac

halic

ek e

t al.

(200

9b)

Sing

le su

bjec

t res

earc

h de

sign

; mul

ti el

emen

t/al

tern

atin

g tre

atm

ents

Inte

rven

tioni

sts: t

wo

grad

uate

stud

ents

N

o ag

es o

r gen

der

prov

ided

Parti

cipa

nts w

ith A

SD:

two

fem

ale

parti

ci-

pant

sA

ge: 1

1 an

d 7 

year

sD

iagn

osis

: ASD

Dia

gnos

tic to

ol: c

hild

-ho

od ra

ting

scal

e

2.0

Ghz

Mac

-Boo

k™

lapt

op c

ompu

ters

with

M

ac O

S X

ope

ratin

g sy

stem

, 2 e

xter

nal

iSig

ht™

cam

eras

, iC

hat™

vid

eoco

nfer

-en

cing

softw

are

One

lapt

op c

ompu

ter

with

iSig

ht™

cam

era

Func

tiona

l ana

lysi

sSt

uden

ts w

ere

train

ed

to c

ondu

ct fu

nctio

nal

anal

ysis

via

live

vid

eo

conf

eren

ced

coac

hing

Inte

rven

tioni

st va

ri-ab

les:

non

eA

SD p

artic

ipan

t var

i-ab

le: i

ndiv

idua

lised

ta

rget

ed b

ehav

iour

th

at c

halle

nges

Posi

tive

Dem

onstr

ated

cle

ar

func

tion

of b

ehav

iour

fo

r bot

h pa

rtici

pant

s

Wea

k

Mea

dan

et a

l. (2

016)

Sing

le su

bjec

t res

earc

h de

sign

; mul

tiple

bas

e-lin

e de

sign

Inte

rven

tioni

sts: t

hree

fe

mal

e pa

rent

s Age

s no

t pro

vide

dPa

rtici

pant

s with

ASD

: th

ree

parti

cipa

nts,

two

mal

es a

nd o

ne fe

mal

eA

ge: 2

–4 (M

= 3)

Dia

gnos

is: A

SDD

iagn

ostic

tool

: pre

-sc

hool

lang

uage

scor

e an

d A

ges a

nd S

tage

s Q

uesti

onna

ire—

soci

al

emot

iona

l

iPad

s pro

vide

d to

fam

i-lie

s use

d fo

r vid

eo

reco

rdin

g Sk

ype

Elec

troni

c m

ater

ials

sh

ared

via

a se

cure

on

line

file

shar

-in

g B

ox. C

amta

sia

softw

are

to re

cord

se

ssio

ns

Nat

ural

istic

teac

hing

Inte

rnet

-Bas

ed P

aren

t-Im

plem

ente

d C

om-

mun

icat

ion

Stra

tegi

es

(i-Pi

CS)

Firs

t pha

se c

onsi

sted

of tr

aini

ng d

eliv

ered

w

ith a

coa

ch v

ia

skyp

e la

sting

45 

min

Seco

nd p

hase

was

dire

ct

coac

hing

thro

ugh

the

inte

rven

tion

whi

ch

invo

lved

a 5

-7-m

inut

e te

achi

ng se

ssio

n w

ith

the

ASD

par

ticip

ant

Coa

chin

g to

ok p

lace

tw

o tim

es p

er w

eek

and

an a

nnot

ated

vi

deo

feed

back

was

pr

ovid

ed e

very

4th

co

achi

ng se

ssio

n

Inte

rven

tioni

st va

ri-ab

les:

qua

lity

and

rate

w

ith w

hich

the

par-

ent’s

impl

emen

ted

the

natu

ralis

tic te

achi

ng

strat

egy

(Fid

elity

)A

SD p

artic

ipan

t var

i-ab

les:

chi

ldre

n’s s

ocia

l co

mm

unic

atio

n in

itia-

tions

and

resp

onse

sA

dditi

onal

fide

lity

test-

ing

on th

e co

achi

ng

and

train

ing

proc

e-du

res t

o as

certa

in

the

fidel

ity o

f the

co

achi

ng

Mix

edTh

erap

ists d

emon

strat

ed

an in

crea

se in

fide

lity

of im

plem

enta

tion-

on

of st

rate

gies

With

ver

y cl

ear r

elat

ions

hips

de

mon

strat

ed in

2 o

ut

of 3

day

sC

hild

ren’

s ini

tiatio

ns

incr

ease

d ov

er th

e in

terv

entio

n as

did

the

perc

enta

ge o

f suc

cess

-fu

l com

mun

icat

e-on

in

tera

ctio

ns fo

r 2 o

ut

of 3

par

ticip

ants

Wea

k

Page 16: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

597Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Nee

ly e

t al.

(201

6)Si

ngle

subj

ect r

esea

rch

desi

gn; m

ultip

le b

ase-

line

desi

gn

Inte

rven

tioni

sts: t

hree

fe

mal

es c

urre

ntly

w

orki

ng a

t Uni

vers

ity

ABA

clin

icA

ge: 2

0–22

(M =

21

year

s, 4 

mon

ths)

Parti

cipa

nts w

ith A

SD:

thre

e pa

rtici

pant

s, tw

o fe

mal

es a

nd o

ne m

ale

Dia

gnos

is: t

wo

with

A

SD d

iagn

osis

1 w

ith

PDD

-NO

S D

iagn

ostic

To

ols:

Par

ticip

ant

A sc

ores

on

AD

OS,

A

SRS

and

Pres

choo

l La

ngua

ge S

ale

Stud

ent B

onl

y A

SRS

repo

rted.

Stu

dent

C

had

no re

porte

d pr

e-in

terv

entio

n la

ngua

ge

outc

omes

ipad

min

i use

d to

reco

rd

sess

ions

Vid

eos s

ubse

quen

tly

dow

nloa

ded

onto

ex

tern

al h

ard-

driv

eV

see

softw

are

used

to

cond

uct v

ideo

con

fer-

ence

d us

ing

lapt

op2.

5-G

Hz

Tosh

ibaT

M

com

pute

r2.

4-G

Hz

Mac

Boo

kTM

All

inte

rven

tioni

sts u

sed

pers

onal

Mac

Boo

ksV

ideo

conf

eren

cing

so

ftwar

e, H

IPPA

-co

mpl

iant

Nat

ural

istic

/inci

dent

al

teac

hing

Pre-

inte

rven

tion

train

-in

g; o

nlin

e m

odul

e,

self-

eval

uatio

n an

d de

laye

d fe

edba

ck

vide

o m

odel

ling

5-m

in b

asel

ine

vide

os

of th

erap

ist w

orki

ng

on ta

rget

man

dFo

llow

ed b

y se

cond

vi

deo

whi

ch w

as

eval

uate

d fo

r fide

lity

inde

pend

ently

by

ther

apist

and

trai

ner

and

subs

eque

ntly

di

scus

sed

thro

ugh

vide

ocon

fere

ncin

g.

Add

ition

al m

aint

e-na

nce

prob

es w

ere

carr

ied

out 2

and

4

mon

ths a

fter fi

delit

y re

ache

d

Inte

rven

tioni

st va

ri-ab

les:

freq

uenc

y of

co

mm

unic

atio

n op

portu

nitie

sPe

rcen

tage

of i

ncid

enta

l te

achi

ng st

eps p

er-

form

ed c

orre

ctly

Scor

es o

n so

cial

val

idity

Tota

l dur

atio

n of

trai

n-in

gA

SD p

artic

ipan

t var

i-ab

le: c

hild

man

ds

Posi

tive

All

ther

apist

s inc

reas

ed

corr

ect i

mpl

emen

ta-

tion

of in

cide

ntal

te

achi

ng a

nd re

ache

d fid

elity

All

Parti

cipa

nts w

ith

ASD

incr

ease

d m

and-

ing

Ade

quat

e

Page 17: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

598 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Sim

acek

et a

l. (2

017)

Sing

le su

bjec

t res

earc

h de

sign

; mul

ti el

emen

t al

ongs

ide

a m

ultip

le

prob

e m

ultip

le b

ase-

line

and

ABA

B re

ver-

sal f

or fi

rst b

asel

ine

Inte

rven

tioni

st Pa

rtici

-pa

nts:

par

ents

of t

he

ASD

indi

vidu

als n

o de

tails

wer

e pr

ovid

edPa

rtici

pant

s with

ASD

: tw

o fe

mal

es p

artic

i-pa

nts

Age

: 3.5

and

4 y

ears

Dia

gnos

is: A

SDD

iagn

ostic

tool

not

re

porte

dFu

nctio

nal a

sses

s-m

ent a

nd st

ruct

ured

de

scrip

tive

asse

ssm

ent

com

plet

ed p

rior t

o in

terv

entio

nSc

ores

of V

AB

S,

Vin

elan

d pa

rent

in

terv

iew

repo

rted

alon

gsid

e pr

evio

us

and

curr

ent s

ervi

ces

incl

udin

g EI

BI f

or o

ne

parti

cipa

nt

Del

l Opt

iPle

x30

10 D

eskt

op w

ith

Del

l 24i

n m

onito

r, Lo

gite

ch H

D P

roW

ebca

m C

920,

Log

-ite

ch C

lear

Cha

t Com

-fo

rt/U

SB H

eads

etH

390

Goo

gle

Han

gout

for

vide

o co

nfer

enci

ngD

ebut

scre

en re

cord

ing

softw

are

Pare

nts u

sed

pers

onal

co

mpu

ter a

long

side

as

prov

ided

HD

Pro

Web

cam

C92

0

Func

tiona

l ana

lysi

s and

fu

nctio

nal c

omm

uni-

catio

n tra

inin

gC

oach

es c

ondu

cted

a

pre-

inte

rven

tion

tele

phon

e ca

ll to

ca

rry

out a

func

tiona

l as

sess

men

t int

er-

view

. Fol

low

ed b

y a

struc

ture

d de

scrip

-tiv

e as

sess

men

t to

mim

ic th

e oc

cur-

renc

es o

f tar

gete

d be

havi

ours

in th

e na

tura

l env

ironm

ent,

no c

oach

ing

occu

rred

. Pa

rtici

pant

s wer

e in

struc

ted

rem

otel

y on

how

to c

ondu

ct

the

FA, w

ith fe

edba

ck

bein

g pr

ovid

ed a

t the

st

art o

f eac

h se

ssio

n,

thro

ugho

ut th

e se

ssio

n an

d vi

a em

ail

FCT:

bas

elin

e co

n-du

cted

whe

re id

iosy

n-cr

atic

beh

avio

urs w

ere

rein

forc

ed. T

rain

ing

was

pro

vide

d in

the

use

of F

CT

usin

g di

rect

feed

back

and

w

ritte

n in

struc

tions

vi

a em

ail

Inte

rven

tioni

st va

ri-ab

les:

fide

lity

to st

udy

proc

edur

es w

as m

eas-

ured

for 2

0% o

f all

outc

omes

usi

ng a

task

an

alys

is o

f cor

rect

pr

oced

ures

Pare

nt ra

tings

of t

reat

-m

ent a

ccep

tabi

lity

ASD

par

ticip

ant

varia

bles

: ind

ivid

u-al

ised

idio

sync

ratic

be

havi

our (

inap

prop

ri-at

e w

ays t

o ac

quire

re

info

rcem

ent)

Indi

vidu

alis

ed A

AC

Posi

tive

Func

tions

of b

ehav

iour

id

entifi

ed th

roug

h FA

. B

oth

parti

cipa

nt’s

Idi-

osyn

crat

ic re

spon

ses

redu

ced

to 0

Wea

k

Page 18: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

599Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Sues

s et a

l. (2

014)

Sing

le su

bjec

t res

earc

h de

sign

; mul

ti-el

emen

t an

d A

BAB

reve

rsal

de

sign

s

Inte

rven

tioni

st: th

ree

pare

nts g

ende

r not

pr

ovid

edA

ge: (

M =

37 y

ears

). N

o pr

e-in

terv

entio

n A

BA

expe

rienc

e pr

ovid

edPa

rtici

pant

s with

ASD

: th

ree

mal

esA

ge: 2

9–39

 mon

ths

(M =

34 m

onth

s)D

iagn

osis

: PD

D-N

OS,

di

agno

stic

tool

not

re

porte

d. N

o pr

e-in

terv

entio

n as

sess

-m

ent i

nfor

mat

ion

prov

ided

Lapt

op a

nd S

kype

use

d fo

r Vid

eo C

onfe

renc

-in

g, D

ebut

vid

eoco

n-fe

renc

ing

softw

are

Elec

troni

c co

py o

f tra

inin

g m

anua

l

Func

tiona

l Ass

essm

ent

and

Func

tiona

l com

-m

unic

atio

n tra

inin

gPa

rent

s pro

vide

d w

ith

two

dida

ctic

trai

ning

se

ssio

ns v

ia v

ideo

co

nfer

enci

ng. C

over

-in

g FA

, FC

T an

d be

havi

our p

rinci

ples

Pa

rent

s sub

sequ

ently

co

ache

d vi

a te

lehe

alth

to

con

duct

FA

and

FC

T

Inte

rven

tioni

st va

ri-ab

les:

fide

lity

to F

CT

task

with

adh

eren

ce

with

per

sona

lised

task

an

alys

is fo

r ses

sion

sTy

pe o

f err

or re

cord

edSo

cial

val

idity

que

stion

-na

ireA

SD p

artic

ipan

t var

i-ab

les:

indi

vidu

alis

ed

chal

leng

ing

beha

viou

r

Mix

edFA

succ

essf

ully

com

-pl

eted

and

iden

tified

a

func

tion

for e

very

pa

rtici

pant

Fide

lity

of F

CT

incr

ease

d sl

ight

ly fo

r ea

ch p

artic

ipan

t and

be

havi

our t

hat c

hal-

leng

es d

ecre

ased

, no

func

tiona

l rel

atio

nshi

p be

twee

n co

ache

d an

d un

-coa

ched

sess

ions

an

d no

bas

elin

e co

m-

plet

ed

Wea

k

Sues

s et a

l. (2

016)

Sing

le su

bjec

t res

earc

h de

sign

; mul

ti el

emen

t de

sign

with

mul

tiple

ba

selin

e

Inte

rven

tioni

sts: p

aren

ts

of A

SD in

divi

du-

als.

No

info

rmat

ion

prov

ided

Parti

cipa

nts w

ith A

SD:

five

parti

cipa

nts

Thre

e m

ales

and

two

fem

ales

Age

: 2.5

–7.1

 yea

rs

(M =

5)D

iagn

osis

: ASD

, di

agno

stic

tool

not

re

porte

dPr

e-in

terv

entio

n de

scrip

tive

func

tiona

l as

sess

men

t rep

orte

d

AS

per W

acke

r et a

l. (2

013a

)Sk

ype

Func

tiona

l ana

lysi

s and

Fu

nctio

nal c

omm

uni-

catio

n tra

inin

gPa

rent

s wer

e tra

ined

via

vi

deo

conf

eren

cing

to

con

duct

FA

s and

su

bseq

uent

FC

TIn

itial

1 h

mee

ting

was

co

nduc

ted

to d

iscu

ss

purp

ose

and

expl

ain

desc

riptiv

e as

sess

-m

ent

FA w

as su

bseq

uent

ly

perfo

rmed

with

ong

o-in

g in

struc

tion

from

th

e co

ach

3 × 15

 min

coa

ched

FC

T se

ssio

ns su

bse-

quen

tly to

ok p

lace

as

per

Wac

ker e

t al.

(201

3a)

Inte

rven

tioni

st va

ri-ab

les:

non

eA

SD p

artic

ipan

t va

riabl

es: i

ndiv

idua

lly

targ

eted

beh

avio

ur

that

cha

lleng

esTa

sk c

ompl

etio

n m

ands

Posi

tive

Prob

lem

beh

avio

ur

redu

ced

for a

ll pa

rtici

-pa

nts I

ncre

ased

man

ds

and

task

com

plet

ion

Stat

istic

al te

sting

of

effec

t siz

e co

nclu

ded

that

cha

nged

wer

e si

gnifi

cant

Wea

k

Page 19: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

600 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Vis

mar

a et

 al.

(201

3)Si

ngle

subj

ect r

esea

rch

desi

gn; m

ultip

le b

ase-

line

desi

gn

Inte

rven

tioni

sts: e

ight

pa

rent

s of c

hild

ren

invo

lved

, sev

en

fem

ales

and

one

mal

eN

o ag

es re

porte

dEd

ucat

ion,

sala

ry,

empl

oym

ent s

tatu

s an

d m

arita

l sta

tus

repo

rted

Parti

cipa

nts w

ith A

SD:

eigh

t par

ticip

ants

, no

gend

ers p

rovi

ded

Age

: 18–

45 m

onth

s (M

= 27

)D

iagn

osis

: ASD

Dia

gnos

tic to

ols,

DSM

-IV

, AD

OS

used

as a

cu

t off

for i

nclu

sion

bu

t not

repo

rted.

A

dditi

onal

serv

ices

re

ceiv

ed re

porte

d

Early

Sta

rt D

enve

r M

odel

onl

ine

train

ing

prog

ram

Lapt

op fo

r vid

eo c

alls

, sp

ecifi

c so

ftwar

e de

tails

not

pro

vide

d

Nat

ural

istic

trea

tmen

t pr

ogra

mV

ideo

con

fere

ncin

g an

d us

e of

a se

lf- g

uide

d w

ebsi

te o

n pa

rent

tra

inin

g in

Ear

ly

Star

t Den

ver M

odel

(E

SDM

)B

asel

ine

was

10 

min

fil

min

g pa

rent

chi

ld

inte

ract

ion

Wee

kly

pare

nt tr

aini

ng

sess

ions

alo

ngsi

de

vide

o co

nfer

enci

ng

pare

nt c

oach

ing

ses-

sion

s las

ting

1.5 

h

Inte

rven

tioni

st va

riabl

es: p

aren

t sat

-is

fact

ion,

inte

rven

tion

skill

s, pa

rent

eng

age-

men

t sty

les

mat

erna

l beh

avio

ur ra

t-in

g sc

ale

Pare

nt w

ebsi

te u

sage

ASD

indi

vidu

al

outc

omes

: fun

ctio

nal

verb

al u

ttera

nces

non

-ve

rbal

join

t atte

ntio

nIm

itativ

epl

ay a

ctio

ns o

n ob

ject

s an

d ge

sture

s

Mix

edPa

rent

eng

agem

ent

scor

es a

nd fi

del-

ity sc

ores

incr

ease

d fro

m b

asel

ine

for a

ll pa

rtici

pant

sA

SD p

artic

ipan

t sco

res

of v

erba

l utte

ranc

es

and

join

t atte

ntio

n in

crea

sed

for s

ome

put

not a

ll of

par

ticip

ants

(m

ultip

le b

asel

ine

not

grap

hed)

Wea

k

Vis

mar

a et

 al.

(201

2)Si

ngle

subj

ect r

esea

rch

desi

gn; m

ultip

le b

ase-

line

desi

gn

Inte

rven

tioni

sts: n

ine

pare

nts o

f chi

ldre

n,

seve

n fe

mal

es a

nd tw

o m

ale

No

ages

pro

vide

d N

o pr

e-in

terv

entio

n ex

pe-

rienc

e re

porte

dPa

rtici

pant

s with

ASD

: ni

ne p

artic

ipan

ts, n

o ge

nder

s pro

vide

dA

ge: 1

6-38

 mon

ths

(M =

28.8

9)D

iagn

osis

: six

with

A

SD a

nd th

ree

with

PD

D-N

OS

Dia

gnos

tic

tool

s: A

DO

SPr

e-as

sess

men

t inf

orm

a-tio

n pr

ovid

ed in

clud

-in

g M

ulle

n Sc

ales

of

Early

Lea

rnin

g an

d V

inel

and

Ada

ptiv

e B

ehav

iour

scal

es

Inte

r-bas

ed v

ideo

con

-fe

renc

ing

softw

are

Com

pute

r, La

ptop

s and

w

ebca

ms

Trai

ning

DV

D in

ES

DM

Nat

ural

istic

trea

tmen

t pr

ogra

mV

ideo

con

fere

nced

co

achi

ng o

f ESD

M10

-min

vid

eo p

robe

s w

ere

com

plet

ed a

t the

st

art o

f eac

h se

ssio

n,

cons

istin

g of

nat

ural

ly

occu

rrin

g si

tuat

ions

an

d ev

alua

ted

skill

s us

ing

ESD

M c

heck

list

Targ

et b

ehav

iour

s wer

e se

lect

ed fr

om th

ese

resu

ltsTr

aini

ng D

VD

was

pr

ovid

ed12

wee

kly

vide

o co

nfer

-en

cing

sess

ions

teac

h-in

g ES

DM

con

duct

ed

Inte

rven

tioni

st va

riabl

es: fi

delit

y of

im

plem

enta

tion

usin

g th

e ES

DM

fide

lity

scal

e M

ater

nal B

ehav

-io

ur R

atin

g sc

ale

Feas

ibili

ty a

nd a

ccep

t-ab

ility

que

stion

naire

ASD

par

ticip

ant v

ari-

able

sC

hild

Soc

ial C

omm

u-ni

catio

n B

ehav

iour

s, pr

ompt

ed v

erba

lisa-

tions

, spo

ntan

eous

ve

rbal

isat

ions

and

sp

onta

neou

s im

itatio

nM

acA

rther

Bat

es sc

ores

on

voc

abul

ary

Vin

elan

d A

dapt

ive

Beh

avio

ur R

atin

g sc

ale

Posi

tive

Pare

nt fi

delit

y sc

ores

si

gnifi

cant

ly im

prov

ed

over

tim

e

Wea

k

Page 20: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

601Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Vis

mar

a et

 al.

(201

6)G

roup

rese

arch

des

ign;

ra

ndom

ised

com

pari-

son

grou

p

Inte

rven

tioni

sts 2

4 pa

rent

sG

roup

1: t

hree

mal

es

and

11 fe

mal

eG

roup

2: t

wo

mal

e an

d ei

ght f

emal

esA

ges n

ot re

porte

dPa

rtici

pant

s with

ASD

: 24

par

ticip

ants

Age

: (M

= 31

.9 m

onth

s)D

iagn

osis

: ASD

Dia

gnos

tic to

ol: A

DO

STe

lehe

alth

gro

up:

six

mal

es a

nd fo

ur

fem

ales

Com

paris

on g

roup

: 11

mal

es a

nd th

ree

fem

ales

Add

ition

al se

rvic

es

repo

rted

Citr

ix p

rogr

am G

oTo-

Mee

ting®

Pare

nts a

cces

sed

usin

g ho

me

com

pute

r, w

eb-

cam

or t

able

t. A

cces

s to

ESD

M tr

aini

ng

web

site

Nat

ural

istic

trea

tmen

t pr

ogra

mIn

vesti

gatin

g pa

rent

’s

use

of E

SDM

Tele

heal

th g

roup

Rece

ived

acc

ess t

o ES

DM

onl

ine

train

-in

g on

goin

g w

eekl

y vi

deoc

onfe

renc

ing

to

coac

h th

em th

roug

h ES

DM

pro

cedu

res

Com

paris

on g

roup

Com

mun

ity tr

eatm

ent

as u

sual

gro

upRe

ceiv

ed m

onth

ly

vide

ocon

fere

ncin

g no

t ba

sed

upon

the

ESD

M

but d

iscu

ssin

g th

eir

curr

ent t

reat

men

t, al

ongs

ide

acce

ss to

th

e ES

DM

web

site

Ass

essm

ents

wer

e 5 

min

free

-pla

y tim

e

Inte

rven

tioni

st va

ri-ab

les:

P-E

SDM

fide

l-ity

che

cklis

tPa

rent

web

site

dur

atio

nPa

rent

satis

fact

ion

ques

tionn

aire

ASD

par

ticip

ant v

ari-

able

s: sp

onta

neou

s fu

nctio

nal v

erba

l ut

tera

nces

, Im

itativ

e fu

nctio

nal p

lay

actio

ns

with

or w

ithou

t ob

ject

s Non

-ver

bal

join

t atte

ntio

n

Mix

ed fo

r ASD

indi

vid-

ual’s

beh

avio

ur o

nly

sign

ifica

nt b

ehav

iour

di

ffere

nce

betw

een

grou

ps w

as im

itatio

nSi

gnifi

cant

ly m

ore

par-

ents

in th

e te

lehe

alth

gr

oup

met

fide

lity

afte

r coa

chin

g

Wea

k

Page 21: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

602 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Vis

mar

a et

 al.

(200

9)G

roup

rese

arch

des

ign;

no

n ra

ndom

ised

com

-pa

rison

gro

up

Inte

rven

tioni

sts: t

en

prof

essi

onal

s rec

ruite

d fro

m se

lect

ed c

entre

s, oc

cupa

tion,

num

ber

of y

ears

’ exp

eri-

ence

wor

king

with

in

divi

dual

s with

ASD

an

d pr

evio

us tr

aini

ng

prov

ided

Age

and

gen

der n

ot

repo

sted

Parti

cipa

nts w

ith A

SD:

29 p

artic

ipan

tsA

ge: 2

4–51

mon

ths.

(M =

32) t

eleh

ealth

gr

oup

and

(M =

33)

mon

ths f

or li

ve g

roup

Dia

gnos

is: A

SDD

iagn

ostic

tool

: AD

OS

ESD

M tr

aini

ng D

VD

2 da

y vi

deo

conf

eren

ced

train

ing

sem

inar

(te

chno

logy

det

ails

no

t pro

vide

d)

Nat

ural

istic

trea

tmen

t pr

ogra

mPh

ase

1B

asel

ine

10-m

in p

robe

2-da

y tra

inin

g co

nfer

-en

ce2 

h tra

inin

g fo

r eac

h pr

ofes

sion

al c

on-

duct

ed v

ia te

lehe

alth

to

dis

cuss

indi

vidu

al

need

s. 1-

h ph

one-

call

follo

w u

pPh

ase

2Pr

ofes

sion

als w

ere

give

n a

pare

nt tr

ain-

ing

DV

D a

nd a

3-h

di

dact

ic se

min

ar

on p

aren

t tra

inin

g,

alon

gsid

e a

2 h

grou

p su

perv

isio

n an

d 1 

h te

leph

one

conf

eren

ce.

Parti

cipa

nts s

ubm

itted

a

1 h

vide

o of

par

ent

coac

hing

sess

ion,

self

rate

d fid

elity

scor

es

Inte

rven

tioni

st va

ri-ab

les:

inte

rven

tioni

st an

d pa

rent

fide

lity

of im

plem

enta

tion

and

inte

rven

tioni

st sa

tisfa

ctio

n w

ith th

e pr

oced

ures

ASD

par

ticip

ant v

ari-

able

s: fr

eque

ncy

of

child

soci

o-co

mm

uni-

cativ

e be

havi

ours

Imita

tive

play

act

ions

on

obje

cts

and

gestu

res

Obs

erva

tion

ratin

gs o

f ch

ild e

ngag

emen

t

Posi

tive

Teac

hing

via

dist

ance

le

arni

ng w

as a

s effe

c-tiv

e as

teac

hing

usi

ng

live

inte

ract

ion

No

diffe

renc

e in

ther

a-pi

st fid

elity

Atte

ntio

n an

d so

cial

in

itiat

ion

beha

viou

rs

incr

ease

d si

gnifi

cant

ly

from

bas

elin

e

Wea

k

Page 22: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

603Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Wac

ker e

t al.

(201

3a)

Sing

le su

bjec

t res

earc

h de

sign

: mul

ti el

emen

t w

ith m

ultip

le b

asel

ine

acro

ss p

artic

ipan

ts fo

r FC

T co

mpo

nent

Inte

rven

tioni

sts18

par

ents

, 16

fem

ales

an

d tw

o m

ales

Age

: M

= 33

 yea

rs o

ld N

o fo

rmal

trai

ning

in

beha

viou

ral t

reat

men

tPa

rtici

pant

s with

ASD

: 17

par

ticip

ants

, gen

-de

r not

pro

vide

dA

ge: 2

9–80

mon

ths

Dia

gnos

is: A

SD o

r PD

D-N

OS

diag

nosti

c to

ol: D

SM-I

V, A

DI

and

AD

OS.

Aut

hors

st

ate

that

furth

er

diag

nosti

c an

d de

mo-

grap

hic

info

rmat

ion

can

be fo

und

in su

bse-

quen

t pub

licat

ion

Sess

ions

took

pla

ce in

re

gion

al te

lehe

alth

cl

inic

sW

indo

ws b

ased

PC

w

ith te

leco

nfer

enci

ng

softw

are

and

basi

c w

ebca

m a

nd m

icro

-ph

one

FA a

nd F

CT

train

ing

Pare

nts a

ttend

ed a

re

gion

al c

linic

whe

re

they

wer

e ta

ught

usi

ng

vide

o-co

nfer

enci

ng

to c

ompl

ete

FA o

f pr

oble

m b

ehav

iour

an

d su

bseq

uent

FC

TFA

pro

cedu

res

desc

ribed

in m

ore

deta

il in

Wac

ker e

t al.

(201

3b) b

elow

FCT

train

ing

via

vide

o co

nfer

enci

ng in

1 h

w

eekl

y se

ssio

n to

co

ach

thro

ugh

FCT

proc

edur

esFi

ve m

inut

e bl

ocks

w

ere

reco

rded

th

roug

hout

eac

h se

s-si

on fo

r sco

ring

Inte

rven

tioni

st va

ri-ab

les:

acc

epta

bilit

y of

in

terv

entio

nA

SD p

artic

ipan

t var

i-ab

les:

% re

duct

ion

in

targ

eted

cha

lleng

ing

beha

viou

r

Posi

tive

All

parti

cipa

nts h

ad

larg

e re

duct

ion

in

targ

eted

beh

avio

ur, s

ix

sam

ples

onl

y gr

aphe

dPa

rent

s rat

ed th

e in

ter-

vent

ion

high

ly

Wea

k

Wac

ker e

t al.

(201

3b) b

Con

duct

ion

Func

tiona

l A

naly

se o

f Pro

b-le

m b

ehav

iour

via

te

lehe

alth

Sing

le su

bjec

t res

earc

h de

sign

; mul

ti el

emen

t de

sign

Inte

rven

tioni

sts: 2

0 pa

rent

s of c

hild

ren,

19

fem

ales

and

one

mal

eA

ge: (

M =

34 y

ears

)Pa

rtici

pant

s with

ASD

: 20

par

ticip

ants

, gen

-de

rs n

ot p

rovi

ded

Dia

gnos

is: s

even

with

A

SD a

nd 1

3 w

ith

PDD

-NO

S D

iagn

ostic

to

ols:

DSM

-IV,

AD

I an

d A

DO

S

Sony

PC

S-16

00 v

ide-

ocon

fere

ncin

g sy

stem

w

ith P

TZ c

amer

aSo

ny G

520

vide

o m

onito

rTe

leco

nsul

tatio

nD

ell W

indo

ws X

PLo

gite

ch 6

00 W

ebca

mLo

gite

ch G

330

Embl

aze-

VCO

N v

Poin

t H

D so

ftwar

eV

ideo

LAN

VLC

med

ia

play

erW

indo

ws M

ovie

Mak

er

Func

tiona

l ana

lysi

sV

ideo

conf

eren

cing

use

d to

car

ry o

ut tr

aini

ng

and

com

plet

ion

of F

A

acro

ss fo

ur p

hase

s of

train

ing

Initi

al tr

aini

ng in

pha

se

1 an

d 2

focu

sed

beha

viou

r ana

lytic

al

proc

edur

esPa

rent

s int

ervi

ewed

ab

out c

halle

ngin

g be

havi

ours

and

com

-pl

eted

log

and

pref

er-

ence

ass

essm

ent

Phas

e 4

Pare

nts c

ondu

cted

an

FA w

ith su

ppor

t fro

m

the

coac

h

Inte

rven

tioni

st va

riabl

es: P

roce

dura

l in

tegr

ityA

SD p

artic

ipan

t var

i-ab

les:

indi

vidu

alis

ed

targ

et c

halle

ngin

g be

havi

our,

iden

tified

an

d op

erat

iona

lly

defin

ed u

sing

pre

-as

sess

men

t int

ervi

ews

and

logs

Posi

tive

Func

tions

wer

e su

c-ce

ssfu

lly id

entifi

ed

in 9

0% o

f cas

es, w

ith

the

addi

tiona

l tw

o ca

ses n

ot id

entif

ying

a

func

tion

due

to lo

w

leve

ls o

f beh

avio

ur

that

cha

lleng

es

Wea

k

Page 23: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

604 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 1

(con

tinue

d)

Stud

yRe

sear

ch d

esig

nPa

rtici

pant

sTe

chno

logy

Inte

rven

tion

cate

gory

an

d ai

ms

Dep

ende

nt V

aria

bles

Out

com

esQ

ualit

y

Wai

ner a

nd In

gers

oll

(201

5)Si

ngle

subj

ect r

esea

rch

desi

gn: m

ultip

le b

ase-

line

desi

gn

Inte

rven

tioni

st: fi

ve p

ar-

ents

, all

fem

ale

Age

s no

t rep

orte

dPa

rtici

pant

s with

ASD

: fiv

e pa

rtici

pant

s, ge

n-de

r not

pro

vide

dA

ge: 2

9–59

mon

ths

(M =

42.2

)D

iagn

osis

: ASD

Dia

gnos

tic to

ol n

ot

repo

rted

Onl

ine

Reci

proc

al Im

i-ta

tion

Trai

ning

(RIT

) w

ebsi

teC

orre

spon

ding

PD

F m

anua

lFa

mili

es o

wn

hom

e co

mpu

ters

and

web

-ca

ms C

omm

erci

ally

av

aila

ble

vide

ocon

fer-

enci

ng so

ftwar

e, n

ot

nam

ed

Nat

ural

istic

teac

hing

Hyb

rid a

ppro

ach

of

an o

nlin

e tra

inin

g pr

ogra

m a

nd v

ideo

co

nfer

enci

ng to

inve

s-tig

ate

RIT

10-m

in b

asel

ine,

film

ed

prob

es w

here

par

ents

in

tera

cted

with

thei

r ch

ildre

n in

pla

ySe

lf -d

irect

ed c

ondi

tion

pare

nts u

sed

onlin

e tra

inin

g pr

ogra

m in

R

IT w

ith fo

ur le

sson

s, pr

e an

d po

st kn

owl-

edge

test

vide

o ex

am-

ples

, act

ive

lear

ning

se

lf-m

onito

ring

and

hom

ewor

k3 ×

30 m

in c

oach

ing

sess

ions

invo

lvin

g 10

 min

pro

bes a

the

star

t of s

essi

on

Inte

rven

tioni

st va

ri-ab

les:

RIT

fide

lity

Pare

ntal

eng

agem

ent

Pare

ntal

kno

wle

dge

Pare

ntal

vie

ws o

n tre

at-

men

t acc

epta

bilit

yA

SD p

artic

ipan

t var

i-ab

les:

chi

ld’s

spon

ta-

neou

s im

itatio

n

Mix

edPa

rent

al k

now

ledg

e of

R

IT m

etho

ds si

gnifi

-ca

ntly

incr

ease

dPr

ogra

m fi

delit

y in

crea

sed

from

bas

e-lin

e fo

r all

parti

ci-

pant

s, no

t sig

nific

antly

fro

m se

lf-di

rect

ed to

vi

deo

conf

eren

cing

Incr

ease

d im

itatio

n fo

r so

me

child

ren

but n

ot

all,

how

ever

sig-

nific

ant r

elat

ions

hip

betw

een

pare

nt fi

del-

ity a

nd c

hild

imita

tion

Wea

k

Wilc

zyns

ki e

t al.

(201

7)N

o ex

perim

enta

l des

ign

Inte

rven

tioni

sts: o

ne

fem

ale

spec

ial e

duca

-tio

n te

ache

r Age

not

pr

ovid

edA

SD p

artic

ipan

t: on

e m

ale

parti

cipa

ntA

ge: 5

 yea

rsD

iagn

osis

: ASD

, di

agno

stic

tool

not

re

porte

d

PC a

nd w

ebca

mA

utis

m T

rain

ing

Solu

tions

web

bas

ed

train

ing

GoT

oMee

ting

vide

o co

nfer

enci

ng so

ftwar

e

Com

preh

ensi

ve tr

aini

ngC

ompl

etio

n of

onl

ine

beha

viou

r ski

lls tr

ain-

ing;

aut

ism

trai

ning

so

lutio

ns c

over

ing

beha

viou

r ana

lytic

al

prin

cipl

es F

ollo

wed

by

vid

eo c

onfe

renc

ed

coac

hing

sess

ion,

tra

inin

g m

anua

l and

pr

ovid

ed fe

edba

ck o

n pr

e-re

cord

ed v

ideo

s

Inte

rven

tioni

sts

varia

bles

: fide

lity

of

impl

emen

tatio

n of

ea

ch tr

aini

ng c

ompo

-ne

nt a

sses

sed

Kno

wle

dge

of in

terv

en-

tions

ASD

par

ticip

ant b

ehav

-io

ur: c

ompl

ianc

e w

ith ta

sks c

ompl

eted

, in

itial

com

plia

nce

and

com

plet

ion

of ta

sk

Mix

edIm

plem

enta

tion

of m

ost

train

ing

com

pone

nts

incr

ease

d af

ter t

rain

-in

gK

now

ledg

e of

key

com

-po

nent

s inc

reas

edA

SD p

artic

ipan

t var

i-ab

le: s

mal

l inc

reas

e in

in

itial

com

plia

nce

but

com

plet

ion

of c

ompl

i-an

ce w

as a

t cei

ling

leve

ls p

re-in

terv

entio

n

Wea

k

Page 24: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

605Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

on selected 28 studies. Likewise, ICA was calculated for the descriptive synthesis. The second coder scored 100% of selected studies across all extracted information. ICA was calculated by dividing the total number of agreed variables divided by total number of variables scored and multiplied by 100. There was a 92% agreement on coding. ICA was also calculated on the quality assessment at 96% following discussion on one disagreed study.

Efficacy Outcomes

Intervention outcomes were rated for efficacy on an ordinal scale of ‘Positive’, ‘Mixed’ or ‘Negative’. Visual analysis of graphed data was used for studies employing single subject research designs, while statistical testing was employed to determine outcomes of group designs. Studies were consid-ered ‘positive’ if improvements were made by all partici-pants across all dependent variables. They were considered ‘Mixed’ if positive results were visible but did not apply to all dependent variables and ‘Negative’ if no improvements were made for any dependent variable.

Quality Assessment

Studies included in the review were independently assessed for rigor by the first and second authors using the stand-ards created by Reichow et al. (2008). Disagreements were discussed with the third author. This assessment used two rubrics to measure research quality, one for group research and one for single-subject research. Both consist of meth-odological elements deemed important for research rigor. Selected studies were assessed against the appropriate rubrics and an overall rigor rating was created using guide-lines on how to synthesis rubrics ratings (Reichow et al. 2011, p. 30). This process evaluated study quality across two levels of methodological features: primary and secondary indicators. Primary indicators were considered vital com-ponents in research design in order to demonstrate validity. Secondary indicators were deemed as important but not vital components of research.

Primary indicators for group research included: partici-pant characteristics, independent variables, comparison con-ditions, and dependent variable (Table 2). Primary indicators for single subject research included: participant characteris-tics, independent variables, baseline conditions, dependent variables, visual analysis and experimental control (Table 3). Secondary indicators for group research design included: (1) random assignment, (2), Inter-observer agreement (IOA), (3) blind raters, (4), fidelity, (5) attrition, (6) generalisation or maintenance, (7), effect size and (8) social validity. Sec-ondary indicators for single subject research included: (1) inter-observer agreement (IOA), (2) kappa, (3), blind raters, Ta

ble

2 Q

ualit

y in

dica

tor a

sses

smen

t for

gro

up re

sear

ch d

esig

ns

IV in

depe

nden

t var

iabl

e, R

A ra

ndom

ass

ignm

ent,

ES e

ffect

siz

e, U

una

ccep

tabl

e, E

evi

denc

e of

Com

, Con

com

paris

on c

ondi

tion,

IOA

inte

robs

erve

r agr

eem

ent,

SV s

ocia

l val

idity

, A a

ccep

tabl

e,

N n

o ev

iden

ce o

f DV

depe

nden

t var

iabl

e, B

R bl

ind

rate

r, H

hig

h, S

tat s

tatis

tical

testi

ng, G

en/M

ain

gene

ralis

atio

n/m

aint

enan

ce

Parti

cipa

nts

IVC

om C

onD

VLi

nkSt

atR

AIO

AB

lind

Rat

erFi

delit

yA

ttriti

onG

en/M

ain

ESSV

Ove

rall

Bea

rss e

t al.

(201

7)H

HU

HH

HN

NN

EE

NE

EW

eak

Hei

tzm

an-P

owel

l et a

l. (2

014)

UH

UH

HU

NE

NE

EN

NE

Wea

kIn

gers

oll a

nd B

erge

r (20

15)

UH

HH

HH

EN

NN

NN

NE

Wea

kIn

gers

oll e

t al.

(201

6)U

HH

HH

HE

EN

EN

EN

EW

eak

Kur

avac

kel e

t al.

(201

8)U

HH

HH

HE

NN

NN

NE

EW

eak

Lind

gren

et a

l. (2

015)

UH

AH

HH

NE

NN

EN

NE

Wea

kV

ism

ara

et a

l. (2

016)

UH

HH

HH

EN

EE

EE

NE

Wea

kV

ism

ara

et a

l. (2

009)

UH

AH

HU

NE

EE

EN

NE

Wea

k

Page 25: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

606 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Tabl

e 3

Qua

lity

indi

cato

r ass

essm

ent f

or si

ngle

subj

ect r

esea

rch

desi

gns

IV in

depe

nden

t var

iabl

e, U

una

ccep

tabl

e, E

evi

denc

e of

DV

depe

nden

t var

iabl

e, A

acc

epta

ble,

N n

o ev

iden

ce o

f IO

A in

tero

bser

ver a

gree

men

t, H

hig

h, G

en/M

ain

gene

ralis

atio

n/m

aint

enan

ce

Stud

y N

ame

Parti

cipa

nt

char

acte

ristic

sIV

Bas

elin

eD

VV

isua

l an

alys

isEx

perim

enta

l co

ntro

lIO

AK

appa

Fide

lity

Blin

d ra

ters

Gen

eral

isat

ion

or m

aint

Soci

al

valid

ityO

vera

ll

Bar

retto

et a

l. (2

006)

UH

UH

HH

EN

NN

NE

Wea

kB

arka

ia e

t al.

(201

7)A

HA

HA

AE

NE

NN

EW

eak

Ben

son

et a

l. (2

017)

UH

UH

AA

EE

EN

NE

Wea

kG

ibso

n et

 al.

(201

0)U

HH

HH

HE

NE

NN

EW

eak

Hig

gins

et a

l. (2

017)

AH

UH

UU

EN

EN

EE

Wea

kM

acha

licek

et a

l. (2

009b

)U

HU

HH

HE

NN

NN

EW

eak

Mac

halic

ek e

t al.

(201

0)A

HU

HA

UE

NN

NE

EW

eak

Mac

halic

ek e

t al.

(201

6)U

HU

HU

UE

NE

NN

EW

eak

Mac

halic

ek e

t al.

(200

9a)

UH

UH

UU

EN

EN

NE

Wea

kM

eada

n et

 al.

(201

6)U

HA

HA

AE

NE

EE

EW

eak

Nee

ly e

t al.

(201

6)H

HA

HH

HE

NE

NE

EA

dequ

ate

Sim

acek

et a

l. (2

017)

UH

AH

HH

EN

EN

EE

Wea

kSu

ess e

t al.

(201

4)U

HU

HU

UE

NE

NN

EW

eak

Sues

s et a

l. (2

016)

UH

UH

AA

EN

NN

NE

Wea

kV

ism

ara

et a

l. (2

012)

UH

AH

AH

EE

EE

EE

Wea

kV

ism

ara

et a

l. (2

013)

UH

AH

UU

EE

EE

EE

Wea

kW

acke

r et a

l. (2

013a

)H

HU

HA

AE

NE

NN

EW

eak

Wac

ker e

t al.

(201

3b)

UH

AH

AA

EN

NN

NE

Wea

kW

aine

r and

Inge

rsol

l (20

15)

UH

HH

AA

EN

EN

EE

Wea

kW

ilczy

nski

et a

l. (2

017)

UH

UH

UU

NN

EN

NE

Wea

k

Page 26: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

607Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

(4) fidelity, (5) generalisation or maintenance and (6) social validity.

A score sheet created by the authors was used to score each of the identified variables against the operational defini-tions set out in Reichow et al. (2011). Each primary variable was scored as ‘High (H)’, ‘Acceptable (A)’ or ‘Unacceptable (U)’. Secondary indicators were scored as ‘evidence (E)’ or ‘no evidence (N)’. Each score was then combined to give an overall quality rating for each study of ‘strong’, ‘adequate’ or ‘weak’. To receive an overall ‘strong’ rating, studies must have received a high rating for all primary indicators and meet four of the secondary indicators. An overall ‘adequate’ rating was awarded to a study that received a high rating for four primary indicators and meet two secondary indicators with no unacceptable ratings in primary indicators. A study received an overall ‘weak’ rating if it was awarded less than four high ratings in primary indicators and less than two secondary indicators. Final ratings of each study were amal-gamated and assessed using the formula set out by Reichow (2011, p. 31), which allowed for an overall rating of EPB to be assigned to the field.

Results

According to the inclusion criteria, a total of 28 studies were deemed eligible and were incorporated in the descriptive synthesis with key data extracted and coded (Table 1). Each study was subsequently examined to determine its qual-ity according to the indicators identified by Reichow et al. (2008). In the following sections, a summary of coded vari-ables and quality measures is presented.

Study Design

All but two of the selected studies (Machalicek et al. 2009a; Wilczynski et  al. 2017) used an experimental research design, with the majority (64%; n = 18) employing a single subject research design and fewer employing a group design (28%; n = 8). Of the single subject research multiple baseline designs were utilised in 36% of studies (n = 10), as were multielement designs. Reversal designs were rarely used in the research (14%; n = 4).

Participants

Interventionist Participant

A total number of 293 interventionists were included in the 28 studies. Of these, 68 were placed in a comparison group and did not undertake any training via telehealth, leaving 225 interventionists in experimental groups across all stud-ies. Of these, 86% (n = 194) were parents, 9% (n = 21) were

direct front line staff, including ABA therapists, graduates working in university clinics and other associated profes-sionals working in the field, and 4% (n = 10) were teachers.

Age and gender for the interventionists were reported rarely with only 25% (n = 7) of studies reporting both char-acteristics (Bearss et al. 2017; Barkaia et al. 2017; Hig-gins et al. 2017; Neely et al. 2016; Machalicek et al. 2010; Wacker et al. 2013a, b). Another 25% (n = 7) of studies reported neither age nor gender (Benson et al. 2017; Kura-vackel et al. 2018; Machalicek et al. 2009a, b; Simacek et al. 2017; Suess et al. 2016; Vismara et al. 2009). Gender alone was reported in 39% (n = 11) of studies (Barretto et al. 2006; Gibson et al. 2010; Ingersoll et al. 2016; Ingersoll and Berger 2015; Machalicek et al. 2016; Meadan et al. 2016; Vismara et al. 2012, 2013, 2016; Wainer and Ingersoll 2015; Wilczynski et al. 2017). Age alone was reported in 11% (n = 3) of studies (Suess et al. 2014; Lindgren et al. 2015; Heitzman-Powell et al. 2014).

In studies where interventionist demographics were reported, a total of 97 females and 14 males took part in the research. The average age of interventionists was 31.7. Few participants had previous experience implementing behav-ioural analytic procedures (14%; n = 16).

Participants with ASD

A total of 307 participants with ASD took part in the 28 studies. Of this, 76 were allocated to a control or compari-son group and did not receive telehealth interventions, leav-ing 231 participants in telehealth experimental groups. Of these 57%, (n = 231) took part in group research, while 42% (n = 96) were included in single subject research designs and 2% (n = 4) were included in studies that did not operate an experimental research design.

Age and gender of participants with ASD were reported more frequently than for interventionists, with both varia-bles being reported in 75% (n = 21) of studies (Barretto et al. 2006; Barkaia et al. 2017; Bearss et al. 2017; Benson et al. 2017; Gibson et al. 2010; Higgins et al. 2017; Ingersoll and Berger 2015; Kuravackel et al. 2018; Lindgren et al. 2015; Machalicek et al. 2009a, b, 2010, 2016; Meadan et al. 2016; Neely et al. 2016; Simacek et al. 2017; Suess et al. 2014, 2016; Vismara et al. 2016; Wilczynski et al. 2017). Only 3% (n = 1) of studies did not report any information about the age or gender of participants with ASD (Heitzman-Powell et al. 2014). Participants’ age was stated in 21% (n = 6) of studies in which gender was omitted (Vismara et al. 2009, 2012, 2013; Wacker et al. 2013a, b; Wainer and Ingersoll 2015), while no studies reported gender in isolation.

Diagnostic tools used to provide the participants with their diagnoses of ASD or PDD-NOS were reported spo-radically throughout the literature. Of the demographics reported for participants with ASD, 93 were male and 61

Page 27: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

608 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

were female. The average age from each study where age was reported was 4.73 years with the range being 1.75–16 years’ old.

Intervention Characteristics

Categorisation of Intervention Aims

Studies included in this review were organised according to the intervention techniques used (Fig. 2). The largest cate-gory was functional analysis (FA) and subsequent functional communication training (FCT), with 43% (n = 12) of studies investigating these topics (Barretto et al. 2006; Benson et al. 2017; Gibson et al. 2010; Lindgren et al. 2015; Machalicek et al. 2009b, 2010, 2016; Simacek et al. 2017; Suess et al. 2014, 2016; Wacker et al. 2013a, b). Techniques derived from naturalistic and incidental teaching were employed in 36% (n = 10) of studies (Barkaia et al. 2017; Ingersoll et al. 2016; Ingersoll and Berger 2015; Meadan et al. 2016; Neely et al. 2016; Vismara et al. 2009, 2012, 2016; Wainer and Ingersoll 2015). Behaviour support strategies, including positive behaviour support were investigated in 7% (n = 2) of studies (Bearss et  al. 2017; Kuravackel et  al. 2018). Training participants to conduct preference assessments was examined in 7% (n = 2) of studies (Higgins et al. 2017; Machalicek et al. 2009a). The final two studies focused on comprehensive training packages designed to provide par-ticipants with an overview of behaviour analytic principles (Heitzman-Powell et al. 2014; Wilczynski et al. 2017).

Training Characteristics

When examining eligible studies, it was apparent that sev-eral commonalities occurred across training techniques and

platforms used. These included technology-based train-ing and video-conference sessions that provided coaching. Coaching was defined as providing individualised training and feedback regarding the implementation of the interven-tion of choice; this could be conducted via telephone, email or video-conferencing. Feedback on performance was deliv-ered live or retroactively using recorded footage. Coaching was used as a standalone training strategy 25% (n = 7) of studies (Barretto et al. 2006; Benson et al. 2017; Lindgren et al. 2015; Machalicek et al. 2009b, 2016; Simacek et al. 2017; Suess et al. 2016).

Technology-based training involved the utilisation of technology to provide interventionists with the theoreti-cal background knowledge of procedural techniques in preparation of intervention commencement. Twenty stud-ies included a technology based training components were included in 71% (n = 20) of studies. Written instructions, websites including interactive modules, a training DVD, manuals or with video-conferenced didactic training were utilised to provide this training. Equipment included laptops, cameras, scanners and commercially available videoconfer-encing software. A hybrid approach including coaching and technology-based training was undertaken in 75% (n = 21) of studies (Barkaia et al. 2017; Bearss et al. 2017; Gibson et al. 2010; Heitzman-Powell et al. 2014; Higgins et al. 2017; Ingersoll and Berger 2015; Ingersoll et al. 2016; Kuravackel et al. 2018; Machalicek et al. 2009a, 2010; Meadan et al. 2016; Neely et al. 2016; Suess et al. 2014; Vismara et al. 2009, 2012, 2013, 2016; Wacker et al. 2013a, b; Wainer and Ingersoll 2015; Wilczynski et al. 2017).

Dependent Variables

Results indicate that 69% (n = 19) of studies measured vari-ables for both interventionists and participants with ASD, 11% (n = 3) of studies measured interventionist behaviour alone. All studies that measured interventionist behaviours included a measure of procedural fidelity via task analysis, a fidelity checklist or video-recorded probes. Knowledge tests were used in 14% (n = 4) of studies and these scores were compared to pre-intervention scores to determine the effect of the intervention (Heitzman-Powell et al. 2014; Ingersoll and Berger 2015; Wainer and Ingersoll 2015; Wilczynski et al. 2017).

Child behaviour was measured alone in 21% (n = 6) of studies and 68% (n = 19) of studies measured participant with ASD variables alongside interventionist variables. Data collection for child behaviours was conducted via video-recorded probes or questionnaires and standardised tests. Of these, 50% (n = 14) of studies measured individualised prob-lem behaviour as part of an FA to assess function or teach replacement behaviour (e.g. FCT). Examples of the indi-viduals’ challenging behaviour include elopement (Gibson

FA+FCT43% (n = 12)

Natrualistic36% (n = 10)

Preference Assessment 7% (n = 2)

Comprehensive 7% (n = 2)

Behaviour Support

7% (n = 2)

Fig. 2 Proportion of studies completing research in each intervention category

Page 28: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

609Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

et al. 2010), self-injurious behaviour and screaming (Benson et al. 2017), noncompliance and property destruction (Bar-retto et al. 2006). From the remaining studies, 43% (n = 12) investigated increases in social-communication responses (Barkaia et al. 2017; Benson et al. 2017; Ingersoll et al. 2016; Lindgren et al. 2015; Meadan et al. 2016; Neely et al. 2016; Simacek et al. 2017; Suess et al. 2016; Vismara et al. 2009, 2012, 2013, 2016) All studies attempted to teach chil-dren to request using either an alternative communication system (e.g., touching or handing over a communication card to access a tangible; Benson et al. 2017) or vocalisations (e.g., providing echoic prompts in contrived communica-tion opportunities to increase child vocal requesting; Barkaia et al. 2017). Other facets of social communication measured including joint-attention and initiation of communication (e.g., Neely et al. 2016).

The final dependent variable measured in the research was imitation skills. This was included in 18% of studies (n = 5) (Vismara et al. 2009, 2012, 2013, 2016; Wainer and Ingersoll 2015) all five studies trained parents in naturalis-tic teaching techniques and attempted to increase children’s imitation skills in play based or fun situations.

Efficacy Outcomes

Results of efficacy (Fig. 3) show that 61% (n = 17) of stud-ies were rated as ‘positive’ in which improvements were achieved by all participants across all dependent variables (Barretto et al. 2006; Benson et al. 2017; Gibson et al. 2010; Higgins et al. 2017; Ingersoll and Berger 2015; Ingersoll et al. 2016; Lindgren et al. 2015; Machalicek et al. 2010, 2009b; Neely et al. 2016; Simacek et al. 2017; Suess et al. 2016; Vismara et al. 2009, 2012, 2016; Wacker et al. 2013a, b). A closer examination reveals that 36% (n = 10) of stud-ies employed FA + FCT procedures (Barretto et al. 2006; Benson et al. 2017; Gibson et al. 2010; Lindgren et al. 2015; Machalicek et al. 2009b, 2010; Simacek et al. 2017; Suess et al. 2016; Wacker et al. 2013a, b) demonstrating a clear behaviour function for each participant and showing decreases in challenging behaviour following FCT; in terms of procedural fidelity, this was established for all interven-tionists. Of studies focusing on naturalistic teaching, 35% (n = 6) were also scored as positive (Ingersoll et al. 2016; Ingersoll and Berger 2015; Neely et al. 2016; Vismara et al. 2009, 2012, 2016), achieving an increase in interventionist knowledge or fidelity alongside improvements in child social communicative behaviour or imitation responses. The final positively scored study included a preference assessment (Higgins et al. 2017) and indicated a positive relationship between telehealth training and the correct implementation of preference assessment procedures.

Overall, 32% (n = 9) of studies received a ‘mixed’ efficacy rating (Barkaia et al. 2017; Bearss et al. 2017; Machalicek

et al. 2016; Meadan et al. 2016; Suess et al. 2014; Vismara et al. 2013, 2016; Wainer and Ingersoll 2015; Wilczynski et al. 2017). For example, 44% (n = 4) of these studies found improvements in interventionist treatment fidelity across all participants but failed to increase scores of social commu-nication or imitation behaviours consistently across par-ticipants (Meadan et al. 2016; Wainer and Ingersoll 2015; Vismara et al. 2013). None of the 28 studies included in this review received a ‘negative’ rating.

Quality Assessment

Of the eight studies employing a group research design, all (n = 8) received an overall weak quality rating (Fig. 4). Of the 71% (n = 20) of studies employing a single subject research design (Fig. 5), 5% (n = 1) received an overall ade-quate quality rating; the remaining 95% (n = 19) received an overall weak quality rating. An overall rating for each study can be found alongside individual indicator ratings in Tables 2 and 3.

The research scored highly on several primary indica-tors, including both the dependent and independent vari-ables, which were described thoroughly with replicable precision in 100% of single subject and group research. In group research links to past research were successfully made in 100% of studies meaning they provided strong links between the original research questions and the analysis of the data established in their studies. Comparison groups, when present, were described with high replicable detail in 50% (n = 4) of studies and with some details emitted in 25% (n = 2). The remaining studies operated a within group design and did not include a comparison group to describe. Statistical analyses were also completed to a high standard in 75% (n = 6) of studies (Bearss et al. 2017; Ingersoll and Berger 2015; Ingersoll et al. 2016; Kuravackel et al. 2018;

0

1

2

3

4

5

6

7

8

9

10

FA+FCT Naturalis�c BehaviourSupport

PreferenceAssessment

Comprehensive

Num

ber o

f Stu

dies

Intervention Category

Postive Mixed Negative Undetermined

Fig. 3 Efficacy outcomes of each intervention category

Page 29: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

610 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Lindgren et al. 2015; Vismara et al. 2016) as all contained sample sizes > 10 participants per group and conducted appropriate statistical analysis across dependent variables.

However, high scores were not evident across all indi-cators. In single subject research design studies only 10% (n = 2) for studies were rated highly for baseline (Gibson et al. 2010; Wainer and Ingersoll 2015), meaning they had three measurable data points, were described in replicable details, appeared to be stable and did not include any trends, including counter therapeutic trends. An additional 35% (n = 7) were rated as ‘Acceptable’ as more than 50% but less than 100% of baselines in the study met the above criteria (Barkaia et al. 2017; Meadan et al. 2016; Neely et al. 2016; Simacek et al. 2017; Vismara et al. 2012, 2013; Wacker et al. 2013b). 55% of studies (n = 11) were rated as having unacceptable baseline conditions. Despite conditions being

accurately described and for the most part containing three data points, many failed to show stable levels or trends.

For both single subject and group research to be rated ‘High’ for participant characteristics studies needed to report information on participant age, gender, diagnostic instru-ment, interventionist characteristics and scores on stand-ardised tests if applicable. As many of the studies included measures of both interventionist and participants with ASD behaviour both were considered as participants for the pur-pose of this review. Overall only 11% (n = 3) of the studies were rated highly. This means they reported information on participant age, gender, diagnostic instrument, intervention-ist characteristics and scores on standardised tests if appli-cable. An ‘Acceptable’ rating was awarded to 15% (n = 3) of studies, as they provided demographics on all participant’s age and gender, and provided standardised test scores. The remaining 79% (n = 22) of studies all met the ‘Unacceptable’ rating, where age and gender for both the individual with ASD and the interventionists was not reported consistently.

The overall quality ratings for each study were combined to allow for an overall rating of EPB to be given to the field. Using the formula suggested by Reichow et al. (2011) the amount of ‘high’ and ‘adequate’ studies were combined to provide an overall score for the field, which due to meth-odological omissions discussed was designated as ‘Not an Evidence Based Practice’.

Discussion

The purpose of this review was to (a) identify and categorise key intervention properties and procedures used in research using telehealth to provide behaviour analytic provisions to individuals with ASD, (b) to assess the overall outcomes of selected studies both in the success of the training proce-dures and the outcomes for individuals with ASD, and (c) to examine the quality of selected research. It is the aim of the review that it can be used to guide future research and practice by identifying successful procedures and highlight-ing methodological flaws.

Findings from the synthesis of 28 studies suggested that telehealth can be an acceptable platform for behaviour ana-lytic interventions and assessments. A total of 293 interven-tionists were trained across studies providing intervention to 307 individuals with ASD. Outcomes indicate positive gains across participants with 100% of studies (n = 28) studies reporting improvements in at least one dependent variable and 61% (n = 17) of studies reporting favourable outcomes across all dependent variables. None of the 28 studies met sufficient quality indicators to be determined as of ‘high’ quality and only one study was determined as being of ‘adequate’ quality. The remaining 96% (n = 27) of studies were rated as ‘weak’. Due to what we consider are

0

1

2

3

4

5

6

7

8

9

Participants IndependentVariable

ComparisonGroup

DependentVariable

Link toResearch

Statistics

Num

ber o

f Stu

dies

Primary Indicators - Group Research Design

High Adequate Unacceptable

Fig. 4 Number of studies scoring on each primary indicator—group research design

0

5

10

15

20

25

Participants IndependentVariable

Baseline DependentVariable

VisualAnalysis

ExperimentalControl

Num

ber o

f Stu

dies

Primary Indicator - Single Subject Design

High Adequate Unacceptable

Fig. 5 Number of studies scoring on each primary indicator—single subject research design

Page 30: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

611Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

minor methodological flaws, an overall rating of ‘not an evi-dence-based practice’ was assigned to telehealth as a means of providing ABA-based interventions. Although positive outcomes were achieved for involved participants, there is a demand for further high quality research that can adhere to a rigorous methodological structure. Each of the research aims will now be discussed in more detail.

The first aim of this review was to synthesise and catego-rise intervention aims and procedures. A variety of ABA-based procedures were targeted within the literature: FA and FCT, naturalistic teaching, preference assessments, behav-iour support and comprehensive programs. The numbers of studies in each category were not evenly distributed, most studies investigated FA and FCT procedures (43%; n = 12) or naturalistic teaching (39%; n = 11). Research on using telehealth to conduct comprehensive treatment is lacking. Only 7% (n = 2) of selected studies were categorised as ‘comprehensive’ (Heitzman-Powell et al. 2014; Wilczynski et al. 2017), but both had methodological downfalls. Using telehealth to oversee comprehensive packages is a vital area for future research with potentially significant practical implications. Two other key ABA-based teaching strategies were overlooked in the research: Discrete Trial Training (DTT) and functional/daily living skills training. DTT is highly repetitious and includes very structured arrangements of consequences and antecedents. It has been shown to suc-cessfully teach skills to children with ASD across devel-opmental domains such as, communication, imitation and self-care (Sheinkopf and Siegel 1998). DTT implementation requires technical knowledge and success is linked to good training procedures (Symes et al. 2006). On the other hand, DTT has been criticised as teaching skills that present a lack of generality into typical, ecologically relevant settings. Fur-ther research is needed to determine its suitability through a telehealth model.

Conversely, functional/daily living skills may be ideally suited. Strategies of task analysis and chaining are used to systematically teach ‘chains’ of behaviours found in eve-ryday tasks, such as brushing teeth or preparing a snack. These methods have a strong empirical base, have been recognised as evidence-based practice (Wong et al. 2014) and have been demonstrated using a parent training model (Kroeger and Sorensen 2010), highlighting their generality and social validity. It is therefore relatively surprising that research into using telehealth to conduct this training is not forthcoming and future research in this direction is needed.

A total of 71% (n = 20) of studies included an initial train-ing period. Initial training has been recognised as a key com-ponent in achieving procedural fidelity in behaviour analytic practice (Denne et al. 2015; Symes et al. 2006). Researchers have translated proven face–face training techniques onto a telehealth platform, such as modelling of procedures, prac-tice using role play and tests of knowledge (Fetherstone and

Sturmey 2014; Miltenberger 2004). All 28 studies incor-porated a live coached component, in addition to initial training or as a stand-alone training procedure. Once again, proven training techniques were utilised, such as modelling appropriate behaviour, error correction procedures and per-formance feedback. Due to using a combination of training variables it was not possible to isolate the most success-ful training components. Future researchers may consider a component analysis to assess the best type of training and avoid unnecessarily waste of resources.

Information regarding the type of technology was limited within the research with only a small number of studies pro-viding extensive information on this aspect. Video confer-encing software used to conduct didactic training and video coaching was often free to access and readily available, e.g., Skype, Viber or iChat. Hardware such as personal comput-ers, web cameras or tablets were often reported as family’s own or pre-existing in the intervention centre. Initial training was conducted via a website in eight studies, where website training was utilised this was often already available from previous research, such as the Early Start Denver Model training website (e.g. Vismara et al. 2016).

The review synthesised participant information. By determining who can be trained to carry out interventions and who is likely to benefit from them, the scope of the telehealth model can be revealed. A total of 225 interven-tionist participants took part. Participants were employed in a number of different sectors: health, education, research and social care or were family members, primarily parents of the participants with ASD. This synthesis demonstrates the capacity of telehealth to train and supervise a multi-disciplinary team, highlighting the potential of the telehealth model amongst the reality of current ASD services in the UK, where interdisciplinary teams working together to plan provision is common practice (Department of Educa-tion, Department of Health 2015; Department of Education Northern Ireland 2005).

The largest proportion of studies (64%; n = 18) used par-ent training to support the provision of home-based interven-tion or assessments. The National Research Council (NRC) dictates that parent involvement is a fundamental component of effective ASD intervention (NRC 2001). Parent training and subsequent intervention implementation has been identi-fied as evidence-based practice (EBP), as long as treatment fidelity can be achieved (Wong et al. 2014). The outcomes of this review indicate that fidelity can be achieved using a telehealth model and combination of telehealth and parent training has a promising future.

The age of participants with ASD ranged from 1.75–16 years, with the majority of participants being under 6 years old. Current research trends indicate that young age is a crucial predictor of success in behavioural interven-tions (Perry et al. 2011). The UK government initiatives

Page 31: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

612 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

have highlighted early intervention as a crucial focus for future research (National Institute for Health Research 2017). The application of telehealth with this age cohort is very promising, enabling parents to receive training prior to the commencement of educational services could be key in future service models. Despite the promising prospects of early intervention, the research is limited to this narrow age range. Prior research shows that ABA-based intervention can have great success with both a teenage and adult age cohort (Bennet and Dukes 2013; Koegel et al. 2014; Santiago et al. 2016). Future research might focus on the application of these interventions with an older age group allowing for a greater concept of the scope of telehealth.

The second aim of the review was to assess the outcomes of the research in order to determine if the interventions were successful. An overview of selected research indicates at least some favourable outcomes in all 28 studies. Out-comes were measured for both interventionists and partici-pants with ASD and varied depending on intervention aims and category.

A total of 75% (n = 21) of studies collected data on at least one measure of interventionist behaviour. All but one collected data on procedural fidelity. Measures of fidelity have been shown to correlate with best outcomes for child participants (Penn et al. 2007; Symes et al. 2006; Whiteford et al. 2012). All 21 studies showed improvement in pro-cedural fidelity for all participants involved. However, one study (Barkaia et al. 2017) reported improved measures of fidelity but still achieved a relatively low fidelity level of around 60% which would not be considered widely accept-able. Several other studies reported the need to perform ‘top up’ training in order for agents to reach pre-set fidelity cri-teria. Despite these few discrepancies, the literature does demonstrate the capabilities of telehealth and goes some way to answering the pertinent question of whether behav-iour analytic provisions can be delivered via a telehealth with appropriate levels of fidelity to ensure best outcomes. Additional studies should also focus on collecting fidelity on the coach’s procedures whilst training interventionists, this data was collected by a small number of studies (e.g. Neely et al. 2016) and allows for a tertiary level of data collection to ensure a greater level of procedural integrity across all levels of the research.

Data on outcomes of participants with ASD were col-lected in 85% (n = 24) of studies. Measures differed based upon the intervention category but as a whole improvement was less consistent than measures of fidelity for interven-tionists. Measures of challenging behaviour were collected in 50% (n = 14) of studies, social-communication responses were collected in 46% (n = 13) of studies and motor imitation was measured in 17% (n = 5). Overall, there was improve-ment in target behaviour across studies, although several studies observed little or no improvements in some but not

all participant outcomes (e.g. Barkaia et al. 2017; Macha-licek et al. 2016; Meadan et al. 2016; Suess et al. 2014; Vismara et al. 2013; Wainer and Ingersoll 2015). A greater proportion of naturalistic interventions were rated as mixed when compared to FA + FCT studies (45% vs. 17%). For example, Barkaia et al. (2017) found clear gains in mand and echoic behaviour in one out of three participants. Whether this was a result of individual differences or a failure of the telehealth model remains to be seen, although as mentioned earlier this study reported low levels of therapist fidelity. In a similar study Neely et al. (2016) were able to achieve a high rating of fidelity across therapists and increased manding for all participants with ASD. This was the only study to be rated as of ‘adequate’ quality. Individual differences in outcome success have often perplexed ABA researchers. On-going research aims to identify factors which may predict success (Mudford et al. 2009; Perry et al. 2011; Whiteford et al. 2012). This area is somehow explored in several of the group design studies included in this review (e.g. Ingersoll et al. 2016; Vismara et al. 2009, 2016) but further research is needed in this area.

The final aim of the present systematic review was to rate the methodological quality of the existing body of evidence. All 28 eligible studies were assessed against the research quality indicators developed by Reichow et al. (2008). Over-all ratings of quality were low and telehealth-based applica-tions of ABA are currently deemed to have a status of ‘Not an EBP’.

In the single subject research design studies, more than half of the studies (39%; n = 11) were rated as having unac-ceptable baseline conditions. Despite conditions being accurately described and for the most part containing three data points, many failed to show stable levels or trends. This is perhaps a result of the applied nature of the research in which it is not always practical or even possible to wait for stable trends of baseline responding. Future research should aim to establish a stable baseline level, so that it can provide a stronger demonstration of a functional relation between the intervention and behaviour change and higher levels of inter-nal validity. Pre-planning resources so as to enable extension of baseline if stable levels of behaviour are not achieved in the first three data points should be conducted.

Experimental control was demonstrated to an acceptable level in 13 studies; similarly, 14 studies were adequate for visual analysis. Research deemed unacceptable failed to demonstrate experimental control as visual analysis showed an unacceptable level of overlapping data or absence of three instances of experimental control. Future studies should ensure that these essential aspects are present by increasing participants or replications.

The participant demographic indicator achieved the low-est score, with 79% (n = 22) of studies being deemed unac-ceptable. Only two studies were rated highly in this indicator

Page 32: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

613Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

(Neely et al. 2016; Wacker et al. 2013a) and age and gender of interventionists was rarely reported. Detailed demograph-ics allow for the generalisation and replication of findings; by omitting this information, researchers undermine external validity. It is vital that future research reports detailed demo-graphics of both interventionists and participants, including level of education and experience and diagnosis and pre-intervention assessment respectively. Future researchers should consider providing all participant demographics for both the participants with ASD and the interventionists. This should include age and gender, pre assessment tools and previous experience. High methodological rigor in this area is demonstrated by the three studies within this review that scored highly on the participant indicator (Bearss et al. 2017; Neely et al. 2016; Wacker et al. 2013a).

Omission of age or gender was quite often the limiting factor restricting quality ratings across studies amongst both single subject research design and group research design. If participant details had been reported even to an adequate standard, three additional group design studies and two addi-tional single subject studies would have gained an overall quality rating of ‘adequate’ (Gibson et al. 2010; Ingersoll et al. 2016; Kuravackel et al. 2018; Lindgren et al. 2015; Simacek et al. 2017) and one group design study would have achieved a ‘strong’ rating (Vismara et al. 2016). With this in mind the formula for determining EBP can be reapplied (Reichow 2011, p. 34). The research would now be provided with a higher score (z = 79), which would in turn translate to a rating of an ‘Established EBP’. This is a vast differ-ence from the original score. It could be argued that this is a weakness of the quality assessment, which allows rela-tively small omissions to have such a large effect on ratings; however, as discussed previously, participant information is a vital component in the establishment of external valid-ity therefore collecting and reporting key information is of crucial importance. Interestingly, no group research design studies were rewarded an acceptable rating for the partici-pant indicator, whilst 15% (n = 3) of single subject research design studies scored an acceptable rating. This may allow for conclusions that single subject research design holds a higher standard of research rigor in comparison to group research designs. It is also important to note that only 36% (n = 10) of the reviewed 28 studies included maintenance or follow-up probes. Again, of these studies just 25% (n = 2) of group research designs showed evidence of maintenance probes whilst 50% (n = 10) of single subject research designs reported this variable. This adds to the conclusion that a single subject research design may hold itself above group research design in research quality and the individualised nature and repeated measurements are more suited to the heterogeneity of behaviour analytic interventions. Of all 28 studies, just 30% (n = 3) had promising follow-up data. This should be a prioritised area of focus for future research.

Current research surrounding telehealth interventions as a means to train interventionists, although still limited, is progressing. The limitations we have identified will aid in the development of methodologically strong studies The use of telehealth is not aimed to replacing face-to-face behav-ioural interventions but to complement or boost their results. Future reviews are needed to assess the outcomes of a com-bination of telehealth and face–face models of delivery, which were excluded from this current review. Addition-ally, all eligible studies were conducted in the United States, therefore future research should focus on the feasibility and cost effectiveness of similar provisions in different coun-tries in which cultural differences might impact on existing models.

In sum, this systematic review suggests that training interventionists to implement behaviour analytic provisions for children with ASD via telehealth is feasible and effec-tive. Small improvements in research rigor could lead to this delivery model being deemed an EBP. Future research-ers should familiarise themselves with quality indicators to ensure methodologically robust research is conducted.

Author Contributions JF participated in the study design, data collec-tion and interpretation of findings, and production of first draft; EC participated in the study design, data collection and interpretation of findings and production of first draft; KD conceived of the study, led its design, made substantial contributions to analysis and interpretation of data, and critically revised manuscript drafts. All authors read and approved the final manuscript.

Funding First and second authors are in receipt of PhD research stu-dentships by the Department for the Economy Northern Ireland.

Compliance with Ethical Standards

Conflict of interest Authors declare that they have no conflict of inter-est.

Ethical Approval This article does not contain any studies with human participants or animals performed by any of the authors.

Open Access This article is distributed under the terms of the Crea-tive Commons Attribution 4.0 International License (http://creat iveco mmons .org/licen ses/by/4.0/), which permits unrestricted use, distribu-tion, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

References

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th edn.). Washington, DC: APA.

Barkaia, A., Stokes, T. F., & Mikiashvili (2017). Intercontinental tel-ehealth coaching of therapists to improve verbalizations by chil-dren with autism. Journal of Applied Behavior Analysis, 50(2), 582–589.

Page 33: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

614 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

Barretto, A., Wacker, D. P., Harding, J., Lee, J., & Berg, W. K. (2006). Using telemedicine to conduct behavioral assessments. Journal of Applied Behavior Analysis, 39(3), 333–340.

Bearss, K., Burrell, L. T., Challa, S. A., Postorino, V., Gillespie, S. E., Crooks, C., & Scahill, L. (2017). Feasibility of parent train-ing via telehealth for children with autism spectrum disorder and disruptive behaviour: a demonstration pilot. Journal of Autism and Developmental Disorders, 48(4), 1020–1030.

Behavior Analyst Certification Board (BACB 2014). Professional and ethical compliance code for behavior analysts. Retrieved from http://www.bacb.com/Downl oadfi les/BACB_Compl iance _Code.pdf.

Behavior Analyst Certification Board. (BACB 2018). Board certified behaviour analyst. Retrieved from https ://www.bacb.com/bcba/.

Bennet, K. D., & Dukes, C. (2013). A systematic review of teaching daily living skills to adolescents and adults with autism spectrum disorder. Review Journal of Autism and Developmental Disorders, 1(1), 2–10.

Benson, S. S., Dimian, A. F., Elmquist, M., Simacek, J., McComas, J., & Symons, F. J. (2017). Coaching parents to assess and treat self-injurious behaviour via telehealth. Journal of Intellectual Dis-ability Research. https ://doi.org/10.1111/jir.12456 .

Boisvert, M., Lang, R., Andrianopoulos, M., & Boscardin, M. L. (2010). Telepractice in the assessment and treatment of individu-als with autism spectrum disorders: A systematic review. Devel-opmental Neurorehabilitation, 13(6), 423–432.

Buescher, A. V. S., Cidav, Z., Knapp, M., & Mandell, D. S. (2014). Costs of autism spectrum disorders in the United Kingdom and the United States. Jama Pediatrics, 168(8), 721–728.

Bulgren, J. A. (2002). The educational context and outcomes for high school students with disabilities: The perceptions of parents of students with disabilities. Research Report. Retrieved from https ://files .eric.ed.gov/fullt ext/ED469 288.pdf.

Centers for Disease Control and Prevention. (2018). Autism spectrum disorder (ASD). Retrieved from https ://www.cdc.gov/ncbdd d/autis m/data.html.

Denne, L., Thomas, E., Hastings, R., & Hughes, C. (2015). Assessing competencies in applied behavior analysis for tutors working with children with autism in a school-based setting. Research in Autism Spectrum Disorders, 20, 67–77.

Department of Education. (2005). Evaluating provision for autistic spectrum disorders in schools. Retrieved from https ://www.educa tion-ni.gov.uk/publi catio ns/evalu ating -provi sion-autis tic-spect rum-disor ders.

Department of Education/Department of Health. (2015). Special edu-cational needs and disability code of practice: 0 to 25 years. Stat-utory guidance for organisations which work with and support children and young people who have special educational needs or disabilities. Retrieved from https ://www.gov.uk/gover nment / uploa ds/syste m/uploa ds.

Department of Health (2011). Whole system demonstrator program. Retrieved from https ://www.gov.uk/gover nment /uploa ds/syste m/uploa ds/attac hment _data/file/21526 4/dh_13168 9.pdf.

Department of Health, Social Services and Public Safety Northern Ireland (2011). Transforming your care; A review of health and social care in Northern Ireland. Retrieved from http://www.trans formi ngyou rcare .hscni .net/wp-conte nt/uploa ds/2012/10/Trans formi ng-Your-Care-Revie w-of-HSC-in-NI.pdf.

Dillenburger, K. (2011). The emperor’s new clothes: Eclecticism in autism treatment. Research in Autism Spectrum Disorders, 5(3), 1119–1128.

Eikeseth, S., Hayward, D., Gale, C., Gitlesen, J.-P., & Eldevik, S. (2008). Intensity of supervision and outcome for preschool aged children receiving early and intensive behavioral interventions: A preliminary study. Research in Autism Spectrum Disorders, 3(1), 67–73.

Fetherstone, A. M., & Sturmey, P. (2014). The effects of behavioral skills training on instructor and learner behavior across responses and skill sets. Research in Developmental Disabilities, 35(2), 541–562.

Gibson, J. L., Pennington, R. C., Stenhoff, D. M., & Hopper, J. S. (2010). Using desktop videoconferencing to deliver interventions to a preschool student with autism. Topics in Early Childhood Special Education, 29(4), 214–225.

Heitzman-Powell, L. S., Buzhardt, J., Rusinko, L. C., & Miller, T. M. (2014). Formative evaluation of an ABA outreach training pro-gram for parents of children with autism in remote areas. Focus on Autism and Other Developmental Disabilities, 29(1), 23–38.

Higgins, W. J., Luczynski, K. C., Carroll, R. A., Fisher, W. W., & Mudford, O. C. (2017). Evaluation of a telehealth training pack-age to remotely train staff to conduct a preference assessment. Journal of Applied Behavior Analysis, 50(2), 238–251.

Horn, B. P., Barragan, G. N., Fore, C., & Bonham, C. A. (2016). A cost comparison of travel models and behavioural telemedicine for rural, Native American populations in New Mexico. Journal of Telemedicine and Telecare, 22(1), 47–55.

Howlin, P., Goode, S., Hutton, J., & Rutter, M. (2004). Adult out-come for children with autism. Journal of Child Psychology and Psychiatry, 45(2), 212–229.

Ingersoll, B., & Berger, N. I. (2015). Parent engagement with a tele-health-based parent-mediated intervention program for children with autism spectrum disorders: Predictors of program use and parent outcomes. Journal of Medical Internet Research, 17(10), 1–15.

Ingersoll, B., Wainer, A. L., Berger, N. I., Pickard, K. E., & Bonter, N. (2016). Comparison of a self-directed and therapist-assisted telehealth parent-mediated intervention for children with ASD: A pilot RCT. Journal of Autism and Developmental Disorders, 46(7), 2275–2284.

Keenan, M., Dillenburger, K., Röttgers, H.-R., Dounavi, K., Jóns-dóttir, S. L., Moderato, P., Schenk, J.-A.-M., Virués-Ortega, J., Roll-Pettersson, L., & Martin, N. (2015). Autism and ABA: The gulf between North America and Europe.. Review Journal of Autism and Developmental Disorders, 2(2), 167–183.

Kessler, D., Lewis, G., Kaur, S., Wiles, N., King, M., Weich, S., Sharp, D. J., Araya, R., Hollinghurst, S., & Peters, T. J. (2009). Therapist-delivered internet psychotherapy for depression in primary care: A randomised controlled trial. The Lancet, 374(9690), 628–634.

Kmet, L. M., Lee, R. C., & Cook, L. S. (2004). Standard quality assess-ment criteria for evaluating primary research papers from a vari-ety of fields. Alberta Heritage Foundation for Medical Research. Retrieved from http://www.ihe.ca/advan ced-searc h/stand ard-quali ty-asses sment -crite ria-for-evalu ating -prima ry-resea rch-paper s-from-a-varie ty-of-field s.

Knapp, M., Romeo, R., & Beecham, J. (2009). Economic cost of autism in the UK. Autism, 13(3), 317–336.

Knutsen, J., Wolfe, A., Burke, B. L., Hepburn, S., Lindgren, S., & Coury, D. (2016). A systematic review of telemedicine in autism spectrum disorders. Review Journal of Autism Developmental Disorders, 3(4), 330–344.

Koegel, L. K., Park, M. N., & Koegel, R. L. (2014). Using self-man-agement to improve the reciprocal social conversation of children with autism spectrum disorder. Journal of Autism Developmental Disorders, 44(5), 1055–1063.

Kroeger, K., & Sorensen, R. (2010). A parent training model for toilet training children with autism. Journal of Intellectual Disability Research, 54(6), 556–567.

Kuravackel, G. M., Ruble, L. A., Reese, R. J., Ables, A. P., Rodgers, A. D., & Toland, M. D. (2018). Compass for hope: Evaluating the effectiveness of a parent training and support program for

Page 34: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

615Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

children with ASD. Journal of Autism and Developmental Disor-ders, 48(8), 404–416.

Lindgren, S., Wacker, D. P., Suess, A., Schieltz, K., Pelzel, K., Kopel-man, T., Lee, J., Romani, P., & Waldron, D. (2015). Telehealth and autism: Treating challenging behavior at a lower cost. Pediatrics, 137(2), 167–175.

Machalicek, W., Lequia, J., & Raulston, T. J. (2016). Behavioral tele-health consultation with families of children with autism spectrum disorder. Behavioral Interventions, 31(3), 223–250.

Machalicek, W., O’Reilly, M., Chan, J. M., Rispoli, M., Davis, T., Shogren, K., Sigafoos, J., Lancioni, G., Antonucci, M., Langth-orne, P., Andrews, A., & Didden, R. (2009b). Using videoconfer-encing to conduct functional analysis of challenging behaviour and develop classroom behavioral support plans for students with autism. Education and Training in Developmental Disabilities, 44(2), 207–217.

Machalicek, W., O’Reilly, M., Chan, J. M., Rispoli, M., Lang, R., Davis, T., Shogren, K., Sorrells, A., Lanciono, G., Sigafoos, J., Green, V., & Langthorne, P. (2009a). Using videoconferencing to support teachers to conduct preference assessments with student with autism and developmental disabilities. Research in Autism Spectrum Disorders, 3(1), 32–41.

Machalicek, W., O’Reilly, M. F., Rispoli, M., Davis, T., Lang, R., & Franco, H., J (2010). Training teachers to assess the challenging behaviors of students with autism using tele-conferencing. Edu-cation and Training in Autism and Developmental Disabilities, 45(2), 203–215.

Makrygianni, M.-K., & Reed, P. (2010). A meta-analytic review of the effectiveness of behavioural early intervention programs for children with Autistic Spectrum Disorders. Research in Autism Spectrum Disorders, 4(4), 577–593.

Meadan, H., & Daczewitz, M. E. (2015). Internet-based intervention training for parents of young children with disabilities: A promis-ing service-delivery model. Early Child Development and Care, 185(1), 155–169.

Meadan, H., Snodgrass, M. R., Meyer, L. E., Fisher, K. M., Chung, M. Y., & Halle, J. W. (2016). Internet-based parent-implemented intervention for young children with autism: A pilot study. Journal of Early Intervention, 38(1), 3–23.

Miltenberger, R. G. (2004). Behavior modification: Principles and procedures (3rd ed.). Belmont: Wadsworth.

Moher, D., Liberati, A., Altman, D. G., & The, P. R. I. S. M. A. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA Statement. PLoS Medicine, 6(7), e1000097.

Mudford, O., Blampied, N., Phillips, K., Harper, D., Foster, M., Church, J., Hunt, M., Prochnow, J., Rose, D., Arnold-Saritepe, A., Peters, H., Lie, C., Jeffrey, K., Messick, E., Sumpter, C., McE-wan, J., & Wilczynski, S. (2009). Technical review of published research on applied behaviour analysis interventions for people with autism spectrum disorders. Wellington: Ministry of Educa-tion, Auckland Uniservices Ltd..

Murphy, M. A., & Ruble, L. A. (2012). A comparative study of rural-ity and urbanicity on access to and satisfaction with services for children with autism spectrum disorders. Rural Special Education Quarterly, 31(3), 3–11.

National Autistic Society (2017). Autism facts and history. Retrieved from http://www.autis m.org.uk/about /what-is/myths -facts -stats .aspx.

National Health Medical Research Council. (1999). A guide to the development, implementation and evaluation of clinical practice guidelines. Canberra: Commonwealth of Australia.

National Institute for Health Research (2017). Intensive behavioural interventions based on applied behaviour analysis (ABA) for young children with Autism spectrum disorder: A systematic review and cost-effectiveness analysis. .

National Research Council. (2001). Educating children with autism. Washington, DC: National Academy Press.

Neely, L., Rispoli, M., Gerow, S., & Hong, E. R. (2016). Preparing interventionists via telepractice in incidental teaching for children with autism. Journal of Behavior Education, 25(4), 393–416.

Neely, L., Rispoli, M., Gerow, S., Hong, E. R., & Hagan-Burke, S. (2017). Fidelity outcomes for autism-focused interventionists coached via telepractice: A systematic literature review. Journal of Development and Physical Disability, 29(6), 849–874.

Office of National Statistics. (2016). Internet users in the UK: 2016. Retrieved from https ://www.ons.gov.uk/busin essin dustr yandt rade/itand inter netin dustr y/bulle tins/inter netus ers/2016.

Parsons, D., Cordier, R., Vaz, S., & Lee, H. C. (2017). Parent-medi-ated intervention training delivered remotely for children with autism spectrum disorder living outside of urban areas: System-atic review. Journal of Medical Internet Research. 19(8), e198.

Penn, H., Prichard, A., & Perry, A. (2007). The reliability and valid-ity of a pilot version of the york measure of quality of intensive behavioural intervention. Journal on Developmental Disabili-ties, 13(3), 149–166.

Perry, A., Cummings, A., Geier, J. D., Freeman, N. L., Hughes, S., Managhan, T., Reitzel, J. A., & Williams, J. (2011). Predictors of outcome for children receiving intensive behavioral interven-tion in a large, community-based program. Research in Autism Spectrum Disorders, 5(1), 592–603.

Plantiveau, C., Dounavi, K., & Virués-Ortega, J. (2018). High levels of burnout among early-career board certified behavior analysts with low collegial support in the work environment. European Journal of Behavior Analysis. https ://doi.org/10.1080/15021 149.2018.14383 39.

Reichow, B. (2011). Development, procedures, and application of the evaluative method for determining evidence-based practices in autism. In B. Reichow et al. (Eds.), Evidence-based practices and treatments for children with autism (pp. 25–39). New York: Springer. https ://doi.org/10.1007/978-1-4419-6975-0_2.

Reichow, B. (2012). Overview of meta-analyses on early intensive behavioral intervention for young children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 42(4), 512–520.

Reichow, B., Hume, K., Barton, E. E., & Boyd, B. A. (2018). Early intensive behavioral intervention (EIBI) for young children with autism spectrum disorders (ASD). Cochrane Database of Systematic Reviews. https ://doi.org/10.1002/14651 858.CD009 260.pub2.

Reichow, B., Volkmar, F. R., & Cicchetti, D. V. (2008). Development of the evaluative method for evaluating and determining evidence-based practices in autism. Journal of Autism and Developmental Disorders, 38, 1311–1319.

Salomone, E., Besterah, K., Derbyshire, K., McCloy, C., Hastings, R. P., Howlin, P., & Charman, T. (2014). Emotional and behavioural problems in children and young people with autism spectrum dis-order in specialist autism schools. Research in Autism Spectrum Disorders, 8(6), 661–668.

Salomone, E., & Maurizio Arduino, G. (2017). Parental attitudes to a telehealth parent coaching intervention for autism spectrum disorder. Journal of telemedicine and telecare, 23(3), 416–420.

Santiago, J. L., Hanley, G. P., Moore, K., & Jin, C. S. (2016). The generality of interview-informed functional analyses: Systematic replications in school and home. Journal of Autism Developmental Disorders, 46(3), 797–811.

Sheinkopf, S. J., & Siegel, B. (1998). Home-based behavioral treatment of young children with autism. Journal of Autism and Develop-mental Disorders, 28(1), 15–23.

Simacek, J., Dimian, A. F., & McComas, J. J. (2017). Communication Intervention for young children with server neurodevelopmental

Page 35: Telehealth as a Model for Providing Behaviour Analytic Interventions … · 2019-09-06 · Current reviews have not focused specifically on ABA-based interventions and have instead

616 Journal of Autism and Developmental Disorders (2019) 49:582–616

1 3

disabilities via telehealth. Journal of Autism and Developmental Disorders, 47(3), 744–767.

Suess, A. N., Romani, P. W., Wacker, D. P., Dyson, S. M., Kuhle, J. L., Lee, J. F., Lindgren, S. D., Kopelman, T. G., Pelzel, K. E., & Waldron, D. B. (2014). Evaluating the treatment fidelity of parents who conduct in home functional communication train-ing with coaching via telehealth. Journal of Behavior Education, 23(1), 34–59.

Suess, A. N., Wacker, D. P., Schwartz, J. E., Lustig, N., & Detrix, J. (2016). Preliminary evidence on the use of telehealth in an outpatient behavior clinic. Journal of Applied Behavior Analysis, 49(3), 686–692.

Symes, M., Remington, B., Brown, T., & Hastings, R. (2006). Early intensive behavioral intervention for children with autism: Thera-pists’ perspectives on achieving procedural fidelity. Research in Developmental Disabilities, 27, 30–42.

The Scottish Government. (2011). A national telehealth and telecare delivery plan for Scotland to 2015 driving improvement, integra-tion and innovation. Retrieved from http://www.gov.scot/Resou rce/0041/00411 586.pdf.

Vismara, L. A., McCormick, C., Wagner, A. L., Monlux, K., Nad-ham, A., & Young, G. S. (2016). Telehealth parent training in the early start Denver model: Results from a randomized control trial. Focus on Autism and Other Developmental Disabilities, 20(12), 1–3.

Vismara, L. A., McCormick, C., Young, G. S., Nadhan, A., & Monlux, K. (2013). Preliminary findings of a telehealth approach to parent training in autism. Journal of Autism and Developmental Disor-ders, 43(12), 2953–2969.

Vismara, L. A., Young, G. S., & Rogers, S. J. (2012). Telehealth for expanding the reach of early autism training to parents. Autism Research and Treatment, 20(12), 1–12.

Vismara, L. A., Young, G. S., Stahmer, A. C., McMahon Griffin, E., & Rogers, S. J. (2009). Dissemination of evidence-based practice:

Can we train therapists from a distance? Journal of Autism and Developmental Disabilities, 39, 1636.

Wacker, D. P., Lee, J. F., Dalmau, Y. C., Kopelman, T. G., Lindgren, S. D., Kuhle, J., Pelzel, K. E., Dyson, S., Schieltz, K. M., & Wal-dron, D. B. (2013a). Conducting functional analysis of problem behaviour via telehealth. Journal of Applied Behavior Analysis, 46(1), 31–46.

Wacker, D. P., Lee, J. F., Dalmau, P., Kopelman, Y. C., Lindgren, T. G., Kuhle, S. D., Pelzel, J., Dyson, K., Schieltz, S., K. M., & Waldron, D. B. (2013b). Conducting functional communication training via telehealth to reduce problem behavior in children with autism. Journal of Developmental and Physical Disabilities, 25(1), 35–48.

Wainer, A. L., & Ingersoll, B. R. (2015). Increasing access to an ASD imitation intervention via a telehealth parent training program. Journal of Autism and Developmental Disabilities, 45(12), 3877–3890.

Webb, T., Joseph, J., Yardley, L., & Michie, S. (2010). Using the inter-net to promote health behavior change: A systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. Journal of Medical Internet Research. https ://doi.org/10.2196/jmir.1376.

Whiteford, S., Blacklock, K., & Perry, A. (2012). Brief report: Reli-ability of the york measure of quality of IBI (YMQI). Journal on Developmental Disabilities, 18(3), 63–67.

Wilczynski, S. M., Labrie, A., Baloski, A., Kaake, A., Marchi, N., & Zoder-Martell, K. (2017). Web-based teacher training and coach-ing/feedback: A Case Study. Psychology in the Schools, 54(4), 433–445.

Wong, C., Odom, S. L., Hume, K., Cox, A., Fettig, A., Kucharczyk, S., Brock, M., Plavnick, J. B., Fleury, V. P., & Schultz, T. R. (2014). Evidence-Based Practices for Children, Youth, and Young Adults with Autism Spectrum Disorder. Retrieved from http://autis mpdc.fpg.unc.edu/sites /autis mpdc.fpg.unc.edu/files /2014-EBP-Repor t.pdf.