9
Our reference: ESWA 5889 P-authorquery-v8 AUTHOR QUERY FORM Journal: ESWA Article Number: 5889 Please e-mail or fax your responses and any corrections to: E-mail: [email protected] Fax: +31 2048 52799 Dear Author, Please check your proof carefully and mark all corrections at the appropriate place in the proof (e.g., by using on-screen annotation in the PDF file) or compile them in a separate list. To ensure fast publication of your paper please return your corrections within 48 hours. For correction or revision of any artwork, please consult http://www.elsevier.com/artworkinstructions. Any queries or remarks that have arisen during the processing of your manuscript are listed below and highlighted by flags in the proof. Click on the ‘Q ’ link to go to the location in the proof. Location in article Query / Remark: click on the Q link to go Please insert your reply or correction at the corresponding line in the proof Q1 Please provide 3–5 Research highlights. For more information, see www.elsevier.com/researchhighlights. Q2 Please check the placement of Fig. 7, and correct if necessary. Q3 This section comprises references that occur in the reference list but not in the body of the text. Please position each reference in the text or, alternatively, delete it. Any reference not dealt with will be retained in this section. Thank you for your assistance.

EDUCA: A web 2.0 authoring tool for developing adaptive and intelligent tutoring systems using a Kohonen network

Embed Size (px)

Citation preview

Our reference: ESWA 5889 P-authorquery-v8

AUTHOR QUERY FORM

Journal: ESWA

Article Number: 5889

Please e-mail or fax your responses and any corrections to:

E-mail: [email protected]

Fax: +31 2048 52799

Dear Author,

Please check your proof carefully and mark all corrections at the appropriate place in the proof (e.g., by using on-screen annotation in the PDFfile) or compile them in a separate list. To ensure fast publication of your paper please return your corrections within 48 hours.

For correction or revision of any artwork, please consult http://www.elsevier.com/artworkinstructions.

Any queries or remarks that have arisen during the processing of your manuscript are listed below and highlighted by flags in the proof. Clickon the ‘Q’ link to go to the location in the proof.

Location inarticle

Query / Remark: click on the Q link to goPlease insert your reply or correction at the corresponding line in the proof

Q1 Please provide 3–5 Research highlights. For more information, see www.elsevier.com/researchhighlights.

Q2 Please check the placement of Fig. 7, and correct if necessary.

Q3 This section comprises references that occur in the reference list but not in the body of the text. Pleaseposition each reference in the text or, alternatively, delete it. Any reference not dealt with will be retainedin this section.

Thank you for your assistance.

1

2

3

4

56

7

9

10111213141516

1 7

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

Expert Systems with Applications xxx (2011) xxx–xxx

ESWA 5889 No. of Pages 9, Model 5G

9 February 2011

Contents lists available at ScienceDirect

Expert Systems with Applications

journal homepage: www.elsevier .com/locate /eswa

EDUCA: A web 2.0 authoring tool for developing adaptive and intelligenttutoring systems using a Kohonen network

Ramón Zatarain Cabada a,⇑, María Lucía Barrón Estrada a, Carlos Alberto Reyes García b

a Instituto Tecnológico de Culiacán, Juan de Dios Bátiz s/n col. Guadalupe, Culiacán, Sinaloa, CP 80220, Mexicob Instituto Nacional de Astrofísica, Óptica y Electrónica (INAOE), Luis Enrique Erro No. 1, Sta. Ma. Tonanzintla, Puebla, CP 72840, Mexico

a r t i c l e i n f o

1819202122

Keywords:Intelligent tutoring systemsCooperative/collaborative learningAuthoring tools and methodsLearning communities

2324252627

0957-4174/$ - see front matter � 2011 Published bydoi:10.1016/j.eswa.2011.01.145

⇑ Corresponding author.E-mail address: [email protected] (R.Z. Cabada

Q1

Please cite this article in press as: Cabada, R. Z.Kohonen network. Expert Systems with Applicati

a b s t r a c t

This paper presents a Web 2.0 Learning Environment, for a systematic creation of adaptive and intelligenttutoring systems. Authoring contents is made by a community of users including teachers and students.The tutoring systems adapt the contents according to the best learning style using self-organizing maps(SOMs). The SOM was trained for classifying Felder–Silverman learning styles. The most importantadvantage of these unsupervised neural networks is that they do not require an external teacher for pre-senting a training set. The approach was implemented under an authoring tool that allows the productionof personalized learning material to be used under collaborative and mobile learning environments. Thetutoring systems together with the neural network can also be exported to mobile devices. We presentdifferent results to the approach working under the authoring tool.

� 2011 Published by Elsevier Ltd.

28

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

1. Introduction

Since the beginning of Intelligent Tutoring Systems (ITS) re-search, more than twenty authoring systems for ITS have beendeveloped (Murray, Blessing, & Ainsworth, 2003). Those authoringtools can be classified according to what type of tutoring systemthey produce. For example the author tool SIMQUEST (de Jonget al., 1999) produces ‘‘simulation-based learning’’ systems, IRIS(Arruarte, Fernández, Ferrero, & Greer, 1997) creates ‘‘multipleknowledge types’’ systems and InterBook (Brusilovsky & Schwarz)generates Intelligent/adaptive Hypermedia. One shared feature ofall of those tools is the separate role of authors and learners. For in-stance, in SIMQUEST one author creates the simulation model, thelearner interface, the instructional design, and the environment.In this list of tasks, the learners are never involved. In IRIS, theauthor produces an ITS by following two main phases: Specifyingthe general requirements of the tutoring system, and filling thelearning contents of the ITS. On the other hand, building adaptiveeducational material is a similar procedure: the developer has tocreate content objects and specify the links between them. Author-ing tools for developing adaptive educational/tutoring systems likeInterBook, SIGUE (Carmona, Bueno, EduardoGuzman, & Conejo,2002), NetCoach (Weber, Kuhl, & Weibelzahl, 2001), and Ale(Specht, Kravcik, Klemke, Pesin, & Hüttenhain, 2002) differentiateonly by the interface tools they operate. Some of them use specialmarkup languages and some GUI interfaces. The author creates

81

82

83

Elsevier Ltd.

).

, et al. EDUCA: A web 2.0 authoons (2011), doi:10.1016/j.eswa

the learning environments and the learner read the learningcontents.

In the last years many research groups in the field of educationare using Web 2.0 technologies, such as wikis, blogs, recommenda-tion systems and social networking (O’Reilly, http://oreilly.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html). Thiskind of technology is now identified as Social Software. In the fieldof e-learning, a ‘‘tutor centered’’ concept is shifting to becomemore learner centered (coined as e-learning 2.0), where learnersare also part of a community of authors and users of the learningresources (Hage & Aimeur, 2008). On the other hand, Learner orStudent Models are the core of the personalization of IntelligentTutoring Systems. They make available tutoring tailored or adaptedto the needs of the individual students (Kerly & Bull, 2008). Manyapproaches and implementations have been developed in recentyears in order to model students’ learning styles (Carmona, Castil-lo, & Millán, 2008; Graf, Kinshuk, & Liu, 2008). Most of those imple-mentations use Bayesian Networks (Carmona et al., 2008), LinearTemporal Logic (Limongelli, Sciarrone, & Vaste, 2008), or Neuro-fuzzy Networks (Zatarain-Cabada et al., 2008). In the case of usinga learning model like Felder–Silverman (Felder & Silverman, 1988),we also use the Index of Learning Style Questionnaire (Felder &Solomon, http://www.engr.ncsu.edu/learningstyles/ilsweb.html).

In this work we propose a different approach for selecting a stu-dent’s learning style using self-organising feature maps (Kohonenneural networks) (Kohonen, 1989). Advantages of Kohonen net-works include implementation simplicity, execution speed and ashorter training process; however maybe the most importantadvantage of these unsupervised neural networks is that they do

ring tool for developing adaptive and intelligent tutoring systems using a.2011.01.145

Original text:
Inserted Text
kohonen
Original text:
Inserted Text
Culiacan
Original text:
Inserted Text
Guadalupe
Original text:
Inserted Text
Mexico Carlos Alberto Reyes Garcıa
Original text:
Inserted Text
Astrofısica,
Original text:
Inserted Text
(INAOE)
Original text:
Inserted Text
1
Original text:
Inserted Text
Puebla,C.P.
Original text:
Inserted Text
Mexico
Original text:
Inserted Text
Felder-Silverman
Original text:
Inserted Text
(O’Reilly,
Original text:
Inserted Text
,
Original text:
Inserted Text
Felder-Silverman
Dr Ramon
Comment on Text
(Brusilovsky & Schwartz, 1998) change related to Q3
Dr Ramon
Comment on Text
(O'Reilly, 2005) related to Q3
Dr Ramon
Comment on Text
(Felder et al., 2004) related to Q3
Dr Ramon
Comment on Text
Replace the whole abstract for the new one: "We present a Web 2.0 tool for creating adaptive and intelligent tutoring systems. The tool can produce learning material for mobile learning environments. Authoring contents is made by a community of users including teachers and students. A Kohonen network is used to classify Felder-Silverman learning styles. We present different results to the approach working under the authoring tool."

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

2 R.Z. Cabada et al. / Expert Systems with Applications xxx (2011) xxx–xxx

ESWA 5889 No. of Pages 9, Model 5G

9 February 2011

not require an external teacher for presenting a training set. Duringa training session, our Kohonen network receives a number of dif-ferent input patterns (the student learning style obtained from theILSQ, the course learning style, and the student’s grade in thecourse), discovers significant features in these patterns (Felder–Silverman learning styles) and learns how to classify input.

In this context, we have designed and implemented a softwaretool (EDUCA) to create adaptive learning material in a Web 2.0 col-laborative learning environment. The material is initially createdby a tutor/instructor and later maintained and updated by theuser/learner community to each individual course. The coursescan dynamically recognize user learning characteristics and be dis-played on mobile computers (cell phones, PDA, etc.). EDUCA makesuse of Web 2.0 technologies as a recommendation system for filter-ing future Web learning resources, and Web mining for discoveringsuch resources.

The arrangement of the paper is as follows: Section 2 gives ageneral structure of the tool. Section 3 presents the neural networkand predictive engine used in the tool. Results are shown in Section4. Discussions and conclusions are given in Section 5.

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

2. The methodology

2.1. Building a tutoring system with Educa

The process of constructing a new tutoring system (an adaptiveor intelligent system) consists of three main steps (Fig. 1). DuringStep 1 a tree structure of the adapted or intelligent tutoring systemis designed by the main instructor(s) of the learning material. Inthe structure the designer specifies the course information (title,general description, author name, etc.), the unit names, and foreach sub unit, the designer defines names and tags related to thatsub unit, and all the prerequisites the student should get done. Inthe tree structure, the designer also inserts quizzes (multiple selec-tion and choice). Quizzes are an important element to provideadaptation capabilities to the produced tutors.

In step 2 the tree structure is filled with domain contents (aknowledge base), and some other learning resources. At the begin-ning of the creation the instructor or teacher authors the tutoringsystem by inserting different learning objects like text fragments,images, audio/video clips, and by defining learning styles, prereq-uisites, tags and quizzes. At a later time, learning resources areadded to the tutoring system by learners, who make recommenda-tion of resources they find commonly in the web. Those resourcescan be found also in a special resource repository of Educa. Afterthe author creates the tutoring system, she/he can save it and ex-port it to a Mobile Learning format used to display tutoring sys-tems on mobile devices (step 3). The saved/exported file willenclose three elements: a XML file corresponding to the learningresources or contents, a predictive engine for navigation pur-poses, and the SOM Neural Network for learning style classifica-

Fig. 1. Building a tutoring

Please cite this article in press as: Cabada, R. Z., et al. EDUCA: A web 2.0 authoKohonen network. Expert Systems with Applications (2011), doi:10.1016/j.eswa

tion. Another option to the output of Educa is to export thetutoring system to SCORM format. The benefit of this format isthe availability of the material in any distance learningenvironment.

2.2. Educa architecture

Educa Architecture is composed by five main components ormodules (Fig. 2): an authoring tool, two repositories (for resourcesand courses), an intelligent delivery Engine, and a recommendationengine.

The authors create initially a tutoring or adaptive system (a spe-cial type of knowledge base) using Educa authoring tool whichruns in a desk computer. The tutoring system then is exported toa mobile computer (it can also be run in one wireless emulator likeSun Java Wireless Toolkit). Once the system is installed in a mobiledevice, a student can display the learning objects (LO) by using anIntelligent Delivery Engine (installed together with a neural net-work in the mobile). The engine displays the LOs in the mobileaccording to the learning style of the student and with the helpof the neural network.

When the authors create the LOs, they have two different op-tions: One choice, the traditional one, is importing LOs from differ-ent sources like SCORM, HTML, .doc or .PDF files or by editingdirectly the learning material by using a text editor of Educa. Thesecond choice is more Web 2.0 oriented, and it consists of usinga recommendation engine. This application employs two reposito-ries: a resource repository, which is used for recommending newresources found in the Web by community members; a courserepository which stores all the courses created with Educa. Bothrepositories are stored in a DBMS.

2.3. Creating the knowledge base

As we have mentioned before (Section 2.1), a course is createdby first step designing a tree structure of the adapted or intelligenttutoring system, which represents the knowledge of the system. Inorder to designing and implementing a course knowledge represen-tation, we apply some of the concepts related to Knowledge SpaceTheory (Doignon & Falmagne, 1999). This theory provides a soundfoundation for structuring and representing the knowledge domainfor personalized or adapted learning. It applies concepts from com-binatory theory and we use it to model particular or personalizedcourses according to different learning styles. Educa enables thecreation or construction and application of discipline-specificknowledge spaces (or structures). An adapted assessment basedupon knowledge spaces and student prerequisites (and employinga Kohonen neural network for identifying learning styles), will de-rive a particular or personalized path of learning objects. Fig. 3shows an example of the knowledge domain for a Compiler course.

system with Educa.

ring tool for developing adaptive and intelligent tutoring systems using a.2011.01.145

Original text:
Inserted Text
(Felder-Silverman
Original text:
Inserted Text
educa
Original text:
Inserted Text
Tutoring
Original text:
Inserted Text
Adaptive System
Original text:
Inserted Text
Course.

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

Fig. 2. Educa architecture.

R.Z. Cabada et al. / Expert Systems with Applications xxx (2011) xxx–xxx 3

ESWA 5889 No. of Pages 9, Model 5G

9 February 2011

The domain represents the knowledge of two main chapters(Front-end and Back-end). The first chapter contains four topicsand one quiz. Each topic is represented by a special type of conceptmap providing learning material of the topic knowledge domain. Foreach topic a set of prerequisites and quizzes are set. For example, inorder to study syntactic analysis it is necessary first to study con-text-free grammars. Based on the prerequisite relationship identi-fied in this way, a knowledge structure (a subset of the knowledgedomain) represents the personalized or adapted learning material.

Fig. 4 shows the knowledge domain of the topic parsing (syn-tactic analysis). In each line we see different learning objects teach-ing the same subject under different learning style. In the first path(pointed by a star) the last component is shown using the combi-nation of dimensions (visual, sensitive, global). In this way, wecan have many combinations or paths for learning the same topic.Dashed lines represent those paths. We can also see the prerequi-sites for studying the topic (Lecture 2 – Lexical Analysis).

2.4. Adding learning objects

In Educa we find two main authors: the instructor o tutor andthe learners. The instructor creates an intelligent tutoring (adap-tive) system by first building the tree structure of the knowledgedomain (a learning object container) by using the Edita visual edi-

Fig. 3. Knowledge domain

Please cite this article in press as: Cabada, R. Z., et al. EDUCA: A web 2.0 authoKohonen network. Expert Systems with Applications (2011), doi:10.1016/j.eswa

tor (see Fig. 3). The content for each topic is added by importing al-ready prepared learning material in different standard formats likehtml, pdf, doc or SCORM learning objects from any type of source(Fig. 5). The author can also add learning material by using a simpleeditor included in the tool.

Another important learning object the authors insert into theknowledge repository is a quiz. This object can be added in everypart of the domain (see Fig. 3). The quiz is essential for the dynamiccourse adaptation because it provides important information to theneural network.

After the author creates the knowledge base of the tutoring sys-tem, she/he can save it and export it to a Mobile Learning formatused to display tutoring systems on mobile devices. The saved/ex-ported file will enclose three elements: a XML file correspondingto the learning style model, a predictive engine for navigation pur-poses, and the Kohonen Neural Network for learning style classifica-tion. Another option to the output of the fuzzy editor is to export thelearning material to SCORM format. The benefit of this format is theavailability of the material in any distance learning environment.

The other authors in Educa are the Learners. When a student orlearner reads a tutoring system for the first time, a user profile iscreated in the system. This profile contains student data like stu-dent’s learning style, academic records and GPA, past uploaded re-sources (recommendation), and general academic information.

Once a tutoring system has been created, the module PublishedCourse stores it in a course repository. We know that learners usu-ally read tutoring systems stored in some kind of repository, butthey also consult other learning resources in different web sites.For example a student who needs to implement a LR parser in acompiler course, could use the tutoring system stored in the courserepository, but she/he could also consult extra resources in theWeb. This material found by the student would be rated and rec-ommended to be added to the regular compiler course. Educa usesa Hybrid Recommendation System (Burke, 2002) which stores newresources into a Resource Repository and Text Mining to search re-sources in the Web. Fig. 6 represents the different modules andconnections of Educa.

3. The predictive engine

The main goal of the predictive engine is to identify dynamicallythe student’s learning style whenever he is running the tutoring

for a compiler course.

ring tool for developing adaptive and intelligent tutoring systems using a.2011.01.145

Original text:
Inserted Text
Course Repository.

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

Fig. 4. Concept map for parsing topic.

Fig. 5. Adding content to the tutoring system.

Q2

4 R.Z. Cabada et al. / Expert Systems with Applications xxx (2011) xxx–xxx

ESWA 5889 No. of Pages 9, Model 5G

9 February 2011

system. At the beginning an interpreter select content (learningobjects) based upon the student’s learning style, obtained fromthe student profile. The learning style of a student can be modifiedaccording to evaluations applied to the student (see Fig. 7).

260

261262264264

265

266

267

268

269

270

271272274274

3.1. The Kohonen neural network

The predictive or intelligent delivery engine is implemented bya self-organizing feature map or Kohonen neural network which istrained using unsupervised learning. In competitive learning, neu-rons compete among themselves to be activated. The Kohonenmodel provides topological mapping, placing a fixed number of in-put patterns from the input layer into a higher-dimension outputor Kohonen layer (Fig. 8). The Kohonen layer consists of a singlelayer of computation neurons, with two types of different connec-tions: forward connections, from input layer to the Kohonen layer,and lateral connections between neurons in the Kohonen layer.During training, the neural network receives new input patterns

Please cite this article in press as: Cabada, R. Z., et al. EDUCA: A web 2.0 authoKohonen network. Expert Systems with Applications (2011), doi:10.1016/j.eswa

presented as vectors. Every neuron in the Kohonen layer receivesa modified copy of the input pattern. The lateral connections pro-duce excitatory or inhibitory effects, depending on the distancefrom the winning neuron.

3.2. Training the Kohonen network

An input vector in our neural network is described as:

D ¼ ½dfsdap�;

where D is the input vector, and it is formed by three elements: dfs

which is the student learning style identified by applying the Fel-der–Silverman ILSQ questionnaire; da which is the learning styleused in the learning material read by the student; and p is the stu-dent grade obtained in the test when the student has learning styledfs and the course was offered using learning style da.

Vectors dfs and da are also composed as:

da ¼ dfs ¼ ½c1c2c3�;

ring tool for developing adaptive and intelligent tutoring systems using a.2011.01.145

Original text:
Inserted Text
student.(See
Original text:
Inserted Text
)
Original text:
Inserted Text
kohonen
Original text:
Inserted Text
kohonen
Original text:
Inserted Text
Felder-Silverman

275

276

277

278

279

280

281

282284284

285

286

287

288

289

290292292

293

294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

311

312

313

314

315

316

317

Fig. 6. General architecture of Educa.

Fig. 7. The Predictive engine.

Fig. 8. Kohonen network for learning styles.

R.Z. Cabada et al. / Expert Systems with Applications xxx (2011) xxx–xxx 5

ESWA 5889 No. of Pages 9, Model 5G

9 February 2011

where c1 c2 c3 represents three scores for Perception, Input, andUnderstanding Dimension in the ILSQ questionnaire.

Fig. 8 shows part of the Kohonen network architecture. We cansee that the input layer has seven neurons, corresponding to three-dimension vectors dfs and da, and the student grade p. Vector’s in-put data vary between �11 and +11, which is massaged to therange �1 to +1 with the equation:

Please cite this article in press as: Cabada, R. Z., et al. EDUCA: A web 2.0 authoKohonen network. Expert Systems with Applications (2011), doi:10.1016/j.eswa

Massaged value11 ¼ vi=jvimaxj;

where vi is a ILSQ score, and vimax is the maximum ILSQ score value(+11). In Fig. 8, as we observe, �3, an ILSQ score for visual/verballearning style, is mapped to �0.272. On the other hand, the studentgrade, which varies between 0 and 100, is also massaged to therange �1 to +1, with equation:

vnj ¼ vj � 2=vjmax� 1;

where vj is the student grade or score, and vjmax is the maximumstudent grade (+100). For example, 70 is mapped to 0.4 (Fig. 8).

The Kohonen layer has 1600 neurons arranged in a structure ofa 40 � 40 hexagonal grid. The output of the network consists ofthree signals or values ranging between �1 and +1. These dataare then decoded to the ILSQ range (�11 to +11); they representthe learning style of the student.

The procedure to train the neural network consisted in threesteps. The sample for this experiment was 140 high-school stu-dents. During the first step we applied the ILSQ questionnaire inorder to identify the learning style of each student. In the secondstep we created three different introductory courses: ComputerScience, Photography, and Eolic Energy. For each course we pro-duced eight versions for each learning style (visual/verbal, sequen-tial/global, sensing/intuitive, and active/reflective). Randomly, thestudents received each of the three courses, in only one learningstyle. We recorded the assigned learning styles of each student inthe three courses. In the third step and after the students tookthe courses, we applied tests in order to evaluate the performanceof the students in each course.

With these three elements (student learning styles, courselearning styles, and student evaluation or results) we created 140input vectors for training the network. We trained the networkwith 6000 iterations, an initial neighbourhood ratio of 50% of thelattice size and a learning rate of 0.1.

ring tool for developing adaptive and intelligent tutoring systems using a.2011.01.145

Original text:
Inserted Text
-11 to
Original text:
Inserted Text
-1
Original text:
Inserted Text
-3,
Original text:
Inserted Text
-0.272.
Original text:
Inserted Text
-1
Original text:
Inserted Text
-1 to
Original text:
Inserted Text
(-11
Dr Ramon
Comment on Text
In relation to Q3, I do not have changes with respect to figure 7

318

319

320

321

322

323

324

325

326

327

328

329

330

331

332333

335335

336

337

338

339

340341343343

344

345

346

347

348

349

350

351

352

353

354

355

356

357

358

359

360

361

362

363

364

365

366

367

368

369

370

371

372

Fig. 9. Eolic energy, computer introduction, and Mayan language courses in a mobile phone.

Fig. 10. Tracing student’s learning style, presenting two quizzes, and asking to rate a course.

6 R.Z. Cabada et al. / Expert Systems with Applications xxx (2011) xxx–xxx

ESWA 5889 No. of Pages 9, Model 5G

9 February 2011

The network has 1600 neurons arranged in the form of a two-dimensional lattice with 40 rows and 40 columns, and every inputvector has seven elements, as we established previously.

3.3. Using the Kohonen network

As we explained before the network is applied to identify learn-ing styles of students. The network is then exported together withthe ITS and the predictive engine to the mobile (see Fig. 6). Whenthe student is displaying an ITS in a time t, the learning materialshown to the students is using a learning style g. Whenever thestudent answers a quiz as part of the learning contents, he receivesa grade k.

Therefore, the network r takes as input the learning style of thedisplayed contents, and performs a search to find the winner-takes-all (best-matching) neuron jx at iteration p, using the mini-mum-distance Euclidean criterion

jxðpÞ ¼ minkX �W jðpÞk ¼ ½Rðxi �wijÞ2�1=2;

where n is the number of neurons in the input layer, m is the num-ber of neurons in the Kohonen layer, X is the input pattern vectorand W is the weight vector.

Neuron jx, the output of the network, is the student learningstyle which is defined as

gðt þ 1Þ ¼ rðgðtÞ;kÞ:

This process of identifying the student learning style is performedevery time the student answers a quiz on the ITS.

Please cite this article in press as: Cabada, R. Z., et al. EDUCA: A web 2.0 authoKohonen network. Expert Systems with Applications (2011), doi:10.1016/j.eswa

4. Results and discussion

The evaluation of an authoring tool can be given from two dif-ferent perspectives: the authoring tool and the intelligent tutoringor adapted system. In this paper, we present the evaluation of theauthoring tool. The authoring tool EDUCA was evaluated witharguments like software usability (human–machine interfaces),program content and functionality. Before the evaluation we of-fered a small course using the authoring tool. There were 30 learn-ers who tested the tool. The volunteers consisted of graduate(master degree) and undergraduate students and professors inthe computer systems department of the Instituto Tecnológico deCuliacán. The course was given in four hours. With regard of the re-sults or products of the course, they produced different intelligenttutoring systems for topics like Compiler Construction, Introduc-tion to Computer Science, teaching the Maya Language, introduc-tion to Eolic Energy, etc. Fig. 9 shows different snapshots of suchcourses, displayed on mobile phones (Sun Java Wireless Toolkit2.5.2).

One important application of Educa is tracing the student’slearning style during the execution of a tutoring system or course(first and second mobile phones of Fig. 10). This information can beprecious for research in the field of learning. The third and fourthphones show two quizzes of the Mayan language course. The lastphone is just a question to the student about rating the course. Thisinformation is for recommendation purposes.

To assess the tool we applied a survey of 20 questions to eachparticipant at the end of the mini course, asking the learners to

ring tool for developing adaptive and intelligent tutoring systems using a.2011.01.145

Original text:
Inserted Text
kohonen
Original text:
Inserted Text
discussions
Original text:
Inserted Text
(human-machine

373

374

375

376

377

378

379

380

381

382

383

384

385

386

387

388

389

390

391

392

393

394

395

396

397

398

399

400

401

402

403

404

405

406

407

408

409

410

411

412

413

414

415

416

417

418

419

420

421

422

423

Fig. 11. Evaluation of the tool.

Q3

R.Z. Cabada et al. / Expert Systems with Applications xxx (2011) xxx–xxx 7

ESWA 5889 No. of Pages 9, Model 5G

9 February 2011

evaluate the software tool on the Likert scale according to their le-vel of agreement or disagreement. Fig. 11 depicts the frequenciesin the evaluation for five questions. As shown in the graph, the re-sults tell us that most of the group in the workshop ‘‘agree’’ or‘‘strongly agree’’ with respect to the interfaces, easiness to generatean intelligent tutor, learning time for using the tool, time to pro-duce an intelligent tutor (1 h) and the course organization.

424

425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469

5. Discussions and conclusions

Authoring Systems for Intelligent Tutoring Systems and pro-grams alike were introduced in the 1970s. Since then there havebeen a diversity of authoring tools dealing with different aspectsand methods to be used. Murray et al. (2003) provides a full pictureof the state of the art in ITS authoring systems. This work presentsauthoring tools in the categories of simulations, human expertise,instruction strategies, and special purpose. All of those tools aremore PC-oriented. With respect to adaptation using learning styles,related work aims at identifying a learning style using approacheslike Bayesian networks, decision trees, or Hidden Markov Models.In Carmona et al. (2008), Graf et al. (2008) and Limongelli et al.(2008) work, learning styles are calculated based only on the ILSQquestionnaire and none of those works are authoring tools. Thereare several authoring tools used to create mobile applications likeMyLearning (Attewell et al., 2009), zirada (http://www.Zirada.com),Test Editor (Romero, Ventura, Hervás, & De Bra, 2006), or media-Board (Attewell et al., 2005). Some of them are more PocketPC’soriented and some are focused to quiz editing or game-basedlearning. None of those author tools however, have the ability ofadapting to the user’s learning style, nor have portability acrossdifferent computer and operating system platforms.

The software tool Educa was implemented with Java version 1.6and XML. The learning material produced with the tool is platformindependent and it has been tested with different software emula-tors (NHAL Win32 Emulator, J2ME Wireless Toolkit and Sony Erics-son SDK), cell and smart phones (Sony Ericsson and Nokia). Wepresented a test with one of such mobile devices. Currently empir-ical studies are taking place to examine the students’ reaction tothe learning material produced using Educa. Future work shouldfocus on continuing testing with official and complete materialfor course programs in public and private schools in Mexico. Rightnow, we are starting working with social networking. In this case,the main idea is to give support to create and maintain social learn-ing networks with adaptation possibilities.

470471472473474475476

6. Uncited references

Brusilovsky and Schwarz (1998), Felder et al. (2004), O’Reilly(2005), Zirada Mobile Publisher (2009).

Please cite this article in press as: Cabada, R. Z., et al. EDUCA: A web 2.0 authoKohonen network. Expert Systems with Applications (2011), doi:10.1016/j.eswa

Acknowledgments

The work described in this paper is fully supported by a grantfrom the DGEST (Dirección General de Educación Superior Tec-nológica) in México under the program ‘‘support and developmentof academic bodies’’ [Academic Body: Research in SoftwareEngineering].

References

Arruarte, A., Fernández, I., Ferrero, B., & Greer, J. (1997). The IRIS shell: How to buildITSs from Pedagogical and design requisites. International Journal of ArtificialIntelligence in Education, 341–381.

Attewell, J. (2005). From research and development to mobile learning: tools foreducation and training providers and their learners. <www.mlearn.org.za/CD/papers/Attewell.pdf>, retrieved October 9, 2009.

Attewell, J. (2009). Mobile technologies and learning: A technology update andmlearning project summary. London: Learning and skills development agency.<www.m-learning.org/reports.shtml>, retrieved October 9, 2009.

Brusilovsky, P., & Schwarz, E. (1998). Web-based education for all: A tool fordeveloping adaptive courseware. Computer Networks and ISDN Systems, 30(1–7),291–300.

Burke, R. (2002). Hybrid recommender systems: Survey and experiments. UserModeling and User Adapted Interactions, 12(4), 331–370.

Carmona, C., Bueno, D., EduardoGuzman, & Conejo, R. (2002). SIGUE: Making webcourses adaptive. In: Proceedings of second international conference on adaptivehypermedia and adaptive web-based systems (AH’2002), Málaga, Spain, pp. 376–379.

Carmona, C., Castillo, G., & Millán, E. (2008). Designing a Bayesian network formodeling student’s learning styles. In: Proceedings of the eighth internationalconference on advanced learning technologies (ICALT 2008), pp. 346–350.

de Jong, T., Limbach, R., Gellevij, M., Kuyper, M., Pieters, J., & van Joolingen, W. R.(1999). Cognitive tools to support the instructional design of simulation-baseddiscovery learning environment: The SIMQUEST authoring system. In Designapproaches and tools in education and training (pp. 215–225). Dordrecht: KluwerAcademic Publishers..

Doignon, J. –P., & Falmagne, J. C. (1999). Knowledge spaces. Springer-Verlag.Felder, R.M., & Solomon, B.A. (2004). Index of Learning Styles Questionnaire. <http://

www.engr.ncsu.edu/learningstyles/ilsweb.html>, retrieved October 9, 2009.Felder, R. M., & Silverman, L. K. (1988). Learning and teaching styles in engineering

education. Engineering Education, 78, 674–681.Graf, S., Kinshuk & Liu, T. (2008). Identifying learning styles in learning

management systems by using indications from students’ behavior. InProceedings of the Eighth International Conference on Advanced LearningTechnologies (ICALT 2008) (pp. 482–486). IEEE Computer Society.

Hage, H., & Aimeur, E. (2008). Harnessing learner’s collective intelligence: A web 2.0approach to e-learning. In Proceeding of the Nineth International Conference onIntelligent Tutoring Systems (ITS 2008). LNCS (vol.5091, pp. 438–447).Heidelberg: Springer.

Kerly, A., & Bull, S. (2008). Children’s Interactions with Inspectable and NegotiatedLearner Models. In Proceedings of the Nineth International Conference onIntelligent Tutoring Systems (ITS 2008). LNCS (Vol. 5091, pp. 132–141).Heidelberg: Springer.

Kohonen, T. (1989). Self-organization and associative memory (Third ed.). Springer-Verlag.

Limongelli, C., Sciarrone, F., & Vaste, J. (2008). LS-PLAN: An effective combination ofdynamic courseware generation and learning styles in web-based education. InProceedings of the Fifth International Conference on Adaptive Hypermedia andAdaptive Web-based Systems (AH 2008). LNCS (Vol. 5149, pp. 133–142).Heidelberg: Springer.

Murray, T., Blessing, S., & Ainsworth, S. (2003). Authoring tools for advancedtechnology learning environments. Kluwer Academic Publishers..

ring tool for developing adaptive and intelligent tutoring systems using a.2011.01.145

Original text:
Inserted Text
hour)
Dr Ramon
Comment on Text
(Zirada Mobile Publisher, 2009) related to Q3
Dr Ramon
Comment on Text
Zirada instead of zirada
Dr Ramon
Sticky Note
Completed set by Dr Ramon
Dr Ramon
Sticky Note
Replace IP "www.Zirada.com" to "www.itclearning.com.au/"
Dr Ramon
Cross-Out
Dr Ramon
Inserted Text
http://www.itclearning.com.au/

477478479480481482483484485486

487488489490491492493494495496

8 R.Z. Cabada et al. / Expert Systems with Applications xxx (2011) xxx–xxx

ESWA 5889 No. of Pages 9, Model 5G

9 February 2011

O’Reilly, T. (2005). What is Web 2.0. <http://oreilly.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html>, retrieved October 9, 2009.

Romero, C., Ventura, S., Hervás, C., & De Bra, P. (2006). An authoring tool for buildingboth mobile adaptable tests and web-based adaptive or classic tests. InProceedings of the Third International Conference on Adaptive Hypermedia andAdaptive Web-based Systems (AH 2006) (pp. 203–212). Springer-Verlag.

Specht, M., Kravcik, M., Klemke, R., Pesin, L., & Hüttenhain, R. (2002). Adaptivelearning environment (ALE) for teaching and learning in WINDS. In Proceedingsof the Second International Conference on Adaptive Hypermedia and Adaptive Web-based Systems (AH’2002) (pp. 572–581). Springer-Verlag.

497

Please cite this article in press as: Cabada, R. Z., et al. EDUCA: A web 2.0 authoKohonen network. Expert Systems with Applications (2011), doi:10.1016/j.eswa

Weber, G., Kuhl, H.-C. & Weibelzahl, S. (2001). Developing adaptive internet basedcourses with the authoring system NetCoach. <http://wwwis.win.tue.nl/ah2001/papers/GWeber-UM01.pdf>, retrieved October 9, 2009.

Zatarain-Cabada, R., Barrón-Estrada, M. L., Sandoval, G., Osorio, M., Urías, E., &Reyes-García, Carlos A. (2008). Authoring neuro-fuzzy tutoring systems for Mand e-learning. In Proceedings of the Seventh Mexican International Conference onArtificial Intelligence (MICAI 2008). LNCS (Vol. 5317, pp. 789–796). Springer-Verlag.

Zirada Mobile Publisher, the Premier Mobile Content Creation Tool. <http://www.Zirada.com>, retrieved October 9, 2009.

ring tool for developing adaptive and intelligent tutoring systems using a.2011.01.145

Dr Ramon
Comment on Text
Replace "www.Zirada.com" to http://www.itclearning.com.au/