Development of Communicative Competence Evaluation Based ... · Evaluation and training authoring tool of communication abilities for the elderly and logopathy group is that expert

Development of CommunicativeCompetence Evaluation Based on Smart

Device

Gen-Yong Jeong1

1Dept. of Interior Design, 277 Hyodeok-ro,Gwangju University, Nam-gu,Gwangju City, 61743, KOREA

[email protected]

Abstract

Background/Objectives: Patient group who appealscommunication problem has lately grown according to notonly increasing the number of seniors due to the aging so-ciety but increasing the number of the logopathy due toentering an aging society.

Methods/Statistical Analysis: Prototype was im-plemented in this study to test operation that is composedof development of Korea model assessment of communica-tion abilities as well as training service content based on K-WAB, technology of decision making through Face Trackingand Hand Tracking, gathering and analysis program of brainwave based on BCI, and an assessment of communicationabilities for the elderly who are suffer from logopathy.

Findings: Communicative competence evaluation basedon smart device connected with expert and training servicesas well as its required content are developed to able to trainthe logopathy group and the grey who have difficulties ofcommunication not only in a hospital but in a home assess-ment of communication abilities.

Improvements/Applications: It can be easily usedsmart devices at home as communication training contents

International Journal of Pure and Applied MathematicsVolume 120 No. 6 2018, 4767-4777ISSN: 1314-3395 (on-line version)url: http://www.acadpubl.eu/hub/Special Issue http://www.acadpubl.eu/hub/

4767

and it service are offered to increase communication abili-ties for the elderly and logopathy group. Cost savings effectfor welfare benefit of disadvantaged groups as well as socialcost will be also expected through this.

Key Words : Logopathy Group, Aphasia, Dementia,Silver Generation, Functional Contents.

1 Introduction

Patient group who appeals communication problem has lately grownaccording to not only increasing the number of seniors due to theaging society but increasing the number of the logopathy due tocerebral stroke and Alzheimer’s[1,2]. Training to solve communi-cation problem up now is reliant on face-to-face talk mainly basedon paper-pencil through rehabilitation medicine and visiting speechtherapy center. But measures which are easily able to train com-munication skill at home are needed in order to train communica-tion skill for the seniors who have difficulty moving around and thelogopathy group who have difficulty visiting doctor[3,4]. Trainingservice of communication skill based on smart devices is also neededto minimize social cost and accessibility but also to serve diagnosisservice connected specialist for feedback and management of trainresult of the seniors and logopathy group[5,6].

Assessment of communication abilities as well as training ser-vice based on professional connected type for the logopathy groupand the elderly who have difficult in communication for the purposeof training in the hospital as well as at home is to be developed andrequired Korean model content. Phased assessment scenario basedon standard inspection method is not only produced but also cus-tomized training scenario through feedback of professional basedon user communication competence provided[7,8]. Authoring toolbased on smart devices and computer is also required to developaccording to demands for specialized assessment and training ser-vice for the elderly and the logopathy group. Korean content modelis produced based on Korean standard inspection method to eval-uate communication competence for the elderly and the logopathygroup, such as K-WAB(Korean version-the Western Aphasia Bat-tery), K-BNT(Korean version-Boston Naming Test). The develop-

International Journal of Pure and Applied Mathematics Special Issue

4768

ment of UX/UI design with easy-to-use is necessary to maximizethe learning effect for the elderly who is not familiar with smartdevices[9,10].

2 Research and development

2.1 Accuracy of decision making through facetracking

Main function of this study provides an assessment of communica-tion abilities as well as training service based on professional con-nected type for the logopathy group and the elderly who have dif-ficult in communication for the purpose of training in the hospitalas well as at home. This system is composed of various functions,such as Korea model assessment as well as training service contentbased on smart devices, authoring tool for assessment and train-ing scenario, user-based assessment analysis, specialist evaluation,training information analysis, user bio-information collecting andanalysis, and generating function of customized scenario using useremotion inference. Flowchart of assessment of communication abil-ities and UI training contents is shown in Figure 1.

Figure 1: Flowchart of assessment of communication abilities andUI training contents


4769

2.2 Gathering and analysis program of brain-wave information based on BCI

Gathering and analysis program of brainwave information is for in-formation structure and analysis of brainwave sensor. Data is to becollected through communicating with Bluetooth Dongle. Informa-tion of the following such as Attention, Meditation, Raw Wave, Sig-nal Status, Delta of EEG Power, Theta, Low-Alpha, High-Alpha,Low-Beta, Low-Gamma, and High-Gamma wave is obtained as col-lecting data packet is analyzed and then analyzed information ac-cessed by UDP server is transmitted to client connections. Alsothe analyzed brainwave information is able to transmit to clientconnection. Protocol structure and message is defined as a transfermethod for Ack of Request is shown in Figure 2.

Figure 2: Process of collecting brainwave information

2.3 Function design of service scenario genera-tion, authoring and editing

Evaluation and training authoring tool of communication abilitiesfor the elderly and logopathy group is that expert is not only gen-erating evaluation and training entry but also serves function ofgenerating customized scenario after analysis of history of user in-formation so as to perform evaluation and training more effectively.Authoring tool is managed by using database and database suppliesall the information on user management, assessment and trainingquestion management, preset management, user history inquiry and


4770

management, as well as evaluation and training scenario manage-ment is shown in Figure 3.

Figure 3: Screen design of authoring tool in service scenario

2.4 Management of user usage history evalua-tion and training repository

Customized training scenario management based on user informa-tion and usage history has a function to provide customized trainingscenario based on the preference information for registered assess-ment and training questions like Figure 4 that is to provide functionof registration, inquiry, delete, and correction for preference infor-mation which is defined question at each item.

Figure 4: Usage history and assessment/ Logic diagram of traininginformation management system


4771

2.5 Development of intuitive UX/UI design

Structure of training screen layout to meet smart device(tablet)is a basic configuration and 30sp(Scale independent Pixel) size byAndroid is basically used to display text. UI structure with densitythat do not disturb usage of the elderly and logopathy group isdeveloped.

Default camera in smart device instead of professional imageprocessing camera for face recognition is used to analyze imagebased on pixel. Real time face tracking technology that not onlydoes not require additional functionality requirement in defaultcamera hardware but also is not need high performance equipmentfor library operation is developed as shown in Figure 5.

Figure 5: Pixel-based Image Analysis Function Diagram

Facial areas are to be extracted by real time face tracking tech-nology based on pixel as shown in Figure 6. Condition value of eyeis to be traced through not only moving focus of recognized area butalso disappearing focus within the designated time according to afulfillment of matching algorithm based on XML and then its inter-facing technology is developed. Compatibility of camera hardwareneeds to be considered in case of using Face Detection as GoogleDefault API in order for image processing of smart device. NativeC++ library is developed for an effective image processing due tothe restriction of implementing detail function such as eye recogni-tion. Hardware compatibility is increased through loading NativeC++ module, while performance of image processing is reinforcedby a high level of treatment in matching algorithm XML parsing.


4772

Figure 6: Function structure of Face Tracking

Finger is recognized by extraction technology of hand skeletonand its point based on technology of pixel base real time trackingusing smart device camera. Decision technology of relative locationin hand is developed through matching algorithm with recognize in-formation. Tracking of each finger joint is performed to trace com-plex movement and hand tracking technology equivalent to level ofextracting movement which is relevant to Flipping, Swivel, Eleva-tion, and Tilt for hand position. Hand movement at each step istraced through Hand Tracking and the value of the result for givencommand is refined. And then interfacing technology that collectsresult of response mixed with above two-level movement is devel-oped. Collected result value is divided into voice and image fortransmission for server. MPEG-4 data form is transferred in caseof voice, whereas MPEG-4 data filmed on cameras and the valueof the result in image recognition are transferred in case of image.If necessary, an extracted movement can be recorded to a series ofdata format and it is recorded in the XML and Json format andis transferred. Demonstration scene of Face Tracking and HandTracking are shown in Figure 7.

Figure 7: Face Tracking & Hand Tracking


4773

3 Results and Discussion

3.1 Test operation for the elderly and feedback

In order for feedback and verification of development service con-tents against the elderly, a laboratory of speech language therapyfield test in a senior-friendly experience center which is located inGwangju city Silver Health Town is operating now. A laboratoryof speech language therapy field test is composed of developmentservice content using eight smart devices as shown in Figure 8.Content design and its development was verified and tested for theconvenience of the elderly who are not familiar with smart devicesas shown in Figure 9.

Figure 8: Formation of laboratory of speech language therapy fieldtest

Survey for UX/UI and usability through user as well as workingpersonnel reflects service content upgradability and development.

Figure 9: Content verification test

3.2 Prototype fabrication

The result of prototype fabrication is shown in Figure 10 to performtest operation of communication abilities assessment and trainingservice for the elderly and logopathy group.


4774

Figure 10: Prototype of communication abilities assessment andtraining service

4 Conclusion

It is possible to manage individual user history information as aseparate reference type to exploit statistical data. Prediction al-gorithm is developed to be able to predict preference based on CFfilter on the basis of accumulated data. According to provide com-munication training content and service to improve the seniors andlogopathy group, it is possible to train them easily using smartdevice. Welfare benefaction for positive discrimination and the re-duction of social costs effect are expected through this. The fieldof speech therapy and creation of convergence service may be con-tributed when it comes to provide service of communication trainingcontent and professional connected service. Side effect that is intel-lectual advancement in member of society and emotional stabilityis expected.

5 Acknowledgment

This Study was conducted by research funds from Gwangju Uni-versity in 2018, Korea.

References

[1] Gu, Xiaole. (2016). LANGUAGE AND INTERCULTRALCOMMUNICATION. Assessment of intercultural communica-tive competence in FL education: A survey on EFL teachers’perception and practice in China, 16(2), 254-273.


4775

[2] Dahm, M. R. , Cartmill, J. A. (2016). Medical education. Talk-ing their way to success: communicative competence for inter-national medical graduates in transition, 50(10), 992-993.

[3] Pearl, P. L. , McConnell, E. R. , Fernandez, R. , Brooks-Kayal,A. (2014). PEDIATRIC NEUROLOGY. Survey of the Profes-sors of Child Neurology: Neurology Versus Pediatrics Homefor Child Neurology, 51(3), 344-347.

[4] Mahon, B. , Cantlon, J. (2011). Cognitive neuropsychology.The specialization of function: Cognitive and neural perspec-tives, 28(3-4), 147-155.

[5] Wang, Yuan , Cao, Dong-yuan , Remeniuk, Bethany , Krim-mel, Samuel , Seminowicz, David A. , Zhang, Ming. (2017).Pain. Altered brain structure and function associated with sen-sory and affective components of classic trigeminal neuralgia,158(8), 1561-1570.

[6] Hall, T. , Krahn, G.L. , Horner-Johnson, W. , Lamb, G. ,(2011). The Rehabilitation Research and Training Center Ex-pert Panel on Health Measurement Rehabilitation psychology.Examining Functional Content in Widely Used Health-RelatedQuality of Life Scales, 56(2), 94-99.

[7] Collins, B.C. , Hager, K.L. , Galloway, C.C. (2011). Educationand Training in Autism and Developmental Disabilities. Ad-dition of Functional Content during Core Content Instructionwith Students with Moderate Disabilities, 46(1), 22-39.

[8] Adam, C. , Lorini, E. (2014). COMMUNICATIONS IN COM-PUTER AND INFORMATION SCIENCE. A BDI EmotionalReasoning Engine for an Artificial Companion, -(430), 66-78.

[9] Tada, T. (2007). DEMENTIA JAPAN. The understanding ofprevention methods for dementia: a questionnaire survey forattendants at a dementia lecture, 21(2), 215-246.

[10] Hiraishi, Hironori. (2017). INTERNATIONAL JOURNALOF COGNITIVE INFORMATICS AND NATURAL INTEL-LIGENCE. Qualitative Analysis of Concentration Level inThrowing Using Simple Brain-Wave Sensor, 11(3), 17-30.


4776

4777

4778

Documents

Development of Communicative Competence Evaluation Based ... · Evaluation and training authoring tool of communication abilities for the elderly and logopathy group is that expert