7
Processing of sEMG Signals for Online Motion of a Single Robot Joint Through GMM Modelization* Albert Author 1 and Bernard D. Researcher 2 AbstractThis paper aims to explore the possibility to use Electromyography signals to train a Gaussian Mixture Model in order to estimate in real-time the bending angle of a single human joint. Extraction of features is performed through wavelet transform of which best configuration is investigated. GMM is validated on new unseen data and the classification performances are compared with respect to mother wavelet chosen for computing wavelet transform and the number of collected trials used during the training phase. Achieved results show that our procedure is able to obtain high performances (Normalized Mean Square Error: 0.91, 0.90, 0.81 for the three subjects, respectively), using as feature Mean Average Value of first level decomposition coefficients with Daubechies db2 wavelet function. The framework requires a 2 minutes lasting signal of three Electromyography (EMG) channels for Gaussian Mixture Model (GMM) training and exhibits a mean time of 2.4 mS for signal processing (excluding acquisition). Procedure has been tested on a humanoid robot successfully replicating original movement. I. INTRODUCTION This demo file is intended to serve as a “starter file" for the International Conference on Intelligent Robots and Systems papers produced under L A T E X using IEEEtran.cls version 1.7a and later. Behavior of human limbs and its correlation with muscles pulses are the subject of many researchers since they stand at the basis of bio-mechanical solutions for locomotor diseases, prosthesis and exoskeletons. Knowledge in the filed can also improve humanoid robots behavior looking more natural. A widely used approach is to analyze signals resulting from skeletal muscle activity called EMG due to their strong relation to strength, location, time and effort of the movement. Generally, Surface Electromyography (sEMG) signals are preferred, as they keep information being ex- tracted in a less invasive way. Some widespread techniques adopted for pattern recognition are Fourier transform [1], Integral Absolute Value (IAV), variance and zero crossing [2], Mean Average Value (MAV) [3], Rooted Mean Square (RMS), Mean Power Frequency (MPF) [4], or as proposed in [5] full wave rectification, filtering and normalisation. The major drawback of these transformation methods, especially fast and short-term Fourier Transform, is that they assume signal to be stationary [6]. However EMG signals are non- stationary, so an alternative approach, based on Wavelet *This work was not supported by any organization 1 Albert Author is with Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, 7500 AE Enschede, The Netherlands [email protected] 2 Bernard D. Researcheris with the Department of Electrical Engineering, Wright State University, Dayton, OH 45435, USA [email protected] Transform, is wide spreading. Daubechies proved use of Wavelet Transform to analyze time series that contain non- stationary power at many different frequencies [7]. Early as 1997, Laterza found out that Wavelet Transform is an alternative to other time frequency representations with the advantage of being linear, yielding a multiresolution rep- resentation and not being affected by crossterms [8]. In [9], Guglielminotti theorized that Wavelet Transform exhibits very good energy localization in the time-scale plane when the shape of the EMG signal is matched with wavelet shape. Recent works reinforced advantages in using wavelet trans- form for EMG analysis [10], [11], [12]. By investigating and analyzing various research studies on Wavelet Transform, Chowdhury concluded that analyzing sEMG signals using Daubechies functions renders good results [10]. In order to synthesize wavelet information some statistical features have been used in [13] and [14]. Notable in EMG analysis is the number of channels considered to predict movement as it includes or excludes situations where some signals may be not available. Increase number of channels obviously increases classification effi- ciency, but results with four channels obtained by Tsenov ([15]) suggest that a low number of channels may be sufficient. Several studies have used features extracted from EMG to feed different machine learning algorithms (i.e., Neural Networks (NN), GMM, Hidden Markov Model (HMM)) to predict and replicate complex human movements ([10], [16], [12], [17], [18]) but most of them concern movements of the upper limb ([19], [20], [21]). Recently, focus has been placed on the issue of how to determine the human intent of a continuous motion instead of discrete patterns. Han developed a state space EMG model based on Hill Muscle Model (HMM) for continuous estima- tion of elbow joint which however involves many physiolog- ical parameters and whose computational complexity of joint motion states makes it unsuitable for real-time applications [22]. An EMG-driven virtual arm has being developed by Manal ([23]) which through recognition of muscles activation reproduces the movement according to HMM. Behavior of the virtual arm is very faithful to a real one in contrast to a robot whose motion requires a specific translation of human movement to mechanical components. A working online estimation of elbow joint has been proposed in [24] where EMG patterns recognition is approached through a Hierarchical Projected Regression (HPR) algorithm that con- structs incrementally a tree-based knowledge library, whose components represent local regression models. It uses only

Processing of sEMG Signals for Online Motion of a Single

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Processing of sEMG Signals for Online Motion of a Single

Processing of sEMG Signals for Online Motion of a Single Robot JointThrough GMM Modelization*

Albert Author1 and Bernard D. Researcher2

Abstract— This paper aims to explore the possibility touse Electromyography signals to train a Gaussian MixtureModel in order to estimate in real-time the bending angle of asingle human joint. Extraction of features is performed throughwavelet transform of which best configuration is investigated.GMM is validated on new unseen data and the classificationperformances are compared with respect to mother waveletchosen for computing wavelet transform and the number ofcollected trials used during the training phase. Achieved resultsshow that our procedure is able to obtain high performances(Normalized Mean Square Error: 0.91, 0.90, 0.81 for the threesubjects, respectively), using as feature Mean Average Valueof first level decomposition coefficients with Daubechies db2wavelet function. The framework requires a 2 minutes lastingsignal of three Electromyography (EMG) channels for GaussianMixture Model (GMM) training and exhibits a mean time of2.4 mS for signal processing (excluding acquisition). Procedurehas been tested on a humanoid robot successfully replicatingoriginal movement.

I. INTRODUCTION

This demo file is intended to serve as a “starter file" for theInternational Conference on Intelligent Robots and Systemspapers produced under LATEX using IEEEtran.cls version 1.7aand later.

Behavior of human limbs and its correlation with musclespulses are the subject of many researchers since they stand atthe basis of bio-mechanical solutions for locomotor diseases,prosthesis and exoskeletons. Knowledge in the filed can alsoimprove humanoid robots behavior looking more natural.

A widely used approach is to analyze signals resultingfrom skeletal muscle activity called EMG due to theirstrong relation to strength, location, time and effort of themovement. Generally, Surface Electromyography (sEMG)signals are preferred, as they keep information being ex-tracted in a less invasive way. Some widespread techniquesadopted for pattern recognition are Fourier transform [1],Integral Absolute Value (IAV), variance and zero crossing[2], Mean Average Value (MAV) [3], Rooted Mean Square(RMS), Mean Power Frequency (MPF) [4], or as proposedin [5] full wave rectification, filtering and normalisation. Themajor drawback of these transformation methods, especiallyfast and short-term Fourier Transform, is that they assumesignal to be stationary [6]. However EMG signals are non-stationary, so an alternative approach, based on Wavelet

*This work was not supported by any organization1Albert Author is with Faculty of Electrical Engineering, Mathematics

and Computer Science, University of Twente, 7500 AE Enschede, TheNetherlands [email protected]

2Bernard D. Researcheris with the Department of ElectricalEngineering, Wright State University, Dayton, OH 45435, [email protected]

Transform, is wide spreading. Daubechies proved use ofWavelet Transform to analyze time series that contain non-stationary power at many different frequencies [7]. Earlyas 1997, Laterza found out that Wavelet Transform is analternative to other time frequency representations with theadvantage of being linear, yielding a multiresolution rep-resentation and not being affected by crossterms [8]. In[9], Guglielminotti theorized that Wavelet Transform exhibitsvery good energy localization in the time-scale plane whenthe shape of the EMG signal is matched with wavelet shape.Recent works reinforced advantages in using wavelet trans-form for EMG analysis [10], [11], [12]. By investigating andanalyzing various research studies on Wavelet Transform,Chowdhury concluded that analyzing sEMG signals usingDaubechies functions renders good results [10]. In order tosynthesize wavelet information some statistical features havebeen used in [13] and [14].

Notable in EMG analysis is the number of channelsconsidered to predict movement as it includes or excludessituations where some signals may be not available. Increasenumber of channels obviously increases classification effi-ciency, but results with four channels obtained by Tsenov([15]) suggest that a low number of channels may besufficient.

Several studies have used features extracted from EMGto feed different machine learning algorithms (i.e., NeuralNetworks (NN), GMM, Hidden Markov Model (HMM)) topredict and replicate complex human movements ([10], [16],[12], [17], [18]) but most of them concern movements of theupper limb ([19], [20], [21]).

Recently, focus has been placed on the issue of how todetermine the human intent of a continuous motion insteadof discrete patterns. Han developed a state space EMG modelbased on Hill Muscle Model (HMM) for continuous estima-tion of elbow joint which however involves many physiolog-ical parameters and whose computational complexity of jointmotion states makes it unsuitable for real-time applications[22]. An EMG-driven virtual arm has being developed byManal ([23]) which through recognition of muscles activationreproduces the movement according to HMM. Behavior ofthe virtual arm is very faithful to a real one in contrastto a robot whose motion requires a specific translation ofhuman movement to mechanical components. A workingonline estimation of elbow joint has been proposed in [24]where EMG patterns recognition is approached through aHierarchical Projected Regression (HPR) algorithm that con-structs incrementally a tree-based knowledge library, whosecomponents represent local regression models. It uses only

Page 2: Processing of sEMG Signals for Online Motion of a Single

one channel as input signal and effectiveness of the methodis supported by some experiments.

The aim of this study is to estimate a single-joint angleby mean of a GMM trained with EMG features extractedthrough Wavelet Transform. A Gaussian Mixture Regression(GMR) technique is then used to retrieve the data fromthe trained model. This approach enables an autonomousextraction of the task-related information encoded in EMGsignals, without loss of generality. Moreover, such a prob-abilistic framework based on Mixture of Gaussians (MoG)distributions only require a reduced number of parameters tobe kept, resulting in lightweight models.

Furthermore, a GMM\GMR probabilistic framework re-quires low training data to achieve good results; provides fastregression that perfectly matches with the use on an onlineapplication and is robust to channels loss.

The paper is structured as follows: Section II will de-scribe the procedure to extract task-related features fromEMG signals, the algorithm for knee angle estimation, andmodelization technique. Section III will provide descriptionof a complete test. Results of the application of the proposedapproach will be presented in Section IV. Finally, in Sec-tion V we will summarize and discuss the results achieved.

II. METHODOLOGY

A. Signal acquisition

Electromyography (EMG) signals were acquired with anactive 8-channel wireless EMG system at 1000 Hz. The eightEMG electrodes were placed on the left leg of each subjectin order to cover the principal muscular groups active duringthe kick task. In more detail, the following muscle wererecorded: Rectus femoris, Vastus lateralis, Vastus medialis,Tibialis anterior, Gastrocnemius lateralis, Gastrocnemiusmedialis, Biceps femoris caput longus, Peroneus longus.

Synchronously to the EMG signals, we recorded the kine-matics of the left leg by means of an optoelectronic system.Six retro reflecting markers were placed on the subject’sleg aka LGT, LLE, LHF, LLM, LVMH, LVTH. Six infrareddigital cameras recorded the marker positions (namely, theleg kinematic) at 60 Hz during the whole recording session.

B. Signal analysis

Wavelet transform is similar to Fourier Transform exceptthat instead of using a basis composed by sine and cosineit uses particular functions that satisfy certain mathematicalrules. Moreover, wavelet analysis allows to extract signalinformation regarding both the time and the frequencydependance and can be applied in a useful manner ina wide window of time as well as a closer one. Signalis transformed into a linear composition of scaled andshifted version of a base function called mother waveletor wavelet function. Wavelet Transform is subdivided inDiscrete Wavelet Transform (DWT) and Continuous WaveletTransform (CWT). Projecting our signal to the basis yieldsto approximation (low frequency) and detail (high frequency)coefficients which are the real subject of our analysis.

A complete and detailed description of Wavelet Transformand supporting theory can be found in [25] and [26].

Every wavelet yields to different results even when appliedto same signal thus selection of mother wavelet plays a keyrole in the framework formulation.

In his research studies on Wavelet Transform, Chowd-hury has concluded that analyzing sEMG signals usingDaubechies family function renders successful results so asin other studies [10], [27], [28], [12]. To obtain better resultsfrom a sEMG analysis on different applications, Chowdhuryrecommends to use the db function (db2, db4, db6, db44and db45) at decomposition level 4. Phinyomark suggests,moreover, to use the db7 wavelet function.

Each of the function above mentioned has been tested todiscover the one that leads to better results. Once waveletdecomposition has been done, detail coefficients have beenused as input for an ulterior step as to synthesize information.Were chosen MAV and RMS since both methods turned outgood results in [27] and [12]. Moreover Standard Deviation(VAR, Equation ??) has been computed given that it hasbeen chosen as an interesting measure in [13].

In Figure II-B are shown sEMG of the first channelused and features resulting from wavelet analysis and MAVcomputation of decomposition coefficients.

0 0.2 0.4 0.6 0.8 1

−200

0

200

(a) original sEMG

0.2 0.4 0.6 0.8 10

20

40

(b) MAV of wavelet coefficients

Fig. 1. Original sEMG of first channel (vastus lateralis) with results ofelaboration: wavelet transform and MAV computation of level 1 decompo-sition coefficients.

C. Gaussian mixture model and regressionFor modelization purposes, we exploited a stochastic ap-

proach in order to address the high variability of the inputEMG signals. Information extracted from EMG was used asinput of a Gaussian Mixture Model (GMM) to estimate itscorrelation with the knee bending angle α.

The aim of GMM is to obtain the weighted sum of KGaussian components which best approximates the inputdataset representing the set of kick trials used for the training.In this particular case, the total number of data samples wasN = nT , where n is the number of trials used to trainthe system, and T = 2000 is the number of observationsacquired during each trial. A single data in input at theframework is described in Equation 1.

Page 3: Processing of sEMG Signals for Online Motion of a Single

ζj = {t, ξ, α} ∈ RD ξ = {ξc}c=1,...,C (1)

where:

• t ∈ R is the time elapsed from the beginning of the trial(ms);

• ξc ∈ R is the cth EMG channel;• ξ ∈ RC is the set of considered channels, 1 ≤ |ξ| ≤ 8;• α ∈ R is the knee bending angle;• 3 ≤ D ≤ 10 is the dimensionality of the problem.

The GMM was trained through the Expectation-Maximization (EM) algorithm [29], resulting in a proba-bility distribution of the train dataset later used to per-form the regression of the knee angle. The Expectation-Maximization algorithm iteratively estimates the optimal pa-rameters θ = (πk, µk,Σk) that characterizes the K mixturescomposing the GMM. The algorithm can be separated intwo cyclic phases: Expectation and Maximization. The EMloop stops when the increment of the log-likelihood L =∑Nj=1 log (p (ζj |θ)) at each iteration becomes smaller than a

defined threshold ε, given by L(t+1)L(t) < ε.

The algorithm optimizes the parameters of the K Gaussiancomponents by maintaining a monotone increasing likeli-hood during the local search of the maximum. This approachenables an autonomous extraction of the kick characteristicEMG signal while still maintaining an appropriate general-ization.

Finally, the resulting probability density function is com-puted:

p (ζj) =

K∑k=1

πkN (ζj ;µk,Σk) (2)

where:

• πk are priors probabilities;• N (ζj ;µk,Σk) are Gaussian distribution defined by µk

and Σk, respectively mean vector and covariance matrixof the k-th distribution.

The main drawback in the learning process lies in the EMrequirement of a prior specification for the model complexity(i.e., the number of components K). On one hand, an over-estimation of this parameter might lead to over-fitting and,consequently, to a poor generalization; on the other hand, anunderestimation will result to poor regression performances.To deal with this issue we introduced an entropy basedselection of the best number of components, K, in the GMM.

Several entropy based model selection techniques has beenproposed in literature (e.g., Bayesian Information Criterion(BIC) [30], Akaike Information Criterion (AIC) [31],Minimum Description Length (MDL) [32], and MinimumMessage Length (MML) [33]). Although, in [34] the authorsproposed a specific criteria to estimate the value of the Kparameter in the case of EMG signals, in this work wepreferred a more standard approach based on BIC. In ourexperiments the whole learning process has been repeatedwith different GMM complexities by using BIC (Equation 3)

as index of model quality with respect to the number ofcomponents K.

SBIC = −2L+ np logN (3)

where:• L =

∑Nj=1 log (p (ζj |θ)) is the log-likelihood for the

considered model θ;• np = (K − 1) +K(D+ 1

2D(D+ 1)) is the number offree parameters required for a mixture of K componentswith full covariance matrix.

The log-likelihood measures how well the model fits thedata, while the second term is introduced to avoid dataoverfitting and maintain the model general enough. In ourexperiments the best BIC value was obtained with K = 15components.

The Gaussian Mixture Regression (GMR) has been used toretrieve a smooth generalized version of the signal encodedin the associated GMM. So that, the conditional expectationof knee joint angle α̂ is calculated from the consecutivetemporal value t and the EMG signals ξ known a priori.As we already said, the k-th Gaussian component is definedby the parameters (πk, µk, Σk), where:

µk = {µp,k µα,k} Σk =

[Σp,k Σpα,kΣαp,k Σα,k

](4)

with µp and Σp respectively the mean and the covarianceof the known a priori information. The conditional expecta-tion and its covariance can be estimated respectively usingEquation 5 and 6.

α̂ = E [α |t, ξ ] =

K∑k=1

βkα̂k (5)

Σ̂s = Cov [α |t, ξ ] =

K∑k=1

β2kΣ̂α,k (6)

where:• βk =

πkN (t,ξc|µp,k,Σp,k )∑Kj=1N (t,ξc|µp,j ,Σp,j )

is the weight of the k-thGaussian component through the mixture;

• α̂k = E [αk |t, ξ ] = µα,k +Σαp,k (Σp,k)

−1({t, ξ} − µp,k) is the conditional

expectation of αk given {t, ξ};• Σ̂α,k = Cov [αk |t, ξ ] = Σα,k + Σαp,k (Σp,k)

−1Σpα,k

is the conditional covariance of αk given {t, ξ}.Thus, the generalized form of the motions ζ̂ = {t, ξ, α̂}

required only the weight, mean and covariance of the Gaus-sian components calculated through the EM algorithm.

D. Procedure effectiveness

Finally, we exploited the Normalized Mean Square Error(NMSE) in order to evaluate the effectiveness of the GMM-based system. This function measures the goodness of fitbetween test and reference data, in our case α̂ (the dataestimated through the GMR) and α (the angle calculatedby means of the motion capture system):

Page 4: Processing of sEMG Signals for Online Motion of a Single

NMSE(t) = 1−∥∥∥∥ α̂(t)− α(t)

α̂(t)− µt(α)

∥∥∥∥2

(7)

where:• t is the temporal instant from the beginning of the trial

(ms);• α̂(t) is the estimated angle at the instant t;• α(t) is the angle calculated through the motion capture

at the instant t;• µt(α) is the mean along the time of the angles given

by the motion capture.NMSE costs vary between −∞ (bad fit) to 1 (perfect fit).

Zero is the value reached from a straight line in fitting thereference.

III. RUNNING ONE TESTThree healthy volunteers (S1-S3; age 30± 4; one female)

participated in the experiment. No motor related problemshave been reported. The study was carried out in accordancewith the principle of the Declaration of Helsinki.1. Subjectswere asked to naturally kick a ball (diameter 17 cm) froma sitting position. The ball was positioned on the floor ata fixed distance (2 cm) from the foot. After each kick, anoperator was in charged of the ball reposition. As additionalbehavioral and motivational task, we asked to the subjectsto try to shot the ball in a goal in front of them (distance350 cm, width 122 cm, height 76.2 cm). It is worth to noticethat the task was fully self-paced. Each participant performedseveral repetitions of the aforementioned task over a singlerecording session (day).

Computation of sEMG signals for feeding the model wasmade offline using MATLAB2 tools. Original signals werescanned to individuate and isolate every kick, selecting in ourcase a number of 2000 samples, since they were sufficientto cover the whole movement.

A window of 200 mS was chosen as an intermediate valueof the interval proposed in [35] that exhibits interval within150-250 mS to be an optimal choice to deal with EMG.

To extract features corresponding to instant t was consid-ered the portion of sEMG signal going from t−window tot. Actual window was processed using Wavelet Transformusing a certain mother wavelet. As suggested in [36] and[27] only detail coefficients of first level decomposition weretaken, of which was subsequently calculated one of synthesisvalue exposed in Section II-B.

The window was then shifted by one to compute featurefor t + 1 and procedure repeated until signal end. Sameprocedure was repeated for each kick collecting 1800 fea-tures for each one. A preparatory study on every channelwas conducted looking for the more informative muscles,using mother wavelet db2 and MAV feature because werethe most promising. According to results of Table I chan-nels corresponding to Vastus lateralis, Vastus medialis andTibialis anterior were taken in account.

1WMA Declaration of Helsinki - Ethical Principles for Medical Re-search Involving Human Subjects

2MATLAB, The MathWorks, Inc., Natick, Massachusetts, United States

At time t features corresponding to knee bending angleα are the three features obtained from processing windowof the three channels. Estimated α values were compared totest ones computing NMSE.

We first investigate of which mother wavelet gave bestperformance setting GMM to work with ten repetitions ofkicks as training set and three repetitions as test set. Thencewe focused on the best mother wavelet and examined howmany repetitions were necessary for a good modelization.Procedure was finally tested to a humanoid robot making itperforming kicks. A C++ software based on Robot OperatingSystem (ROS) was developed to simulate EMG generationand communicate joint angle estimated to the robot.

IV. RESULTS

# Channel Subject 1 Subject 2 Subject 3 Sum1 Rectus Femoris 0,5917 0,4523 0,1727 1,21672 Vastus Lateralis 0,7401 0,5403 0,5426 1,8233 Vastus Medialis 0,5917 0,8093 0,6266 2,02764 Tibialis anterior 0,0674 -0,2407 0,4706 0,29735 Gastrocnemius lateralis -0,5058 0,3614 -0,3206 -0,4656 Gastrocnemius medialis 0,5107 0,0233 0,191 0,7257 Biceps femoris caput longus -0,0022 0,5074 -0,0281 0,47718 Peroneus longus 0,1567 -0,0734 0,0380 0,1213

TABLE INMSE VALUES RESULTING FROM TESTS USING ONLY ONE CHANNEL

FOR TRAINING GMM WITH FEATURES EXTRACTED THROUGH DB2 AND

MAV OF COEFFICIENTS.

Mother Wavelet Subject 1 Subject 2 Subject 3 Sum %db2 0,8256 0,8484 0,7539 2,4279 80,93db4 0,8021 0,7779 0,4415 2,0215 67,38db6 0,8051 0,8397 0,3710 2,0158 67,19db7 0,7732 0,8544 0,6568 2,2844 76,15db44 0,7574 0,5983 0,6234 1,9791 65,97db45 0,5426 0,7828 0,3928 1,7182 57,27

TABLE IINMSE ERROR OF THE THREE SUBJECTS OF DATASET FOR EACH

DAUBECHIES WAVELET TESTED WITH RMS FEATURE.

Mother Wavelet Subject 1 Subject 2 Subject 3 Sum %db2 0,5701 0,7409 0,8583 2,1693 72,31db4 0,5806 0,8008 0,5825 1,9639 65,46db6 0,5455 0,6945 0,8531 2,0931 69,77db7 0,7177 0,8092 0,8678 2,3947 79,82db44 0,6306 0,7931 0,6455 2,0692 68,97db45 0,7258 0,8345 0,7572 2,3175 77,25

TABLE IIINMSE ERROR OF THE THREE SUBJECTS OF DATASET FOR EACH

DAUBECHIES WAVELET TESTED WITH MAV FEATURE.

Best result was achieved with mother wavelet db2 andMAV features with an 80,93% of correct estimation al-though db7 and RMS exploited values slightly lower withits 79,82%. Estimation using variance as feature turned outwith lower performances of at least ten percent respect to theother ones, so it turned out to be not suitable for this kind

Page 5: Processing of sEMG Signals for Online Motion of a Single

Mother Wavelet Subject 1 Subject 2 Subject 3 Sum %db2 0,7252 0,7171 0,6139 2,0562 68,54db4 0,5967 0,8694 0,6563 2,1224 70,75db6 0,4321 0,7946 0,5203 1,7470 58,23db7 0,6760 0,8494 0,5909 2,1163 70,54db44 0,6150 0,7642 0,6279 2,0071 66,90db45 0,3603 0,7446 0,5189 1,6238 54,13

TABLE IVNMSE VALUES OF TESTS TO FIND BEST mother wavelet WITHIN

VARIANCE OF FIRST LEVEL DECOMPOSITION COEFFICIENTS.

0

10 20

30 40 50

60

0.75

0.8

0.85

0.9

training set width

NM

SE

subject 1subject 2subject 3

Fig. 2. Tests to investigate effectiveness of GMM corresponding tocardinality of training set.

of analysis. Results showed that is not possible to elect onemother wavelet to be better than others since further com-putation has equal importance as choice of wavelet function.Same wavelet transform could be suitable or not dependingon how information extracted is treated. An example is Db45which exploits a 77,25% of correct estimation when usedwith RMS while exploits only a 54,15% when used withstandard deviation. Combinations with higher values are theones which yield a similar (and good) estimation for all thethree subjects, while others may fit very well for one subjectand very bad for the other two. As the number correspondingto Daubechies function increases also do processing time ofWavelet Transform while GMM suitability decreases, hencedb2 derives as the one to prefer.

Despite the high values of NMSE, corresponding togood modeling, estimation was not as clean as wanted, inparticular, as can be seen in Figure 3, for the presenceof oscillations. This problem could anyway be treated via

Fig. 3. Angle of knee joint estimated (in blue) against angle to predict (inred) of subject 1 for a 60 large training set which exploited 0,9114 NMSEvalue.

software considering oscillation as noise.In Figure IV are showed differences in using a training set

with larger dimension. Best results are obtained including allavailable repetitions, however good values of NMSE occurwith an over 50 elements training set which corresponds toabout 2 minutes of motion. Test on the robot was made usinga Intel R© 64-bit computer with i3 quad core CPU of 2.13GHz and 4 GB of RAM. Computation of Wavelet Trans-form, feature extraction and regression was tried for eachsubject model achieving a mean time of 2.4 mS (excludingacquisition), which grants large space for other stuff as thetotal amount of time shall be below the threshold of 300 mS[19].

Fig. 4. Motion of a NAO robot controlled by EMG signals.

Figure 4 shows motion of a NAO robot3 controlled throughEMG signals. Generation of signal is simulated via softwareand estimated angle is sent to robot with TCP/IP protocol.Our software is able to send pose messages to robot at240 Hz, although in practice rate has been reduce to satisfyNAO bound of 50 Hz.

The framework was successively tested on a seconddataset of three different persons which contains EMG col-lected while performing gait. Were used db2 mother waveletand MAV features. Signals and angles are relative to right an-kle motion and specifically concern Peroneus longus, Tibialisanterior and Gastrocnemius lateralis. Although number ofrepetitions is lower respect to first dataset used, and numberof samples is lower due to shorter movement analyzed,results (reported on Table V ) strengthen validity of theprocedure.

ID subject # repetitions # tests samples NMSEcgrad 5 2 651 0.9052cgsad 8 2 550 0.8344sbnad 8 2 701 0.8170

TABLE VRESULTS FOR DATASET OF ANKLE MOTION.

V. CONCLUSION

This paper proposed a method to estimate a single-jointangle by means of Surface Electromyography signals for

3Aldebaran Robotics - SAS (Limited Company). www.aldebaran.com

Page 6: Processing of sEMG Signals for Online Motion of a Single

online purposes. Wavelet Transform has been chosen astechnique of feature extraction and best mother waveletfunction has been individuated from some successfully usedpreviously in literature. Physiological information has beenencoded through a Gaussian Mixture Model, while the jointangle related to a new sequence of unseen Electromyographydata has been estimated from the model by using GaussianMixture Regression. Results exhibited an high accuracy injoint angle estimation (NMSE> 0, 8) for all the subjectseven if a margin for improvement still exists. This studyshowed a possible way to command a single joint of a robotby means of sEMG which require a great effort for set-up due to GMM training phase but that turns out very fastat execution time making it suitable for real-time. Furtherwork will be to improve robustness of the framework withan higher number of people and test it on other joints suchto validate compatibility to whole body. Another aspect toconsider will be to deal with the delay between the start ofEMG signals and the start of actual human motions which iscalled Electro Mechanical Delay (EMD). Such improvementswill make the framework proper for online controlling ofhumanoid robots and exoskeletons.

REFERENCES

[1] M. Costa, L. Pereira, R. Oliveira, R. Pedro, T. Camata, T. Abrao,M. Brunetto, and L. Altimari, “Fourier and wavelet spectral analysisof EMG signals in maximal constant load dynamic exercise,” inEngineering in Medicine and Biology Society (EMBC), 2010 AnnualInternational Conference of the IEEE, pp. 4622–4625, Aug 2010.

[2] S. Lee and G. Saridis, “The control of a prosthetic arm by EMG pat-tern recognition,” Automatic Control, IEEE Transactions on, vol. 29,pp. 290–302, Apr 1984.

[3] C. Loconsole, S. Dettori, A. Frisoli, C. A. Avizzano, and M. Bergam-asco, “An EMG-based approach for on-line predicted torque controlin robotic-assisted rehabilitation,” in Haptics Symposium (HAPTICS),2014 IEEE, pp. 181–186, IEEE, 2014.

[4] T. Lalitharatne, Y. Hayashi, K. Teramoto, and K. Kiguchi, “A studyon effects of muscle fatigue on EMG-based control for human upper-limb power-assist,” in Information and Automation for Sustainability(ICIAfS), 2012 IEEE 6th International Conference on, pp. 124–128,Sept 2012.

[5] M. Sartori, M. Reggiani, E. Pagello, and D. Lloyd, “Modeling theHuman Knee for Assistive Technologies,” Biomedical Engineering,IEEE Transactions on, vol. 59, pp. 2642–2649, Sept 2012.

[6] A. Ismail and S. Asfour, “Continuous wavelet transform application toEMG signals during human gait,” in Signals, Systems amp; Computers,1998. Conference Record of the Thirty-Second Asilomar Conferenceon, vol. 1, pp. 325–329 vol.1, Nov 1998.

[7] I. Daubechies, “The wavelet transform, time-frequency localizationand signal analysis,” Information Theory, IEEE Transactions on,vol. 36, pp. 961–1005, Sep 1990.

[8] F. Laterza and G. Olmo, “Analysis of EMG signals by means of thematched wavelet transform,” Electronics Letters, vol. 33, pp. 357–359,Feb 1997.

[9] P. Guglielminotti and R. Merletti, “Effect of electrode location onsurface myoelectric signal variables: a simulation study,” in 9th Int.Congress of ISEK, vol. 188, 1992.

[10] R. H. Chowdhury, M. B. I. Reaz, M. A. B. M. Ali, A. A. A. Bakar,K. Chellappan, and T. G. Chang, “Surface Electromyography SignalProcessing and Classification Techniques,” Sensors, vol. 13, no. 9,pp. 12431–12466, 2013.

[11] U. Sahin and F. Sahin, “Pattern recognition with surface EMG signalbased wavelet transformation,” in Systems, Man, and Cybernetics(SMC), 2012 IEEE International Conference on, pp. 295–300, Oct2012.

[12] A. Phinyomark, C. Limsakul, and P. Phukpattaranont, “Application ofWavelet Analysis in EMG Feature Extraction for Pattern Classifica-tion,” Measurement Science Review, vol. 11, no. 2, pp. 45–52, 2011.

[13] A. Subasi, “EEG signal classification using wavelet feature extractionand a mixture of expert model,” Expert Systems with Applications,vol. 32, no. 4, pp. 1084–1093, 2007.

[14] A. Subasi, “Application of adaptive neuro-fuzzy inference system forepileptic seizure detection using wavelet feature extraction,” Comput-ers in Biology and Medicine, vol. 37, no. 2, pp. 227–244, 2007.

[15] G. Tsenov, A. Zeghbib, F. Palis, N. Shoylev, and V. Mladenov, “Neuralnetworks for online classification of hand and finger movements usingsurface emg signals,” in Neural Network Applications in ElectricalEngineering, 2006. NEUREL 2006. 8th Seminar on, pp. 167–171,IEEE, 2006.

[16] K. Englehart, B. Hudgins, P. A. Parker, and M. Stevenson, “Clas-sification of the Myoelectric Signal using Time-Frequency BasedRepresentations,” pp. 431–438, Jul-Sep 1999.

[17] Y. Huang, K. Englehart, B. Hudgins, and A. Chan, “Optimizedgaussian mixture models for upper limb motion classification,” inEngineering in Medicine and Biology Society, 2004. IEMBS’04. 26thAnnual International Conference of the IEEE, vol. 1, pp. 72–75, IEEE,2004.

[18] A. D. Chan and K. B. Englehart, “Continuous myoelectric controlfor powered prostheses using hidden markov models,” BiomedicalEngineering, IEEE Transactions on, vol. 52, no. 1, pp. 121–124, 2005.

[19] M. Arvetti, G. Gini, and M. Folgheraiter, “Classification of EMGsignals through wavelet analysis and neural networks for controllingan active hand prosthesis,” in Rehabilitation Robotics, 2007. ICORR2007. IEEE 10th International Conference on, pp. 531–536.

[20] X. Yong, X. Jing, Y. Jiang, H. Yokoi, and R. Kato, “Tendon drivefinger mechanisms for an emg prosthetic hand with two motors,” inBiomedical Engineering and Informatics (BMEI), 2014 7th Interna-tional Conference on, pp. 568–572, IEEE, 2014.

[21] N. JIANG and D. Farina, “Myoelectric control of upper limb prosthe-sis: current status, challenges and recent advances,”

[22] J. Han, Q. Ding, A. Xiong, and X. Zhao, “A state space emg modelfor the estimation of continuous joint movements,” 2014.

[23] K. Manal, R. V. Gonzalez, D. G. Lloyd, and T. S. Buchanan, “A real-time EMG-driven virtual arm,” Computers in Biology and Medicine,vol. 32, no. 1, pp. 25 – 36, 2002.

[24] Y. Chen, X. Zhao, and J. Han, “Hierarchical projection regression foronline estimation of elbow joint angle using EMG signals,” NeuralComput and Applic, vol. 23, p. 1129–1138, 2013.

[25] L. Chun Lin, “A Tutorial of the Wavelet Transform,”[26] Y. Sheng, “Wavelet transform,” The transforms and applications

handbook, pp. 747–827, 1996.[27] I. Elamvazuthi, G. Ling, K. Nurhanim, P. Vasant, and S. Parasur-

aman, “Surface electromyography (sEMG) feature extraction basedon Daubechies wavelets,” in Industrial Electronics and Applications(ICIEA), 2013 8th IEEE Conference on, pp. 1492–1495, June 2013.

[28] M. Reaz, M. Hussain, and F. Mohd-Yasin, “EMG analysis usingwavelet functions to determine muscle contraction,” in e-Health Net-working, Applications and Services, 2006. HEALTHCOM 2006. 8thInternational Conference on, pp. 132–134, Aug 2006.

[29] A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihoodfrom incomplete data via the EM algorithm,” JOURNAL OF THEROYAL STATISTICAL SOCIETY, SERIES B, vol. 39, no. 1, pp. 1–38,1977.

[30] G. Schwarz, “Estimating the dimension of a model,” The Annals ofStatistics, vol. 6, no. 2, pp. 461–464, 1978.

[31] H. Akaike, “Information theory and an extension of the maximumlikelihood principle,” in 2nd International Symposium on InformationTheory, pp. 267–281, 1973.

[32] A. Barron, J. Rissanen, and B. Yu, “The minimum description lengthprinciple in coding and modeling,” IEEE Transactions on InformationTheory, vol. 44, no. 6, pp. 2743–2760, 1998.

[33] C. S. Wallace and D. L. Dowe, “Minimum message length andkolmogorov complexity,” The Computer Journal, vol. 42, no. 4,pp. 270–283, 1999.

[34] J. Chu and Y. J. Lee, “Conjugate prior penalized learning of Gaussianmixture models for EMG pattern recognition,” in IEEE/RSJ Interna-tional Conference on Intelligent Robots and Systems, pp. 1093–1098,2007.

[35] L. H. Smith, L. J. Hargrove, B. A. Lock, and T. A. Kuiken, “Deter-mining the optimal window length for pattern recognition-based myo-electric control: balancing the competing effects of classification errorand controller delay,” Neural Systems and Rehabilitation Engineering,IEEE Transactions on, vol. 19, no. 2, pp. 186–192, 2011.

Page 7: Processing of sEMG Signals for Online Motion of a Single

[36] F. A. Mahdavi, S. A. Ahmad, M. H. Marhaban, R. Mohammad,and A. T., “Surface Electromyography Feature Extraction Based onWavelet Transform,” International Journal of Integrated Engineering,vol. 4, no. 3, pp. 1–7, 2012.