On the Impact of Personality in Massive Open Online Learning

  • Published on
    14-Jan-2017

  • View
    130

  • Download
    3

Transcript

On the Impact of Personalityin Massive Open Online Learning Guanliang Chen, Dan Davis, Claudia Hauff, Geert-Jan HoubenWeb Information Systems, TU DelftWhythis research?PersonalityMOOC-basedlearningClassroom-based learning- Conscientious learners are likely to succeed.- mattersMOOCsWhythis research?PersonalityMOOC-basedlearningClassroom-based learning- Conscientious learners are likely to succeed.- mattersDo learners' personalities impact their learning & learning behaviour in the MOOC setting?MOOCsWhat research questions?What research questions?1 Does personality impact learner engagement, learner behaviour and learner success in the context of MOOCs?What research questions?1 Does personality impact learner engagement, learner behaviour and learner success in the context of MOOCs?Can learners' personalities be predicted based on their behaviour exhibited on a MOOC platform? 2MethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionMethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionMOOCEX101x +LearningdataPersonalityTestCourseSurveysPriorknowledgePersonalityinformationMethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionBig Five Personality TestExtraversionConscientiousness Being organised, disciplined and achievement-orientedA high degree of sociability and assertivenessAgreeableness Being helpful to others, cooperative and sympatheticNeuroticism Emotional stability, the level of anxiety and impulse controlOpenness Being intellectual curious and prefer variety and noveltyMethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionBig Five Personality TestExtraversionConscientiousness Being organised, disciplined and achievement-orientedA high degree of assertivenessAgreeableness Being cooperativeNeuroticism Emotional stability,anxietyOpenness Being prefer MethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionBig Five Personality TestExtraversionConscientiousness Being and A high degree of assertivenessAgreeableness Being cooperativeNeuroticism Emotional stability,anxietyOpenness Being intellectual curious and prefer variety and noveltyMethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionMethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionVideo-based features- Time watching video material - # videos skipped - Quiz-based features- Time solving quizzes - # Questions learners attempted to solve - Forum-based features- # New forum questions - # Forum replies - MethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionVideo-based features- Time watching video material - # videos skipped - Quiz-based features- Time solving quizzes - # Questions learners attempted to solve - Forum-based features- # New forum questions - # Forum replies - In total, there are 20 features.MethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionMethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionLow prior-knowledge groupHigh prior-knowledge groupLearnersMethodDataGatheringFeatureEngineeringCorrelationAnalysisPrediction18 features 5 personality traitsSpearmans rankcorrelation analysisLow prior-knowledge groupHigh prior-knowledge groupLearnersMethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionMethodDataGatheringFeatureEngineeringCorrelationAnalysisPredictionLearning featuresPersonality traitsInputRegressionModelOutputGaussian ProcessesRamdom ForestsResultsCorrelation AnalysisPrediction AccuracyPrediction AccuracyResultsCorrelation AnalysisLow prior-knowledge group E A C N OTime watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18# Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17# New forum questions 0.07 0.04 0.01 0.04 0.00# Forum replies 0.12 0.12 0.00 0.01 0.03# Total forum postings 0.11 0.10 0.03 0.03 0.02Forum browsing time -0.10 0.00 0.06 -0.04 -0.13Forum accesses -0.11 -0.04 0.06 -0.05 -0.16# Forum interactions 0.10 0.11 0.03 0.04 0.03Total time on-site -0.02 -0.03 0.12 0.01 -0.19Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15# Videos skipped 0.02 0.07 -0.14 -0.04 0.18# Videos sped up 0.00 -0.03 0.10 -0.01 -0.02Maximum session time -0.02 -0.05 0.10 0.00 -0.17Average session time 0.00 -0.03 0.05 -0.01 -0.08Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14Final score -0.06 -0.07 0.12 0.07 -0.15Prediction AccuracyResultsCorrelation AnalysisLow prior-knowledge group E A C N OTime watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18# Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17# New forum questions 0.07 0.04 0.01 0.04 0.00# Forum replies 0.12 0.12 0.00 0.01 0.03# Total forum postings 0.11 0.10 0.03 0.03 0.02Forum browsing time -0.10 0.00 0.06 -0.04 -0.13Forum accesses -0.11 -0.04 0.06 -0.05 -0.16# Forum interactions 0.10 0.11 0.03 0.04 0.03Total time on-site -0.02 -0.03 0.12 0.01 -0.19Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15# Videos skipped 0.02 0.07 -0.14 -0.04 0.18# Videos sped up 0.00 -0.03 0.10 -0.01 -0.02Maximum session time -0.02 -0.05 0.10 0.00 -0.17Average session time 0.00 -0.03 0.05 -0.01 -0.08Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14Final score -0.06 -0.07 0.12 0.07 -0.15Only openness to experience and conscientiousness are significantly correlated with a number of features. Prediction AccuracyResultsCorrelation AnalysisLow prior-knowledge group E A C N OTime watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18# Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17# New forum questions 0.07 0.04 0.01 0.04 0.00# Forum replies 0.12 0.12 0.00 0.01 0.03# Total forum postings 0.11 0.10 0.03 0.03 0.02Forum browsing time -0.10 0.00 0.06 -0.04 -0.13Forum accesses -0.11 -0.04 0.06 -0.05 -0.16# Forum interactions 0.10 0.11 0.03 0.04 0.03Total time on-site -0.02 -0.03 0.12 0.01 -0.19Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15# Videos skipped 0.02 0.07 -0.14 -0.04 0.18# Videos sped up 0.00 -0.03 0.10 -0.01 -0.02Maximum session time -0.02 -0.05 0.10 0.00 -0.17Average session time 0.00 -0.03 0.05 -0.01 -0.08Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14Final score -0.06 -0.07 0.12 0.07 -0.15Only openness to experience and conscientiousness are significantly correlated with a number of features. Conscientious learners (self-disciplined, striving for success) are likely to be more engaged with more learning materials.Prediction AccuracyResultsCorrelation AnalysisLow prior-knowledge group E A C N OTime watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18# Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17# New forum questions 0.07 0.04 0.01 0.04 0.00# Forum replies 0.12 0.12 0.00 0.01 0.03# Total forum postings 0.11 0.10 0.03 0.03 0.02Forum browsing time -0.10 0.00 0.06 -0.04 -0.13Forum accesses -0.11 -0.04 0.06 -0.05 -0.16# Forum interactions 0.10 0.11 0.03 0.04 0.03Total time on-site -0.02 -0.03 0.12 0.01 -0.19Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15# Videos skipped 0.02 0.07 -0.14 -0.04 0.18# Videos sped up 0.00 -0.03 0.10 -0.01 -0.02Maximum session time -0.02 -0.05 0.10 0.00 -0.17Average session time 0.00 -0.03 0.05 -0.01 -0.08Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14Final score -0.06 -0.07 0.12 0.07 -0.15Only openness to experience and conscientiousness are significantly correlated with a number of features. Learners with high openness (being intellectually curious, prefer variety) are less likely to spend time on the learning material.Conscientious learners (self-disciplined, striving for success) are likely to be more engaged with more learning materials.Prediction AccuracyCorrelation AnalysisResultsHigh prior-knowledge group E A C N OTime watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03# Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03# New forum questions -0.04 0.04 0.10 -0.03 0.03# Forum replies -0.02 0.03 0.15 0.08 0.03# Total forum postings -0.03 0.02 0.15 0.02 0.03Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06Forum accesses -0.14 -0.06 0.03 -0.04 -0.04# Forum interactions -0.02 0.02 0.15 0.03 0.03Total time on-site -0.07 -0.07 0.11 0.04 -0.03Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03Average time responded to quizs 0.03 -0.05 0 0.05 0.02# Videos skipped 0.09 0.08 -0.09 -0.04 0.00# Videos sped up 0.03 0.00 0.06 0.09 0.06Maximum session time -0.04 -0.04 0.11 0.04 -0.04Average session time 0.06 -0.05 0.03 0.06 -0.04Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00Final score -0.12 -0.05 0.07 0.01 -0.01Prediction AccuracyCorrelation AnalysisResultsHigh prior-knowledge group E A C N OTime watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03# Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03# New forum questions -0.04 0.04 0.10 -0.03 0.03# Forum replies -0.02 0.03 0.15 0.08 0.03# Total forum postings -0.03 0.02 0.15 0.02 0.03Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06Forum accesses -0.14 -0.06 0.03 -0.04 -0.04# Forum interactions -0.02 0.02 0.15 0.03 0.03Total time on-site -0.07 -0.07 0.11 0.04 -0.03Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03Average time responded to quizs 0.03 -0.05 0 0.05 0.02# Videos skipped 0.09 0.08 -0.09 -0.04 0.00# Videos sped up 0.03 0.00 0.06 0.09 0.06Maximum session time -0.04 -0.04 0.11 0.04 -0.04Average session time 0.06 -0.05 0.03 0.06 -0.04Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00Final score -0.12 -0.05 0.07 0.01 -0.01Again, no significant correlation between behavioural features and agreeableness and neuroticism can be observed.Prediction AccuracyCorrelation AnalysisResultsHigh prior-knowledge group E A C N OTime watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03# Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03# New forum questions -0.04 0.04 0.10 -0.03 0.03# Forum replies -0.02 0.03 0.15 0.08 0.03# Total forum postings -0.03 0.02 0.15 0.02 0.03Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06Forum accesses -0.14 -0.06 0.03 -0.04 -0.04# Forum interactions -0.02 0.02 0.15 0.03 0.03Total time on-site -0.07 -0.07 0.11 0.04 -0.03Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03Average time responded to quizs 0.03 -0.05 0 0.05 0.02# Videos skipped 0.09 0.08 -0.09 -0.04 0.00# Videos sped up 0.03 0.00 0.06 0.09 0.06Maximum session time -0.04 -0.04 0.11 0.04 -0.04Average session time 0.06 -0.05 0.03 0.06 -0.04Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00Final score -0.12 -0.05 0.07 0.01 -0.01Again, no significant correlation between behavioural features and agreeableness and neuroticism can be observed.Conscientious learners are likely to be active in forum discussion, while extraneous leaners not.Prediction AccuracyCorrelation AnalysisResultsHigh prior-knowledge group E A C N OTime watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03# Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03# New forum questions -0.04 0.04 0.10 -0.03 0.03# Forum replies -0.02 0.03 0.15 0.08 0.03# Total forum postings -0.03 0.02 0.15 0.02 0.03Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06Forum accesses -0.14 -0.06 0.03 -0.04 -0.04# Forum interactions -0.02 0.02 0.15 0.03 0.03Total time on-site -0.07 -0.07 0.11 0.04 -0.03Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03Average time responded to quizs 0.03 -0.05 0 0.05 0.02# Videos skipped 0.09 0.08 -0.09 -0.04 0.00# Videos sped up 0.03 0.00 0.06 0.09 0.06Maximum session time -0.04 -0.04 0.11 0.04 -0.04Average session time 0.06 -0.05 0.03 0.06 -0.04Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00Final score -0.12 -0.05 0.07 0.01 -0.01Again, no significant correlation between behavioural features and agreeableness and neuroticism can be observed.Overall, behavioural features extracted from MOOC log traces are less correlated with personality traits than lexical or behavioural features extracted from social media traces.Conscientious learners are likely to be active in forum discussion, while extraneous leaners not.Prediction AccuracyCorrelation AnalysisResultsEvaluation: Spearman rank correlation coefficientPrediction AccuracyCorrelation AnalysisResultsEvaluation: Spearman rank correlation coefficientSignificant correlations (indicating usable predictions) are achieved for 4 of the 5 personality traits.Prediction AccuracyCorrelation AnalysisResultsEvaluation: Spearman rank correlation coefficientSignificant correlations (indicating usable predictions) are achieved for 4 of the 5 personality traits.The correlation coefficients tend to increase with increasing course weeks.Prediction AccuracyCorrelation AnalysisResultsEvaluation: Spearman rank correlation coefficientSignificant correlations (indicating usable predictions) are achieved for 4 of the 5 personality traits.The correlation coefficients tend to increase with increasing course weeks.Extraversion and neuroticism achieve the highest prediction accuracy.SummarySummary1 Various learning features are correlated with the personality traits of conscientiousness and openness.Summary1 Various learning features are correlated with the personality traits of conscientiousness and openness.The predictions are statistically significant for 4 out of the 5 personality traits and improve as more data becomes available. 2http://bit.ly/wis-learning-analyticsThanks for your attention!http://bit.ly/wis-learning-analytics

Recommended

View more >