Upload
ming-chi-liu
View
82
Download
0
Embed Size (px)
Citation preview
OSCE 創新學習與雲端大數據高峰論壇
1
教育資料思考如何應用資料科學於 OSCE 中Thinking with educational data The use of data science for OSCE
劉明機 助理研究學者國立成功大學 工程科學系Email liumingchigmailcom
20161221
OSCE 創新學習與雲端大數據高峰論壇
220161221
bull 教育資料科學家bull 關鍵字歷程的語意分析與推薦bull 情感學習 (Affective learning)
bull 「運用深度學習技術於評量與培養運算思維能力bull 科技部資訊教育學門 兩年期計畫主持人劉明機 博士
liumingchigmailcom
OSCE 創新學習與雲端大數據高峰論壇
3
Outlines 資料科學 PISA OSCE 的相關議題 評分信效度 關卡設計 學習效率 如何應用資料科學於 OSCE 中 資料科學用藥須知 如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
4
什麼是資料科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
5
資料科學 = 統計 + 計算 + 科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
620161221 cs109org
資料科學工作流程
OSCE 創新學習與雲端大數據高峰論壇
7
Data is the New Everything
20161221
OSCE 創新學習與雲端大數據高峰論壇
820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
220161221
bull 教育資料科學家bull 關鍵字歷程的語意分析與推薦bull 情感學習 (Affective learning)
bull 「運用深度學習技術於評量與培養運算思維能力bull 科技部資訊教育學門 兩年期計畫主持人劉明機 博士
liumingchigmailcom
OSCE 創新學習與雲端大數據高峰論壇
3
Outlines 資料科學 PISA OSCE 的相關議題 評分信效度 關卡設計 學習效率 如何應用資料科學於 OSCE 中 資料科學用藥須知 如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
4
什麼是資料科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
5
資料科學 = 統計 + 計算 + 科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
620161221 cs109org
資料科學工作流程
OSCE 創新學習與雲端大數據高峰論壇
7
Data is the New Everything
20161221
OSCE 創新學習與雲端大數據高峰論壇
820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
3
Outlines 資料科學 PISA OSCE 的相關議題 評分信效度 關卡設計 學習效率 如何應用資料科學於 OSCE 中 資料科學用藥須知 如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
4
什麼是資料科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
5
資料科學 = 統計 + 計算 + 科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
620161221 cs109org
資料科學工作流程
OSCE 創新學習與雲端大數據高峰論壇
7
Data is the New Everything
20161221
OSCE 創新學習與雲端大數據高峰論壇
820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
4
什麼是資料科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
5
資料科學 = 統計 + 計算 + 科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
620161221 cs109org
資料科學工作流程
OSCE 創新學習與雲端大數據高峰論壇
7
Data is the New Everything
20161221
OSCE 創新學習與雲端大數據高峰論壇
820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
5
資料科學 = 統計 + 計算 + 科學
20161221
OSCE 創新學習與雲端大數據高峰論壇
620161221 cs109org
資料科學工作流程
OSCE 創新學習與雲端大數據高峰論壇
7
Data is the New Everything
20161221
OSCE 創新學習與雲端大數據高峰論壇
820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
620161221 cs109org
資料科學工作流程
OSCE 創新學習與雲端大數據高峰論壇
7
Data is the New Everything
20161221
OSCE 創新學習與雲端大數據高峰論壇
820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
7
Data is the New Everything
20161221
OSCE 創新學習與雲端大數據高峰論壇
820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
1020161221
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
11
PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)
PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養
20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
12
What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice
20161221
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
1320161221
Allocation of educational resources and mathematics performance教育資源跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
1420161221
Teachers salaries and mathematics performance教師的薪水跟數學成績
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
1520161221
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
16
PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用
20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
17
Studentslsquo motivation and grouping of students分組方式與動機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
18
Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告
20161221httpbestreviewscomhow-reliable-are-amazon-ratings
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
19
The Paid Review Bias付錢評分偏誤
20161221
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
21
Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students
Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
22
Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision
A majority felt the tasks required in some stations required a higher degree of learning than they had achieved
Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
23
OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
2420161221
OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)
Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
25
Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations
Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios
Establishing links with hospitals to obtain space for conducting the OSCE
20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
26
二十年後的公民需要具備什麼核心能力
20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
27
日本藥學檢驗 PhCAT
20161221
httpwwwphcatorjppage_id=319
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
28
日本 OSCE
20161221 httpwwwphcatorjp
httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
29
OSCE 的相關議題 評分信效度
關卡設計
學習效率
20161221
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
30
OSCE 評分信效度20161221
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
31
考官如何 2 秒評分
20161221
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
32
外表重要嗎
20161221
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
33
Physical attractiveness on academic performance外表對成績影響
20161221
Photographs of the student IDApproval from the institution
Multiple raters (1-5)The same 50 images for
normalization
Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
34
Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要
20161221
Personal appearance measures
ModelsMales (N = 2487) Females (N = 2878)
A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044
Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091
Very well groomed 0263 0274 0163 0114
Below average groomingminus
0492minus
0468 minus 0197 minus 0155
R squared 0219 0222 0235 0237 029 0294 0293 0297
linear regression results for the effects of personal appearance on overall GPA
French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
35
More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)
Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)
Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)
20161221
Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
36
But Attractiveness can be a disadvantage in some situations (Lombarts 2014)
Disadvantaged when applying for militaryLess may be expected of them
Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)
Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)
20161221
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
37
Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment
20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
38
Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student
However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination
Overall scores on the OSCE are often not very reliable
20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
39
It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量
20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
40
Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan
The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)
20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
4120161221
Roter Interaction Analysis System (RIAS) A method for coding medical dialogue
Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
4220161221
Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)
Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)
A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
43
OSCE 關卡設計20161221
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
44
人類沒有工作的那一天20161221
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
20161221 45
( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代
( 數位時代 ) 機器人可能讓全人類都沒有工作
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
46
Robots that can adapt like animals機器人像動物一樣適應
20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422
Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
47
Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)
20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
49
Eureqa The Robot Scientist機器科學家
20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
5020161221httpkrishnaorgevolution-from-scientist-to-monkey
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
51
智慧科技 走入日本居家式照護
20161221
「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔
httpwwwchinatimescomnewspapers20160126000336-260207
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
52
人工智慧來了 淘金潮 vs失業潮
20161221 httpswwwyoutubecomwatchv=571p_v4wriM
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
53
機器人上陣 配藥零失誤
20161221 httpudncomnewsstory73311827544
讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
54
科技性失業 人類不適任的未來
20161221httpswwwyoutubecomwatchv=X439JRyoyXo
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
55
未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力
情感能力
20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
56
模擬藥局 Students had to imagine patientsrsquo characteristics and
could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient
20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
57
A virtual practice environment
20161221
Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop
communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
58
Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on
nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE
20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
5920161221
Table 2 Study Protocol for the Two Groups
Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007
Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)
Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
62
Empathy is related to OSCE scores同理心跟 OSCE 分數有關
20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
63
如何自動評估情感能力
20161221
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
64
Microsoft Emotion Recognition API
20161221httpswwwprojectoxfordaidemoEmotion
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
65
蕭博駿到底喜不喜歡當工具人
20161221
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
66
Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)
The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value
The valence indicates whether the facial expressions are positive or negative
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
67
Emotional states of the clips
Figure 4 The valences of an example clip indicating the generally negative emotion of a student
N ValenceMean SD 95 CI to mean
24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
68
Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力
20161221
Input data
EEG
Eye movement
Physiological signals
Dialogue
情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)
引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
69
Target problem
20161221
為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
70
Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異
20161221
The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration
Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757
True Positive Rate higher is betterFalse Positive Rate lower is better
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
71
毅力的重要性
20161221
「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
72
怎麼量測毅力
20161221
乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
73
Flappy Bird game
20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
74
Flappy Bird 誤我一生
20161221httpswwwyoutubecomwatchv=RLYINpY-zLw
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
75
遊戲培養團隊合作
20161221httpswwwyoutubecomwatchv=gPBnJO1Niww
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
76
Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力
20161221Example problem in a physics video game
NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
77
The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 51
Unsolved 47 96
Silver 42 81 62
Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05
Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground
GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
78
The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用
20161221
PMP GAP Unsolved Silver Gold Enjoy Self-p
GAP 22
Unsolved 12 94
Silver 31 84 60
Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07
Physics post test 16 02 01 04 minus21 15 15
Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
79
OSCE 學習效率20161221
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
8020161221
Work Smart Not Hard
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
81
Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)
Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)
20161221
Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
82
Flight path deviation between subjects and autopilot有刺激比較能控制
20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml
Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎
Thync
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
84
OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)
An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)
OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)
The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)
20161221
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
85
造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE
Students were stressed by the lack of enough time to deal with the scenario in some stations
20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
86
護理師壓力大
20161221
訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8
趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
87
危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice
Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)
20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
88
如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
89
Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test
掌聲鼓勵
枑鼎漆講秞虴匼第刲坰狟婥督昢
撈奀刲坰ㄛ婓盄煦砅
2010
秞虷厙 - Yisellcom
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
90
Two tests
the controlled task the experimental task
30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
91
Timeline of experimental procedure
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
92
Gender differences in anxiety
The controlled task The experimental task
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
93
Applause decrease malersquos anxiety Topographical map of the brain
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
94
如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
95
Data Science Pitfalls資料科學注意事項
20161221
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
96
用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
20161221httpwww5678newscomnews_detailsphpn=201607160849213852
資料科學注意事項
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
97
A correlation of 085 was obtained
20161221
A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated
Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
98
Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
99
相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形
20161221
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
100
大數據已死
20161221
「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
101
Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin
實際選舉的結果 Franklin 61 gt 37 Landon
George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19
doi101111j1740-9713201400778x
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
102
壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中
20161221
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
103
龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest
20161221
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
104
Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料
20161221
Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
105
如何提升資料素養
20161221
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
10620161221 1 Thinking with data
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
10720161221 2 Frame your problem
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
108
資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare
Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments
20161221
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機
OSCE 創新學習與雲端大數據高峰論壇
10920161221
Thank You for Listening
Email liumingchigmailcom
劉明機