1

MusicNet Case  Study

Machine  Learning  – CSE546Sham  KakadeUniversity  of  Washington

December  6,  2016©Sham  Kakade 1

2

Announcements:

n HW4  due  Mon  (must  submit  by  Weds,  for  any  credit)

n Poster  Session  Thurs,  Dec  8

n Today:  ¨MusicNet case  study¨MDPs

©Sham  Kakade

2

Poster  Sessionn Thursday  Dec  8,  9-11:30am

¨ Please  arrive  20  mins  early  to  set  up

n Everyone  is  expected  to  attendn Prepare  a  poster

¨ We  provide  poster  board  and  pins¨ Both  one  large  poster  (recommended)  and  several  pinned  pages  are  OK

n Capture¨ Problem  you  are  solving¨ Data  you  used¨ ML  methodology¨ Results  

n Prepare  a  

3

MusicNet Dataset

©Sham  Kakade 5

Learning  Diagnostics

©Sham  Kakade 6

4

Learned  Features  (ok-ishfeatures,  qualitatively)

©Sham  Kakade 7

Learning  Diagnostics

©Sham  Kakade 8

5

Learned  Features  (reported)

©Sham  Kakade 9

Reinforcement  Learning

training  by  feedback

©Sham  Kakade 10

6

Learning  to  act

n Reinforcement  learningn An  agent  

¨ Makes  sensor  observations¨ Must  select  action¨ Receives  rewards  

n positive  for  “good”  statesn negative  for  “bad”  states

[Ng  et  al.  ’05]  

©Sham  Kakade 11