Lecture 17 Lab – Skeleton Logging

Jonathan Bisnett - 2664338July 7, 2018

EEC 693 – Applied Computer Vision with Depth CamerasProfessor Wenbing Zhao

6/7/2018 Jonathan Bisnett Lecture 2 Lab

Figure 1 shows the initial screen when the application starts.

Figure 1 - Initial Application Screen

I have included the standard logic I have used in all the other Kinect applications to allow for restart and for changing the elevation of the sensor. The buttons near the bottom left control the usage of the application. “Track” is only active when a replay is either active or has occurred and there is no tracking active. “Start Log” will open the file and start logging the skeleton tracking data. This will enable the “Stop Log” button. This can be seen in Figure 2.

Clicking the “Stop Logging” button will enable both the “Start Logging” and the “Start Replay” buttons. The user can either replay the last set of skeleton tracking frames, which will loop continuously, or they can start a new logging session. This can be seen in Figure 3.

Page 2

6/7/2018 Jonathan Bisnett Lecture 2 Lab

Figure 2 - Start Logging clicked

Figure 3 - Stop Logging clicked

Page 3

6/7/2018 Jonathan Bisnett Lecture 2 Lab

When the user clicks the “Start Replay” button, the file containing the skeleton tracking log is opened, read, and then closed. The information is calculated and keep in a multidimensional array that allows for the information to be replayed to the canvas in sync with the color image frames. The following figure shows a frame from the replay.

Figure 4 - Replay in progress

Once the replay is in progress, the user can either stop the replay or can go back to tracking mode. If the user returns to tracking mode, there is no active logging until the user clicks “Start Log” again. It will show the skeleton tracking but will not log the information. If the user select “Stop Replay”, the buttons for “Track”, “Start Log” and “Start Replay” will become enabled. Any of these choices is valid at this point.

Figure 5 shows the screen after clicking “Stop Replay.”

Page 4

6/7/2018 Jonathan Bisnett Lecture 2 Lab

Figure 5 - After Stop Replay clicked

Conclusion

This was another interesting lab. I had not really considered how easily the skeleton tracking stream could be saved and replayed. This could be very beneficial for understand actions or even possible issues with the software. I suspect this is very similar to what the Kinect SDK allows for recording sessions and playing them back. That one obviously does it outside the application which means I don’t have to play games with the code, but it also creates absolutely huge files.

This was a great learning experience. Thanks.

Page 5