12
1 Multimedia Signal Processing Group Swiss Federal Institute of Technology, Lausanne Applying Transform-domain Scrambling to Automatically Detected Faces Pavel Korshunov, Aleksei Triastcyn, and Touradj Ebrahimi

MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

1

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Applying Transform-domain Scrambling to Automatically Detected Faces

Pavel Korshunov, Aleksei Triastcyn, and Touradj Ebrahimi

Page 2: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

2

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Introduction

Recipe– Take simple face detection

(OpenCV)– Combine with a privacy filter– Apply filter to all detected regions

in a video

Focus on the privacy filter

Page 3: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

3

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Privacy Filters

Simple: pixelization, masking, and blurring– Non-reversible– encryption anonymization, etc.

Anonymization (replacing with another object)– Non-reversible– Hard to implement

Encryption– Video alterations break the filter– Complex

Page 4: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

4

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Transform-domain scrambling

Seed random generator with a secret key Randomly flip sign of 63 DCT coefficients

in a scrambled macro block During decoding, repeat the same

ScramblinScramblinggScramblinScramblinggTransformTransformTransformTransform Entropy Entropy

codingcodingEntropy Entropy codingcodingframe bitstream

encoder

Page 5: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

5

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Scrambling in JPEG

F. Dufaux and T. Ebrahimi, “Scrambling for privacy protection in video surveillance systems,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 18, no. 8, pp. 1168–1174, Aug 2008.

Page 6: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

6

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Transform-domain scrambling

Pros– Reversible method– Does not negatively affect coding efficiency– Scrambling strength can be controlled– Security can be insured

Cons– Must be integrated inside the encoder

Page 7: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

7

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Subjective evaluation results

Detection accuracy:0.24

Page 8: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

8

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Subjective evaluation results

Page 9: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

9

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Scrambled frame, morning video

Page 10: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

10

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Scrambled frame, evening video

Page 11: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

11

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Scrambled frame, evening video

Page 12: MediaEval 2012 Visual Privacy Task: Applying Transform-domain Scrambling to Automatically Detected Faces

12

Multimedia Signal Processing GroupSwiss Federal Institute of Technology, Lausanne

Conclusion

Face detection played unexpectedly important role

– Either use better detection or re-think evaluation methodology

Subjects were highly irritated with scrambling!

– Make scrambling more human-friendly