Embed Size (px)
Citation preview
Processing Digital Camera ImagesSS 2011
2
We
Responsible: Prof. Dr. Alexa, Prof. Dr. Bickel Uwe Hahne‣ [email protected]‣ EN 721 Mathias Eitz‣ [email protected]‣ EN 721 Administration: Helga Kallan‣ [email protected]‣ EN 716
3
You
Have to work in teams - introduce yourself…‣ CS Student?
- Which Graphics/Vision classes have you taken?- Why are you attending this course?- What do you expect to learn?
4
You
Have to work in teams - introduce yourself…‣ CS Student?
- Which Graphics/Vision classes have you taken?- Why are you attending this course?- What do you expect to learn?
If not done:‣ Please register for course on www.cg.tu-berlin.de
If not done:Please register for course on
www.cg.tu-berlin.de
5
Course schedule
Introduction of topics: 12.04., 19.04. Basic Talks: 26.04. ~ 24.05.‣ Teams start their project by preparing basic talk‣ Talk covers important aspect that is useful in itself Project roadmap: 31.05.‣ Slides presented in class, list all milestones Implementation project: 31.05. – 12.07.‣ Demo & talk in class 28.06., 05.07., 12.07. Documentation (online): 19.07.
6
Rules
Language‣ English presentations / Diskussionen auf Deutsch? Grading‣ Attendance & participation: 10%‣ Basic talk: 20%‣ Project roadmap: 10%‣ Project (implementation): 40%‣ Documentation (online): 20% Reuse existing resources - you must give
references
6
7
What the course is notabout
Basic Image Processing‣ Convolution, Morphological operators, Filters‣ But might need those as building blocks Photoshop‣ Won’t learn how to use Photoshop‣ Theory of some advanced PS features might be
covered (Panorama function of CS3 uses recent research results)
Photography‣ Won’t learn how to take good pictures‣ But might need to take pictures for some projects
8
What the course is about
Computational Photography‣ Epsilon Photography
- Taking multiple pictures with varying camera parameters
- E.g.: HDR, Panorama‣ Coded Photography
- Modifying lens to achieve a certain goal- E.g.: Deblurring, light field capture, relighting
‣ Essence Photography- Beyond the human eye- E.g.: Photo tourism, scene completion
9
Panoramic Images
First example: Panoramic images‣ Problem: limited fov of digital cameras‣ Compact camera: 50x35º‣ Human: 200x135º‣ Panorama 360x180º
11
High Dynamic Range
2nd example: High dynamic range & tone mapping‣ Problem: limited contrast of digital cameras
Images: Fattal et al.
12
Recovering HDR
Take multiple pictures, vary exposure time
13[Fattal et al.]
17
Fluttered Shutter
Problem: unwanted motion blur[Raskar et al.]
Fluttered Shutter
Traditional camera: shutter is always open
18
Fluttered Shutter
Fluttered Shutter: Distinct open close pattern
19
20
Fluttered Shutter
Deblurred result
Seam Carving
Problem: How to resize an image?‣ Scaling?‣ Cropping?‣ Seam Carving?
21
[Avidan & Shamir]
scaled cropped seam carved
original:
Patchmatch[Barnes et al.]
Scene Completion
How to realistically replace unwanted parts of a scene?
25
[Hays et al.]
Scene Completion [Hays & Efros]
Input image Scene Descriptor Image Collection
200 matches20 completionsContext matching
+ blending
Photo Tourism
28
[Snavely et al.]
Live demo: http://phototour.cs.washington.edu
29
Summary
You have seen several example projects. In the end you should know how all of them
work. You will explore and present basic techniques
and methods. You will re-implement one of those projects, or you implement a new idea ( please
contact me during this week).
30
Todo until next week
Check last years’ projects‣ Links are on the course website‣ Browse last years courses Check similar courses of other universities‣ See links at end of presentation Check our project list‣ Find at least two projects you are interested in‣ After class contact potential team members
31
Resources - I
Finding papers: Google (Scholar) Similar courses:‣ http://www.cs.brown.edu/courses/csci2951-b/‣ http://graphics.cs.cmu.edu/courses/15-463/‣ http://www.cc.gatech.edu/classes/AY2005/cs4803cp_
summer/‣ http://graphics.stanford.edu/courses/cs448-04-spring/‣ http://people.csail.mit.edu/fredo/PhotoSeminar05/‣ http://cs.nyu.edu/~fergus/teaching/comp_photo/‣ http://www.cs.unc.edu/~lazebnik/research/fall08/‣ http://cameraculture.media.mit.edu/Fall2010Computat
ionalCamera
32
Resources - II
Siggraph coursenotes:‣ http://web.media.mit.edu/~raskar/photo/ Book:‣ http://www.amazon.com/dp/1568813139/ Conference:‣ http://cameraculture.media.mit.edu/iccp10
33
Resources – III
Image/Video References: Connelly Barnes, Eli Shechtman, Adam Finkelstein, Dan B Goldman -
PatchMatch: A Randomized Correspondence Algorithm for Structural Image EditingACM Transactions on Graphics (Proc. SIGGRAPH), August 2009
Shai Avidan and Ariel Shamir. 2007. Seam carving for content-aware imageresizing. In ACM SIGGRAPH 2007 papers (SIGGRAPH '07). ACM, New York, NY, USA, , Article 10 . DOI=10.1145/1275808.1276390 http://doi.acm.org/10.1145/1275808.1276390
Noah Snavely, Steven M. Seitz, Richard Szeliski, "Photo tourism: Exploring photo collections in 3D," ACM Transactions on Graphics (SIGGRAPH Proceedings), 25(3), 2006, 835-846.
Ramesh Raskar, Amit Agrawal, and Jack Tumblin, Coded Exposure Photography: Motion Deblurring using Fluttered Shutter, ACM SIGGRAPH 2006
James Hays, Alexei A. Efros. Scene Completion Using Millions of Photographs. ACM Transactions on Graphics (SIGGRAPH 2007). August 2007, vol. 26, No. 3
R. Fattal, D. Lischinski and M. Werman,Gradient Domain High Dynamic Range Compression, ACM Transactions on Graphics (Proc. ACM SIGGRAPH 2002)
